The key on the planter opened a basement where there was cheese -- it isn't the key to the upper room of the tavern.

But the beggar mentioned a key among the flowers, there weren't any flowers in the planter -- just a small-tree-looking bush.