There is a known bug if you used that key on the graveyardgate before the gardens. It seems to be broken then. I personnaly dont know a solution for it sorry.

Joliekiller, paladin on a crusade against (almost) all evil.