Yep, there is a time limit. If you've taken the deed quest and finished it, then after a while the teleporter doesnt work no longer.

Joliekiller, paladin on a crusade against (almost) all evil.