Did you have anything running in the background? A memory leak could account for performance degradation over time. Some people had problems with sluggishness using older video drivers, but that would be more of a consistent effect.
Were there a lot more NPCs or something in the area where it started to get sluggish? If you quit the game and restart, does that fix the problem? How about if you reboot the computer first?