Apparently you broke the quest to complete it. Guess the guards are programmed to react to the "crowd warmer".

Every time there I run into trouble on the road, there is always a dwarf at the bottom of it. Don't they know how to drive above ground?