I think people were getting confused about where to go because the map was getting cluttered.

That said, I imagine the "in game" reason is because we can't show our head anywhere while we're wanted by those who serve the Flaming Fist.