I just reactivated an old savegame to check about hese walls. and yes, if you just entered the fjords there are kind of force fields left and right of the long island which stretches from the SW to NW. The road you mentioned is the road to the champions port, which you will follow later on.
This confines you to a small area, until you have deactivated them together with the 2 red antidragon-zones.
To do this you have to go through an active teleporter.
No, I'm not going to spoil your search

. But there is another teleporter you can reach in this zone.