You can, you have to use the teleporting shrines. And you need to use the teleporting shrine to get to orobas fjord (next part of the game).