Ok, you need to do quests to get in the tower. I was doing the same thing at first.
Do all the totems (chose helpers).
Save the one guy from being killed by the lizards. He'll give you a useful book.
Stop the wind and light the candles on the one penninsula and you'll get more specific directions from there.
And if the game was simple, you'd probably complain it was too short :P