You can progress at your own pace. Let's be honest, every RPG is like this. "Make haste, hero! Fate of the world depends on you!" -- "Ok, old man. I shall vanquish the evil and-... Ooh a flower. Ooh a sidequest. Ooh a farm I can build. This dragon I've literally stopped one step from getting a scripted encounter with ain't going anywhere."
