A potential factor for limiting the level to 4 is that higher level spells and abilities aren’t uniformly implemented into the game yet, so their exclusion would not be arbitrary.
Was the only reason you played the game gathering exp? Not to explore or complete quests or fight in battles? Because you can do all of these without gaining more exp just fine.