Agree with Cammy, your game must be bugged. You should hit level 2 shortly after hitting the beach and be around level 4 by the time you get to the goblin camp (depends on how many side quests you do around the druid grove).
You can also avoid an all out war with the goblins by sneaking in. There are a couple of alternate ways into the camp that make them think you belong there.
