i would have taken my time and killed all of the scorpions the first time. but for your sake, yes go back down and kill the rest of the skeletons. i think that you should get as much XP as you can just to make the game easier.