You should be more than a high enough level to handle Stormfist castle and the areas after that. I would clear the Rivertown sewers first if you have not already done so, but you are good to go whenever you wish.