No rush indeed. A higher level is required as Raze said, and on top of that, once you get in the castle, you'll find out soon enough that life in a palace isn't always as great as it might seem...

I am in blood
Stepp'd in so far, that, should I wade no more,
Returning were as tedious as go o'er.