That quest is designed to fail. The other marked one should direct you to the castle, but there is no need to hurry to get in...