Run into the castle, then after you are stopped by the guards and that conversation ends, immediately click inside again. They will not be fast enough to stop you a second time.