From the main gate, up the hill and across the bridge, you can edge around the left side and jump over to get access to part of the tower. Keep an eye out for levers to open the gates. There are a couple ledges you can jump up onto, as well.
Near the base of the tower there are some platforms with ladders you can use to get up and inside.
