You never 'have' to find it, though you can run out of other things to do (at which point you will need to take the tower if you want the story to advance). To reach it, go to the Maxos Temple in Broken Valley (marked on the map). Once done there, you can access a teleporter that will take you to the island the tower is on.
