The quarry tower and top of the wall remains above the poison (as does the mine entrance, the top of Lovis' tower and a couple other places). There is also one quest on sentinel island that can not be completed until after you have the battle tower, though you may want to use the quest item yourself rather than complete the quest. All other open quests in either area will fail as soon as you take the tower.
