Acting on a somewhat vague memory of getting into a fight when I tried storming the Battle Tower early (seems to be a recurring theme with my play-throughs), I think introducing yourself to the candidates is the best approach.
I just wanted to talk to the Hermit about carrots.
