Why you can't? What happens when you trying to do that?

There is a bug that if you had chosen your 4 trainers BEFORE the man on the pillar - quest can't be activated, afair.