Late into the party but yea, it doesnt matter whatsoever.
The only instance where there is an acknowledgement to this is at the begining of act 3 when Emperror offers you the astral tadpole, if you have used the tadpole powers to a certain extent (not sure how many or how much) you have to pass a wisdom check to not turn into half mindflayer. Not really sure why that would make it harder to refuse him but regardless, thats it. At one point if you piss Emperror off he goes on a rant telling you how we are his puppets and he can make us do anything, but nothing ever comes of it and its never acknowledged again so I guess he was bsing.

Honestly as much as I love the game, it has its flaws and upon further replay a lot of the story and character motivation is very wobly and iffy. Its mentioned in other threads that this is likely due to the rewrites with Daisy and Emperror but how knows, in either case its clear that the tadpole powers gameplay feature was put to the forefront so that players can engage it freely without any fear of reprocussions, gameplay or storywise, which is imo just a bad call from Larian, it should be a roleplay decision, not a gameplay one and players should just be able to chose if they wish to make it harder on themselves and stick to their moral high ground, or take any advantage they can get and take the powers.