The only thing I can say for sure is that if you actively use tadpoles, you will be offered to go further and gain even more power in exchange for becoming a Mind Flayer. But this can be abandoned at a certain stage.
If you completely ignore the tadpoles - I do not know.
