Who's to say the Emperor only had one astral tadpole? It's not unreasonable that he may have been secreting a spare or two.

Often it seems like some people would prefer to find flaws. Absence of knowledge presents as certainty.