This is a really good idea <3.
It would add so much to the lore, and it should be harder to persuade the companions to join you too imo(still persuadable, but just make you need to persuade them instead of them accepting your leadership so easily like it is for a High Elf or Human).