3 companions out of 13 is still way less possibilities than 5 out of 13...
I'm not sure it's very complicated to balance the game and create difficulty levels for every companions number.