I don't think it's true about all the companions... Shadowheart's character development actually requires you to have her in your party during your travels and most of the revelations concerning her are a direct result of going to specific places on the map with her... Astarion is probably the one who's interactions in the camp are the most significant, but you have some interactions in the world map with him as well.
