Same issue for me. Summon Animal Companion or Summon Familiar starts combat.

Also - adding a 5th NPC party member initiates combat as well.