I mean, he wasn't exactly a big opponent to begin with. You can even go at dialogue range, let the cutscene start and STILL one shot him with your first attack freeing the fishermen without a single collateral death.
Party control in Baldur's Gate 3 is a complete mess that begs to be addressed. SAY NO TO THE TOILET CHAIN