Even when you fail the cha checks and start fighting with the fishermen, you can still kill the mind flayer during the fight. It’s still very easy to kill at 3 HP and killing it immediately ends the encounter. I think you somehow found the one way to make it very difficult.
