Yes a evil playthrough would never just let it slide, and party watching its the worse part.
In my lawful evil playthrough I was fine with it, would do the same if the roles were reversed. He's not a pushover and that's why he gets my respect. Actually from all the companions Astarion is my favorite one. I don't get the hate. Unless of course you're playing a goody two-shoes.