The enemy AI is extremely cruel, they pretty much always go for weak/downed party members first. Once we get difficulty options the fights will probably be more balanced in this regard. My tip for now is to try to get him to higher ground at the start of a fight.
But I think you're onto something, one thing I as a player have learned (the hard way) in tabletop games, is to always kill the casters first.