Are you playing in co-op?
Someone on PC got a crash in co-op when a character was charmed, after an error message came up about each player needing to be assigned a character, but it was ok in single player. That issue should be fixed in the next update (currently going through the submission process with Microsoft).
If you are having a problem with a particular fight, try it in single player, or try a change of tactics to disable and kill the opponent that uses Charm as quickly as possible.
If you are playing in Classic difficulty mode, reducing it to Explorer mode could also help, though that would limit all crowd control skills and special arrows, etc, that the opponents use, and alter hit points and chance to hit to make combat overall easier.