Should be a fairly simple fix, anyone involved in Dialog drops it upon fights that would normally involve them.
Two thoughts for fixes.
1. Disable character switching during dialog.
2. When one character enters dialog, the entire party is pulled into dialog as well.
3. Prematurely end dialog when receiving damage.
