I had something similar with summoned ogres in act1 attacking someone they were not supposed to, the game is still rough around the edges on this regard, reload an earlier save