Wanted to add that I experianced this as well, however did not need an imp to cast. I simply returned to camp via the waypoint and the map menu and on both occasions party members turned on me. Upon first return only Astarion was hostile. Upon second return Le'zal was hostile.
