No. Also, I destroyed the totem mid-combat as well and it worked for me so that isn't necesarily the cause.

Can only suggest reloading and trying again.