He attacked me at the end of the fight as well but I hadn't used any aoe and he had taken 0 damage he just said oh you like to fight lets fight