Now that you mention it that does make sense. I did finally manage to get this fight over with (restarting also seemed to help abit) by getting the jump on the AI. This seemed to result in different behaviour from the AI and resulted in less use of invisibility. Which then slowed down the fight alot less.

Kind of hard to determine if its completly tied to invisibility though. Havent used it myself. Will have to do some testing I guess.