Can't speak for your situation, but I have not had that issue, at all, in playing a few Abjuration wizards who I typically always pre-buff with False Life coupled with Shield of Faith from [Great]Sword of Justice.