Nobody ever got stunlocked from not having physical armor, just sayin. Even so there's no reason you can't go half and half, in fact that's what I always do and I'm probably one of the more avid "there isn't a problem" believers of the bunch.
I died a ton to Knockdown Arrow and Battering Ram before I invested properly in physical armor.
It's not as likely to CC your whole party, but it's great not to get ruined by those abilities.
