The game uses the armour class of where you get hit in determining damage; the overall armour listed in the stats is just for your information. Not using a shield means a loss of some blocking and less equipment to have bonuses on, but doing damage faster can make up for that. Offense and defense are based on agility, as is your chance to hit and be hit (see
differences between classes - minor spoilers).
