Quality of armor only determines how many charm or enchantment slots the armor has, nothing to do with the strength of the armor. And the armor in divinity 2 is percentage based so +3 means it prevents 3% of the damage. It doesn't mean much early in the game but counts more later on.