Are you an Elf?
Are you using blood sacrifice? Some items have stat minimums, which can be decreased by using certain skills.
I.e. item has a con value, gives bonus value to dex and str, item unequips, I can no longer wear chest, as a result I lose more stats, shield is unequipped.