Nope, no penalties. Just doesn't make much sense to use items to raise his strength so he can wear heavy armor.