The biggest problem with Unarmed is that all attributes are hard-capped at 100. Hand-to-Hand's damage is based only on Strength, equipment doesn't count for that. So as soon as your strength hits 100, that is all the damage you will ever do.
You can still deck yourself out with the rare charms that add to Melee Damage, but those add only 10 at the most per charm.
You will also want to increase Dexterity for the increase to Critical Damage that comes from that attribute, and wear items with +Critical Chance, but that's all that can be done really to tweak an Unarmed build.
