Your class has a hidden effect on your stats. A Warrior will do 4 times as much damage with the same weapon and same stat build as a mage, and have a higher chance to hit. It's better to go a a warrior, because as you noted, Charms can make up for your lack of mana, but you'll never make up for the reduced damage.
90 STR and 90 AGI is okay, but you can get them higher.
