You can get a lot of Charisma points from items, so you don't need to invest many hard points into that ability. Your Charisma char should have the Pet Pal talent as well, or otherwise you are missing out on a lot of XP on the second map.

If you really need to tank something, just use some summons. You are sacrificing way too much offensive power by running around with a shield.

You need less ability points by making one of your main chars a crafter, because only main chars have access to traits (passive boni, including the option to get +1 to crafting). However you can just as well hire a 5th party member just for crafting/blacksmithing and leave him/her back at your homestead.

If you have a mage as one of your main chars, I would give that char pet pal, because there are only few good talents for casters. You can trade 1 talent point for 2 attribute / 10 ability points later, so don't pick stuff like All Skilled up or Know It All.