Yes, that's a way you defenitely can go ... With my Warrior Priest I put points in Strength & intelligence (go for balanced two handed swords) so my HP & MP regenerate faster.
With Summon Ghost I only needed so far just a few healing potions here and there (now Wirlpriesly is level 19, on nightmare), all the rest the Ghost do fill up my HP bar. Together with skill Life Tap it's easy to fill up my mana pool fast (faster than drinking a mana potion (if Life Tap isn't in 'cool down time' of course

).
Didn't invest a point in dexterity and just in the beginning a few points in Spirit. All the other points I become via equipment (in first place I go for all equipm. with boosts to vitality and/or spirit).
Good luck killing enemies "up close and personal" ...
... these are the words of Gawain,
Gawain is the name