It would work, but not on a tank... a summoner/buffer/controller type character would work best as then you are not tied to either str/fin/int as your summons don't scale of them, and buffs and positioning spells do not really benefit from those stats either.
Shield would be for extra defense, and a shield throw now and then (scales off the shield stat to my knowledge?) and the loss of a weapon is not felt as keenly on a character whose role is pure support.
You can go for high wits/memory then, always go first in fights where you then summon your incarnate, use adrenaline, reposition allies or enemies and use whichever buffs benefit the scenario best.
Pawn talent will also help