Does your character do more damage with the same spell? I've never had that problem, but it could be that for some reason the dolls aren't as powerful with magic at the same skill level as your character (which is weird 'cause the doll themselves are magical...)