Yup. I am using mostly physical damage on all my party members. I am not saying focusing on magical damage is bad per se, but you need a lot more involvement to make it shine.