As I've got a bit further on (level 11) I've learnt that "only focus on physical" made sense earlier, and my team handle most battles very well, but you do get the occasional enemy with tons of physical armour and little or no magic armour and I don't have a good way to deal with them. Spawning the incarnate and totems on a surface is usually my best answer, along with elemental arrows from Sebille, and I've just about coped with that so far.