The "physical" resist is called dodging and it can be a little bit annoying when your read "miss" in a tough fight. If magical spells can miss entirely, we can discuss balancing.

Or better, leave it as it is.