I can set everything in the game as high as it goes, but disable shadows and get a consistent 60fps.

If I turn on Shadows, even Low Quality, that drops to 33ish fps.

Are shadows processor or GPU taxing?