It's not awful, by any means. Playing zoomed out helps. I think it could hit the sweet spot where it's just not an issue with only a few minor tweaks:

1) a camera "settle in" period after it jumps (with an option to enable/disable)
2) a slider for animation speed