You can set the camera pretty close to vertical... but I see what you mean now (I don't usually have the camera at either extreme zoom level, and apparently never zoomed fast enough to overshoot what I wanted enough to notice that). Presumably the movement is to allow the camera to get past cliffs, etc, to keep zooming in if you keep telling it to zoom.
