Are you moving your mouse cursor to the bottom edge of the screen? WASD and the arrow keys can also move the camera.
The Home key will re-centre the camera focus on your lead character, as will double clicking on the lead character's portrait, single clicking on another character's portrait (making them the leader... or you can switch leaders using F1, F2, etc) or left clicking and holding to direct the character(s) to move.
In the Game section of the options you can lower the camera pan speed. Eventually there should be an option added to disable scrolling the screen with the mouse.
