Move your mini-map away from the edge of the screen, so you can at least see 1 pixel of background around it. Even with your mini-map in the corner, you should still be able to scroll in those directions moving your cursor to the edge, but avoiding the map.