Clicking on the <home> key focuses on the selected character and edge panning again works. I agree it should always work- except as the OP says when you are not looking at the map.