I'm having the same issue, it's incredibly difficult to play the game with a gamepad because of this.