I have the same problem, it's really annoying and the only way I know how to fix it is by quitting the game completely and starting it back up again. :/