Happens to me too. Shutting the game completely and restarting solves it for awhile.