It does get stuck occasionally: just press left-shift to cancel it if it's being annoying. I also got the highlight characters toggle for some reason (probably my clumsy fingers misbehaving) so if it's that, the grave accent key should get rid of it again.
