A game should be annoying? Interesting. So, if darkvision becomes the new normal, what's the issue with just getting rid of a useless visual mechanic and implement it in a different way that makes it still special, but not annoying for everyone else?
Sometimes, yes... You should be able to stumble into dark room, not realizing it is already occupied by 20 drow elite warriors with darkvision, standing perfectly still and watching your every move. That's something you can't have with darkness not really being dark.

It's the closest thing you'll get to DM just not telling you what's infront of you if you didn't think to bring a torch...