I’m going waaaay back but to me invisible is invisible - you shouldn’t be able to be attacked unless your opponent has sone means to detect invisibility ..true sight etc..
Maybe if using an area of effect spell or flaming oil etc , maybe if the player character is clumsy or wearing full platemail then an attacker might successfully hear them and attack with disadvantage ..
I generally employ thrown oil or burning hands etc to find auntie Ethel before she bales out of the tea house & to me that’s a plausible method of detecting invisibility..