I’m going waaaay back but to me invisible is invisible - you shouldn’t be able to be attacked unless your opponent has sone means to detect invisibility ..true sight etc..
Maybe if using an area of effect spell or flaming oil etc , maybe if the player character is clumsy or wearing full platemail then an attacker might successfully hear them and attack with disadvantage ..
I generally employ thrown oil or burning hands etc to find auntie Ethel before she bales out of the tea house & to me that’s a plausible method of detecting invisibility..
That is simply not how 5e works. Sorry but this isn't generic RPG system where it works however you want it to. There are very specific rules regarding invisibility in 5e and your description just isn't it.
