What button are you pressing? There is the indivual Hide action (available in the character's action bar, default keybind C on PC) and then there's the Party Hide (button next to the party portraits, default keybind Shift+C on PC).