It would be very difficult to program the game, so that the ability ends up being neither game breaking nor useless.

Even in tabletop, it is difficult for DMs to deal with. Pretty common for DMs to house rule changes to gloom stalker.