yes anyone you feed to the fish lord is gone "for good"
but if you kill the fish it also kills your buff

Luke Skywalker: I don't, I don't believe it.
Yoda: That is why you failed.