I might be misremembering, but wasn't there originally an encounter with the fishers by their boat if you went there before the trapped mindflayer? And they said they were wrecked because they were lured onto the rocks by a kind of siren-type illusion?
I definitely also recall them saying something about being tempted onto the rocks at some point, in some patch.
Though I didn’t think you could find them by their boat until after freeing them from the mind flayer, at which point they’d (usually?) decided you were tainted and refused to speak. Maybe that changed in an earlier patch.