In the very beginning when you have it into the nautiloid after you first meet Astarion, the three Fisher people were not there. I'm assuming this is a glitch.