You do realize that we're never returning to Fort Joy after leaving the island, right? The only reason to ever go back to those turtles in fact is to open that locked chest and grab a source pool, and that's one of the few areas with a reason to revisit it once you have cleared it once.
And Larian doesn't want respawning things so people don't farm XP. Just saying.
