Bahara, the Amadia disciple you meet elsewhere says that she escaped Fort Joy years ago. It might be temporary for the prisoners, but it's not for the guards, which is why the lack of those things after years is so striking.
Clearly the weather around this island is not very nice at all given the 44 dozen ships wrecked along the coastlines, including some wedged about 30 meters above the water line in rocks 200 meters from the water. I wouldn't want to be a guard living in a tent for years with the kind of storms this place gets.
Fort Joy needs another floor.I also realized there seems to be nobody corning the market in halibut, sheep's cheese, or tomatoes.
There was once, but they "mysteriously vanished" after half a day.