On Fort Joy you are a prisoner or an escaped prisoner, Off of it you are a danger to society and must be locked up or killed. They are not natural allies.