you have to talk to one of the other guys in town - i think may be richard - and he tells you that the guards are needed elsewhere for something. when you go back and talk to the guards, they leave, and then you can jump the fence and talk to Kevin.