I figured this out by waypoint to outskirts and then some told this is not yours. So drop start dropping all items from that house untill after waypiont noone told anything. After that just waypint to square and noone was hostile.