I had this conflict, Raze. I left the chests in there - and couldn't reenter after a while - it was my guess that giving Finnegan back his lockpicks closes the teleporter - cause the thief says something about him wanting to loot the place.
Kiya