Did you defeat all of the bandits along the path and in front of their headquarters? The door by the teleporter will remain locked, but the other should open. Did you check all the loot? The lead bandit may drop a key (don't recall).