1)after you have the password for the bandit camp: do NOT say anything to Louis!! (he is in barracks Brocken Valley Village).
2) You must search this bandit camp and do all quests in this bandit camp first! (to the south if you are by the "Tribal Scrine")
3) You must trigger the Quest "Daylight Robbery" somewhere in Brocken Valley
4) After choose the side of the bandits and do the battle ... go back to the Bandit camp and find Ragnar somewhere in one of the tents!
5) If you now wish to buy something from the bandit you rescued earlier out of the gail in the barracks (forgot his name on this moment

!): do this BEFORE you say at Louis you know the password of the bandit camp!
6) After completed the quests for the bandits + the quest "Daylight Robbery", you can say Louis you know the password and then go back to the bandit camp and kill all the bandits!
7) After that you can do the Temple of Doom, but you can also do this earlier or later on (I think it make totally NO difference do this Temple before or after say to Louis about the bandit camp)
But a warning!!: make a extra savegame BEFORE you go IN this Temple of Doom!! After you go In, the door is closed!!
Note: A bandit-quest for Tagos: fidn his Axe. If you have the Tagos' Axe found and bring him to Tagos you can choose to NOT give this Axe back to him and Tagos attack you! Win the battle and Tagos give up before he die and you have the Axe + a reward for this quest!!