You should have gotten a cutscene with Svadilfari saying he would defeat you in the air (or something like that), and running off towards the cave entrance.
For a couple chests there you need to complete a quest for the beholder Groth (behind the locked door in that cave) before you can get the keys.
