There is no level 5 key in act 3, and no level 6 key in act 4. The next patch will hopefully fix that, but at least in act 3 the level 6 BF key will open both the 5th and 6th dungeon.