The keys found within the BF are useless, and do not open anything. The amulet for the hermit should be in a cave just north east of the hermit's place.