Actually, even though Blake mentions reputation, you just need to do one of the quests that get you an invitation to the castle for him to agree to sell you the key to Nericon's garden.
As long as your reputation is high enough that NPCs will talk to you, I don't think there are any other reputation requirements for getting or completing quests.
