I have 18 int but I can't tell what kind of explosive mushroom I'm looking at until a die decides I don't have amnesia. How does that work?

How about just tying these checks to character traits like WIZARD/HERBALIST/SCHOLAR or whatever?