There are two different mushrooms.

The large pretty one from the southern woods is, as noted, quite tasty and improves your luck.

The imp farmer wants a different one - you find it to the northwest - guarded, more or less (usually less).

Reality is for those who cannot cope with fantasy. Fortunately, I can cope quite well.