i would suggest maybe preemptively clicking the button rather than reactively clicking it.
Good point, but exploring in turn based mode is really tedious, so that advice only applies on subsequent playthroughs (and only if I can remember what’s coming).