I've found that even walking through an underground area could render them lost. Lost Wyll just by visiting Zentirim merchant under the Inn. Hopefully they hotfix this soon.

Balance is more than light and dark, more than sin and virtue.