I had the same issue and fixed it by taking Wyll to Waukeen's Rest.
It is important to fully walk into the burning building while he's in the party. The exclamation mark will go away and Wyll will say he can't talk right now, after which you can just go back to camp and he'll no longer do that.
