Hello. This happened to me too. I wouldn't say it's a bug, though.
The quest will close either if you consume Mudbarrow's spirit or leave the island. You'll miss out on the XP, but you still got the loot from the chest.
I wish there would have been another option, but I'm still happy with all the possibilities within the game.