There's nothing that can be done about it unfortunately. The quest will be carried around by you until the End of Time.
It's definitely something Larian needs to fix though. Hopefully future patches will solve this problem.