It was discussed many times before...
But yes, this thing is a annoying. At the very least Larian should remove disapproval there if you decline him and lock their post skinny-dip scene banter behind active doubleromance(instead of being deleted).
Edit: Don't forget this :
, if you want to see changes.