Well, that is part of the reason why he is to eager to engage with the drow in the brothel. So, yes, I will say that is most likely the reason.
And I am so sorry, because that could make romancing him with a drow... problematic