Not only does it not make a difference, but parts of the game assume one of your characters is male and the other is female even if both of them are not!
That sounds like they forgot to update conversation options, like with Arhu when you complete the first map.