Not only does it not make a difference, but parts of the game assume one of your characters is male and the other is female even if both of them are not!