That could lead to some funny and perhaps realistic dialogue.

"You don't like men?"
Oh, I like men; I just don't fancy dwarves."

"And here I thought elves stoked your fire."
"Elves are fine, but I chase the womenfolk, long ears or otherwise."