I think players should be able to change their character's sex if they choose to. However, it should not be a purely mechanical toggle-box sort of thing, but rather a (totally optional) quest line. There's a lot of roleplaying potential in storylines about trans or genderfluid characters. It could be very fun and fulfilling and could allow you to explore experiences beyond your own, which is what roleplaying is all about.
