For me, gender is almost entirely connected to what role I am to play.
Nimble, agile and dexterous? Female character, because it just looks odd to watch a male move gracefully.
More bulky? Male, because being bulky is a male sort of thing
This is of course just a general outline.
