I don't see how loading matters in any way. Crossbows are nothing special even if you don't have to load them.

Crossbow, hand 1D6
Crossbow, heavy 1D10 (two handed)
Crossbow, light 1D8 (two handed)

I mean what is so special about crossbows that makes them OP if you take the loading action away???