You just need another one handed weapon (use whatever your second best weapon is in your off hand).
By default equipping a one handed weapon always puts it in your main hand. Select your off hand in the inventory to equip a second weapon (in the Xbox version, select your off hand, on the right of the character model, hit A to display a list of one handed weapons, then select one and hit A again to equip it).
