There are not any listed penalties for mixing one handed weapon types. It does look better with matched sets, but I didn't notice any issues swapping weapons around early in the game. For awhile now I've been using two axes, but that has been because axes have had the best damage and bonuses.