I honestly hope you will need an action or at least bonus action to swap weapons. I think this is missing for proper balance as right now its too easy. I must admit PoE2 option to have a onehanded melee and ranged weapon, while switching costing an action was an elegant way of making it a reasonable trade-off.
Now I could agree with this here just like when you drink a potion.
