Using potions for a bonus action is ok, but I like the idea of limiting inventory actions much more. Changing weapons / equipment, like any other actions with items, must spend a bonus action too. And the use of food during combat should definitely be prohibited.