This sounds like a fun idea. Like you said, it would give more improvised weapon options. Plus the sound of vases breaking over people's heads also sounds fun.
As a collector or trinkets, bobbles, and pretty things, I also like the option to be able to collect even more. Especially, as you have pointed out, when we can already collect crates, chests, barrels, and other similar containers.
It would be fun if something like this ever became possible.