It has worked wonderfully at my tables and has done a lot to provide motivation to my wizard players to seek out the magical places and people of the world.
Did you have other caster classes in the party? Wasn't they feeling robbed of their stuff? I know I would have been.
What do you think about giving every character the ability to hide and disingage as a bonus action? What are the thoughts of a rogue player?