allow changing weapons during combat. it's a normal part of most combats, this weapon isn't working so try another.
if not a free change, make it cost a bonus action or even a full action though I think that's a steep cost.
Also, most magic weapons I've found so far mostly require martial proficiency. spread this out a bit so other characters can use them.