It happen to me but I had just saved. I reloaded and tried selecting the character holding the wand (or did I give the wand to my main character?) before asking this time - anyway it worked.