Yea that is the same problem I had on PC version that is why I said there may be some kind of requirement or something.
I don't know either all I know is it would not work for me either early on.
You are putting it in the empty hand right. Not sure how a xbox controller works as I've never used one but maybe it is high-lightable or something to choose the hand you want the weapon to go into.