Thank you for your help people. The problem was just that the character who initiated the conversation was not the one holding the item...
This is really counterintuitive imho however, since the game doesn't tell you anything.