I explicitly avoided showing jaheria the artifact but she some how knows about it.
Right, I didn't tell her about the artifact but she knew. It is immersion breaking. As well as the 'put it back in the pack' animation.
Indeed, I explicitly waited for the last big patch to start a "hopefully bugless" playthrough. It is 2 years after this bugreport and this relatively small but important issue is still there. There was no "put it back in the pack" animation that I observed, only her saying "Protected by the artifact, you can infiltrate ... Until then, we'll keep drinking wine when we meet." So even the sentences seem to contradict each other.
Why they put a DC of 21 to keep the artifact hidden if the story line assumes Jaheira knows about it is beyond me. I spent 3 inspiration dice on my honour run to pass that check...