Happened in my playthrough as well.

Like you described, Victoria had the book the first time I talked to her, then I came back later so I could pickpocket it and it was missing.