Three pieces of circumstantial evidence are enough that they can not be easily dismissed. Confront Esmeralda with this evidence, or you can talk to the legion commander (or save and try both).

The book is found on the ground floor, not upstairs in the bedroom. You can find an item upstairs useful if you have the Pet Pal talent (an alternate way to narrow down the list of suspects).