From what I've now seen, it definitely seems to be caused by Guidance. Straight rolls with just CHA modifier are fine. Whatever Guidance is doing, it's doing it incorrectly. Perhaps the d4 roll is made once for the actual calculation and again for the mouseover information box.