The point of Scrolls is that they are a thing which non-mages can use. As in, scrolls by definition, don't require you to have mage-like stats, so it makes sense that they do not use your stats and hence do not scale.
That said, it's a good point that they'll become less useful as you level up, so it probably wouldn't hurt for scrolls to scale based on your overall level.
