I too noticed this. I also noticed that if you learn a scroll like for example Mage Armour, then as you level and you can pick new spells you can get Mage Armour again and it's not an option for the memorized when you are leveling. However outside of leveling and through the normal method to change out spells you can pick it there.