Cleric's spells were always prayers. That's why they can cast them while wearing heavy armor. The RP reason against armor is it interferes with delicate hand movements.