The cantrips damage dice increase by one at certain levels, the first increas being at level 5, so not in the EA so far.
Its a balancing issue, so you can't plow through every encounter. You have to choose between doing higher damage or saving your resources, or spamming long rests after every encounter. ^^