I think maybe reducing the starting population would be a better way to speed up battles. Fortified building should be at least a little hard to destroy.
In the campaign this seems like a good idea. If in a campaign you didn't start with population at all and you got more troops from deploying them on the campaign map it would speed up games, reduce the impact the dragon can have without overt nerfs and increase the importance of good play on the campaign map.
