It's just how DnD works. Casting multiple spells or throwing out some 20-sword-slash-combo in a 6 second interval isn't going to happen without some magical enhancement to your speed.