Speed is funny in this game.

On the one hand you've got a character in stupid armor, speed 5, moving at around 0.8 versus the hasted dex scoundrel with the talent rushing at 5.5, or 7 times as fast.

If you want more speed, wear leather armor and wield daggers (daggers can grant you bonus speed just by wielding them).

I find the walking speed is fine, provided you aren't bogged down by armor.