I think movement is fine. At first i had major problems with my warriors and was of the same opinion as the OP, but then I discovered that crafting can negate the movement penalty on heavy armor; drag it to the anvil and I have seen an armor with -0.38 movement beturned into an armor with +0.10, huge advantage suddenly.