Solved. You can't just uninstall the game via Steam. You need to go into the actual local files folder and delete all the left over files. If you fully remove EVERYTHING, and then reinstall via Steam, the game sound will work again and you can enjoy the lovely music, etc.

Yay.