Once you select the ladder, moving forward should have your character climb up, while backwards is down. That's how it works on the Xbox, anyway (left stick up/down to climb up/down), but I doubt the design would be different on the PC. Did you try the W/S or arrow keys?
