You should be able to level up by clicking the '+' icon on the character portraits bottom left. However I do agree that this is a bit unintuitive and not necessarily immediately obvious.