As a extra possibility - Last time I checked, it was entirely possible to climb back out of the hole as well; it's just a matter of fighting against the user-unfriendly UI and the clunky control system to get your character to stand on the right space to have them climb up.
