After freeing Mayrina and killing the hag I went to smash up the nearly destroyed cage with my spear. I guess the game decided I was standing in the cage while I did it because I promptly fell to my death and returned to the campsite.
Seemed a little unlikely for me to destroy a cage while standing in it - my character has 14 int.