I passed my perception check on the crumbled wall in the Goblin Camp and above the entrance to the fort. This is the one near the sleeping goblins and bugbears.

I wandered away to kill the enemies in their sleep, as one does, and when I returned I could no longer highlight the wall.

I held X (PS5) for the expanding search radius. This allowed me to select the wall. I attacked it with a spear. This clipped my character through the wall. My character could move around in the small area behind it, but he could not move out or jump out.

I resolved it by using the fast travel point in the fort.