Same issue. After I escaped the fort I started experiencing crashes at times when I load the game. I think the first crash occurred after I left the fort, ran into some skellies, reloaded quicksave. I am no longer 100% sure if I returned to the fort before the first crash.
Once I travelled back to the fort after leaving it, I experience hang-ups of up to 30 seconds where my memory usage maxes out. During hang-up graphics are paused, SFX/BGM still active, cursor still active.
This seems to be a very high repro case with critical severity (blocker for some as it renders fort area quite unplayable, I don't have anything major to do there anymore thankfully so I can skip it), any chance of Larian employee being able to give a hotfix ETA? I assume you are already planning a patch for next week but I think this is worthy of a hot-fix.