Update: backing up to a file before the fps drops occurred allowed me to progress to the point where the fps started dropping without issue.
I'm now in the area where my fps had previously tanked to 12, but am at a full stable 60.
So for the moment I'll be saving even more frequently so I can reload if the fps problem resurfaces.