After playing a bit more, it does seem like BG3 has some extreme swings in performance. In gameplay I seem to run somewhere between 80-130 (maxed out, DLSS quality, 2k) but in conversations in certain shots it dips as low as 20-30. Some optimisation to be done, no doubt.