Something that has seemed to work for me - I disabled the tutorial tooltips from the options menu and now I’m noticing very minimal lag when switching characters. Still lags when performing summons but it’s MUCH better. Worth trying for anyone experiencing performance issues.
