So after some more testing, I figured out that the load times are just longer than what I'm used to.

Case closed!