I am also having this issue, and having to work elsewhere to progress. It does suck though, because I wanted to solve this after finishing up the goblins and returning. Seems it is loading assets over those related puzzle markers on the circles and keeps reloading new ones each time. After going in and out the loading zone twice, they all end up like dirt.
Hopefully this doesn't halt progression. :O
