There should be a speed-up button imo, it's the same with traveling it can get a bit tedious if you're going back to places that are already safe and explored.