Never done it but I do not think just being near the temple would trigger anything. You need to finish the whole chain quest to get into the temple. Until then, you are not in the zone to trigger any event.