There is a lever in the temple to completely avoid puzzle (should give you perception check)