In my opinion, you should long rest at your camp at least three or four times before you even get to the Grove, so before you pick up your fourth companion even. Long rests are so important for story progression in act one! You get some really cool early cutscenes long resting before the Grove. What I do is tackle the temple to the east first, and get a few long rests in while I’m doing that.
