I think the issue is you’re not supposed to open the chest, just deliver it. If you want its contents pick it up, leave and open it when you’re alone.
I didn’t know Rugan and Olly left with the chest if you take a long rest without grabbing it, but it’s consistent with other sequences. It’s how the game represents time passing.
