Those "encounters" are all over the map(s), it's not just a grove thing.

Most of them have preset if you don't get involved in them that will happen after certain quest or long rest counter too.