Also, maybe not have the party walk right into fire, acid or anything dangerous when they follow me.
Do they? That didn't happen on my playthrough. They always stopped before fire. Acid is not dangerous as it doesn't do dmg.
Not universally, the pathing still needs some work though. There's about an even chance between the party navigating around hazards or just plowing through them and taking damage, and then a smaller chance of them just getting stuck there if the AI can't find a path, even though there almost always is.
It's especially common for them to rush through anything on the ground after a battle to the character being controlled though. That needs to be changed.