People do not follow you in combat. They go where you click them to go. Only outside of combat do they follow you (and it is possible to disable that). So why would you need to walk in poison with your party outside of combat?

The problem is not this talent, the problem is you not understanding basic game mechanics.