No.
However, sometimes there are conversations which are triggered automatically once you walk within a certain range. Those conversations are with the person who is in front, the one you are controlling. If that is not your persuasion character, and there is a persuasion check there, your chances of failing it are higher.
That's the only downside.
