Yes that is the one, extremely annoying.
I did however read that if you engage dialogue with one or the bridge trolls with an un affected member of the party and while in dialogue you attacked him with the person affected he would knock you back initiating dialogue resetting the effect. Unfortunately for me i have already killed both bridge trolls...
