Did a full rest and the jellyfish are still swarming around.
Yes, you are stuck with your swarm. It's such a weird choice that you cannot disable or enable them manually. I gave Jaheira a few levels in beekeeping and don't mind the effect but I can imagine it must be annoying if it's your player character.
On another note, I noticed that some of the action poses you can pick in photo mode add subtle speed lines to your character and those don't go away if you change the pose either, which is unfortunate, while on the flip side, the magic poses come without effects which is equally unsatisfying. Although you can always trigger a spell and open photomode without releasing it to get that magic spark - so that's not too much of an issue.