Sounds like poor party composition to me. At level 7, you should have almost no problems at all. If you haven't yet, go save Gareth at the castle and then talk to 'Leya' at Amadia's sanctuary; she removes your collars.
I’m playing on classic difficulty currently, my party composition is posted above, any advice about changes to make would certainly be appreciated.
