I don't really know what to say. My friend played an archer in our last play and he was doing insane damage.
I know he only took Finess as attribute (he had 32 at the end) and he took ranger combat skill, and only that.

I also assume that a ranger dmg comes a lot from his bow, so are you using a bow that fit your level ?