What skill/item are you using?

It it is an item, like a staff, the damage might be limited by it.

If it is a spell, it could be that it is one that doesn't scale (or scales differently that you might think).

Usually the tooltips should give you a good indication of what kind of damage you should be hoping to deal and how you can improve it.