What skill/item are you using?
It it is an item, like a staff, the damage might be limited by it.
If it is a spell, it could be that it is one that doesn't scale (or scales differently that you might think).
Usually the tooltips should give you a good indication of what kind of damage you should be hoping to deal and how you can improve it.