You don't have to do it all in one motion, once you get his scales, stay outside of his domain for a while to patch yourself up. Once healed, deprive him of his dragon powers, and go nuts.
Be wary when approaching him, he starts the fight by firing Stun arrow & Explosive arrow in succession, try using the indentations on the bridge to make his shots miss.