There are a couple of army quests related to the orc camp (supply train and well), which you should have gotten after doing the escort for the healers quest, and another one you'll get after going to the castle and doing some other stuff. Killing the orcs first isn't a problem, though.