Game still feels a bit early access because when you complete certain quests they aren't marked as closed correctly. You finished the Withermoore quest it just didn't mark it as closed.
Far as the elves, do the fight once you're done with all the other quests in there and bought anything you wanted from the Lizard, otherwise you'll have to bribe them to raise their attitude
