As long as you don't encounter him in the poor quarters cemetary it's ok. You can take your time, gain levels and tackle him later. But if you go to this cemetary this before attacking him in Aleroth, he won't turn up again in Aleroth = miss killing XP pts.
Kiya
