That is normal, if you don't deal with him soon enough.
There is a second place you can find him in Aleroth. After encountering him later, he will no loner show up in Aleroth, even if those encounters had not already been triggered.
Did you check out the graveyard?
Move the pot of flowers from Jake's wife's grave to his grave.
