I found that he would get stuck on doorways and the like, but if I reloaded, fast traveled, or walked far enough he would pop up next to me.