You still lose the talent point, though (at least pre DE). What you can do is unlearn the talent in the mirror before the talk with Hannag and relearn it afterwards.
Ok, will keep that in mind, although usually I didn't use Hannag as the source master to gain the third source point slot.