I never had that encounter but yes, of course he should leave. Tara is like family to him, staying wouldn't make sense.

"We are all stories in the end. Just make it a good one."

Doctor Who