Add him to the active party and cast Friends on him like 10 times. Each cast -10 approval. At -50 he will leave the camp permanently. Will still give you the Thaniel’s buff in High Hall.