I think it's better not to arrest him. He has some usefull things for sale: e.g. bottles of super poison. Very handy when you have the poison weapon skill.