I was thinking this too and thought it was one of the reason's why his clothes are kept in such good shape apart from the obvious reason. And I wonder if Cazador was once the black sheep of Velioth's "family", the disobedient one who eventually overthrew him.
Cazzy seeing his old self in Astarion would explain all the "special" treatment.
