It's because Damian is a charismatic villain... not to mention the Divine's absence already made him practically invincible.