I don't know if this is a me problem, since lots of people have said he's one of the better villains.

Still, pathetic? Yeah, that is absolutely what I would call him. I expected a lot more from the Cazador/Astarion confrontation.