True, but he's in the wilds, your turf and natural habitat so to speak.
Plus he tries to munch on you. I could see a hunter getting staky stabby happy if you will, and in the current patch you can do just that should the notion take you. I do believe the character you play in-game is skilled enough (plus you do have your party) to kill a full fledged vampire and you'll probably get to do that later (Astarion's Master Cazador).
You could still have the dialogue in there even if you weren't a considered specialist of that field. Also that bit about the caravans got me.
