I feel like the scene with Voss was going for something like "I'm not going to waste my time cleaning up this trash, my minions are more than enough to deal with them". Which would work fine if he didn't just personally fry some Flaming Fist...
Yeah, if you walk up to him and talk to him, this is completely fine and it makes sense that he will have his minions deal with us. But you can also shoot the dragon from afar and he will immediately fly away. This is what bugs me.