I believe this is a known bug. There was a large AI overhaul not too long ago and I know Larian has a large update they are working on for combat. For now, I would avoid that trait.
Every time there I run into trouble on the road, there is always a dwarf at the bottom of it. Don't they know how to drive above ground?
