You get the dueling benefit with a shield in your other hand in early access, yes.
*
Of note, at least in early access, you kind of have to have a shield in your other hand to get the bonus. Otherwise, the game assumes you're wielding a longsword, for example, as two handed instead of just one handed, giving you a d10 rather than a d8.