The PHB ruleset says "no weapon" so that would imply it should work with shields. At least that is how we always used it in PnP, but that of course doesn't mean it's the same for BG 3. Though not allowing it would be rather strange, since it only grants a +2 to damage.
