You are correct. Currently in BG3 for offhand attacks, the attribute modifier is swapped from attack roll to damage roll, as opposed to 5e.
This means that without any feats or fighting styles, your offhand attacks have less accuracy than they would in 5e, but do more damage than they would in 5e as well.
This is probably just a bug, but could be intentional.