Most of the "little" magic items indeed don't do much by themselves, they are intended to compliment other items and class features. So, if you can't think of a use for an item ( and some of them are VERY situational ), just sell it.
As an example of good "little" items, I have Karlach kitted out with a helm that gives her 3 rounds of momentum ( i.e. increased movement ) at the beginning of combat, "crusher's ring" which increases her movement by 3m, and items that allow her to cast "Jump"/"Misty Step" once per short rest. Together, these greatly improve her mobility, which is very important for melee-focussed builds.
Obviously, if markedly better items become available, I will use them, but until then, the little ones can be useful.
I would also point out that magic-item scarcity is mostly a matter of personal taste, and has only really appeared in the most recent rewrite of the forgotten realms sourcebooks. Any mods aiming at changing the character of BG3's magic item roster should probably allow for a range of options to suit different tastes.
