You should be able to edit your hotbar to drag the improvised weapon off it entirely or move it to a different spot where it’s not visible on the combined view.
Did that before, but I restart new char quite often, so everytime I have to do it again on every companion. Not a hard work to do, but still annoying.
