The headband does not add or subtract any bonus, so the starting value does not matter a single bit. It makes it so that your native INT is handled as a 18 when making rolls and checks.
Well, as a 17 now.

Party control in Baldur's Gate 3 is a complete mess that begs to be addressed. SAY NO TO THE TOILET CHAIN