Halsin should recognise it, but Larian (who proclaimed themselves our DM) will say that he ignored it because a single armour doesn't actually mean much. Our party could have simply found that armour during our travels, didn't recognise its origins and gave it to SH, purely by accident.
After all, if you manage to kill Gith patrol and dress your party in their armours, nobody asks you whether you are working for Giths.
However, if our entire party would be dressed in these while brandishing the same dismissive faces and goth snowflake attitude, now that would be a completely different matter. At least it should be for Halsin.