I think that you don't actually get those bonuses/penalties; it's only a visual effect. When your attack is actually made, it uses some specific part of the enemy (the torso probably) for Advantage/Disadvantage purposes.
Check the combat log next time you encounter this and see if your attacks are actually being made at advantage from aiming at the head.