It's not extra penalty, it'd be a replacement. Instead of less HP, you'd have less resistance. Maybe OP considers that being more vulnerable to cc is more dangerous than having less HP.
Anyway, one need to evaluate how much speed/con this talent is worth, and compare to the demon trade (1 talent = 2 attributes). This method of comparison helps milking out useless talents.