You'll lose out on some dialoge, other than intimidation checks you'll have issues