I remember distinctly having 2 in charisma when that happened (or in my case did NOT happen) and only added some more later... could be the reason but not sure.