Well etymologically you are correct; Barbarian was just an Ancient Greek insult for anyone who wasn't Greek (making fun of their language, 'bar bar'). I think when people hear Barbarian today they imagine like a Conan type; big sword, muscles, wearing nothing but underwear.