That's probably how it is supposed to work. Think the fact that my icon changes to a "talk to" icon is a bug, and when I actually try it, the game crashes. Or maybe it is because one of my party has Pet Pals perk.