This has also been my experience. Enemies seem to have no problem with their reactions, but my party is not responsive.