Quasit has a fear ability that resets on short rest. You can work around this by simply summoning a new one.