Totally not trolling.

This is honestly the answer to your problem. The percent to hit applies ONLY when the target is red. Keep that fact in mind the the archery system works just fine.