If no one notices a trap, it's noticed when it goes off. Sounds like it's working as intended.
Everyone fails but you still know there's a trap, so you trigger it with Mage Hand from a safe distance. Certainly not even worth having these skills in the game when failure is in fact, a success.