Passive perception checks feel weird because they're not passive. I agree with Abits, Baldur's Gate did it better with finding traps/secret doors.