I don't think the moveable objects should be ignored - you find keys under rocks, trap doors under other objects, treasures behind/under some others. That there is a number where there is nothing, adds to your exploration - I think it can be boring if ONLY things that hide something are highlighted. If it is too much trouble , you can always use the ALT-key to look whether it is worth moving the object.
(Could also be that the world designers copied a lot of moveable objects into the world, and the story designers did not fill all the oppotununities)
