I would have to double check, but the icon is either a closed chest or open chest if it's been looted? I thought it did have an identifier. Also if you hold alt it should say if it is empty or not. Some are bugged but most do.