If all of the secrets are on the same map, then a workaround (of course not ideal) would be to mark the secrets manually on your map, hopefully the player created markers don't disappear for you.