I think this is a great idea. I'm going through a Chult campaign right now and half the fun is all the shenanigans we run into when camping down for the night. Snakes sneaking into your tent, goblin raids, strange creatures prowling, magical illusions in the sky ... really helps with the immersion.
