I've deleted the files in the dynamic folder multiple times (not the folder itself), and never had a problem.