# allow all crawlers User-Agent: * Disallow: /SCHS/healthstats Disallow: /vitalrecords Disallow: /epi/gcdc/manual09 # allow crawling of site by NC Department of Cultural Resources Web Archives User-Agent: archive.org_bot Disallow: /SCHS/healthstats Disallow: /vitalrecords Disallow: /epi/gcdc/manual09