User-agent: *
Crawl-Delay: 10
Disallow: */log.txt
Disallow: */counter.txt