User-agent: *
Disallow: /badarticles/
Disallow: /*.txt?
Disallow: /*.TXT?
Disallow: /pdfs/
Disallow: /comments/img/