User-agent: * crawl-delay: 5 Disallow: /css Disallow: /js Disallow: /mt-static Disallow: /cgi-bin Sitemap: http://news.sciencemag.org/sitemap.xml User-agent: Fasterfox Disallow:/ User-agent: daumoa Disallow: / User-agent: dotbot Disallow: / User-agent: Exabot Disallow: / User-agent: Yandex Disallow: /