User-agent: Slurp Crawl-delay: 1 User-agent: * Disallow: /newsletters/ Disallow: /js/ Disallow: /css/ Disallow: /data/ Disallow: /catalog/product/ Disallow: /*.aspx Disallow: /*.aspx? Disallow: /index.php/ Disallow: /catalog/product_compare/ Disallow: /catalog/category/view/ Disallow: /catalog/product/view/ Disallow: /catalogsearch/ Disallow: /checkout/ Disallow: /customer/ Disallow: /newsletter/ Disallow: /poll/ Disallow: /review/ Disallow: /sendfriend/ Disallow: /tag/ Disallow: /wishlist/ Disallow: /category/ Disallow: /shop.php Disallow: /product/