User-agent: Baiduspider Disallow: / User-agent: bingbot Crawl-delay: 5 # yahoo bot User-agent: Slurp Crawl-delay: 10 # UK majestic User-agent: mj12bot Crawl-delay: 10 User-agent: YandexBot Crawl-delay: 20 User-agent: * Allow: / Disallow: /katalog-firemnich-partneru