# robots.txt for mcprofi User-agent: DataForSeoBot Disallow: / User-agent: bingbot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: PetalBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: * Crawl-delay: 10 Sitemap: https://www.mcprofi.cz/sitemap/products.xml Sitemap: https://www.mcprofi.cz/sitemap/categories.xml Sitemap: https://www.mcprofi.cz/sitemap/articles.xml Sitemap: https://www.mcprofi.cz/sitemap/pages.xml