# CCLS Media Group - Robots.txt User-agent: * Allow: / Disallow: /error/ Disallow: /include/ Disallow: /*.json Disallow: /src/.indexer_files/ # Sitemaps Sitemap: https://ccls.icu/sitemap.xml # Crawl-delay for polite crawling Crawl-delay: 1