# If you want to learn about why our robots.txt looks like this, read this post: https://yoa.st/robots-txt # Prevent crawling of Cloudflare challenge URLs. User-agent: * Disallow: /cdn-cgi/bm/cv/ Disallow: /cdn-cgi/challenge-platform/