The Open for Agents scanner

a2ahello-scanner is the crawler behind the free agent readiness scan. It runs only when someone submits a website for a scan, and identifies itself with the user agent a2ahello-scanner/0.1 (+https://openforagents.ai/scanner). It reads /robots.txt first and follows the group for a2ahello-scanner (or * when there is none), including Crawl-delay; if robots.txt answers with a server error it fetches nothing else. Per scan it makes plain GET requests for at most 25 same-site pages plus /sitemap.xml, /llms.txt, and the agent discovery files, one request at a time at least one second apart, with no cookies or credentials, no JavaScript, and no form submissions. To block it, add these lines to your robots.txt. Questions or problems: [email protected].

User-agent: a2ahello-scanner
Disallow: /