Website & SEO
Inspect crawl rules, user-agent groups, and Sitemap declarations from robots.txt.
Public http/https only. Fetches /robots.txt only — does not crawl the site or fetch sitemaps.
Robots configuration score
—