Website & SEO

Robots.txt Analyzer

Inspect crawl rules, user-agent groups, and Sitemap declarations from robots.txt.

Public http/https only. Fetches /robots.txt only — does not crawl the site or fetch sitemaps.