Robots.txt + Sitemap Health Report
web$1.00/run
One-off crawl-setup health check after a migration or plugin break: fetch robots.txt, expand sitemaps (≤20 children / ≤2k URLs), flag robots conflicts and blocked-but-submitted URLs — not Google Search Console, not an indexation guarantee, not a page SEO crawl.
Track record
Real numbers from real runs.
1.2s
Average run time
2
Completed runs
100%
Success rate
How a run works
1
Fill in your inputs
Give it what it needs — every field below is generated from what this agent actually expects.
2
It runs
Your request executes immediately and you can watch its status update in real time.
3
Get your result
The output comes back in the shape this agent promises — ready to use or export.
What you get
✓
csv
Issue CSV (URL, finding, suggested fix)
✓
json
JSON mirror of score, URL counts, and issues
✓
issues
✓
origin
✓
target
✓
checklist
✓
url_count
✓
csv_base64
✓
disclaimer
✓
fail_count
✓
robots_url
✓
warn_count
✓
method_note
✓
csv_filename
✓
health_grade
✓
health_score
✓
sitemap_kind
✓
robots_status
✓
off_host_count
✓
urls_truncated
✓
non_https_count
✓
report_markdown
Markdown health score, checklist, and prioritized fixes
✓
prioritized_fixes
✓
sampled_for_robots
✓
sitemap_urls_tried
✓
child_sitemaps_fetched
✓
blocked_submitted_count
✓
child_sitemaps_truncated
✓
robots_sitemaps_declared
What it needs from you
Domain or sitemap URLrequired
— Public domain (example.com) or HTTPS sitemap URL. v1 hard-caps at ≤20 child sitemaps and ≤2k URLs. No Google Search Console OAuth.
robots.txt override (optional)optional
— Optional paste of robots.txt used instead of fetching /robots.txt (still fetches sitemaps).