How many websites pass the Robots Sitemap check?

Based on 499 audited sites · Updated 2026-05-08

74.9%of audited sites pass this check↑1.1% vs last month

95% confidence interval: 71%–78.6%

About This Check

Checks whether robots.txt references one or more sitemap URLs. Adding Sitemap directives can speed up discovery and improve crawl coverage.

Why This Matters

LLM Discoverability

Declaring sitemaps in robots.txt ensures AI crawlers can discover all content entry points in a single request, reducing the risk of large or deep sections being entirely missed.

SEO Impact

Linking sitemaps from robots.txt is a Googlebot-recommended pattern that improves crawl coverage for pages with few inbound links and accelerates discovery of newly published content.

Status Breakdown

74.9%pass(374)

25.1%warn(125)

0%fail(0)

Compliance Trend

Daily pass rate across benchmark snapshots (up to 90 days).

Industry Breakdown

How different industries perform on this check.

Other42.9% passavg score 67.4n=7

Energy66.7% passavg score 73.7n=3

Gaming66.7% passavg score 79.3n=3

Retail100% passavg score 77.2n=5

Travel66.7% passavg score 72n=6

Finance80.8% passavg score 75.7n=26