How many websites pass the Ai Txt check?

Based on 499 audited sites · Updated 2026-05-08

17.6%of audited sites pass this check↓0.6% vs last month

95% confidence interval: 14.5%–21.2%

About This Check

ai.txt is an emerging convention for explicit AI agent crawling/indexing guidance. If it is missing, agents may infer rules inconsistently.

Why This Matters

LLM Discoverability

ai.txt offers a dedicated file for communicating AI-specific access policies, allowing granular control over which AI agents can use which content, beyond what robots.txt was designed for.

SEO Impact

ai.txt has no established SEO ranking effect today, but positions the site to comply with evolving AI content-use regulations and gives clear opt-in or opt-out signals to model providers.

Status Breakdown

17.6%pass(88)

82.4%warn(411)

0%fail(0)

Compliance Trend

Daily pass rate across benchmark snapshots (up to 90 days).

Industry Breakdown

How different industries perform on this check.

Other0% passavg score 67.4n=7

Energy0% passavg score 73.7n=3

Gaming0% passavg score 79.3n=3

Retail20% passavg score 77.2n=5

Travel50% passavg score 72n=6

Finance23.1% passavg score 75.7n=26