How many websites pass the Ai Txt check?
Based on 596 audited sites · Updated 2026-07-16
95% confidence interval: 16.3%–22.7%
About This Check
ai.txt is an emerging convention for explicit AI agent crawling/indexing guidance. If it is missing, agents may infer rules inconsistently.
Why This Matters
LLM Discoverability
ai.txt offers a dedicated file for communicating AI-specific access policies, allowing granular control over which AI agents can use which content, beyond what robots.txt was designed for.
SEO Impact
ai.txt has no established SEO ranking effect today, but positions the site to comply with evolving AI content-use regulations and gives clear opt-in or opt-out signals to model providers.
What To Do Next
80.7% of audited sites need attention on ai txt (481 of 596 sites are warning or failing).
- Prioritize ai txt on templates that create many URLs, because one template fix can improve a large share of bot access & control plane.
- After changing the page, re-run the audit and compare the observed value for this check instead of relying on visual inspection alone.
- Use the 19.3% pass rate as a benchmark: if your site fails here, passing the check moves it closer to the visible majority of crawlable, AI-readable pages.
Status Breakdown
Compliance Trend
Daily pass, warning, and failure rates across benchmark snapshots (up to 90 days).
Industry Breakdown
How different industries perform on this check.
23.3% of audited E-Commerce sites pass this check (n=30), compared with 15.7% of Travel & Hospitality sites (n=51).
| Industry | Pass rate | Avg score | Sites |
|---|---|---|---|
| E-Commerce | 23.3% | 69.6 | 30 |
| Technology | 21.6% | 72 | 278 |
| Education | 20% | 71.8 | 30 |
| Finance & Banking | 17.9% | 72.8 | 39 |
| Media & Entertainment | 16.7% | 73.8 | 84 |
| Travel & Hospitality | 15.7% | 74.8 | 51 |
| Food & Beverage | 36.4% | 71.1 | 11limited |
| Telecommunications | 33.3% | 75.7 | 3limited |
| Other | 28.6% | 67 | 7limited |
| Healthcare | 22.2% | 76.7 | 9limited |
Related Checks
Run a free audit to see whether your site passes this check, or browse the leaderboard and the audited-sites directory.