The Census
Every quarter we run the same scan, unchanged, across the same groups of organizations: state governments, universities, the largest nonprofits, health systems, the S&P 500, and a hundred sites each on Drupal and WordPress. Nobody asks us to. Nobody pays for it.
We want to know what the web actually looks like to a machine trying to read it — at a size where one badly built site can't move the answer.
Census Q4 2026
CompleteHow common a failure is across a whole sector. How many state portals block AI crawlers outright. How many university sites publish machine-readable licensing. Whether a Drupal site is measurably better prepared than average.
Those are claims about a population, and 1,000 organizations can carry them.
That one organization is better than another. Two sites can differ in which tests apply to them at all, and we renormalize the scores so they stay comparable. A four-point gap between two named sites is noise.
That's why we publish the spread around every number.
Who we scan, and where each list comes from
A finding nobody can check is an opinion
We modeled this on the WebAIM Million, which has done the same thing for accessibility since 2019 and changed what our industry argues about by doing it. Our findings are aggregate. The dataset underneath them is public, named, with the hash of every result.
How we chose the sites, how many pages of each we read, how hard we crawled, and why we scan organizations that never asked us to.
What a score means. Version 11.0. Every result records the version and date it was scored against, so a standard that moves can't quietly rewrite an old finding.
The same list we measure your own site against. One standard, no special cases for the Census.
The crawler that does the reading. What it fetches, how fast it goes, and how to turn it off.
If your organization is in a cohort and you'd rather we didn't read it, AIRBot honors robots.txt. We'll record that you opted out rather than quietly dropping you from the count.
Is your site ready for AI?
Scan a page, get a number you can verify. Free.