Scan
Sempra
Score
28/100
8 of 51 tests pass · 72 points still on the table
Not ready
AI crawlers are turned away before they reach the content, so nothing else on this page has had a chance to matter.
Do these three first
The fastest 14 points on this scan
CDN and WAF do not silently reject AI crawlers
8 of 8 AI user-agents are rejected or challenged at the edge.
Do this: Stop rejecting AI crawlers at the CDN or WAF.
Primary content is present without JavaScript
Raw HTML contains 0% of rendered text on average across 1 URLs.
Do this: Server-render or statically render the primary content.
Content Signals declared in robots.txt
No Content-Signal line in robots.txt. Missing: search, ai-input, ai-train.
Do this: Declare a Content Signals position in robots.txt.
Nine dimensions, most to least left on the table
1 page crawled
Every test · all 67 tests, in order
67 of 67 showing
AIR-1.1 Can AI crawlers reach your site? PASS 5 pt
No robots.txt is published, so nothing is disallowed.
Your robots.txt file tells crawlers what they may read. A line left behind by a previous site or a copied template can quietly shut out the assistants people now use to find you.
AIR-1.2 Does your CDN let AI crawlers through?8 of 8 AI user-agents are rejected or challenged at the edge. PROBLEM +5
8 of 8 AI user-agents are rejected or challenged at the edge.
Even when robots.txt says yes, a firewall or bot-protection rule can turn assistants away before they reach your pages. We sent a request as each one and recorded what came back.
AIR-1.3 Is your page readable without a security challenge?1 of 1 sampled pages return an interactive challenge (Cloudflare Turnstile). PROBLEM +1
1 of 1 sampled pages return an interactive challenge (Cloudflare Turnstile).
A CAPTCHA or bot check on an ordinary page stops an assistant at the door. These belong on forms and logins, not on pages anyone can read.
AIR-1.4 Have you stated what AI may do with your content?No Content-Signal line in robots.txt. Missing: search, ai-input, ai-train. PROBLEM +3
No Content-Signal line in robots.txt. Missing: search, ai-input, ai-train.
There is now a machine-readable way to say whether AI may search, quote or train on your material. Having a position — any position — is the point.
AIR-1.5 Can a person read your AI policy?robots.txt carries no human-readable policy statement. PROBLEM +1
robots.txt carries no human-readable policy statement.
A few plain sentences in robots.txt saying what you permit. Journalists and lawyers read this file, and right now most sites say nothing.
AIR-1.6 Are you allowing assistants to quote you? PASS 1 pt
No noarchive, nosnippet or max-snippet:0 directives found.
Some sites carry old settings that tell search engines not to show excerpts. Those same settings stop an assistant quoting your page in an answer.
AIR-1.7 Does this page declare its real address?0% of sampled pages emit a valid, self-consistent canonical. 1 have problems. PROBLEM +2
0% of sampled pages emit a valid, self-consistent canonical. 1 have problems.
A canonical link tells a machine which URL is the true one. Without it the same content can be treated as several competing pages.
AIR-1.8 Is your page structured so a machine can follow it?0% of sampled pages carry one main element, a wrapping article or section, and a nav. PROBLEM +2
0% of sampled pages carry one main element, a wrapping article or section, and a nav.
Meaningful sections rather than an undifferentiated wall of containers. It is the difference between a document and a soup of boxes.
AIR-1.9 Do your headings tell a clear story?0% of sampled pages have exactly one non-empty h1 and no skipped heading levels. 1 have no h1 PROBLEM +2
0% of sampled pages have exactly one non-empty h1 and no skipped heading levels. 1 have no h1
One main heading, then sub-headings in order. Assistants use headings to work out what a page is about and which part answers a question.
AIR-1.10 Do you publish a guide for AI assistants?/llms.txt returns HTTP 403. PROBLEM +2
/llms.txt returns HTTP 403.
A file at /llms.txt listing your most important pages. It is early and cheap, and it forces a useful conversation about what actually matters on your site.
AIR-1.11 Can a machine tell what your organization is?No JSON-LD nodes were found across the sample. PROBLEM +2
No JSON-LD nodes were found across the sample.
Structured data that links together — your organization, your site, this page — rather than a scattering of disconnected labels.
AIR-1.12 Can a machine be certain it is you?No sameAs links were found on Organization or Person nodes. PROBLEM +2
No sameAs links were found on Organization or Person nodes.
Links from your markup to authoritative records like Wikidata or ROR. Without one, an assistant is guessing which organization of your name it has found.
AIR-1.13 Can a machine find out who you are?0 of 7 organizational facts are present in the Organization markup: none. PROBLEM +2
0 of 7 organizational facts are present in the Organization markup: none.
Founding date, leadership, address, contact details, legal identifiers. Thin About pages are the most common weakness we see.
AIR-2.1 Primary content is present without JavaScriptRaw HTML contains 0% of rendered text on average across 1 URLs. PROBLEM +6
Raw HTML contains 0% of rendered text on average across 1 URLs.
AIR-2.4 Stable, human-readable anchor IDs on section headingsNo subheadings in the sample. NOT SCORED —
AIR-2.5 Alt text on content images, empty alt on decorativeNo images in the sample. NOT SCORED —
AIR-2.6 Key facts exist as HTML text, not only in images or PDFs PASS 1 pt
No page in the sample looks like its facts live only in an image or a document.
AIR-3.1 JSON-LD is generated from mapped fields, not hardcodedSchema values track visible content across 0 templates. NEEDS WORK +1
Schema values track visible content across 0 templates.
AIR-3.2 BreadcrumbList on every page below the homepage PASS 2 pt
No pages below the homepage were sampled.
AIR-3.5 isAccessibleForFree, about, and mentions with entity references0 of 1 substantive pages declare isAccessibleForFree; 0 reference subject entities by identifier. PROBLEM +1
0 of 1 substantive pages declare isAccessibleForFree; 0 reference subject entities by identifier.
AIR-3.8 Schema validation of the structured data on the page PASS 2 pt
0 nodes across 1 pages parse, carry what their types require, and hold well-formed values.
AIR-4.5 Missing pages return 404 or 410 PASS 1 pt
0 of 1 deliberately invalid URLs returned HTTP 200.
AIR-4.6 Redirects resolve in a single hop PASS 1 pt
1 of 1 sampled URLs redirect.
AIR-4.8 Sitemap lastmod reflects real content changesNo sitemap URLs with lastmod values were found. PROBLEM +2
AIR-4.9 Sitemap index split by type, with media sitemapsNo sitemap could be fetched or parsed. PROBLEM +1
AIR-5.1 Author entity pages with credentialsNo Person entities appear anywhere in the sample. PROBLEM +2
AIR-5.2 Bylines linked to author entitiesNo substantive pages in the sample to check for a byline. NOT SCORED —
No substantive pages in the sample to check for a byline.
AIR-5.4 datePublished and dateModified are accurate0 of 1 pages carry a publication or modification date across 0 distinct dateModified values. PROBLEM +2
0 of 1 pages carry a publication or modification date across 0 distinct dateModified values.
AIR-6.4 No captchas on browse, search, or filter interactions PASS 2 pt
No search or filter surface in the sample returned a challenge.
AIR-7.1 Markdown companion for every canonical pageNo Markdown companions were probed. NOT SCORED —
AIR-7.3 Accept: text/markdown content negotiation0 of 1 URLs serve Markdown for Accept: text/markdown. PROBLEM +2
LI-2 speakable on summaries and ledesNo speakable specification found on any sampled page. NOT SCORED —
LI-3 IndexNow fires on publish and updateNo IndexNow key file was discoverable. The file is named after the key, which is not published, so this is 'not discoverable' rather than proof of absence. NOT SCORED —
No IndexNow key file was discoverable. The file is named after the key, which is not published, so this is 'not discoverable' rather than proof of absence.
LI-4 Editorial policy page referenced via publishingPrinciples0 of 0 Organization nodes reference publishingPrinciples. NOT SCORED —
LI-5 NLWeb endpoint exposed as an MCP server with an ask methodNo NLWeb endpoint was discoverable. NOT SCORED —
LI-6 Domain MCP server over real content APIsNo domain MCP server or tool descriptor was discoverable. NOT SCORED —
BP-3 GA4 channel group for AI assistant referrersWhether a channel group exists for AI assistant referrers is not visible from outside. Analytics presence is; the grouping is not. NOT SCORED —
Whether a channel group exists for AI assistant referrers is not visible from outside. Analytics presence is; the grouping is not.
BP-4 Server-side tagging captures stripped referrersReconciliation between server-side and client-side numbers has to be attested. NOT SCORED —
Reconciliation between server-side and client-side numbers has to be attested.
BP-5 Access log retention with a queryable storeLog retention and queryability are not observable from outside the site. NOT SCORED —
Log retention and queryability are not observable from outside the site.
BP-7 Fixed prompt panel run monthly across modelsAnswer-share tracking happens outside the site and must be attested. NOT SCORED —
Answer-share tracking happens outside the site and must be attested.
BP-8 Extraction-fidelity baseline capturedNo extraction-fidelity baseline is captured by this version of the scanner, which makes no live model calls. NOT SCORED —
No extraction-fidelity baseline is captured by this version of the scanner, which makes no live model calls.
BP-9 Search Console and Bing Webmaster Tools verifiedNeither Search Console nor Bing Webmaster Tools verification was found. NOT SCORED —
Neither Search Console nor Bing Webmaster Tools verification was found.
Not applicable — 34 tests answered with a dash, excluded from the score: AIR-2.2, AIR-2.3, AIR-2.4, AIR-2.5, AIR-3.3, AIR-3.4, AIR-3.6, AIR-3.7, AIR-4.1, AIR-4.2, AIR-4.3, AIR-4.4, AIR-4.7, AIR-4.10, AIR-5.2, AIR-5.3, AIR-5.5, AIR-5.6, AIR-6.1, AIR-6.2, AIR-6.3, AIR-7.1, AIR-7.2, AIR-7.4, LI-1, LI-7, BP-1, BP-2, BP-3, BP-4, BP-5, BP-6, BP-7, BP-8.
By dimension
Where Sempra's 28 came from. Open a line to see its tests, worst first.
1 · Primary Indicators 6 of 30 6 20
AIR-1.2 Does your CDN let AI crawlers through?8 of 8 AI user-agents are rejected or challenged at the edge. PROBLEM
8 of 8 AI user-agents are rejected or challenged at the edge.
Even when robots.txt says yes, a firewall or bot-protection rule can turn assistants away before they reach your pages. We sent a request as each one and recorded what came back.
AIR-1.3 Is your page readable without a security challenge?1 of 1 sampled pages return an interactive challenge (Cloudflare Turnstile). PROBLEM
1 of 1 sampled pages return an interactive challenge (Cloudflare Turnstile).
A CAPTCHA or bot check on an ordinary page stops an assistant at the door. These belong on forms and logins, not on pages anyone can read.
AIR-1.4 Have you stated what AI may do with your content?No Content-Signal line in robots.txt. Missing: search, ai-input, ai-train. PROBLEM
No Content-Signal line in robots.txt. Missing: search, ai-input, ai-train.
There is now a machine-readable way to say whether AI may search, quote or train on your material. Having a position — any position — is the point.
AIR-1.5 Can a person read your AI policy?robots.txt carries no human-readable policy statement. PROBLEM
robots.txt carries no human-readable policy statement.
A few plain sentences in robots.txt saying what you permit. Journalists and lawyers read this file, and right now most sites say nothing.
AIR-1.7 Does this page declare its real address?0% of sampled pages emit a valid, self-consistent canonical. 1 have problems. PROBLEM
0% of sampled pages emit a valid, self-consistent canonical. 1 have problems.
A canonical link tells a machine which URL is the true one. Without it the same content can be treated as several competing pages.
AIR-1.8 Is your page structured so a machine can follow it?0% of sampled pages carry one main element, a wrapping article or section, and a nav. PROBLEM
0% of sampled pages carry one main element, a wrapping article or section, and a nav.
Meaningful sections rather than an undifferentiated wall of containers. It is the difference between a document and a soup of boxes.
AIR-1.9 Do your headings tell a clear story?0% of sampled pages have exactly one non-empty h1 and no skipped heading levels. 1 have no h1 PROBLEM
0% of sampled pages have exactly one non-empty h1 and no skipped heading levels. 1 have no h1
One main heading, then sub-headings in order. Assistants use headings to work out what a page is about and which part answers a question.
AIR-1.10 Do you publish a guide for AI assistants?/llms.txt returns HTTP 403. PROBLEM
/llms.txt returns HTTP 403.
A file at /llms.txt listing your most important pages. It is early and cheap, and it forces a useful conversation about what actually matters on your site.
AIR-1.11 Can a machine tell what your organization is?No JSON-LD nodes were found across the sample. PROBLEM
No JSON-LD nodes were found across the sample.
Structured data that links together — your organization, your site, this page — rather than a scattering of disconnected labels.
AIR-1.12 Can a machine be certain it is you?No sameAs links were found on Organization or Person nodes. PROBLEM
No sameAs links were found on Organization or Person nodes.
Links from your markup to authoritative records like Wikidata or ROR. Without one, an assistant is guessing which organization of your name it has found.
AIR-1.13 Can a machine find out who you are?0 of 7 organizational facts are present in the Organization markup: none. PROBLEM
0 of 7 organizational facts are present in the Organization markup: none.
Founding date, leadership, address, contact details, legal identifiers. Thin About pages are the most common weakness we see.
Full marks — 2 pass
AIR-1.1 Can AI crawlers reach your site? PASS
No robots.txt is published, so nothing is disallowed.
Your robots.txt file tells crawlers what they may read. A line left behind by a previous site or a copied template can quietly shut out the assistants people now use to find you.
AIR-1.6 Are you allowing assistants to quote you? PASS
No noarchive, nosnippet or max-snippet:0 directives found.
Some sites carry old settings that tell search engines not to show excerpts. Those same settings stop an assistant quoting your page in an answer.
2 · Rendering and Extraction 1 of 15 1 7
AIR-2.1 Primary content is present without JavaScriptRaw HTML contains 0% of rendered text on average across 1 URLs. PROBLEM
Raw HTML contains 0% of rendered text on average across 1 URLs.
Full marks — 1 pass
AIR-2.6 Key facts exist as HTML text, not only in images or PDFs PASS
No page in the sample looks like its facts live only in an image or a document.
3 · Structured Data and the Entity Graph 5 of 15 5 33
AIR-3.5 isAccessibleForFree, about, and mentions with entity references0 of 1 substantive pages declare isAccessibleForFree; 0 reference subject entities by identifier. PROBLEM
0 of 1 substantive pages declare isAccessibleForFree; 0 reference subject entities by identifier.
AIR-3.1 JSON-LD is generated from mapped fields, not hardcodedSchema values track visible content across 0 templates. NEEDS WORK
Schema values track visible content across 0 templates.
Full marks — 2 pass
AIR-3.2 BreadcrumbList on every page below the homepage PASS
No pages below the homepage were sampled.
AIR-3.8 Schema validation of the structured data on the page PASS
0 nodes across 1 pages parse, carry what their types require, and hold well-formed values.
4 · Crawl, Index and Licensing Hygiene 2 of 12 2 17
AIR-4.8 Sitemap lastmod reflects real content changesNo sitemap URLs with lastmod values were found. PROBLEM
AIR-4.9 Sitemap index split by type, with media sitemapsNo sitemap could be fetched or parsed. PROBLEM
Full marks — 2 pass
AIR-4.5 Missing pages return 404 or 410 PASS
0 of 1 deliberately invalid URLs returned HTTP 200.
AIR-4.6 Redirects resolve in a single hop PASS
1 of 1 sampled URLs redirect.
5 · Authorship, Provenance, Freshness 0 of 12 0 0
AIR-5.1 Author entity pages with credentialsNo Person entities appear anywhere in the sample. PROBLEM
AIR-5.4 datePublished and dateModified are accurate0 of 1 pages carry a publication or modification date across 0 distinct dateModified values. PROBLEM
0 of 1 pages carry a publication or modification date across 0 distinct dateModified values.
6 · Agent Interfaces 2 of 8 2 25
Full marks — 1 pass
AIR-6.4 No captchas on browse, search, or filter interactions PASS
No search or filter surface in the sample returned a challenge.
7 · Alternate Representations 0 of 8 0 0
AIR-7.3 Accept: text/markdown content negotiation0 of 1 URLs serve Markdown for Accept: text/markdown. PROBLEM
What was read
1 page, sampled from this site's own sitemap and internal links. The cap is 32 — a ceiling, not a certainty: a site with fewer reachable pages yields fewer.
The receipt
- Cohort
- sp500
- Source
- List of S&P 500 companies (Wikipedia contributors, 2026-09-08)
- Index
- 11.0, in effect 2026-09-24
- Scanner
- 0.1.0
- Scanned
- 2026-09-20T04:17:31.921764+00:00
- Result hash
- 46aeebff28bdb6f07a785730455a6c20488ddda28a4191f2c3894341c01c9424
- Basis
- public-interest census: a declared bot with a published policy at https://readinessindex.io/bot, honoring robots.txt addressed to AIRBot, reading public pages only. No per-site permission was sought or given.
The hash is the SHA-256 of the full
result.json, recorded when the scan finished rather than
computed now. The raw evidence behind every line above — every
response, cached — is retained and is a median 1.5 MB per site, so
it is not served from here. Ask
us for it if you want to check a number against the bytes it came
from.
Think this is wrong? It might be. Tell us at hello@readinessindex.io and we will look, correct it if it is, and say so publicly either way.
Is your site ready for AI?
Scan a page, get a number you can verify. Free.
About these numbers. Points are whole numbers everywhere on this page. The arithmetic behind them is not — a test scores its weight times its band divided by four, so a row can earn 1.5 points and print as 2. Scores are computed from the exact figures and rounded once, at the end, never from the rounded rows. That means adding the points column up will not give you the score exactly. The rule is published in the standard.