Scan
Williams Companies
Score
49/100
13 of 51 tests pass · 51 points still on the table
Weak
The fundamentals are in place and the machine-readable layer on top of them largely is not.
Do these three first
The fastest 7 points on this scan
Content Signals declared in robots.txt
No Content-Signal line in robots.txt. Missing: search, ai-input, ai-train.
Do this: Declare a Content Signals position in robots.txt.
Progressive disclosure content ships in the initial HTML
0 of 30 pages ship every disclosure panel populated in the raw HTML. 5 pages load more content on scroll with no paginated fallback.
Do this: Render every panel and hide it with CSS.
Every page emits a valid, self-consistent canonical
0% of sampled pages emit a valid, self-consistent canonical. 32 have problems.
Do this: Emit a self-referencing canonical by default.
Nine dimensions, most to least left on the table
32 pages crawled
- williams.com
- www.williams.com/careers
- www.williams.com/careers/total-rewards
- www.williams.com/careers/employees
- www.williams.com/careers/equal-employment-opportunity
- investor.williams.com
- www.williams.com/contact
- www.williams.com/our-company
- www.williams.com/leadership
- www.williams.com/our-company/corporate-governance
- www.williams.com/sequent
- www.williams.com/our-company/our-history
- investor.williams.com/ir-resources/faqs
- www.williams.com/our-company/operations
- www.williams.com/operating-area/transmission-and-gulf-of-mexico
- www.williams.com/operating-area/northeast-gathering-and-processing
- www.williams.com/operating-area/west-gathering-and-processing
- www.williams.com/our-company/customer-electronic-bulletin-boards
- www.williams.com/community/safety
- www.williams.com/community/safety/public-awareness
- www.williams.com/community/safety/public-awareness/public-awareness-resources
- www.williams.com/community/safety/emergency-preparedness
- www.williams.com/our-company/expansion-projects
- www.williams.com/expansion-project/southeast-supply-enhancement
- www.williams.com/expansion-project/northeast-supply-enhancement
- www.williams.com/expansion-project/socrates-power-solution-facilities
- www.williams.com/power-innovation
- www.williams.com/sustainability/corporate-venture-capital
- www.williams.com/sustainability/new-energy-ventures
- www.williams.com/sustainability
- www.williams.com/sustainability/esg
- www.williams.com/sustainability/climate-commitment
Every test · all 67 tests, in order
67 of 67 showing
AIR-1.1 Can AI crawlers reach your site? PASS 5 pt
All 10 AI agents may fetch content paths.
Your robots.txt file tells crawlers what they may read. A line left behind by a previous site or a copied template can quietly shut out the assistants people now use to find you.
AIR-1.2 Does your CDN let AI crawlers through? PASS 5 pt
All 8 AI user-agents receive full content.
Even when robots.txt says yes, a firewall or bot-protection rule can turn assistants away before they reach your pages. We sent a request as each one and recorded what came back.
AIR-1.3 Is your page readable without a security challenge? PASS 1 pt
No interactive challenges on 32 sampled read-only pages.
A CAPTCHA or bot check on an ordinary page stops an assistant at the door. These belong on forms and logins, not on pages anyone can read.
AIR-1.4 Have you stated what AI may do with your content?No Content-Signal line in robots.txt. Missing: search, ai-input, ai-train. PROBLEM +3
No Content-Signal line in robots.txt. Missing: search, ai-input, ai-train.
There is now a machine-readable way to say whether AI may search, quote or train on your material. Having a position — any position — is the point.
AIR-1.5 Can a person read your AI policy?robots.txt carries a 89-character comment, too thin to read as a policy statement. NEEDS WORK +0
robots.txt carries a 89-character comment, too thin to read as a policy statement.
A few plain sentences in robots.txt saying what you permit. Journalists and lawyers read this file, and right now most sites say nothing.
AIR-1.6 Are you allowing assistants to quote you? PASS 1 pt
No noarchive, nosnippet or max-snippet:0 directives found.
Some sites carry old settings that tell search engines not to show excerpts. Those same settings stop an assistant quoting your page in an answer.
AIR-1.7 Does this page declare its real address?0% of sampled pages emit a valid, self-consistent canonical. 32 have problems. PROBLEM +2
0% of sampled pages emit a valid, self-consistent canonical. 32 have problems.
A canonical link tells a machine which URL is the true one. Without it the same content can be treated as several competing pages.
AIR-1.8 Is your page structured so a machine can follow it?9% of sampled pages carry one main element, a wrapping article or section, and a nav. 8 exceed 12 divs per semantic element. PROBLEM +1
9% of sampled pages carry one main element, a wrapping article or section, and a nav. 8 exceed 12 divs per semantic element.
Meaningful sections rather than an undifferentiated wall of containers. It is the difference between a document and a soup of boxes.
AIR-1.9 Do your headings tell a clear story?58% of sampled pages have exactly one non-empty h1 and no skipped heading levels. 1 have no h1; 5 have several; 7 skip a level. NEEDS WORK +1
58% of sampled pages have exactly one non-empty h1 and no skipped heading levels. 1 have no h1; 5 have several; 7 skip a level.
One main heading, then sub-headings in order. Assistants use headings to work out what a page is about and which part answers a question.
AIR-1.10 Do you publish a guide for AI assistants?/llms.txt returns HTTP 404. PROBLEM +2
/llms.txt returns HTTP 404.
A file at /llms.txt listing your most important pages. It is early and cheap, and it forces a useful conversation about what actually matters on your site.
AIR-1.11 Can a machine tell what your organization is?53 of 83 entity nodes carry an @id (64%). The WebPage to WebSite to Organization chain resolves. NEEDS WORK +1
53 of 83 entity nodes carry an @id (64%). The WebPage to WebSite to Organization chain resolves.
Structured data that links together — your organization, your site, this page — rather than a scattering of disconnected labels.
AIR-1.12 Can a machine be certain it is you?No sameAs links were found on Organization or Person nodes. PROBLEM +2
No sameAs links were found on Organization or Person nodes.
Links from your markup to authoritative records like Wikidata or ROR. Without one, an assistant is guessing which organization of your name it has found.
AIR-1.13 Can a machine find out who you are?0 of 7 organizational facts are present in the Organization markup: none. PROBLEM +2
0 of 7 organizational facts are present in the Organization markup: none.
Founding date, leadership, address, contact details, legal identifiers. Thin About pages are the most common weakness we see.
AIR-2.1 Primary content is present without JavaScript PASS 5 pt
Raw HTML contains 86% of rendered text on average across 32 URLs. The worst template is /operating-area/*: 48% across 3 pages.
AIR-2.2 Progressive disclosure content ships in the initial HTML0 of 30 pages ship every disclosure panel populated in the raw HTML. 5 pages load more content on scroll with no paginated fallback. PROBLEM +2
0 of 30 pages ship every disclosure panel populated in the raw HTML. 5 pages load more content on scroll with no paginated fallback.
AIR-2.3 Real data tables with header cells2 tables: 0 complete, 2 without scope on header cells, 0 with no header cells, 0 used for layout. NEEDS WORK +1
2 tables: 0 complete, 2 without scope on header cells, 0 with no header cells, 0 used for layout.
AIR-2.4 Stable, human-readable anchor IDs on section headings22 of 236 subheadings carry a slug-like id (9%); 10 have generated or unstable ids. PROBLEM +1
22 of 236 subheadings carry a slug-like id (9%); 10 have generated or unstable ids.
AIR-2.5 Alt text on content images, empty alt on decorative17 of 309 images carry appropriate alt text: 96 have no alt attribute, 0 use the filename. PROBLEM +1
17 of 309 images carry appropriate alt text: 96 have no alt attribute, 0 use the filename.
AIR-2.6 Key facts exist as HTML text, not only in images or PDFs13 of 32 sampled pages are thin relative to their images or lead with a document download. PROBLEM +1
13 of 32 sampled pages are thin relative to their images or lead with a document download.
AIR-3.1 JSON-LD is generated from mapped fields, not hardcoded5 of 5 templates repeat identical schema literals across pages whose visible content differs. PROBLEM +2
5 of 5 templates repeat identical schema literals across pages whose visible content differs.
AIR-3.2 BreadcrumbList on every page below the homepage PASS 2 pt
97% of pages below the homepage carry a BreadcrumbList with at least two steps.
AIR-3.5 isAccessibleForFree, about, and mentions with entity references0 of 26 substantive pages declare isAccessibleForFree; 1 reference subject entities by identifier. NEEDS WORK +0
0 of 26 substantive pages declare isAccessibleForFree; 1 reference subject entities by identifier.
AIR-3.7 SearchAction on the WebSite node PASS 1 pt
The SearchAction template returns 381 characters of results for a test term.
AIR-3.8 Schema validation of the structured data on the page PASS 2 pt
381 nodes across 30 pages parse, carry what their types require, and hold well-formed values.
AIR-4.4 Correct X-Robots-Tag on non-HTML resources0 of 25 non-HTML resources carry an X-Robots-Tag. PROBLEM +1
AIR-4.5 Missing pages return 404 or 4100 of 10 deliberately invalid URLs returned HTTP 200; 3 sampled pages are thin enough to be not-found templates. NEEDS WORK +0
0 of 10 deliberately invalid URLs returned HTTP 200; 3 sampled pages are thin enough to be not-found templates.
AIR-4.6 Redirects resolve in a single hop PASS 1 pt
30 of 32 sampled URLs redirect.
AIR-4.7 Faceted, calendar, and parameterized URLs are controlled PASS 2 pt
No parameterized URLs appeared in the crawlable sample.
AIR-4.8 Sitemap lastmod reflects real content changes PASS 2 pt
1069 of 1069 sitemap URLs carry a lastmod across 520 distinct dates; 8% share 2019-11-12.
AIR-4.9 Sitemap index split by type, with media sitemapsAn index with 9 child sitemaps covering 1069 URLs, including media. PROBLEM +1
An index with 9 child sitemaps covering 1069 URLs, including media.
AIR-5.1 Author entity pages with credentialsNo Person entities appear anywhere in the sample. PROBLEM +2
AIR-5.2 Bylines linked to author entities0 of 22 substantive pages reference an author by @id; 0 carry a bare string; 22 are unsigned. PROBLEM +2
0 of 22 substantive pages reference an author by @id; 0 carry a bare string; 22 are unsigned.
AIR-5.4 datePublished and dateModified are accurate PASS 2 pt
29 of 32 pages carry a publication or modification date across 25 distinct dateModified values.
AIR-6.3 Form fields carry label, name, and autocomplete12 of 75 form fields carry an accessible name, a meaningful name attribute and a valid autocomplete token where one applies. PROBLEM +1
12 of 75 form fields carry an accessible name, a meaningful name attribute and a valid autocomplete token where one applies.
AIR-6.4 No captchas on browse, search, or filter interactions PASS 2 pt
No search or filter surface in the sample returned a challenge.
AIR-7.1 Markdown companion for every canonical page0 of 23 sampled pages have a Markdown companion at {path}.md returning a Markdown content type. PROBLEM +2
0 of 23 sampled pages have a Markdown companion at {path}.md returning a Markdown content type.
AIR-7.3 Accept: text/markdown content negotiation0 of 25 URLs serve Markdown for Accept: text/markdown. PROBLEM +2
LI-2 speakable on summaries and ledesNo speakable specification found on any sampled page. NOT SCORED —
LI-3 IndexNow fires on publish and updateNo IndexNow key file was discoverable. The file is named after the key, which is not published, so this is 'not discoverable' rather than proof of absence. NOT SCORED —
No IndexNow key file was discoverable. The file is named after the key, which is not published, so this is 'not discoverable' rather than proof of absence.
LI-4 Editorial policy page referenced via publishingPrinciples0 of 30 Organization nodes reference publishingPrinciples. NOT SCORED —
0 of 30 Organization nodes reference publishingPrinciples.
LI-5 NLWeb endpoint exposed as an MCP server with an ask methodNo NLWeb endpoint was discoverable. NOT SCORED —
LI-6 Domain MCP server over real content APIsNo domain MCP server or tool descriptor was discoverable. NOT SCORED —
BP-3 GA4 channel group for AI assistant referrersWhether a channel group exists for AI assistant referrers is not visible from outside. Analytics presence is; the grouping is not. NOT SCORED —
Whether a channel group exists for AI assistant referrers is not visible from outside. Analytics presence is; the grouping is not.
BP-4 Server-side tagging captures stripped referrersReconciliation between server-side and client-side numbers has to be attested. NOT SCORED —
Reconciliation between server-side and client-side numbers has to be attested.
BP-5 Access log retention with a queryable storeLog retention and queryability are not observable from outside the site. NOT SCORED —
Log retention and queryability are not observable from outside the site.
BP-7 Fixed prompt panel run monthly across modelsAnswer-share tracking happens outside the site and must be attested. NOT SCORED —
Answer-share tracking happens outside the site and must be attested.
BP-8 Extraction-fidelity baseline capturedNo extraction-fidelity baseline is captured by this version of the scanner, which makes no live model calls. NOT SCORED —
No extraction-fidelity baseline is captured by this version of the scanner, which makes no live model calls.
BP-9 Search Console and Bing Webmaster Tools verifiedGoogle Search Console verification found on the page. Whether sitemaps are submitted and alerts reach a person cannot be seen from outside. NOT SCORED —
Google Search Console verification found on the page. Whether sitemaps are submitted and alerts reach a person cannot be seen from outside.
Not applicable — 24 tests answered with a dash, excluded from the score: AIR-3.3, AIR-3.4, AIR-3.6, AIR-4.1, AIR-4.2, AIR-4.3, AIR-4.10, AIR-5.3, AIR-5.5, AIR-5.6, AIR-6.1, AIR-6.2, AIR-7.2, AIR-7.4, LI-1, LI-7, BP-1, BP-2, BP-3, BP-4, BP-5, BP-6, BP-7, BP-8.
By dimension
Where Williams Companies's 49 came from. Open a line to see its tests, worst first.
1 · Primary Indicators 15 of 30 15 50
AIR-1.4 Have you stated what AI may do with your content?No Content-Signal line in robots.txt. Missing: search, ai-input, ai-train. PROBLEM
No Content-Signal line in robots.txt. Missing: search, ai-input, ai-train.
There is now a machine-readable way to say whether AI may search, quote or train on your material. Having a position — any position — is the point.
AIR-1.7 Does this page declare its real address?0% of sampled pages emit a valid, self-consistent canonical. 32 have problems. PROBLEM
0% of sampled pages emit a valid, self-consistent canonical. 32 have problems.
A canonical link tells a machine which URL is the true one. Without it the same content can be treated as several competing pages.
AIR-1.8 Is your page structured so a machine can follow it?9% of sampled pages carry one main element, a wrapping article or section, and a nav. 8 exceed 12 divs per semantic element. PROBLEM
9% of sampled pages carry one main element, a wrapping article or section, and a nav. 8 exceed 12 divs per semantic element.
Meaningful sections rather than an undifferentiated wall of containers. It is the difference between a document and a soup of boxes.
AIR-1.10 Do you publish a guide for AI assistants?/llms.txt returns HTTP 404. PROBLEM
/llms.txt returns HTTP 404.
A file at /llms.txt listing your most important pages. It is early and cheap, and it forces a useful conversation about what actually matters on your site.
AIR-1.12 Can a machine be certain it is you?No sameAs links were found on Organization or Person nodes. PROBLEM
No sameAs links were found on Organization or Person nodes.
Links from your markup to authoritative records like Wikidata or ROR. Without one, an assistant is guessing which organization of your name it has found.
AIR-1.13 Can a machine find out who you are?0 of 7 organizational facts are present in the Organization markup: none. PROBLEM
0 of 7 organizational facts are present in the Organization markup: none.
Founding date, leadership, address, contact details, legal identifiers. Thin About pages are the most common weakness we see.
AIR-1.5 Can a person read your AI policy?robots.txt carries a 89-character comment, too thin to read as a policy statement. NEEDS WORK
robots.txt carries a 89-character comment, too thin to read as a policy statement.
A few plain sentences in robots.txt saying what you permit. Journalists and lawyers read this file, and right now most sites say nothing.
AIR-1.9 Do your headings tell a clear story?58% of sampled pages have exactly one non-empty h1 and no skipped heading levels. 1 have no h1; 5 have several; 7 skip a level. NEEDS WORK
58% of sampled pages have exactly one non-empty h1 and no skipped heading levels. 1 have no h1; 5 have several; 7 skip a level.
One main heading, then sub-headings in order. Assistants use headings to work out what a page is about and which part answers a question.
AIR-1.11 Can a machine tell what your organization is?53 of 83 entity nodes carry an @id (64%). The WebPage to WebSite to Organization chain resolves. NEEDS WORK
53 of 83 entity nodes carry an @id (64%). The WebPage to WebSite to Organization chain resolves.
Structured data that links together — your organization, your site, this page — rather than a scattering of disconnected labels.
Full marks — 4 pass
AIR-1.1 Can AI crawlers reach your site? PASS
All 10 AI agents may fetch content paths.
Your robots.txt file tells crawlers what they may read. A line left behind by a previous site or a copied template can quietly shut out the assistants people now use to find you.
AIR-1.2 Does your CDN let AI crawlers through? PASS
All 8 AI user-agents receive full content.
Even when robots.txt says yes, a firewall or bot-protection rule can turn assistants away before they reach your pages. We sent a request as each one and recorded what came back.
AIR-1.3 Is your page readable without a security challenge? PASS
No interactive challenges on 32 sampled read-only pages.
A CAPTCHA or bot check on an ordinary page stops an assistant at the door. These belong on forms and logins, not on pages anyone can read.
AIR-1.6 Are you allowing assistants to quote you? PASS
No noarchive, nosnippet or max-snippet:0 directives found.
Some sites carry old settings that tell search engines not to show excerpts. Those same settings stop an assistant quoting your page in an answer.
2 · Rendering and Extraction 7 of 15 7 47
AIR-2.2 Progressive disclosure content ships in the initial HTML0 of 30 pages ship every disclosure panel populated in the raw HTML. 5 pages load more content on scroll with no paginated fallback. PROBLEM
0 of 30 pages ship every disclosure panel populated in the raw HTML. 5 pages load more content on scroll with no paginated fallback.
AIR-2.4 Stable, human-readable anchor IDs on section headings22 of 236 subheadings carry a slug-like id (9%); 10 have generated or unstable ids. PROBLEM
22 of 236 subheadings carry a slug-like id (9%); 10 have generated or unstable ids.
AIR-2.5 Alt text on content images, empty alt on decorative17 of 309 images carry appropriate alt text: 96 have no alt attribute, 0 use the filename. PROBLEM
17 of 309 images carry appropriate alt text: 96 have no alt attribute, 0 use the filename.
AIR-2.6 Key facts exist as HTML text, not only in images or PDFs13 of 32 sampled pages are thin relative to their images or lead with a document download. PROBLEM
13 of 32 sampled pages are thin relative to their images or lead with a document download.
AIR-2.3 Real data tables with header cells2 tables: 0 complete, 2 without scope on header cells, 0 with no header cells, 0 used for layout. NEEDS WORK
2 tables: 0 complete, 2 without scope on header cells, 0 with no header cells, 0 used for layout.
Full marks — 1 pass
AIR-2.1 Primary content is present without JavaScript PASS
Raw HTML contains 86% of rendered text on average across 32 URLs. The worst template is /operating-area/*: 48% across 3 pages.
3 · Structured Data and the Entity Graph 6 of 15 6 40
AIR-3.1 JSON-LD is generated from mapped fields, not hardcoded5 of 5 templates repeat identical schema literals across pages whose visible content differs. PROBLEM
5 of 5 templates repeat identical schema literals across pages whose visible content differs.
AIR-3.5 isAccessibleForFree, about, and mentions with entity references0 of 26 substantive pages declare isAccessibleForFree; 1 reference subject entities by identifier. NEEDS WORK
0 of 26 substantive pages declare isAccessibleForFree; 1 reference subject entities by identifier.
Full marks — 3 pass
AIR-3.2 BreadcrumbList on every page below the homepage PASS
97% of pages below the homepage carry a BreadcrumbList with at least two steps.
AIR-3.7 SearchAction on the WebSite node PASS
The SearchAction template returns 381 characters of results for a test term.
AIR-3.8 Schema validation of the structured data on the page PASS
381 nodes across 30 pages parse, carry what their types require, and hold well-formed values.
4 · Crawl, Index and Licensing Hygiene 5 of 12 5 42
AIR-4.4 Correct X-Robots-Tag on non-HTML resources0 of 25 non-HTML resources carry an X-Robots-Tag. PROBLEM
AIR-4.9 Sitemap index split by type, with media sitemapsAn index with 9 child sitemaps covering 1069 URLs, including media. PROBLEM
An index with 9 child sitemaps covering 1069 URLs, including media.
AIR-4.5 Missing pages return 404 or 4100 of 10 deliberately invalid URLs returned HTTP 200; 3 sampled pages are thin enough to be not-found templates. NEEDS WORK
0 of 10 deliberately invalid URLs returned HTTP 200; 3 sampled pages are thin enough to be not-found templates.
Full marks — 3 pass
AIR-4.6 Redirects resolve in a single hop PASS
30 of 32 sampled URLs redirect.
AIR-4.7 Faceted, calendar, and parameterized URLs are controlled PASS
No parameterized URLs appeared in the crawlable sample.
AIR-4.8 Sitemap lastmod reflects real content changes PASS
1069 of 1069 sitemap URLs carry a lastmod across 520 distinct dates; 8% share 2019-11-12.
5 · Authorship, Provenance, Freshness 2 of 12 2 17
AIR-5.1 Author entity pages with credentialsNo Person entities appear anywhere in the sample. PROBLEM
AIR-5.2 Bylines linked to author entities0 of 22 substantive pages reference an author by @id; 0 carry a bare string; 22 are unsigned. PROBLEM
0 of 22 substantive pages reference an author by @id; 0 carry a bare string; 22 are unsigned.
Full marks — 1 pass
AIR-5.4 datePublished and dateModified are accurate PASS
29 of 32 pages carry a publication or modification date across 25 distinct dateModified values.
6 · Agent Interfaces 3 of 8 3 38
AIR-6.3 Form fields carry label, name, and autocomplete12 of 75 form fields carry an accessible name, a meaningful name attribute and a valid autocomplete token where one applies. PROBLEM
12 of 75 form fields carry an accessible name, a meaningful name attribute and a valid autocomplete token where one applies.
Full marks — 1 pass
AIR-6.4 No captchas on browse, search, or filter interactions PASS
No search or filter surface in the sample returned a challenge.
7 · Alternate Representations 0 of 8 0 0
AIR-7.1 Markdown companion for every canonical page0 of 23 sampled pages have a Markdown companion at {path}.md returning a Markdown content type. PROBLEM
0 of 23 sampled pages have a Markdown companion at {path}.md returning a Markdown content type.
AIR-7.3 Accept: text/markdown content negotiation0 of 25 URLs serve Markdown for Accept: text/markdown. PROBLEM
What was read
32 pages, sampled from this site's own sitemap and internal links. The cap is 32 — a ceiling, not a certainty: a site with fewer reachable pages yields fewer.
30 other pages, all 200, by template
The receipt
- Cohort
- sp500
- Source
- List of S&P 500 companies (Wikipedia contributors, 2026-09-08)
- Index
- 11.0, in effect 2026-09-24
- Scanner
- 0.1.0
- Scanned
- 2026-09-20T05:22:44.713495+00:00
- Result hash
- 50dfc59d61a1485e34c256f3109c0383dbc8ce11b6b1b707adaa4510c8b440a8
- Basis
- public-interest census: a declared bot with a published policy at https://readinessindex.io/bot, honoring robots.txt addressed to AIRBot, reading public pages only. No per-site permission was sought or given.
The hash is the SHA-256 of the full
result.json, recorded when the scan finished rather than
computed now. The raw evidence behind every line above — every
response, cached — is retained and is a median 1.5 MB per site, so
it is not served from here. Ask
us for it if you want to check a number against the bytes it came
from.
Think this is wrong? It might be. Tell us at hello@readinessindex.io and we will look, correct it if it is, and say so publicly either way.
Is your site ready for AI?
Scan a page, get a number you can verify. Free.
About these numbers. Points are whole numbers everywhere on this page. The arithmetic behind them is not — a test scores its weight times its band divided by four, so a row can earn 1.5 points and print as 2. Scores are computed from the exact figures and rounded once, at the end, never from the rounded rows. That means adding the points column up will not give you the score exactly. The rule is published in the standard.