Why do AI search engines frequently quote wrong software prices, skip enterprise tiers, or miss product updates when the answers appear right on the company's website?
We combined November 1 to November 19, 2026 HTTP crawl telemetry across 378,392 unique AI-cited pages (including 126,864 SaaS, documentation, and developer pages) with a November 20, 2026 live three-probe technical harness comparing plain HTTP (Browser user agent), plain HTTP (OAI-SearchBot user agent), and headless Playwright Chromium across 200 AI-cited SaaS URLs (Cohort A: 100 /pricing, 50 /docs, 50 /changelog) and 100 top AI-ranked SaaS brands' /pricing endpoints (Cohort B).
Across 378,392 AI-cited pages in Parse's November crawl telemetry and a paired plain-HTTP vs Playwright Chromium audit of 300 live SaaS URLs, SaaS pricing pages deliver 290,627 to 439,533 median HTML bytes (just 4.04% to 2.88% visible text-to-HTML ratio), hide 100% of prices behind JavaScript on up to 11.11% of live pages (including HubSpot, Zoom, Wix, and Lark), block crawlers or OAI-SearchBot on 11% to 15% of active endpoints, and omit public prices on 20.63%.
47.3% of active top-SaaS pricing endpoints fail to expose complete public pricing in plain HTTP HTML
Auditing only URLs that AI search already cites hides severe survivorship bias. In Cohort A (100 AI-cited /pricing URLs), 94% cleared plain HTTP checks because AI engines had already filtered out broken endpoints. When we tested Cohort B, 100 top AI-ranked SaaS brands at their canonical /pricing URL regardless of whether AI cited it, only 63% returned clean HTTP 200: 23% returned HTTP 404 or 410, 11% hit Cloudflare 403 or Vercel 429 bot walls, 3% timed out (Shopify, Asana, FantasyPros), and 1 live 200 endpoint (Exabeam) soft-redirected to its homepage.
Across the 74 active Cohort B pricing endpoints (63 clean HTTP + 11 WAF-blocked), 35 endpoints (47.30%) fail to deliver complete public prices in plain HTTP HTML: 14.86% (11) block plain HTTP behind a WAF, 17.57% (13) show Contact Sales only with zero public figures even after browser rendering, 9.46% (7: HubSpot, Wix, Lark, SignNow, Data Calculus, Expensify, Talkpal) hide 100% of currency prices behind client-side JavaScript, and 5.41% (4: ClickUp, LangChain, WithOrb, Norton) hide additional tier prices behind JavaScript. Only 39 of 74 active endpoints (52.70%) expose complete public pricing in plain HTML.
- Active top-SaaS /pricing pages failing plain-HTML delivery
- 47.3%
35 of 74 active endpoints (Cohort B)
39 exposed full public pricing in plain HTTP HTML
- Median visible text-to-HTML ratio (Cohort B)
- 2.88%
439,533 median raw HTML bytes
Next.js hydration blobs hit 244,737.5 median bytes
- Top-100 SaaS /pricing endpoints refusing OAI-SearchBot
- 13.0%
13 of 100 returned HTTP 403 (vs 6% on Cohort A)
Including sites returning 200 to standard browser UAs
- Median Markdown-to-HTML ratio on 2,488 cited /pricing pages
- 5.15%
157,688 raw bytes; 5,807 ms median latency
vs 17.85% Markdown-to-HTML on 33,698 cited blog posts
Plain-HTML pricing visibility across 74 active top-SaaS /pricing endpoints (Cohort B)
- Full public prices readable in plain HTTP HTML52.70%39 endpoints
- Contact Sales only (no public currency prices)17.57%13 endpoints
- WAF or bot-wall block in plain HTTP (403/429)14.86%11 endpoints
- 100% of prices hidden behind JavaScript9.46%7 endpoints
- Partial prices hidden behind JavaScript5.41%4 endpoints
Takeaway
Across 378,392 AI-cited pages, /product fails direct HTTP 37.5% of the time and /pricing lags at 5,807 ms
Parse's November 1 to 19, 2026 HTTP crawl telemetry across 378,392 unique AI-cited pages shows sharp structural differences by page type. Product pages suffer the lowest clean direct HTTP rate at 62.48% (31.08% escalated to headless browser, TLS impersonation, or proxy fetch, plus 6.02% direct fetch failures), driven heavily by ecommerce protection walls. Pricing pages post the slowest median crawl latency of any page type at 5,807 ms (8,354 ms at p90) alongside 157,688 median raw HTML bytes and just a 5.15% Markdown-to-HTML ratio, compared with 91.91% clean direct HTTP and 17.85% Markdown-to-HTML on blog posts.
Isolating the 126,864 cited pages on SaaS, documentation, and developer domains removes marketplace noise and isolates structural bloat. SaaS /pricing pages still carry the slowest median latency (5,803 ms, p90 8,040 ms) and 40.7% heavier raw HTML than SaaS /blog posts (129,258 vs 91,886 bytes) while delivering under half as many words (1,087 vs 2,462) and a 5.38% Markdown-to-HTML ratio vs 17.63% on SaaS blogs. Cited /changelog pages average just 400 words overall (448 in SaaS) and expose pricing or product JSON-LD on only 2.25% of SaaS pages.
November HTTP crawl performance, payload density, and schema by page type
Direct HTTP success, non-direct crawl escalation, median/p90 latency, raw bytes, Markdown-to-HTML ratio, and Offer/Product schema across all domains.
Clean direct (%) ยท 7 results
- changelog93.59%
- blog91.91%
- pricing87.66%
- docs85.35%
- homepage78.25%
- other70.83%
- product62.48%
Explore the data (7 rows)
| other | 241,948 | 70.83 | 17.97 | 5,699 | 115,578 | 8.3 | 13.68 |
| homepage | 45,931 | 78.25 | 16.34 | 5,629 | 100,920 | 5.39 | 15.99 |
| blog | 33,698 | 91.91 | 5.96 | 5,701 | 98,642 | 17.85 | 8.15 |
| product | 28,250 | 62.48 | 31.08 | 5,453 | 182,565 | 3.74 | 52.17 |
| docs | 25,718 | 85.35 | 8.82 | 5,619 | 107,310 | 9.59 | 2.52 |
| pricing | 2,488 | 87.66 | 8.96 | 5,807 | 157,688 | 5.15 | 32.95 |
| changelog | 359 | 93.59 | 5.29 | 5,383 | 78,174 | 4.65 | 9.86 |
Takeaway
Live SaaS pricing pages ship up to 439,533 bytes of HTML with 244,737.5-byte hydration blobs
Live paired inspection of 300 SaaS endpoints reveals why pricing pages sit at the bottom of text-to-HTML efficiency. In Cohort B (top 100 SaaS /pricing endpoints), median raw HTML reaches 439,533 bytes while visible text shrinks to just 2.88% of payload weight. In Cohort A (100 AI-cited /pricing URLs), median raw HTML hits 290,627 bytes at a 4.04% text-to-HTML ratio, versus 170,883 bytes (4.86%) on /docs and 181,238 bytes (4.31%) on /changelog.
Client-side hydration JSON accounts for much of that dead weight. On Next.js pricing pages in Cohort A, embedded __NEXT_DATA__ script blobs hit a median of 169,265 bytes, 19.7x larger than the 8,575-byte median hydration blob on /docs and 2.3x larger than /changelog (73,559.5 bytes). In Cohort B, Next.js pricing hydration blobs reach a median of 244,737.5 bytes, and 33.33% of live Cohort B pricing pages carry SPA framework markers.
Median raw HTML size and Next.js __NEXT_DATA__ hydration bytes across live SaaS cohorts
- Raw HTML: Cohort B /pricing (Top 100 SaaS)439,533 B2.88% visible text
- Raw HTML: Cohort A /pricing (AI-cited)290,627 B4.04% visible text
- Hydration blob: Cohort B /pricing Next.js244,737.5 Bmedian __NEXT_DATA__
- Raw HTML: Cohort A /changelog181,238 B4.31% visible text
- Raw HTML: Cohort A /docs170,883 B4.86% visible text
- Hydration blob: Cohort A /pricing Next.js169,265 B19.7x /docs
- Hydration blob: Cohort A /changelog Next.js73,559.5 Bmedian __NEXT_DATA__
- Hydration blob: Cohort A /docs Next.js8,575 Bmedian __NEXT_DATA__
Takeaway
57.6% to 61.9% of SaaS pricing pages pack over 50% more off-screen words in HTML than users see
Comparing plain-HTTP visible text against headless Playwright Chromium rendered text shows that pricing pages don't merely hide text behind JavaScript: most also drown crawlers in hidden off-screen HTML. On Cohort A /pricing, the median HTTP page exposes 1,820.5 words while the rendered Chromium page shows only 977.5 words; on Cohort B /pricing, HTTP extracts 1,730 median words versus 1,030 rendered words.
Overall, 57.61% of live Cohort A pricing pages (53 of 92) and 61.90% of Cohort B pricing pages (39 of 63) carry more than 50% extra words in plain HTML compared with the rendered DOM, versus 30.00% on /docs (15 of 50) and 14.58% on /changelog (7 of 48). Extreme examples include squarespace.com/pricing (1,046,884 bytes and 4,864 plain-HTML words collapsing to 568 rendered words) and lastpass.com/pricing (513,873 bytes and 5,088 plain-HTML words collapsing to 1,392 rendered words) from collapsed mega-menus, cookie banners, regional tables, and FAQ accordions.
- Top-SaaS /pricing pages with >50% hidden HTML bloat
- 61.90%
39 of 63 live Cohort B pairs
1,730 median HTTP words vs 1,030 rendered words
- AI-cited /pricing pages with >50% hidden HTML bloat
- 57.61%
53 of 92 live Cohort A pairs
1,820.5 median HTTP words vs 977.5 rendered words
- AI-cited /docs pages with >50% hidden HTML bloat
- 30.0%
15 of 50 live Cohort A pairs
856.5 median HTTP words vs 654.5 rendered words
- AI-cited /changelog pages with >50% hidden HTML bloat
- 14.58%
7 of 48 live Cohort A pairs
666.5 median HTTP words vs 631 rendered words
Takeaway
Up to 17.5% of live SaaS pricing pages hide tier prices behind JavaScript, leaving plain-HTTP fetchers blind
Major AI crawlers such as GPTBot, OAI-SearchBot, ClaudeBot, and PerplexityBot generally read the initial HTTP HTML response without running client-side JavaScript bundles, as Vercel and MERJ documented across network crawl logs. On our live harness, 11.11% of live Cohort B pricing endpoints (7 of 63) exposed zero currency prices in plain HTTP HTML and revealed prices only after Chromium executed JavaScript: HubSpot (5 -> 2,304 words, 0 -> 18 prices), Wix (11 -> 879 words, 0 -> 8 prices), Lark (9 -> 1,174 words, 0 -> 11 prices), SignNow (3 -> 963 words, 0 -> 14 prices), Expensify (507 -> 664 words, 0 -> 5 prices), Talkpal (1,633 -> 1,320 words, 0 -> 8 prices), and Data Calculus (11 -> 544 words, 0 -> 5 prices). Including four partial-JS sites (ClickUp, LangChain, WithOrb, Norton), 17.46% (11 of 63) revealed additional prices only after JS.
In Cohort A (92 live AI-cited pricing pairs), 4.35% (4 pages: hubspot.com/pricing/crm, zoom.us/pricing/zoom-phone, shortpixel.com/pricing, and siem.commandonetworks.com/pricing) hid 100% of prices behind JavaScript, and 16.30% (15 of 92 total, adding 11 partial-JS pages) exposed extra prices only after rendering. Empty client-side shells also broke /docs and /changelog: superset.apache.org/docs (0 -> 744 words), promptfoo.dev/docs (0 -> 507 words), and docs.unity3d.com (18 -> 720 words) accounted for 6.0% JS-dependent /docs pages, while distill.io/changelog hid 98.4% of its content (94 -> 6,017 words) and logiconsystems.com hid 99.2% (6 -> 755 words).
Takeaway
WAFs block 14.9% of active Cohort B pricing pages, and 13% refuse OAI-SearchBot specifically
Bot walls and user-agent-specific rules block AI fetchers long before HTML parsing even starts. Across Cohort B's 100 top SaaS /pricing endpoints, 11% hit WAF or rate-limit challenges on a standard browser HTTP request (14.86% of the 74 active endpoints, via Cloudflare 403, Vercel 429, Akamai 403, and PerimeterX 403), and 13% returned HTTP 403 when probed with the OAI-SearchBot user agent from our non-OpenAI benchmark IP (where IP-verifying WAF rules can trigger alongside UA-only blocks). Even in Cohort A's 100 AI-cited /pricing URLs, 6% hit bot walls in plain HTTP, including xplg.com returning an HTTP 202 AWS WAF Robot Challenge Screen with zero readable words.
Crucially, passing a standard browser curl check does not guarantee OAI-SearchBot access. Pingdom's /pricing page, LastPass's /pricing page, and WithLeaf's /whats-new changelog all returned clean HTTP 200 to the browser user agent while returning HTTP 403 to our OAI-SearchBot user-agent probe from the same benchmark IP. Meanwhile, blameless.com/changelog/november-16-2023 and exabeam.com/pricing returned HTTP 200 while silently redirecting to the site homepage.
Paired Browser HTTP, OAI-SearchBot, and Chromium audit metrics by cohort
HTTP OK (%) ยท 4 results
- Cohort A: /docs (cited)100%
- Cohort A: /changelog (cited)96%
- Cohort A: /pricing (cited)94%
- Cohort B: /pricing (top 100)63%
Explore the data (4 rows)
| Cohort A: /pricing (cited) | 100 | 94 | 6 | 6 | 97 | 4.04 | 5.43 |
| Cohort B: /pricing (top 100) | 100 | 63 | 11 | 13 | 73 | 2.88 | 20.63 |
| Cohort A: /docs (cited) | 50 | 100 | 0 | 0 | 100 | 4.86 | 34 |
| Cohort A: /changelog (cited) | 50 | 96 | 2 | 2 | 100 | 4.31 | 31.25 |
Takeaway
Fewer than 35% of SaaS pricing pages publish Offer or Product JSON-LD, and 2.25% of changelogs do
Machine-readable pricing schema remains sparse even among the SaaS pages AI engines already cite. In Parse's November crawl telemetry, 68.86% of cited pricing pages included some JSON-LD, yet only 32.95% overall (and 34.06% in SaaS/developer domains) published Offer, Product, SoftwareApplication, or AggregateOffer types. Our live Cohort A and Cohort B checks match closely at 34.04% and 28.57% pricing schema presence, while SaaS changelogs fall to 2.25% and SaaS docs to 2.13%.
Meanwhile, accidental noindex tags still show up on live pricing pages. Two AI-cited HTTP 200 pricing URLs in Cohort A (collaboratemd.com/pricing and drchrono.com/pricing) returned meta noindex directives in their HTML, alongside 0.34% of cited pricing pages in the 378,392-page November crawl.
Offer, Product, or SoftwareApplication JSON-LD schema rate by cohort and page type
- All cited /product pages (25,696 HTML)52.17%
- SaaS cited /pricing (Nov crawl)34.06%
- Cohort A live /pricing (94 HTML)34.04%
- All cited /pricing pages (2,367 HTML)32.95%
- Cohort B live /pricing (63 HTML)28.57%
- SaaS cited /product (Nov crawl)26.48%
- Cohort A live /changelog (48 HTML)10.42%
- SaaS cited /changelog (Nov crawl)2.25%
- SaaS cited /docs (Nov crawl)2.13%
Takeaway
44 real-world SaaS failures across Cohort A and Cohort B: from 4-word JS shells to Akamai 403s
The diagnostic logs expose four repeatable failure modes across well-known SaaS brands. Pure JS pricing shells hide every tier price in plain HTTP: HubSpot (/pricing/crm: 4 HTTP words -> 1,800 Playwright words, 0 -> 8 prices; /pricing: 5 -> 2,304 words, 0 -> 18 prices), Zoom (/pricing/zoom-phone: 200 -> 1,386 words, 0 -> 19 prices), Wix (11 -> 879 words, 0 -> 8 prices), Lark (9 -> 1,174 words, 0 -> 11 prices), and SignNow (3 -> 963 words, 0 -> 14 prices).
Empty documentation and changelog shells drop just as hard: superset.apache.org/docs (0 -> 744 words), promptfoo.dev/docs (0 -> 507 words), and distill.io/changelog (94 -> 6,017 words). Bot-wall challenges hit Graylog, Helcim, Carta, Justworks, CoinTracker, Koinly, Clio, PandaDoc (Vercel 429), Pingdom (Akamai 403 to OAI-SearchBot), LastPass (403 to OAI-SearchBot), and XPLG (202 AWS WAF challenge).
All 44 named plain-HTTP vs Playwright Chromium failure records
AI-cited /pricing, /docs, and /changelog URLs hitting JS traps, WAF walls, OAI-SearchBot refusals, noindex tags, or homepage redirects.
PW words ยท Top 10 of 22
distill.io6,017
withleaf.io3,654
hubspot.com1,800
carta.com1,516
zoom.us1,386
graylog.org1,148
justworks.com1,140
netgear.com1,096
logiconsystems.com755
helcim.com750
Explore the data (22 rows)
| changelog | 200 | 200 | 200 | 94 | 6,017 | 0 | 0 | |
| changelog | 200 | 403 | 200 | 3,863 | 3,654 | 4 | 4 | |
| pricing | 200 | 200 | 200 | 4 | 1,800 | 0 | 8 | |
| pricing | 403 | 403 | 200 | 3 | 1,516 | 0 | 1 | |
| pricing | 200 | 200 | 200 | 200 | 1,386 | 0 | 19 | |
| pricing | 403 | 403 | 200 | 5 | 1,148 | 0 | 2 | |
| pricing | 403 | 403 | 200 | 3 | 1,140 | 0 | 16 | |
| changelog | 403 | 200 | 200 | 3 | 1,096 | 0 | 2 | |
| changelog | 200 | 200 | 200 | 6 | 755 | 0 | 0 | |
| pricing | 403 | 403 | 200 | 4 | 750 | 0 | 14 | |
| docs | 200 | 200 | 200 | 0 | 744 | 0 | 0 | |
| docs | 200 | 200 | 200 | 18 | 720 | 0 | 0 | |
| pricing | 200 | 200 | 200 | 644 | 643 | 0 | 4 | |
| changelog | 200 | 200 | 200 | 599 | 619 | 0 | 0 | |
| pricing | 200 | 200 | 200 | 1,301 | 603 | 8 | 8 | |
| pricing | 403 | 200 | 200 | 3 | 600 | 0 | 9 | |
| docs | 200 | 200 | 200 | 0 | 507 | 0 | 0 | |
| pricing | 200 | 200 | 200 | 784 | 488 | 0 | 4 | |
| pricing | 200 | 200 | 200 | 2,667 | 283 | 12 | 0 | |
| pricing | 200 | 200 | 200 | 2 | 111 | 0 | 0 | |
| pricing | 202 | 202 | 202 | 0 | 26 | 0 | 0 | |
| pricing | 200 | 403 | 403 | 1,032 | 15 | 0 | 0 |
Takeaway
Why Parse's AI pricing accuracy study found 97.9% of quotes uncheckable and only 62.8% matching
These front-end rendering and WAF barriers directly explain the measurement gap found in Parse's AI pricing accuracy study. Across 358,902 AI brand price quotes, 97.9% (351,308) could not be checked against a crawled first-party pricing page (including 10,307 quotes where the crawled pricing page text listed fewer than three prices), and only 62.8% of 7,594 checkable quotes matched within 10%, rising to 72.7% when the answer cited the brand's pricing page vs 58.0% when it did not.
In that earlier study, brands whose crawled pricing text failed to match AI quotes included HubSpot (19.7% of 346 quotes) and PagerDuty (3.6% of 56 quotes), alongside Searchable's finding of a 13.5% brand-graded AI error rate on pricing facts. Our live paired harness catches HubSpot serving 4 to 5 words and zero dollar figures in plain HTTP HTML on both /pricing/crm and /pricing, turning a seemingly live page into unreadable boilerplate for non-rendering crawlers.
- of 358,902 AI price quotes could not be checked
- 97.9%
From Parse's AI pricing accuracy study
2.9% (10,307 quotes) failed because page text lacked >=3 prices
- checkable AI price quotes matching the brand page
- 62.8%
4,766 of 7,594 quotes within 10%
Rises to 72.7% when the answer cites the pricing page (vs 58.0%)
- HubSpot price quotes matching crawled text
- 19.7%
68 of 346 quotes in Parse's accuracy study
Live harness confirms HubSpot /pricing returns 5 words and $0 in HTTP
- real pricing errors in hand-checked quotes
- 10.1%
8 of 79 real quotes wrong (vs 13.5% in Searchable)
11 of 23 flagged mismatches were real prices missing from crawled HTML
Takeaway
Study scope, probe rules, and survivorship boundaries
November crawl telemetry covers 378,392 unique organic AI-cited pages inspected between November 1 and November 19, 2026 across ChatGPT Search, Google AI Mode, and Perplexity, including 126,864 pages on SaaS, documentation, and developer websites. Page types follow canonical URL path and subdomain patterns (/pricing, /plans, /docs, /changelog, /whats-new, /blog, /product, /), and latency reflects Parse's November fetch logs rather than first-party engine crawl timing.
The November 20, 2026 live three-probe harness tested every URL from the same environment using standard browser headers, the OAI-SearchBot user agent, and headless Playwright Chromium 151 at network settle. Cohort B probed each top-ranked SaaS brand's canonical /pricing path; some brands that returned 404 (23 of 100) publish pricing at /plans, regional subpaths, or under product docs rather than lacking pricing entirely, while WAF rate-limit and bot-verification blocks (such as HTTP 403/429 on our OAI-SearchBot user-agent probe sent from a non-OpenAI benchmark IP) reflect both user-agent rules and edge IP-verification policies and can vary by IP range, request rate, and region.
How engineering and product marketing teams fix AI pricing and changelog readability
Stop treating the browser inspector as proof that AI crawlers can read your pricing page. Run a plain HTTP curl check with both a standard browser user agent and the OAI-SearchBot user agent, compare extracted words and dollar figures against rendered Chromium output, and make sure every tier name, monthly and annual price, seat minimum, and free-tier limit sits in the initial server-rendered HTML.
Move interactive ROI sliders and currency calculators below a clean static comparison table, strip collapsed mega-menus out of initial HTML or move navigation weight out of top-of-DOM containers, publish Offer and SoftwareApplication JSON-LD, and return clean 301 redirects instead of soft-404 redirects to your homepage. Check your live cited URLs directly via Parse MCP tools (fetch_live_pages, search_cited_pages, check_brand).
Technical remediation checklist for pricing, docs, and changelog pages
| WAF blocks and OAI-SearchBot 403s | 14.86% active WAF; 13% OAI refused | Allow verified OAI-SearchBot IP ranges through Cloudflare, Akamai, and AWS WAF rules on /pricing. |
| Off-screen DOM and __NEXT_DATA__ bloat | 2.88% text/HTML; 245 KB Next.js JSON | Trim serialized mega-menus and unused props out of initial HTML so pricing copy leads early. |
| Missing pricing/product structured data | Only 28.57% to 34.06% Offer JSON-LD | Emit SoftwareApplication, Offer, and UnitPriceSpecification JSON-LD matching visible HTML prices. |
| Client-side JS hiding prices or body copy | 17.46% Cohort B pricing; 6.0% docs | Server-render all plan cards, monthly/annual prices, and limits into initial SSR/SSG HTML. |
| Accidental noindex or soft-404 redirects | 2 Cohort A 200s noindex; 2 homepage redirects | Audit meta robots tags on production deploys and return real 301s to replacement pricing/changelog pages. |
Takeaway
How we measured
We analyzed two empirical datasets: (1) Parse's November 1 to November 19, 2026 HTTP crawl telemetry and text snapshots across all 378,392 unique organic AI-cited pages (including 126,864 SaaS, documentation, and developer pages) across ChatGPT Search, Google AI Mode, and Perplexity; and (2) a November 20, 2026 live three-probe technical audit (plain HTTP Browser UA, plain HTTP OAI-SearchBot UA, and headless Playwright Chromium) across Cohort A (200 real AI-cited URLs: 100 /pricing, 50 /docs, 50 /changelog) and Cohort B (100 top AI-ranked SaaS brands' /pricing endpoints).
- of 74 active top-SaaS /pricing pages failed plain-HTML pricing delivery
- 47.3%
14.86% WAF-blocked, 17.57% Contact Sales only, 9.46% JS-only, 5.41% partial JS
- median visible text-to-HTML ratio on top-SaaS /pricing pages
- 2.88%
439,533 median HTML bytes (vs 4.04% on cited /pricing and 17.85% on /blog)
- of 63 live top-SaaS /pricing pages hid 100% of prices behind JS
- 11.11%
17.46% (11 of 63) revealed additional or all prices only after JS execution
- clean direct HTTP success on 28,250 cited /product pages
- 62.48%
31.08% required non-direct browser, proxy, or TLS fetch (vs 91.91% on /blog)
Get the data
Sources
- Vercel and MERJ: The rise of the AI crawler (opens in a new tab) ยท accessed November 20, 2026
- OpenAI: Overview of OpenAI crawlers (opens in a new tab) ยท accessed November 20, 2026
- Cloudflare: From Googlebot to GPTBot (opens in a new tab) ยท accessed November 20, 2026
- Searchable: AI Brand Misinformation Report (opens in a new tab) ยท accessed November 20, 2026