The same question can produce an answer with recorded citations one time and without them another time. We wanted to know whether those answers name the same brands.
We compared brand lists across 452,990 ChatGPT Search answers to 19,792 questions from May 24 through August 28, 2026. We grouped answer pairs by recorded citation presence, which does not by itself verify whether a search occurred.
Often, they do not. On the same questions, pairs with and without recorded citations named the same first brand 34.5% of the time. Two answers that both had citations agreed 45.9% of the time. The source list is only one part of measuring brand visibility.
The same question can produce a different first brand
We paired an answer with no recorded citations with the nearest answer to the same question that had at least one, up to fourteen days apart. Among 38,997 pairs where both answers named a brand, the first brand matched in 34.5%.
For comparison, two cited answers to the same question matched in 45.9% of 81,859 pairs. The practical point is that seeing a source list does not make a single answer a stable read of your brand’s position.
Same first-named brand on a repeat question
- One answer with citations, one without34.5%
- Both answers with citations45.9%
The rest of the brand list changes too
Mixed-citation pairs shared an average of 28.0% of the brands in their combined lists. Pairs where both answers had recorded citations shared 36.1%. This measures shared membership, rather than whether either answer made the better choice.
Track the brands an answer names and the role it gives each one. The first brand mentioned may be background context, an example or a recommendation; its position in the text alone does not settle that.
Average brand-set overlap
- One answer with citations, one without28.0%
- Both answers with citations36.1%
A missing source list does not prove that no search happened
The study classifies answers by recorded citations. It does not observe a clean retrieval-on versus retrieval-off experiment. Search can occur without a visible citation, and collection differences can affect which citations are stored.
The no-recorded-citation share varied sharply during the study: 44.0% in May, 28.1% in June, 1.9% in July and 0.81% in August. That collection-era change is why these pairs cannot establish a causal effect of web search.
Answers with no recorded citations
Explore the data
| 2026-05 | 44.01 |
| 2026-06 | 28.09 |
| 2026-07 | 1.9 |
| 2026-08 | 0.81 |
Measure your brand and its evidence separately
Repeat the buyer questions that matter. Record which brands appear, which are recommended and which pages support the answer. Look for a recurring change before treating one different first mention as a gain or loss.
When a cited page contains an outdated price or misses a capability, there is a concrete fact to investigate. When the brand list moves without a clear evidence change, collect more observations before choosing an explanation.
What this study establishes
The source study contains 452,990 ChatGPT Search answers to 19,792 tracked questions, May 24–August 28, 2026. It produced 43,757 mixed-citation pairs and 90,858 two-cited-answer pairs; first-brand comparisons use only pairs where both answers named a brand. The comparison pairs are restricted to before July 6 to overlap the main period containing answers without recorded citations.
Canonical brand identities merge name variants. The first-named brand is the one appearing earliest in the answer text. A separate storage-path calculation gave 34.8% first-brand agreement versus 34.5% in the primary calculation.
A separate storage-path calculation gave 34.8% first-brand agreement versus 34.5% in the primary calculation. The study groups answers by recorded citations; it does not establish whether a search took place.
How we measured
We compared brand lists in 452,990 recorded ChatGPT Search answers to 19,792 questions, May 24–August 28, 2026. Pairs are defined by recorded citation presence, not verified search activity.
- first-brand agreement in mixed-citation pairs
- 34.5%
38,997 pairs naming a brand on both sides
- agreement when both answers had citations
- 45.9%
81,859 comparison pairs
- average brand-set overlap in mixed-citation pairs
- 27.9%
Get the data
Sources
- OpenAI: Introducing ChatGPT search · accessed August 29, 2026
- Search Engine Land: ChatGPT search officially launches · accessed August 29, 2026
- Mallen et al.: When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories · accessed August 29, 2026
- Lewis et al.: Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks · accessed August 29, 2026