citemark
Menu

Guide

How ChatGPT chooses which sources to cite

Published · By Shoaib Mustaque· 6-minute read

ChatGPT search retrieves candidate pages through third-party search providers; Microsoft has said Bing is ChatGPT's default search experience. A page Bing has not indexed is therefore unlikely to be cited. From the candidates, the model keeps passages that answer the question directly and links to them. OpenAI does not publish a ranking formula, so the rest is inference from evidence.

On the record

What OpenAI and Microsoft have actually said

Three statements are public. OpenAI's launch post for ChatGPT search, 31 October 2024, says it “leverages third-party search providers, as well as content provided directly by our partners”. Microsoft's Build announcement, 23 May 2023, says “Bing is coming to ChatGPT as the default search experience”. OpenAI's crawler documentation names OAI-SearchBot as the bot that surfaces sites in ChatGPT search.

What is not public: how much of ChatGPT's retrieval comes from Bing versus other providers or OpenAI's own crawling, how candidates are ranked, and how the model decides which of them to cite. OpenAI's help centre says ChatGPT sometimes rewrites a question into one or more targeted queries before sending them to a search provider; it does not say which provider or how results are weighed.

Microsoft's statement is from May 2023 and described ChatGPT's browsing feature, 17 months before ChatGPT search launched. OpenAI has not named Bing in its own documentation since. Our tracking agrees with the older statement: pages absent from Bing are absent from ChatGPT. Everything below separates what the documentation supports from what we infer from running prompts every month.

Step one

Bing has to have your page first

Being indexed by Bing is the prerequisite for ChatGPT search. If Bing has not crawled a page, it cannot be returned as a candidate, and nothing else about the page matters. Most sites have never opened Bing Webmaster Tools. Verifying the site, submitting the sitemap and enabling IndexNow takes an afternoon and is where every engagement starts.

  1. 01

    Verify the site in Bing Webmaster Tools

    Import from Google Search Console if you have it, or verify with a DNS record. Submit the XML sitemap.

  2. 02

    Switch on IndexNow

    IndexNow is an open protocol, supported by Bing, Yandex, Naver, Seznam and Yep, that pings participating engines the moment a URL changes. Without it, Bing may take days or weeks to notice a new page.

  3. 03

    Check robots.txt for Bingbot and OAI-SearchBot

    Both must be allowed. A rule that blocks all bots except Googlebot, common on sites built for Google alone, removes you from ChatGPT search.

  4. 04

    Check the firewall

    Vercel, Cloudflare and similar platforms offer one-click AI bot blocking. Make sure it is off for the search crawlers you want.

  5. 05

    Confirm with a search

    Search site:yourdomain.com on Bing. The count should be close to Google's. Pages missing from Bing are missing from ChatGPT.

Step two

OpenAI's three crawlers and what each controls

OpenAI documents three user agents, and each is controlled independently in robots.txt. OAI-SearchBot decides whether your pages can appear in ChatGPT search. ChatGPT-User fetches a page when a user's question needs it. GPTBot collects content for model training. Blocking GPTBot does not remove you from search, and allowing it does not add you.

OpenAI crawlers
User agentWhat OpenAI says it doesIf you block it
OAI-SearchBot“Used to surface websites in search results in ChatGPT's search features”Your pages stop appearing in ChatGPT search
ChatGPT-UserVisits a page when a user asks something that needs it; “not used for crawling the web in an automatic fashion”ChatGPT cannot read the page live for that user; does not affect search inclusion
GPTBot“Used to make our generative AI foundation models more useful and safe”: training dataNo effect on search; your content is excluded from future training

A sensible default for a brand that wants to be cited: allow OAI-SearchBot and ChatGPT-User, decide about GPTBot on its own merits. The same split exists at Anthropic (Claude-SearchBot and Claude-User for search and fetching, ClaudeBot for training) and at Perplexity (PerplexityBot for search, Perplexity-User for fetching).

Step three

What makes a passage worth quoting

Once a page is a candidate, the model keeps the passages that answer the question with the least work. The best-known controlled study, the 2023 GEO paper, found that adding citations, quotations and statistics raised a source's share of the answer by 30–40 percent, while keyword stuffing did nothing. Our monthly screenshots point the same way.

  • Answer first (in the paper, confirmed in our tracking). The paragraph under a question heading opens with the answer in 40–60 words. A number, a date or a named engine in the first sentence.
  • Statistics and sources (documented). A concrete figure with where it came from. The paper's statistics and citation additions were the top performers.
  • Named author and date (our inference). Pages with a byline and a visible publication date are cited more often in our tracking than anonymous ones. Google recommends accurate bylines for its own systems; we assume the same signals help elsewhere.
  • Consistent entity (our inference). When ChatGPT describes a brand wrongly, the wrong fact usually exists somewhere on the web. Fixing the source fixes the answer within a crawl cycle.
  • Server-rendered HTML (documented crawler behaviour). OAI-SearchBot reads what the server sends. Content that appears only after JavaScript runs is a gamble.
  • Keyword stuffing (documented as useless). 10 percent worse than baseline on Perplexity in the paper.

Timeline

How long it takes to be cited by ChatGPT

Expect the first ChatGPT citations two to eight weeks after a page is indexed in Bing, for long-tail prompts with few established sources. Competitive prompts such as “best X in Bangalore” take six to twelve months, because ChatGPT already has sources it returns for them. Perplexity usually moves first, within one to two weeks, and is the early signal.

ChatGPT citation timeline
WhenWhat is usually true
Days 1–14Site verified in Bing Webmaster Tools; IndexNow live; crawler access fixed; Bing picks up the sitemap
Weeks 2–6Fixed pages re-crawled by Bing; first Perplexity citations for long-tail prompts
Weeks 2–8 after indexingFirst ChatGPT citations for long-tail prompts
Months 2–4Consistent ChatGPT citations for low-competition prompts; brand description corrected
Months 6–12Citations for competitive category prompts, as third-party mentions accumulate

We cannot guarantee any of these. ChatGPT's answers vary between sessions, and OpenAI changes retrieval without notice. What we can do is run the same prompts every month and show you the screenshots.

Checklist

A checklist you can run this week

Six checks cover most of what decides whether ChatGPT can cite you. Each takes minutes and needs no tool beyond a browser. If any fails, fix it before writing a word of new content: the fastest ChatGPT wins we have seen came from indexing and rendering fixes on pages that already existed.

  1. 01

    site:yourdomain.com on Bing

    Is the count close to Google's? Are your key pages there?

  2. 02

    robots.txt

    Are Bingbot, OAI-SearchBot and ChatGPT-User allowed? Is the platform's AI-bot blocker off?

  3. 03

    View source

    Is the answer in the HTML without JavaScript? Is the title specific to the page?

  4. 04

    Ask ChatGPT about your brand

    Does it describe what you do, where you are and who runs it correctly? Where did the wrong facts come from?

  5. 05

    Ask ChatGPT your top ten prompts

    Who is cited? Which third-party pages? That is your mentions list.

  6. 06

    Check your Organization schema

    Does it name the same entity as your Google Business Profile and LinkedIn page? Does it validate?

The free AI visibility audit runs these checks and 50 prompts for you, with screenshots, in five working days.

Sources

Sources

Every factual claim above about how an engine works, or about what a company publishes, links to the source it came from. Each URL was opened and checked on the date shown at the top of this guide. If a source later changes or disappears, the claim should be re-checked, not assumed.

  1. 01OpenAI, “Introducing ChatGPT search”, 31 October 2024https://openai.com/index/introducing-chatgpt-search/
  2. 02OpenAI Help Center, “ChatGPT search”https://help.openai.com/en/articles/9237897-chatgpt-search
  3. 03Microsoft, “Microsoft Build brings AI tools to the forefront for developers”, 23 May 2023https://blogs.microsoft.com/blog/2023/05/23/microsoft-build-brings-ai-tools-to-the-forefront-for-developers/
  4. 04OpenAI, “Overview of OpenAI crawlers” (OAI-SearchBot, ChatGPT-User, GPTBot)https://developers.openai.com/api/docs/bots
  5. 05IndexNow protocolhttps://www.indexnow.org/
  6. 06Bing Webmaster Toolshttps://www.bing.com/webmasters
  7. 07Aggarwal et al., “GEO: Generative Engine Optimization”, arXiv, November 2023; KDD 2024https://arxiv.org/abs/2311.09735
  8. 08Google Search Central, “Creating helpful, reliable, people-first content” (bylines)https://developers.google.com/search/docs/fundamentals/creating-helpful-content
  9. 09Perplexity, “Perplexity crawlers”https://docs.perplexity.ai/guides/bots
  10. 10Anthropic, “Does Anthropic crawl data from the web, and how can site owners block the crawler?”https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler

Keep reading

Related guides

  • How to get cited in Google AI Overviews

    Google AI Overviews are built from Google's normal index and rankings: Google says they only show information backed by top web results. What Google has documented, three steps that follow from it, what doesn't help, and a realistic timeline.
  • What is Generative Engine Optimization (GEO)?

    Generative Engine Optimization (GEO) is the work of becoming a source that ChatGPT, Gemini, Perplexity, Claude and Google AI Overviews cite. Where the term comes from, how engines build answers, what the work involves and how long it takes.
  • llms.txt: what it is and how to write one

    llms.txt is a Markdown file at /llms.txt that tells AI systems what a site is and which pages matter, proposed by Jeremy Howard in September 2024. The spec, who reads it today, Citemark's own file annotated, and six steps to write yours.

See which prompts you're missing from

The free audit runs your category's prompts on ChatGPT, Gemini, Perplexity, Claude and Google AI Overviews and shows who each engine cites today. Five working days, screenshots included.