GPTBot
GPTBot is OpenAI's web crawler for collecting training data; it is distinct from OAI-SearchBot, which indexes pages for ChatGPT search.
Blocking GPTBot in robots.txt keeps a site out of OpenAI's future training sets but does not affect whether ChatGPT can cite the site in search-enabled answers. That depends on OAI-SearchBot and on ChatGPT-User, the fetcher used when a user asks about a specific page.
Many sites blocked GPTBot in 2023 with a group that also matched the search bots. Checking which crawlers a robots.txt actually blocks is the first step of any AI visibility audit.
Related terms
Measure gptbot for your brand
LeapScope tracks the prompts your buyers ask on the AI engines every day and reports mentions, citations and share of voice against your competitors.