AI & Search Wiki Entry

GPTBot

OpenAI's web crawler that gathers content for ChatGPT training and search.

GPTBot is OpenAI's primary crawler, used for both training data collection and ChatGPT Search retrieval. Site owners can block GPTBot via robots.txt User-agent: GPTBot directive. Blocking prevents content from being used in OpenAI training but may also limit ChatGPT Search visibility and citation eligibility.

Related Entries

AI Crawlers

Bots from AI companies that crawl the web to gather training data and index content.

ChatGPT Search

OpenAI's search-powered version of ChatGPT delivering answers with web citations.

robots.txt

A text file at the site root that instructs crawlers which URLs to access.

Want to apply this in practice?

The Complete Wix SEO Course covers this topic and 67 others in step-by-step lessons designed for real Wix sites.

Explore the course