If your site never appears in ChatGPT or Perplexity, the cause is almost always one of five things: you block AI crawlers in robots.txt, you're not in Bing's index, your content isn't extractable, you lack third-party corroboration, or your pages are stale. Each is diagnosable and fixable - usually in under a day.
So "invisible in AI" usually means one of these pipelines is broken for you.
The single most common cause. A blanket Disallow or a security/WAF rule can silently block OAI-SearchBot, PerplexityBot, or Claude-SearchBot.
Fix - allow the search agents in robots.txt:
User-agent: OAI-SearchBot
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: Claude-SearchBot
Allow: /
Note: blocking GPTBot (training) is a separate decision and does not remove you from ChatGPT Search - but blocking OAI-SearchBot does.
Because ChatGPT Search leans on Bing, a site missing from Bing Webmaster Tools is often missing from ChatGPT. Fix: verify the domain in Bing Webmaster Tools, submit your sitemap, and confirm indexation.
If your answer is buried in a wall of text, a hero video, or a JavaScript-rendered blob, the engine can't lift a clean passage. Fix: answer-first intros, question-shaped H2s, tables, and lists.
Models weight consensus. If nobody mentions you on Reddit, G2, or Wikipedia, you look unestablished. Fix: earn mentions on the sources engines already trust (Reddit is ~46.7% of Perplexity's top-10 citations).
83% of AI citations for commercial queries come from pages updated in the last 12 months. Fix: refresh dates, stats, and facts on your key pages.
Fixing robots.txt gets you eligible. To actually get cited: lead with direct answers, add statistics and named sources (the Princeton GEO study found stats lift visibility ~40%), add FAQ schema, and refresh regularly.
Start with our robots.txt AI checker to confirm the agents you allow, then work through the AEO checklist and a full SEO audit. When you're ready, run a free audit of up to 50 pages and see exactly what's blocking your citations.
GPTBot is the training crawler. ChatGPT Search uses OAI-SearchBot. Allow that one specifically - the two settings are independent per OpenAI's documentation. Unblocking OAI-SearchBot is what restores your eligibility to be retrieved and cited in ChatGPT Search results.
Confirm PerplexityBot isn't disallowed in robots.txt and that no WAF or Cloudflare rule blocks it by user-agent or IP. Perplexity honors robots.txt, so an explicit allow plus a clean firewall allowlist is usually enough to make you crawlable again.
Not for ChatGPT - it overlaps with Google's top-10 only ~14% of the time and favors fresher, conversational sources. But strong Google rankings strongly correlate with Perplexity and AI Overview citations, so ranking still helps across most engines even if it's no guarantee.
It can. Aggressive bot management often blocks legitimate AI search agents by default. Allowlist OAI-SearchBot, PerplexityBot, and Claude-SearchBot explicitly so your citation pipeline is not silently cut off at the edge before retrieval ever begins.