# www.myoamigo.com — everything here is public marketing/reference content; all crawlers welcome. # # The stanzas below are explicit, deliberate allowances for AI search and assistant crawlers # (the site-wide default already allows them; being explicit documents intent and survives a # future tightening of the default). Purpose per bot, verified against vendor docs 2026-08-10: # OAI-SearchBot OpenAI: ChatGPT search visibility (not training) # ChatGPT-User OpenAI: user-directed fetches from ChatGPT # GPTBot OpenAI: model-training crawler # Claude-SearchBot Anthropic: Claude search indexing # Claude-User Anthropic: user-directed fetches from Claude # ClaudeBot Anthropic: model-training crawler # PerplexityBot Perplexity: search-result indexing (not training) # Perplexity-User Perplexity: user-directed fetches # Google-Extended Google: Gemini training/grounding control only (regular Googlebot, # which governs Search and AI Overviews, is covered by the default) # CCBot Common Crawl: corpus used by many AI systems User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: GPTBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / User-agent: * Allow: / Sitemap: https://www.myoamigo.com/sitemap.xml