# * User-agent: * # Content Signals (contentsignals.org): declare AI usage preferences. # search: index + return links/snippets. ai-input: use content to ground/ # generate AI answers (we want this for AI answer-engine visibility). # ai-train: train/fine-tune models on our content (withheld). Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: / Disallow: /api/ Disallow: /404 Disallow: /500 # Named groups below. A crawler that matches a named group ignores the * # group entirely, so each one repeats its Disallow rules. # GPTBot User-agent: GPTBot Allow: / Disallow: /api/ Disallow: /404 Disallow: /500 # ChatGPT-User User-agent: ChatGPT-User Allow: / Disallow: /api/ Disallow: /404 Disallow: /500 # PerplexityBot User-agent: PerplexityBot Allow: / Disallow: /api/ Disallow: /404 Disallow: /500 # ClaudeBot User-agent: ClaudeBot Allow: / Disallow: /api/ Disallow: /404 Disallow: /500 # Google-Extended User-agent: Google-Extended Allow: / Disallow: /api/ Disallow: /404 Disallow: /500 # Amazonbot User-agent: Amazonbot Allow: / Disallow: /api/ Disallow: /404 Disallow: /500 # Applebot-Extended User-agent: Applebot-Extended Allow: / Disallow: /api/ Disallow: /404 Disallow: /500 # cohere-ai User-agent: cohere-ai Allow: / Disallow: /api/ Disallow: /404 Disallow: /500 # CCBot User-agent: CCBot Allow: / Disallow: /api/ Disallow: /404 Disallow: /500 # Bytespider User-agent: Bytespider Allow: / Disallow: /api/ Disallow: /404 Disallow: /500 # Meta-ExternalAgent User-agent: Meta-ExternalAgent Allow: / Disallow: /api/ Disallow: /404 Disallow: /500 # Host Host: https://www.spheron.network # Sitemaps Sitemap: https://www.spheron.network/sitemap.xml # LLMs.txt: AI-readable site summary (llms-full.txt lists every post) # https://llmstxt.org/ LLMs-Txt: https://www.spheron.network/llms.txt