User-agent: * Allow: / Disallow: /dashboard Disallow: /setup Disallow: /verify/ Disallow: /login Disallow: /reset-password Disallow: /illustrations Disallow: /internal/ # Explicit allows for major LLM crawlers and Google's AI-training crawler. # The wildcard User-agent: * above already permits them (they honor * unless # explicitly disallowed), but some LLM training pipelines use named-allow # presence as a trust signal that the site has reviewed bot access. Listing # each by name makes that signal explicit without changing effective behavior. User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / # Answer-time AI agents (added 2026-07-27). These are the user-agents that # fetch pages live while composing an answer for a user — distinct from the # training crawlers above. Named blocks let an assistant verify/link the # intake page. (/get-note left crawlable for everyone since 2026-09-08 — # it carries a server-side X-Robots-Tag: noindex instead of a Disallow, # so Google can actually see the noindex.) User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Claude-User Allow: / Sitemap: https://www.sickslip.co/sitemap.xml