# Allow general web crawlers User-agent: * Allow: / Disallow: /login/ Disallow: /logout/ Disallow: /edit/ Disallow: /image/ Disallow: /api/ # Block AI/LLM crawlers User-agent: anthropic-ai User-agent: Applebot-Extended User-agent: Bytespider User-agent: CCBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: cohere-ai User-agent: Diffbot User-agent: FacebookBot User-agent: GPTBot User-agent: ImagesiftBot User-agent: Meta-ExternalAgent User-agent: Meta-ExternalFetcher User-agent: Omgilibot User-agent: PerplexityBot User-agent: Timpibot Disallow: /