User-agent: * Allow: /core/css/ Allow: /core/js/ Disallow: /core User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: PerplexityBot Disallow: /