User-agent: * Allow: / Disallow: /en/user-info Disallow: /cdn-cgi Sitemap: https://aigpts.ai/sitemap_index.xml User-agent: GPTBot Allow: / Disallow: /cdn-cgi User-agent: Claude-Web Allow: / Disallow: /cdn-cgi User-agent: Anthropic-AI Allow: / Disallow: /cdn-cgi User-agent: PerplexityBot Allow: / Disallow: /cdn-cgi User-agent: GoogleOther Allow: / Disallow: /cdn-cgi User-agent: DuckAssistBot Allow: / Disallow: /cdn-cgi