User-Agent: AhrefsBot User-Agent: SemrushBot User-Agent: SemrushBot-* User-Agent: botify User-Agent: ContentKing User-Agent: Amazonbot User-Agent: Omgilibot User-Agent: Diffbot User-Agent: ImagesiftBot User-Agent: Omgili User-Agent: YouBot User-Agent: AhrefsSiteAudit User-Agent: SiteAuditBot User-Agent: SplitSignalBot User-Agent: RyteBot Disallow: / User-Agent: GPTBot User-Agent: ChatGPT-User User-Agent: Google-Extended User-Agent: PerplexityBot User-Agent: ClaudeBot User-Agent: anthropic-ai User-Agent: Bytespider User-Agent: Claude-Web User-Agent: * Allow: / Sitemap: /sitemap.xml