# ai User-agent: aiHitBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Applebot Disallow: / User-agent: Brightbot Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: ClaudeBot Disallow: / User-agent: claudebot Disallow: / User-agent: cohere-ai Disallow: / User-agent: Diffbot Disallow: / User-agent: FacebookBot Disallow: / User-agent: Flyriverbot Disallow: / User-agent: FriendlyCrawler Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: Grammarly Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: omgili Disallow: / User-agent: PerplexityBot Disallow: / User-agent: Timpibot Disallow: / User-agent: YouBot Disallow: / # seo User-agent: Ahrefsbots Disallow: / User-agent: BacklinksExtendedBot Disallow: / User-agent: Barkrowler Disallow: / User-agent: BLEXBot Disallow: / User-agent: Buck Disallow: / User-agent: CheckMarkNetwork Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Hypefactors Disallow: / User-agent: JamesBOT Disallow: / User-agent: KStandBot Disallow: / User-agent: netEstateNECrawler Disallow: / User-agent: Semrushbot Disallow: / User-agent: SeobilityBot Disallow: / User-agent: VelenPublicWebCrawler Disallow: / User-agent: ZoomBot Disallow: / User-agent: ZoominfoBot Disallow: / # host User-agent: 2ipbot Disallow: / User-agent: Birdcrawlerbot Disallow: / User-agent: DnBCrawler-Analytics Disallow: / User-agent: ev-crawler Disallow: / User-agent: GenomeCrawlerd Disallow: / User-agent: HubSpotCrawler Disallow: / User-agent: IonCrawl Disallow: / User-agent: KStandBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: netEstateNECrawler Disallow: / User-agent: Pandalytics Disallow: / User-agent: SeekportCrawler Disallow: / User-agent: Serpstatbot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: XoviOnpageCrawler Disallow: / # social User-agent: AwarioBot Disallow: / User-agent: facebookexternalhit Disallow: / User-agent: meta-externalagent Disallow: / User-agent: TwitterBot Disallow: / # security User-agent: AliyunSecBot Disallow: / User-agent: intelx.io_bot Disallow: / User-agent: WanScannerBot Disallow: /