# getoffer.help / offermate.cc — robots.txt # 最后更新: 2026-10-28 # 策略: 全面放行搜索引擎 + AI 答案引擎爬虫（GEO / AI 可见度优化） # 依据: 面小帮岗位库为公开内容，欢迎被检索、被引用、被学习 User-agent: * Allow: / Disallow: /pass-admin.html Disallow: /mianshi/pass-admin.html # ---- 国际 AI 答案引擎 / 大模型爬虫 ---- User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / User-agent: Google-Extended Allow: / User-agent: GoogleOther Allow: / User-agent: Bingbot Allow: / User-agent: BingPreview Allow: / User-agent: meta-externalagent Allow: / User-agent: Meta-ExternalFetcher Allow: / User-agent: Bytespider Allow: / User-agent: Amazonbot Allow: / User-agent: CCBot Allow: / User-agent: Diffbot Allow: / User-agent: Omgilibot Allow: / User-agent: Omgili Allow: / User-agent: Timpibot Allow: / User-agent: Youbot Allow: / User-agent: AI2Bot Allow: / User-agent: ImagesiftBot Allow: / User-agent: MistralAI-User Allow: / User-agent: Cohere-ai Allow: / User-agent: Webzio-Extended Allow: / User-agent: PetalBot Allow: / User-agent: Scrapy Allow: / User-agent: SemrushBot Allow: / # ---- 国内 AI 答案引擎 / 大模型爬虫 ---- User-agent: Baiduspider Allow: / User-agent: ErnieBot Allow: / User-agent: 360Spider-AI Allow: / User-agent: MoonshotBot Allow: / User-agent: TencentSpider Allow: / User-agent: HunyuanBot Allow: / User-agent: AlibabaBot Allow: / User-agent: TongyiBot Allow: / User-agent: ZhipuBot Allow: / User-agent: Kangaroo Bot Allow: / User-agent: DoubaoSpider Allow: / User-agent: YuanbaoBot Allow: / User-agent: DeepSeekBot Allow: / # ---- 站点地图 ---- # AI 可读索引: /llms.txt Sitemap: https://getoffer.help/sitemap.xml Sitemap: https://getoffer.help/sitemap-archive.xml Sitemap: https://offermate.cc/sitemap.xml Sitemap: https://offermate.cc/sitemap-archive.xml