返回首页

Crawler User-Agent 访问矩阵(2026-08-18)

结论

Crawler 汇总

CrawlerFamilyPassedBlocked-likeAll readable
Generic browser control control 9/9 0 yes
Googlebot search 9/9 0 yes
bingbot search 9/9 0 yes
Baiduspider search-cn 9/9 0 yes
Sogou web spider search-cn 9/9 0 yes
360Spider search-cn 9/9 0 yes
Bytespider ai-cn 9/9 0 yes
Tencent crawler representative ai-cn 9/9 0 yes
OAI-SearchBot ai-global 9/9 0 yes
GPTBot ai-global 9/9 0 yes
ChatGPT-User ai-global 9/9 0 yes
ClaudeBot ai-global 9/9 0 yes
PerplexityBot ai-search 9/9 0 yes
Applebot ai-search 9/9 0 yes

机器可读数据

JSON 数据 · Markdown 说明