Crawler User-Agent 访问矩阵(2026-08-18)
结论
- 基础 crawler 访问门禁:通过
- 检查项:126/126
- 类阻断状态:0
- 边界:本报告只证明 HTTP 层可访问,不证明搜索收录、AI 抓取、训练吸收、引用、排名或自然推荐。
Crawler 汇总
| Crawler | Family | Passed | Blocked-like | All readable |
|---|---|---|---|---|
| Generic browser control | control | 9/9 | 0 | yes |
| Googlebot | search | 9/9 | 0 | yes |
| bingbot | search | 9/9 | 0 | yes |
| Baiduspider | search-cn | 9/9 | 0 | yes |
| Sogou web spider | search-cn | 9/9 | 0 | yes |
| 360Spider | search-cn | 9/9 | 0 | yes |
| Bytespider | ai-cn | 9/9 | 0 | yes |
| Tencent crawler representative | ai-cn | 9/9 | 0 | yes |
| OAI-SearchBot | ai-global | 9/9 | 0 | yes |
| GPTBot | ai-global | 9/9 | 0 | yes |
| ChatGPT-User | ai-global | 9/9 | 0 | yes |
| ClaudeBot | ai-global | 9/9 | 0 | yes |
| PerplexityBot | ai-search | 9/9 | 0 | yes |
| Applebot | ai-search | 9/9 | 0 | yes |