抓取结果:找不到页面
BaiduSpider
2022-09-07 16:48:52
HTTP/1.1, 404 Not Found
获取的 HTTP 响应:
Connection: keep-alive Content-Length: 146 Content-Type: text/html Date: Wed, 07 Sep 2022 08:48:52 GMT Server: nginx
Connection: keep-alive Content-Length: 146 Content-Type: text/html Date: Wed, 07 Sep 2022 08:48:52 GMT Server: nginx
网站 {domain} 设置的 Robots 规则(查看 robots.txt)已阻止 {user_agent} UA 抓取该 URL。你可以把 User Agent 切换成「当前浏览器」再查看该 URL 的抓取结果。
最近使用:
扫描关注公众号