据说soso爬虫也是流氓，真的吗？

crazy4u · 发表于 2009-4-11 20:23:07

刚刚看到有人说soso的爬虫和sogou一样是流氓，每十秒抓一次网页，你们遇到过吗？

crazy4u · 发表于 2009-4-11 20:28:05

一秒钟抓五次，真不拿自己当外人，还好意思在帮助里写上“soso image spider的正常访问并不会对您的网站造成很大负载”。

以前用124.115.0.*网段，被人封光了，现在改用124.115.4.*了。

124.115.4.222 - - [31/Jan/2008:19:21:15 +0800] "GET /h/mingxing/nadimingxing/20061213/4054.html HTTP/1.1" 200 10656 "/h/mingxing/nadimingxing/20061213/4054.html" "Sosoimagespider+(+http://help.soso.com/soso-image-spider.htm)"
124.115.4.222 - - [31/Jan/2008:19:21:15 +0800] "GET /h/mingxing/nadimingxing/20061201/2645.html HTTP/1.1" 200 12086 "/h/mingxing/nadimingxing/20061201/2645.html" "Sosoimagespider+(+http://help.soso.com/soso-image-spider.htm)"
124.115.4.222 - - [31/Jan/2008:19:21:15 +0800] "GET /h/mingxing/nadimingxing/20070118/10751.html HTTP/1.1" 200 10488 "/h/mingxing/nadimingxing/20070118/10751.html" "Sosoimagespider+(+http://help.soso.com/soso-image-spider.htm)"
124.115.4.222 - - [31/Jan/2008:19:21:15 +0800] "GET /plus/feedback_js.php?arcID=2645 HTTP/1.1" 200 13 "/plus/feedback_js.php?arcID=2645" "Sosoimagespider+(+http://help.soso.com/soso-image-spider.htm)"
124.115.4.222 - - [31/Jan/2008:19:21:15 +0800] "GET /plus/feedback_js.php?arcID=10751 HTTP/1.1" 200 13 "/plus/feedback_js.php?arcID=10751" "Sosoimagespider+(+http://help.soso.com/soso-image-spider.htm)"

b81334548 · 发表于 2009-4-11 23:09:44

很多人这样说

ffnn · 发表于 2009-4-12 01:09:56

吃流量的很。一般都禁止他访问的。

chengnuomima · 发表于 2009-4-12 03:23:46

被这几个流氓给收录了请问该怎么封掉他们啊？

ffnn · 发表于 2009-4-13 22:34:35

禁止访问就行了。