Current Position:912sy > Web Development > Block all Bytespider spiders
programming enthusiastprogramming enthusiast Web Development Website Building Tips

Block all Bytespider spiders

近来，Bytespider蜘蛛访问越来越频繁，严重占用宽带。有人说Bytespider是字节跳动蜘蛛，没有可靠证据，不得而知。。

那么直接封杀吧，把他引到sina网吧。。

修改.htaccess文件，添加：

RewriteCond %{HTTP_USER_AGENT} ^(.*)Bytespider$
RewriteRule ^(.*)$ http://www.sina.com.cn/

结果如下：

[root@localhost ~]# ./log.sh | grep "Bytespider"
110.249.201.108 - - [11/Aug/2019:23:01:21 +0800] "GET /space-username-xtzt1990.html HTTP/1.1" 302 285 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.7384.1779 Mobile Safari/537.36; Bytespider"
110.249.201.190 - - [11/Aug/2019:23:01:23 +0800] "GET /forum.php?goto=lastpost&mod=redirect&tid=6313760 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.6116.1513 Mobile Safari/537.36; Bytespider"
110.249.202.62 - - [11/Aug/2019:23:01:23 +0800] "GET /forum.php?goto=lastpost&mod=redirect&tid=3332784 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.1193.1050 Mobile Safari/537.36; Bytespider"
110.249.201.62 - - [11/Aug/2019:23:01:23 +0800] "GET /forum.php?authorid=416874&mod=viewthread&page=1&tid=6790714 HTTP/1.1" 302 286 "-" "Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.5215.1611 Mobile Safari/537.36; Bytespider"
110.249.201.130 - - [11/Aug/2019:23:01:23 +0800] "GET /forum.php?authorid=93496&mod=viewthread&page=337&tid=1573946 HTTP/1.1" 302 287 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.7006.1870 Mobile Safari/537.36; Bytespider"
110.249.202.69 - - [11/Aug/2019:23:01:23 +0800] "GET /forum.php?mod=viewthread&ordertype=1&tid=5379474 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.7170.1667 Mobile Safari/537.36; Bytespider"
110.249.202.91 - - [11/Aug/2019:23:01:24 +0800] "GET /forum.php?authorid=309714&mod=viewthread&page=1&tid=7474282 HTTP/1.1" 302 285 "-" "Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.1891.1766 Mobile Safari/537.36; Bytespider"
110.249.202.106 - - [11/Aug/2019:23:01:24 +0800] "GET /forum.php?goto=lastpost&mod=redirect&tid=4747211 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.9710.1312 Mobile Safari/537.36; Bytespider"
110.249.202.16 - - [11/Aug/2019:23:01:24 +0800] "GET /forum.php?goto=lastpost&mod=redirect&tid=3809730 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.4553.1050 Mobile Safari/537.36; Bytespider"
110.249.201.106 - - [11/Aug/2019:23:01:25 +0800] "GET /forum.php?authorid=75682&mod=viewthread&page=7&tid=1626857 HTTP/1.1" 302 285 "-" "Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.1891.1766 Mobile Safari/537.36; Bytespider"
110.249.202.46 - - [11/Aug/2019:23:01:25 +0800] "GET /forum.php?mod=viewthread&ordertype=1&tid=6710125 HTTP/1.1" 302 275 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.7284.1904 Mobile Safari/537.36; Bytespider"
110.249.202.144 - - [11/Aug/2019:23:01:25 +0800] "GET /forum.php?authorid=59003&mod=viewthread&page=23&tid=321899 HTTP/1.1" 302 283 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.5849.1560 Mobile Safari/537.36; Bytespider"
110.249.201.16 - - [11/Aug/2019:23:01:25 +0800] "GET /forum.php?authorid=105223&mod=viewthread&page=2&tid=2891200 HTTP/1.1" 302 284 "-" "Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.3637.1966 Mobile Safari/537.36; Bytespider"
110.249.201.106 - - [11/Aug/2019:23:01:25 +0800] "GET /forum.php?mod=viewthread&ordertype=1&tid=7085162 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.3935.1138 Mobile Safari/537.36; Bytespider"
110.249.201.148 - - [11/Aug/2019:23:01:26 +0800] "GET /forum.php?mod=viewthread&ordertype=2&tid=4601579 HTTP/1.1" 302 275 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.6386.1100 Mobile Safari/537.36; Bytespider"
110.249.202.238 - - [11/Aug/2019:23:01:26 +0800] "GET /forum.php?goto=lastpost&mod=redirect&tid=4288839 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.4901.1384 Mobile Safari/537.36; Bytespider"
110.249.201.20 - - [11/Aug/2019:23:01:26 +0800] "GET /forum.php?goto=lastpost&mod=redirect&tid=962794 HTTP/1.1" 302 275 "-" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.4745.1260 Mobile Safari/537.36; Bytespider"
111.225.148.56 - - [11/Aug/2019:23:01:28 +0800] "GET /thread-2592255-1-608.html HTTP/1.1" 302 285 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.5117.1057 Mobile Safari/537.36; Bytespider"
110.249.202.154 - - [11/Aug/2019:23:01:28 +0800] "GET /forum.php?mod=viewthread&ordertype=1&tid=3196523 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.6116.1513 Mobile Safari/537.36; Bytespider"
111.225.148.86 - - [11/Aug/2019:23:01:28 +0800] "GET /forum.php?mod=viewthread&ordertype=1&tid=4738597 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.9221.1272 Mobile Safari/537.36; Bytespider"
110.249.201.56 - - [11/Aug/2019:23:01:28 +0800] "GET /forum.php?mod=viewthread&ordertype=1&tid=3149306 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.1046.1940 Mobile Safari/537.36; Bytespider"
111.225.148.230 - - [11/Aug/2019:23:01:30 +0800] "GET /thread-7063023-1-214.html HTTP/1.1" 302 285 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.5117.1057 Mobile Safari/537.36; Bytespider"
111.225.149.72 - - [11/Aug/2019:23:01:30 +0800] "GET /forum.php?goto=lastpost&mod=redirect&tid=7509951 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.9670.1576 Mobile Safari/537.36; Bytespider"
111.225.148.72 - - [11/Aug/2019:23:01:30 +0800] "GET /forum.php?goto=lastpost&mod=redirect&tid=4828123 HTTP/1.1" 302 275 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.9221.1272 Mobile Safari/537.36; Bytespider"
111.225.149.170 - - [11/Aug/2019:23:01:30 +0800] "GET /forum.php?goto=lastpost&mod=redirect&tid=4246749 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.2088.1272 Mobile Safari/537.36; Bytespider"
111.225.149.200 - - [11/Aug/2019:23:01:30 +0800] "GET /forum.php?authorid=389782&mod=viewthread&page=10&tid=3378208 HTTP/1.1" 302 284 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.9221.1272 Mobile Safari/537.36; Bytespider"
110.249.201.230 - - [11/Aug/2019:23:01:30 +0800] "GET /forum.php?goto=lastpost&mod=redirect&tid=7546150 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.8977.1348 Mobile Safari/537.36; Bytespider"
110.249.202.200 - - [11/Aug/2019:23:01:30 +0800] "GET /forum.php?goto=lastpost&mod=redirect&tid=4160469 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.6386.1100 Mobile Safari/537.36; Bytespider"
111.225.149.72 - - [11/Aug/2019:23:01:30 +0800] "GET /forum.php?mod=viewthread&ordertype=1&tid=5447915 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.9670.1576 Mobile Safari/537.36; Bytespider"
111.225.148.243 - - [11/Aug/2019:23:01:31 +0800] "GET /forum.php?mod=viewthread&ordertype=1&tid=5131905 HTTP/1.1" 302 275 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.9670.1576 Mobile Safari/537.36; Bytespider"
111.225.148.25 - - [11/Aug/2019:23:01:31 +0800] "GET /forum.php?mod=viewthread&ordertype=2&tid=4388508 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.8059.1835 Mobile Safari/537.36; Bytespider"
111.225.149.153 - - [11/Aug/2019:23:01:31 +0800] "GET /forum.php?mod=viewthread&ordertype=1&tid=4698508 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.5117.1057 Mobile Safari/537.36; Bytespider"
111.225.148.3 - - [11/Aug/2019:23:01:32 +0800] "GET /thread-6853411-1-395.html HTTP/1.1" 302 285 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.6359.1155 Mobile Safari/537.36; Bytespider"
111.225.148.131 - - [11/Aug/2019:23:01:32 +0800] "GET /thread-4721181-1-770.html HTTP/1.1" 302 285 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.5117.1057 Mobile Safari/537.36; Bytespider"
111.225.149.93 - - [11/Aug/2019:23:01:32 +0800] "GET /forum.php?goto=findpost&mod=redirect&pid=2776142&ptid=1720098 HTTP/1.1" 302 286 "-" "Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.6238.1271 Mobile Safari/537.36; Bytespider"
111.225.148.13 - - [11/Aug/2019:23:01:33 +0800] "GET /thread-3529832-34-17.html HTTP/1.1" 302 285 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2791.1530 Mobile Safari/537.36; Bytespider"
111.225.148.231 - - [11/Aug/2019:23:01:33 +0800] "GET /forum.php?authorid=369692&mod=viewthread&page=18&tid=5521018 HTTP/1.1" 302 286 "-" "Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.5290.1104 Mobile Safari/537.36; Bytespider"
111.225.148.171 - - [11/Aug/2019:23:01:33 +0800] "GET /forum.php?authorid=493518&mod=viewthread&page=1&tid=7052828 HTTP/1.1" 302 285 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.8116.1168 Mobile Safari/537.36; Bytespider"
111.225.148.30 - - [11/Aug/2019:23:01:34 +0800] "GET /forum.php?mod=viewthread&orderby=replies&tid=4410622 HTTP/1.1" 302 278 "-" "Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.6173.1899 Mobile Safari/537.36; Bytespider"
111.225.148.74 - - [11/Aug/2019:23:01:35 +0800] "GET /forum.php?goto=lastpost&mod=redirect&tid=7447942 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.9582.1219 Mobile Safari/537.36; Bytespider"
111.225.148.44 - - [11/Aug/2019:23:01:35 +0800] "GET /forum.php?authorid=42340&mod=viewthread&page=1&tid=4062960 HTTP/1.1" 302 284 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.3573.1643 Mobile Safari/537.36; Bytespider"
111.225.148.142 - - [11/Aug/2019:23:01:35 +0800] "GET /forum.php?goto=lastpost&mod=redirect&tid=4847101 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.7805.1285 Mobile Safari/537.36; Bytespider"
111.225.149.232 - - [11/Aug/2019:23:01:35 +0800] "GET /forum.php?authorid=426901&mod=viewthread&page=2&tid=4491502 HTTP/1.1" 302 284 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2194.1569 Mobile Safari/537.36; Bytespider"
111.225.148.184 - - [11/Aug/2019:23:01:36 +0800] "GET /forum.php?goto=lastpost&mod=redirect&tid=4570115 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.5117.1057 Mobile Safari/537.36; Bytespider"
111.225.148.244 - - [11/Aug/2019:23:01:36 +0800] "GET /thread-2653532-1-802.html HTTP/1.1" 302 285 "-" "Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.9670.1576 Mobile Safari/537.36; Bytespider"
111.225.149.56 - - [11/Aug/2019:23:01:36 +0800] "GET /forum.php?goto=lastpost&mod=redirect&tid=3395062 HTTP/1.1" 302 276 "-" "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.9221.1272 Mobile Safari/537.36; Bytespider"
111.225.149.69 - - [11/Aug/2019:23:01:37 +0800] "GET /forum.php?authorid=433871&mod=viewthread&page=12&tid=3776882 HTTP/1.1" 302 286 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.7436.1798 Mobile Safari/537.36; Bytespider"

http码全为302，跳转到www.sina.com.cn成功。。至此问题解决，一切OK~~~

912sy.com download resources are from the network, only for learning and reference use, the copyright belongs to the original author, do not use for commercial purposes, please remove yourself within 24 hours after downloading.
If the content published on this site inadvertently violates your rights and interests, please contact us and the site will be deleted within one business day.If you encounter any problems please contact customer service QQ:2385367137
912sy " Block all Bytespider spiders

Recommended