|
Робот |
Хиты |
| 1 |
Yandex Robot |
93 484 |
| 2 |
SemrushBot |
76 847 |
| 3 |
Bing Robot |
66 302 |
| 4 |
AhrefsBot |
43 399 |
| 5 |
Googlebot |
41 574 |
| 6 |
DotBot |
27 607 |
| 7 |
MJ12bot |
20 760 |
| 8 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; +http://go.mail.ru/help/robots) |
14 264 |
| 9 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots) |
13 810 |
| 10 |
Bing Preview Robot |
6 855 |
| 11 |
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler) |
4 938 |
| 12 |
Alexa Robot |
4 889 |
| 13 |
Mozilla/5.0 (compatible; 007ac9 Crawler; http://crawler.007ac9.net/) |
1 390 |
| 14 |
Mozilla/5.0 (compatible; SEOkicks; +https://www.seokicks.de/robot.html) |
1 324 |
| 15 |
MauiBot (crawler.feedback+wc@gmail.com) |
1 254 |
| 16 |
BUbiNG Crawler |
1 250 |
| 17 |
Baidu Spider |
830 |
| 18 |
crawler4j (https://github.com/yasserg/crawler4j/) |
384 |
| 19 |
Mozilla/5.0 (compatible; uCrawler/1.0 ; +https://blog.ucoz.ru/upolicy) |
298 |
| 20 |
FaceBook Crawler |
197 |
| 21 |
Yahoo! Slurp |
118 |
| 22 |
Exabot |
112 |
| 23 |
LightspeedSystemsCrawler Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US |
98 |
| 24 |
Google Preview Robot |
92 |
| 25 |
Xenu's Link Sleuth |
85 |
| 26 |
Perl LWP |
65 |
| 27 |
Archive.org Robot |
61 |
| 28 |
Netcraft Spider |
42 |
| 29 |
SimplePie |
23 |
| 30 |
Virusdie crawler/3.0 |
22 |
| 31 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Fast/2.0; +http://go.mail.ru/help/robots) |
22 |
| 32 |
Yetibot |
17 |
| 33 |
Trendiction-Bot |
13 |
| 34 |
Mozilla/5.0 (compatible; oBot/2.3.1; http://filterdb.iss.net/crawler/) |
12 |
| 35 |
CipaCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/aviacity.net) |
10 |
| 36 |
Powermarks |
10 |
| 37 |
CipaCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/xn--b1amfsx.xn--p1ai) |
8 |
| 38 |
SurveyBot |
8 |
| 39 |
VelenPublicWebCrawler (velen.io) |
8 |
| 40 |
MSIE Crawler |
7 |
| 41 |
Mozilla/5.0 (compatible; oBot/2.3.1; +http://filterdb.iss.net/crawler/) |
6 |
| 42 |
LTX71 Robot |
6 |
| 43 |
DomainCheck.io Crawler/1.3 (https://domaincheck.io) |
4 |
| 44 |
IABTechLab Ads.txt Crawler |
4 |
| 45 |
Google AdSense Robot |
4 |
| 46 |
CheckMarkNetwork/1.0 (+http://www.checkmarknetwork.com/spider.html) |
3 |
| 47 |
Zauba Crawler/1.0 (Zauba Search for Research; http://www.zauba.io/; admin@zauba.io) |
3 |
| 48 |
crawler (crawler.feedback@gmail.com) |
2 |
| 49 |
Rogerbot |
2 |
| 50 |
Mozilla/5.0 (compatible; RukiCrawler/1.0; +http://ruki.rezko.net) |
1 |
|
Итого |
422 524 |
|
Всего |
422 529 |
