|
Робот |
Хиты |
| 1 |
Yandex Robot |
104 344 |
| 2 |
Bing Robot |
65 605 |
| 3 |
SemrushBot |
33 885 |
| 4 |
AhrefsBot |
33 814 |
| 5 |
Googlebot |
21 264 |
| 6 |
MJ12bot |
18 947 |
| 7 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots) |
9 801 |
| 8 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; +http://go.mail.ru/help/robots) |
6 048 |
| 9 |
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler) |
5 790 |
| 10 |
Bing Preview Robot |
4 652 |
| 11 |
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.116 Safari/537.36 HubSpot Webcrawler - web-crawlers@hubspot.com |
3 161 |
| 12 |
DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/xn--b1amfsx.xn--p1ai) |
2 523 |
| 13 |
DotBot |
2 368 |
| 14 |
DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/aviacity.net) |
2 242 |
| 15 |
Alexa Robot |
1 097 |
| 16 |
Baidu Spider |
730 |
| 17 |
Yahoo! Slurp |
591 |
| 18 |
FaceBook Crawler |
441 |
| 19 |
Mozilla/5.0 (compatible; SiteExplorer/1.1b; +http://siteexplorer.info/Backlink-Checker-Spider/) |
357 |
| 20 |
Google Preview Robot |
200 |
| 21 |
Mozilla/5.0 (compatible; uCrawler/1.0 ; +https://blog.ucoz.ru/upolicy) |
196 |
| 22 |
Exabot |
109 |
| 23 |
Virusdie crawler/3.0 |
99 |
| 24 |
LinkWalker |
70 |
| 25 |
Mozilla/5.0 (compatible; SEOkicks-Robot; +http://www.seokicks.de/robot.html) |
64 |
| 26 |
Netcraft Spider |
62 |
| 27 |
Mozilla/5.0 (compatible; RukiCrawler/1.0; +http://ruki.rezko.net) |
60 |
| 28 |
Powermarks |
54 |
| 29 |
MSIE Crawler |
46 |
| 30 |
SurveyBot |
40 |
| 31 |
Perl LWP |
34 |
| 32 |
Archive.org Robot |
28 |
| 33 |
LightspeedSystemsCrawler Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US |
22 |
| 34 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Fast/2.0; +http://go.mail.ru/help/robots) |
22 |
| 35 |
Trendiction-Bot |
19 |
| 36 |
SimplePie |
19 |
| 37 |
DomainAppender Robot |
12 |
| 38 |
CheckMarkNetwork/1.0 (+http://www.checkmarknetwork.com/spider.html) |
11 |
| 39 |
Fireball.de Robot |
10 |
| 40 |
Yetibot |
9 |
| 41 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots/2.0; +http://go.mail.ru/help/robots) |
6 |
| 42 |
Auto Spider 1.0 |
6 |
| 43 |
johnhew crawler, johnhew@seas.upenn.edu/Nutch-1.12 |
4 |
| 44 |
TinEye Crawler |
3 |
| 45 |
CRAZYWEBCRAWLER 0.9.10, http://www.crazywebcrawler.com |
3 |
| 46 |
LTX71 Robot |
2 |
| 47 |
Qwant Robot |
2 |
| 48 |
Xenu's Link Sleuth |
2 |
| 49 |
Mozilla/5.0 (Auto Shell Spider) |
2 |
| 50 |
crawler4j (http://code.google.com/p/crawler4j/) |
2 |
|
Итого |
318 878 |
|
Всего |
318 881 |
