|
Робот |
Хиты |
1 |
Bing Robot |
86 966 |
2 |
Yandex Robot |
83 685 |
3 |
DotBot |
43 577 |
4 |
AhrefsBot |
38 291 |
5 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots) |
29 818 |
6 |
SemrushBot |
28 342 |
7 |
Googlebot |
25 691 |
8 |
MJ12bot |
14 007 |
9 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; +http://go.mail.ru/help/robots) |
9 413 |
10 |
WebMeUp Crawler |
8 261 |
11 |
Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler) |
6 801 |
12 |
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler) |
6 503 |
13 |
MauiBot (crawler.feedback+wc@gmail.com) |
2 893 |
14 |
Mozilla/5.0 (compatible; Adsbot/3.1; +https://seostar.co/robot/) |
2 215 |
15 |
Mozilla/5.0 (compatible; LinkpadBot/2.4; +https://linkpad.org/robot/) |
1 393 |
16 |
netEstate NE Crawler (+http://www.website-datenbank.de/) |
1 022 |
17 |
Bing Preview Robot |
359 |
18 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Favicons/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
247 |
19 |
LightspeedSystemsCrawler Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US) |
153 |
20 |
FaceBook Crawler |
127 |
21 |
Baidu Spider |
120 |
22 |
Mozilla/5.0 (Windows NT 6.1; Win64; x64; +http://www.komodia.com/newwiki/index.php/URL_server_crawler) KomodiaBot/1.0 |
92 |
23 |
'Mozilla/5.0 (compatible; Seekport Crawler; http://seekport.com/' |
72 |
24 |
Perl LWP |
55 |
25 |
Spider2.0 |
39 |
26 |
Netcraft Spider |
24 |
27 |
Twitterbot |
23 |
28 |
MSIE Crawler |
18 |
29 |
Mozilla/5.0 (compatible; TestBot/0.1; +In_the_test_phase,_if_the_spider_brings_you_trouble, _please_add_our_IP_to_the_blacklist._Thank_you.) |
18 |
30 |
Powermarks |
17 |
31 |
Google AdSense Robot |
14 |
32 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Fast/2.0; +http://go.mail.ru/help/robots) |
14 |
33 |
Qwant Robot |
10 |
34 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Fast/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
9 |
35 |
CheckMarkNetwork/1.0 (+http://www.checkmarknetwork.com/spider.html) |
9 |
36 |
Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) |
7 |
37 |
Mozilla/5.0 (compatible; Seekport Crawler; http://seekport.com/ |
6 |
38 |
Screaming Frog SEO Spider/12.6 |
5 |
39 |
Mozilla/5.0 (compatible; ThinkBot/0.3.0; +In_the_test_phase,_if_the_spider_brings_you_trouble, _please_add_our_IP_to_the_blacklist._Thank_you.) |
4 |
40 |
Dy robot 1.0 |
4 |
41 |
Google AdWords Robot |
3 |
42 |
& |
3 |
43 |
e.ventures Investment Crawler (eventures.vc) |
3 |
44 |
LinkedIn Robot |
3 |
45 |
Screaming Frog SEO Spider/14.1 |
1 |
46 |
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Nicecrawler/1.1; +http://www.nicecrawler.com/) Chrome/90.0.4430.97 Safari/537.36 |
1 |
47 |
Google Preview Robot |
1 |
48 |
Mozilla/5.0 (compatible; TkBot/0.1; +In_the_test_phase,_if_the_spider_brings_you_trouble, _please_add_our_IP_to_the_blacklist._Thank_you.) |
1 |
49 |
Screaming Frog SEO Spider/15.1 |
1 |
|
Всего |
390 341 |