|
Робот |
Хиты |
1 |
Googlebot |
13 815 |
2 |
DotBot |
11 127 |
3 |
AhrefsBot |
9 189 |
4 |
Yandex Robot |
6 417 |
5 |
SemrushBot |
3 708 |
6 |
WebMeUp Crawler |
2 484 |
7 |
Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler) |
2 145 |
8 |
Bing Robot |
1 438 |
9 |
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler) |
1 360 |
10 |
MJ12bot |
967 |
11 |
Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com) |
670 |
12 |
WebLog Expert |
128 |
13 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
33 |
14 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Fast/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
28 |
15 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
26 |
16 |
Bing Preview Robot |
18 |
17 |
FaceBook Crawler |
10 |
18 |
'Mozilla/5.0 (compatible; GenomeCrawlerd/1.0; https://www.nokia.com/genomecrawler)' |
10 |
19 |
'Mozilla/5.0 (compatible; GenomeCrawlerd/1.0; +https://www.nokia.com/networks/ip-networks/deepfield/genome/)' |
9 |
20 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Favicons/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
8 |
21 |
meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler) |
6 |
22 |
LightspeedSystemsCrawler Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US) |
5 |
23 |
Yahoo! Slurp |
4 |
24 |
Perl LWP |
4 |
25 |
LinkedIn Robot |
2 |
26 |
Twitterbot |
2 |
27 |
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Bravebot/1.0; +https://search.brave.com/help/brave-search-crawler) Chrome/W.X.Y.Z Safari/537.36 |
1 |
28 |
MauiBot (crawler.feedback+wc@gmail.com) |
1 |
29 |
Xenu's Link Sleuth |
1 |
30 |
AskJeeves Robot |
1 |
31 |
Exabot |
1 |
32 |
Netcraft Spider |
1 |
|
Всего |
53 619 |