|
Робот |
Хиты |
| 1 |
AhrefsBot |
298 973 |
| 2 |
DotBot |
112 020 |
| 3 |
Yandex Robot |
64 307 |
| 4 |
WebMeUp Crawler |
40 614 |
| 5 |
Googlebot |
37 184 |
| 6 |
SemrushBot |
29 242 |
| 7 |
Bing Robot |
21 887 |
| 8 |
MJ12bot |
19 757 |
| 9 |
Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler) |
18 825 |
| 10 |
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler) |
14 784 |
| 11 |
Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com) |
5 112 |
| 12 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
4 941 |
| 13 |
WebLog Expert |
3 350 |
| 14 |
netEstate NE Crawler (+http://www.website-datenbank.de/) |
3 052 |
| 15 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
2 191 |
| 16 |
Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; https://zhanzhang.toutiao.com/) |
1 038 |
| 17 |
'Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Mobile Safari/537.36'Bytespider;https://zhanzhang.toutiao.com/ |
816 |
| 18 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Favicons/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
330 |
| 19 |
Twitterbot |
232 |
| 20 |
LightspeedSystemsCrawler Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US) |
204 |
| 21 |
Bing Preview Robot |
156 |
| 22 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
109 |
| 23 |
Mozilla/5.0 (compatible; oBot/2.3.1; http://www.xforce-security.com/crawler/) |
72 |
| 24 |
Mozilla/5.0 (Windows NT 6.1; Win64; x64; +http://url-classification.io/wiki/index.php?title= URL_server_crawler) KStandBot/1.0 |
59 |
| 25 |
FaceBook Crawler |
48 |
| 26 |
Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.0.0 Safari/537.36 |
44 |
| 27 |
Netcraft Spider |
40 |
| 28 |
Perl LWP |
35 |
| 29 |
Baidu Spider |
35 |
| 30 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Fast/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
33 |
| 31 |
LinkedIn Robot |
26 |
| 32 |
Archive.org Robot |
20 |
| 33 |
SeznamBot |
19 |
| 34 |
Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) |
16 |
| 35 |
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Mobile Safari/537.36Bytespider;https://zhanzhang.toutiao.com/ |
11 |
| 36 |
CheckMarkNetwork/1.0 (+http://www.checkmarknetwork.com/spider.html) |
9 |
| 37 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Target/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
5 |
| 38 |
Grub Crawler |
3 |
| 39 |
Screaming Frog SEO Spider/17.2 |
3 |
| 40 |
AskJeeves Robot |
3 |
| 41 |
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Nicecrawler/1.1; +http://www.nicecrawler.com/) Chrome/90.0.4430.97 Safari/537.36 |
3 |
| 42 |
Exabot |
2 |
| 43 |
Mozilla/5.0 (compatible; ev-crawler/1.0; +https://headline.com/legal/crawler) |
2 |
| 44 |
Powermarks |
2 |
| 45 |
Qwant Robot |
2 |
| 46 |
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36 CrawlyProjectCrawler/0.0.6 (email crawlyproject@digitaldragon.dev) |
1 |
| 47 |
Xenu's Link Sleuth |
1 |
| 48 |
Google AdSense Robot |
1 |
| 49 |
everyfeed-spider/2.0 (http://www.everyfeed.com) |
1 |
| 50 |
Google AdWords Robot |
1 |
|
Итого |
679 621 |
|
Всего |
679 627 |
