|
Робот |
Хиты |
| 1 |
Yandex Robot |
1 683 980 |
| 2 |
AhrefsBot |
763 011 |
| 3 |
Bing Robot |
656 550 |
| 4 |
Googlebot |
540 173 |
| 5 |
DotBot |
490 069 |
| 6 |
SemrushBot |
328 624 |
| 7 |
MJ12bot |
312 455 |
| 8 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots) |
140 828 |
| 9 |
WebMeUp Crawler |
89 072 |
| 10 |
Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler) |
67 336 |
| 11 |
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler) |
67 081 |
| 12 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; +http://go.mail.ru/help/robots) |
50 010 |
| 13 |
Ezooms Robot |
19 413 |
| 14 |
Bing Preview Robot |
17 997 |
| 15 |
Mozilla/5.0 (compatible; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots) |
14 065 |
| 16 |
Alexa Robot |
13 123 |
| 17 |
Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com) |
11 966 |
| 18 |
netEstate NE Crawler (+http://www.website-datenbank.de/) |
10 186 |
| 19 |
Baidu Spider |
8 696 |
| 20 |
FaceBook Crawler |
8 196 |
| 21 |
MauiBot (crawler.feedback+wc@gmail.com) |
5 497 |
| 22 |
WebLog Expert |
5 484 |
| 23 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
5 153 |
| 24 |
Mozilla/5.0 (compatible; 007ac9 Crawler; http://crawler.007ac9.net/) |
4 109 |
| 25 |
Google Preview Robot |
3 586 |
| 26 |
Yahoo! Slurp |
3 213 |
| 27 |
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.116 Safari/537.36 HubSpot Webcrawler - web-crawlers@hubspot.com |
3 161 |
| 28 |
Friendly_Crawler/Nutch-1.20-SNAPSHOT |
3 022 |
| 29 |
Mozilla/5.0 (compatible; SEOkicks; +https://www.seokicks.de/robot.html) |
2 841 |
| 30 |
DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/xn--b1amfsx.xn--p1ai) |
2 523 |
| 31 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
2 357 |
| 32 |
DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/aviacity.net) |
2 242 |
| 33 |
Mozilla/5.0 (compatible; Adsbot/3.1; +https://seostar.co/robot/) |
2 215 |
| 34 |
FriendlyCrawler/Nutch-1.20-SNAPSHOT |
1 905 |
| 35 |
Turnitin Robot |
1 666 |
| 36 |
pimeyes.com crawler |
1 596 |
| 37 |
Archive.org Robot |
1 434 |
| 38 |
Mozilla/5.0 (compatible; SEOkicks-Robot; +http://www.seokicks.de/robot.html) |
1 402 |
| 39 |
Mozilla/5.0 (compatible; LinkpadBot/2.4; +https://linkpad.org/robot/) |
1 393 |
| 40 |
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/605.1.16 (KHTML, like Gecko; compatible; Friendly_Crawler/2.0) Chrome/120.0.6099.217 Safari/605.1.15/Nutch-1.20-SNAPSHOT |
1 267 |
| 41 |
BUbiNG Crawler |
1 250 |
| 42 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Favicons/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
1 159 |
| 43 |
Mozilla/5.0 (compatible; SiteExplorer/1.1b; +http://siteexplorer.info/Backlink-Checker-Spider/) |
1 087 |
| 44 |
Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; https://zhanzhang.toutiao.com/) |
1 046 |
| 45 |
'Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Mobile Safari/537.36'Bytespider;https://zhanzhang.toutiao.com/ |
816 |
| 46 |
Mozilla/5.0 (compatible; Nigma.ru/3.0; crawler@nigma.ru) |
807 |
| 47 |
Mozilla/5.0 (compatible; LinkpadBot/2.3; +http://linkpad.org/robot/) |
784 |
| 48 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
691 |
| 49 |
Powermarks |
658 |
| 50 |
meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler) |
644 |
|
Итого |
5 357 839 |
|
Всего |
5 369 497 |
