|
Робот |
Хиты |
1 |
MJ12bot |
60 450 |
2 |
Yandex Robot |
57 792 |
3 |
Bing Robot |
41 278 |
4 |
Googlebot |
23 545 |
5 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots) |
15 113 |
6 |
AhrefsBot |
14 642 |
7 |
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler) |
5 541 |
8 |
Baidu Spider |
5 319 |
9 |
DotBot |
4 882 |
10 |
Turnitin Robot |
1 320 |
11 |
Yahoo! Slurp |
1 111 |
12 |
Mozilla/5.0 (compatible; 007ac9 Crawler; http://crawler.007ac9.net/) |
905 |
13 |
FaceBook Crawler |
510 |
14 |
Google Preview Robot |
441 |
15 |
Mozilla/5.0 (compatible; SEOkicks-Robot; +http://www.seokicks.de/robot.html) |
249 |
16 |
NerdyBot |
238 |
17 |
meanpathbot |
106 |
18 |
Archive.org Robot |
95 |
19 |
LSSRocketCrawler/1.0 LightspeedSystems |
77 |
20 |
Bing Preview Robot |
66 |
21 |
Netcraft Spider |
64 |
22 |
Exabot |
61 |
23 |
SurveyBot |
52 |
24 |
Mozilla/5.0 (compatible; DomainSigmaCrawler/0.1; +http://domainsigma.com/robot) |
43 |
25 |
Powermarks |
42 |
26 |
Rogerbot |
40 |
27 |
Twitterbot |
40 |
28 |
MSIE Crawler |
38 |
29 |
SemrushBot |
32 |
30 |
Mozilla/5.0 (Windows NT 6.2; WOW64) Runet-Research-Crawler (itrack.ru/research/cmsrate; rating@itrack.ru) |
28 |
31 |
Virusdie crawler/2.1 |
18 |
32 |
Mozilla/5.0 (compatible; oBot/2.3.1; +http://filterdb.iss.net/crawler/) |
12 |
33 |
Perl LWP |
11 |
34 |
WebMeUp Crawler |
7 |
35 |
Mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php) |
6 |
36 |
DomainAppender Robot |
6 |
37 |
AdnormCrawler www.adnorm.com/crawler |
5 |
38 |
PagesInventory (robot http://www.pagesinventory.com) |
4 |
39 |
Xenu's Link Sleuth |
4 |
40 |
Mozilla/5.0 (compatible; GrapeshotCrawler/2.0; +http://www.grapeshot.co.uk/crawler.php) |
4 |
41 |
Mozilla/5.0 (compatible; NetSeer crawler/2.0; +http://www.netseer.com/crawler.html; crawler@netseer.com) |
4 |
42 |
PagesInventory (robot +http://www.pagesinventory.com) |
4 |
43 |
Slackbot-LinkExpanding 1.0 (+https://api.slack.com/robots) |
3 |
44 |
LinkdexBot |
3 |
45 |
WebTarantula.com Crawler |
3 |
46 |
DLE_Spider.exe |
2 |
47 |
Google AdSense Robot |
2 |
48 |
CRAZYWEBCRAWLER 0.9.4, http://www.crazywebcrawler.com |
2 |
49 |
CRAZYWEBCRAWLER 0.9.2, http://www.crazywebcrawler.com |
2 |
50 |
SafeSearch microdata crawler (https://safesearch.avira.com, safesearch-abuse@avira.com) |
2 |
|
Итого |
234 224 |
|
Всего |
234 237 |