|
Робот |
Хиты |
1 |
Yandex Robot |
63 190 |
2 |
Googlebot |
36 249 |
3 |
Bing Robot |
5 734 |
4 |
AhrefsBot |
3 928 |
5 |
Ezooms Robot |
1 929 |
6 |
Mozilla/5.0 (compatible; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots) |
886 |
7 |
Google Preview Robot |
609 |
8 |
Nutch/Nutch-2.0 (Nutch Crawler) |
511 |
9 |
Nutch Experimental Crawler/Nutch-1.4 |
400 |
10 |
Mozilla/5.0 (compatible; Nigma.ru/3.0; crawler@nigma.ru) |
297 |
11 |
Mozilla/5.0 (compatible; SWEBot/1.0; +http://swebot-crawler.net) |
222 |
12 |
Baidu Spider |
82 |
13 |
SurveyBot |
53 |
14 |
Powermarks |
50 |
15 |
Netcraft Spider |
45 |
16 |
Mozilla/5.0 (compatible; crawler/3.1.0-SNAPSHOT-20110914.213704 +http://www.notconfigured.com/) |
37 |
17 |
Mozilla/5.0 (compatible; oBot/2.3.1; +http://filterdb.iss.net/crawler/) |
31 |
18 |
EC2LinkFinder |
28 |
19 |
COMODOSpider/Nutch-1.2 |
20 |
20 |
Bing Preview Robot |
19 |
21 |
Nutch Experimental Crawler/Nutch-2.0-dev |
18 |
22 |
MJ12bot |
14 |
23 |
FaceBook Crawler |
12 |
24 |
Entireweb Robot |
10 |
25 |
PagePeeker.com (info: http://pagepeeker.com/robots) |
8 |
26 |
MSIE Crawler |
7 |
27 |
SemrushBot |
6 |
28 |
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/535.21 (KHTML, like Gecko) Chrome/19.0.1042.0 Safari/535.21 PagePeeker/2.1; +http://pagepeeker.com/robots/ |
4 |
29 |
Perl LWP |
3 |
30 |
Comodo-Certificates-Spider |
3 |
31 |
Zealbot |
3 |
32 |
DLE_Spider.exe |
2 |
33 |
Alexa Robot |
2 |
34 |
Mozilla (Search Spider) |
2 |
35 |
sGroup crawler 1/Nutch-1.3 |
2 |
36 |
Larbin |
2 |
37 |
Yahoo! Slurp |
1 |
38 |
Spider |
1 |
39 |
Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html;) Gecko/2008032620 |
1 |
40 |
Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html) Gecko/2008032620 |
1 |
41 |
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Tailrank; http://tailrank.com/robot) Gecko/20021130 |
1 |
42 |
PagesInventory (robot http://www.pagesinventory.com) |
1 |
43 |
PagesInventory (robot http://www.pagesinvenotry.com) |
1 |
44 |
Mozilla/5.0 (compatible; CompSpyBot/1.0; +http://www.compspy.com/spider.html) |
1 |
|
Всего |
114 426 |