Robots |
1 | 476 | 30.22 | Ezooms/1.0 |
2 | 282 | 17.90 | compatible Mozilla/5.0 |
3 | 187 | 11.87 | Googlebot/2.1 |
4 | 158 | 10.03 | MJ12bot/v1.4.3 |
5 | 102 | 6.48 | bingbot/2.0 |
6 | 67 | 4.25 | YandexBot/3.0 |
7 | 55 | 3.49 | msnbot-media/1.1 (+http://search.msn.com... |
8 | 53 | 3.37 | msnbot/2.0b (+http://search.msn.com/msnb... |
9 | 41 | 2.60 | Sogou web spider/4.0 |
10 | 20 | 1.27 | Exabot/3.0 |
11 | 18 | 1.14 | Mail.RU_Bot/2.0 |
12 | 12 | 0.76 | YoudaoBot/1.0 |
13 | 11 | 0.70 | CompSpyBot/1.0 |
14 | 8 | 0.51 | OpenWebIndex/Nutch-1.6 |
15 | 8 | 0.51 | AhrefsBot/4.0 |
16 | 8 | 0.51 | SISTRIX Crawler |
17 | 5 | 0.32 | Web front page analyser. robots.txt comp... |
18 | 5 | 0.32 | YandexMedia/3.0 |
19 | 5 | 0.32 | Mysite/Nutch-2.0 |
20 | 4 | 0.25 | ia_archiver(OS-Wayback) |
21 | 4 | 0.25 | Nutch Spider/Nutch-1.6 |
22 | 4 | 0.25 | linkdex.com/v2.0 |
23 | 4 | 0.25 | proximic |
24 | 4 | 0.25 | Firefox/3.6 |
25 | 3 | 0.19 | YandexImages/3.0 |
26 | 3 | 0.19 | InboundScore/Nutch-1.4 (http://InboundSc... |
27 | 3 | 0.19 | Sosospider+(+http://help.soso.com/webspi... |
28 | 2 | 0.13 | Wotbox/2.01 (+http://www.wotbox.com/bot/... |
29 | 2 | 0.13 | MSIE 7.0 |
30 | 2 | 0.13 | LSSRocketCrawler/1.0 LightspeedSystems |
31 | 2 | 0.13 | SeznamBot/3.0 (+http://fulltext.sblog.cz... |
32 | 2 | 0.13 | MSIE 6.0 |
33 | 2 | 0.13 | Exabot/3.0 (BiggerBetter) |
34 | 2 | 0.13 | BacklinkCrawler (http://www.backlinktest... |
35 | 2 | 0.13 | Nutch Spider/Nutch-1.4 |
36 | 1 | 0.06 | Nutch/Nutch-2.0 (Nutch Crawler) |
37 | 1 | 0.06 | Python-urllib/2.7 |
38 | 1 | 0.06 | Sogou web spider/4.0(+http://www.sogou.c... |
39 | 1 | 0.06 | findlinks/2.6 (+http://wortschatz.uni-le... |
40 | 1 | 0.06 | AcoonBot/4.11.1 |
41 | 1 | 0.06 | - |
42 | 1 | 0.06 | www.integromedb.org/Crawler |
43 | 1 | 0.06 | MSIE 5.01 |
44 | 1 | 0.06 | PagesInventory (robot http://www.pagesin... |