Robots |
1 | 1202 | 36.19 | DotBot/1.1 |
2 | 496 | 14.94 | SemrushBot/1.2~bl |
3 | 344 | 10.36 | linkdexbot/2.0 |
4 | 330 | 9.94 | MJ12bot/v1.4.7 |
5 | 225 | 6.78 | Googlebot/2.1 |
6 | 206 | 6.20 | YandexBot/3.0 |
7 | 135 | 4.07 | compatible Mozilla/5.0 |
8 | 115 | 3.46 | bingbot/2.0 |
9 | 58 | 1.75 | MJ12bot/v1.4.8 |
10 | 57 | 1.72 | Sogou web spider/4.0(+http://www.sogou.c... |
11 | 32 | 0.96 | AhrefsBot/5.2 |
12 | 22 | 0.66 | Yahoo! Slurp |
13 | 15 | 0.45 | SeznamBot/3.2 |
14 | 10 | 0.30 | Linux x86_64 |
15 | 10 | 0.30 | SnowHaze Search/1.0 support@snowhaze.com |
16 | 8 | 0.24 | ia_archiver |
17 | 6 | 0.18 | - |
18 | 5 | 0.15 | SiteExplorer/1.1b |
19 | 5 | 0.15 | Cliqzbot/2.0 |
20 | 5 | 0.15 | CCBot/2.0 (http://commoncrawl.org/faq/) |
21 | 4 | 0.12 | spbot/5.0.3 |
22 | 4 | 0.12 | SEOkicks-Robot |
23 | 4 | 0.12 | MBCrawler/1.0 (https://monitorbacklinks.... |
24 | 3 | 0.09 | PiplBot (+http://www.pipl.com/bot/) |
25 | 3 | 0.09 | GarlikCrawler/1.2 (http://garlik.com/, c... |
26 | 2 | 0.06 | SafeDNSBot (https://www.safedns.com/sear... |
27 | 2 | 0.06 | G-i-g-a-b-o-t |
28 | 2 | 0.06 | SMTBot/1.0 |
29 | 2 | 0.06 | MSIE 5.01 |
30 | 2 | 0.06 | Findxbot/1.0 |
31 | 1 | 0.03 | istellabot/t.1.13 |
32 | 1 | 0.03 | Uptimebot/1.0 |
33 | 1 | 0.03 | MegaIndex.ru/2.0 |
34 | 1 | 0.03 | Quick-Crawler (+https://www.scrapinghub.... |
35 | 1 | 0.03 | 007ac9 Crawler |
36 | 1 | 0.03 | Go-http-client/1.1 |
37 | 1 | 0.03 | MojeekBot/0.6 |