Robots |
1 | 132 | 18.64 | Googlebot/2.1 |
2 | 127 | 17.94 | compatible Mozilla/5.0 |
3 | 110 | 15.54 | YandexBot/3.0 |
4 | 105 | 14.83 | bingbot/2.0 |
5 | 55 | 7.77 | Linux x86_64 |
6 | 55 | 7.77 | MJ12bot/v1.4.5 |
7 | 23 | 3.25 | DotBot/1.1 |
8 | 19 | 2.68 | AhrefsBot/5.0 |
9 | 14 | 1.98 | Baiduspider/2.0 |
10 | 11 | 1.55 | - |
11 | 8 | 1.13 | Exabot/3.0 |
12 | 6 | 0.85 | Sogou web spider/4.0(+http://www.sogou.c... |
13 | 5 | 0.71 | meanpathbot/1.0 |
14 | 4 | 0.56 | msnbot-media/1.1 (+http://search.msn.com... |
15 | 4 | 0.56 | SISTRIX Crawler |
16 | 4 | 0.56 | Exabot/3.0 (BiggerBetter) |
17 | 4 | 0.56 | BLEXBot/1.0 |
18 | 4 | 0.56 | archive.org_bot |
19 | 3 | 0.42 | EasouSpider |
20 | 2 | 0.28 | rogerbot/1.0 (http://moz.com/help/pro/wh... |
21 | 2 | 0.28 | oBot/2.3.1 |
22 | 2 | 0.28 | Python-urllib/2.7 |
23 | 2 | 0.28 | Wotbox/2.01 (+http://www.wotbox.com/bot/... |
24 | 2 | 0.28 | WebIndex |
25 | 2 | 0.28 | PagesInventory (robot http://www.pagesin... |
26 | 2 | 0.28 | Gimme60bot/1.0 |
27 | 1 | 0.14 | nutch-1.4/Nutch-1.4 |