Baiduspider
Avg Crawl Delay (when set) 36s
Mentions
15,378,609
1.16% of hostnames
Disallow All
8,952,075
58% of mentions
Allow
491,337
3% of mentions
Disallow All
+ Allow Some
+ Allow Some
25,303
0% of mentions
Disallow Some
5,269,715
34% of mentions
Disallow Some
+ Allow Some
+ Allow Some
169,892
1% of mentions
No Directives
470,224
3% of mentions
Average Crawl Delay
36
(when set)