YisouSpider
Avg Crawl Delay (when set) 439s
Mentions
567,586
0.04% of hostnames
Disallow All
291,364
51% of mentions
Allow
102,456
18% of mentions
Disallow All
+ Allow Some
+ Allow Some
3,816
0% of mentions
Disallow Some
16,193
2% of mentions
Disallow Some
+ Allow Some
+ Allow Some
4,250
0% of mentions
No Directives
149,480
26% of mentions
Average Crawl Delay
439
(when set)