Zeus
Avg Crawl Delay (when set) 394s
Mentions
1,408,248
0.1% of hostnames
Disallow All
1,405,528
99% of mentions
Allow
198
0% of mentions
Disallow All
+ Allow Some
+ Allow Some
608
0% of mentions
Disallow Some
553
0% of mentions
Disallow Some
+ Allow Some
+ Allow Some
152
0% of mentions
No Directives
1,206
0% of mentions
Average Crawl Delay
394
(when set)