Zeus
Avg Crawl Delay (when set) 420s
Mentions
1,360,529
0.12% of hostnames
Disallow All
1,358,063
99% of mentions
Allow
187
0% of mentions
Disallow All
+ Allow Some
+ Allow Some
574
0% of mentions
Disallow Some
550
0% of mentions
Disallow Some
+ Allow Some
+ Allow Some
132
0% of mentions
No Directives
1,019
0% of mentions
Average Crawl Delay
420
(when set)