*

Mentions
220,828,261
16.93% of hostnames
Disallow All
30,995,119
14% of mentions
Allow
52,748,555
23% of mentions
Disallow All
+ Allow Some
531,171
0% of mentions
Disallow Some
42,016,921
19% of mentions
Disallow Some
+ Allow Some
63,458,472
28% of mentions
No Directives
31,009,925
14% of mentions
Average Crawl Delay
82
(when set)