*

Mentions
227,322,456
17.22% of hostnames
Disallow All
32,458,787
14% of mentions
Allow
56,352,596
24% of mentions
Disallow All
+ Allow Some
548,212
0% of mentions
Disallow Some
42,322,477
18% of mentions
Disallow Some
+ Allow Some
63,800,792
28% of mentions
No Directives
31,742,422
13% of mentions
Average Crawl Delay
82
(when set)