Feedfetcher-Google
Avg Crawl Delay (when set) 248s
Mentions
274,160
0.02% of hostnames
Disallow All
45,278
16% of mentions
Allow
197,612
72% of mentions
Disallow All
+ Allow Some
+ Allow Some
156
0% of mentions
Disallow Some
1,009
0% of mentions
Disallow Some
+ Allow Some
+ Allow Some
27,327
9% of mentions
No Directives
2,777
1% of mentions
Average Crawl Delay
248
(when set)