GoogleOther-Image
Avg Crawl Delay (when set) 10s
Mentions
2,358,623
0.18% of hostnames
Disallow All
226,839
9% of mentions
Allow
1,922
0% of mentions
Disallow All
+ Allow Some
+ Allow Some
2,290
0% of mentions
Disallow Some
990
0% of mentions
Disallow Some
+ Allow Some
+ Allow Some
2,048,368
86% of mentions
No Directives
78,197
3% of mentions
Average Crawl Delay
10
(when set)