GoogleOther-Image
Avg Crawl Delay (when set) 10s
Mentions
3,086,614
0.22% of hostnames
Disallow All
348,770
11% of mentions
Allow
2,496
0% of mentions
Disallow All
+ Allow Some
+ Allow Some
2,372
0% of mentions
Disallow Some
1,974
0% of mentions
Disallow Some
+ Allow Some
+ Allow Some
2,652,388
85% of mentions
No Directives
78,597
2% of mentions
Average Crawl Delay
10
(when set)