AdsBot-Google
Avg Crawl Delay (when set) 12s
Mentions
14,627,335
1.23% of hostnames
Disallow All
68,381
0% of mentions
Allow
395,083
2% of mentions
Disallow All
+ Allow Some
+ Allow Some
22,945
0% of mentions
Disallow Some
10,474,230
71% of mentions
Disallow Some
+ Allow Some
+ Allow Some
3,395,828
23% of mentions
No Directives
270,820
1% of mentions
Average Crawl Delay
12
(when set)