Googlebot-Video
Avg Crawl Delay (when set) 28s
Mentions
193,938
0.02% of hostnames
Disallow All
17,968
9% of mentions
Allow
35,430
18% of mentions
Disallow All
+ Allow Some
+ Allow Some
21,057
10% of mentions
Disallow Some
5,510
2% of mentions
Disallow Some
+ Allow Some
+ Allow Some
101,114
52% of mentions
No Directives
12,848
6% of mentions
Average Crawl Delay
28
(when set)