Applebot-Extended
Avg Crawl Delay (when set) 10s
Mentions
8,278,025
0.63% of hostnames
Disallow All
4,067,732
49% of mentions
Allow
15,483
0% of mentions
Disallow All
+ Allow Some
+ Allow Some
57,474
0% of mentions
Disallow Some
4,745
0% of mentions
Disallow Some
+ Allow Some
+ Allow Some
4,051,706
48% of mentions
No Directives
80,846
0% of mentions
Average Crawl Delay
10
(when set)