Applebot-Extended
Avg Crawl Delay (when set) 10s
Mentions
10,106,911
0.72% of hostnames
Disallow All
6,051,116
59% of mentions
Allow
54,420
0% of mentions
Disallow All
+ Allow Some
+ Allow Some
58,839
0% of mentions
Disallow Some
5,366
0% of mentions
Disallow Some
+ Allow Some
+ Allow Some
3,855,558
38% of mentions
No Directives
81,564
0% of mentions
Average Crawl Delay
10
(when set)