YandexBot
Avg Crawl Delay (when set) 84s
Mentions
5,697,575
0.48% of hostnames
Disallow All
949,794
16% of mentions
Allow
59,900
1% of mentions
Disallow All
+ Allow Some
+ Allow Some
20,889
0% of mentions
Disallow Some
4,600,236
80% of mentions
Disallow Some
+ Allow Some
+ Allow Some
21,905
0% of mentions
No Directives
44,788
0% of mentions
Average Crawl Delay
84
(when set)