YandexBot
Avg Crawl Delay (when set) 80s
Mentions
6,659,766
0.48% of hostnames
Disallow All
1,076,107
16% of mentions
Allow
177,795
2% of mentions
Disallow All
+ Allow Some
+ Allow Some
21,094
0% of mentions
Disallow Some
5,290,303
79% of mentions
Disallow Some
+ Allow Some
+ Allow Some
42,791
0% of mentions
No Directives
51,602
0% of mentions
Average Crawl Delay
80
(when set)