Yandex
Avg Crawl Delay (when set) 30s
Mentions
9,976,973
0.76% of hostnames
Disallow All
1,038,444
10% of mentions
Allow
207,383
2% of mentions
Disallow All
+ Allow Some
+ Allow Some
7,071,023
70% of mentions
Disallow Some
599,957
6% of mentions
Disallow Some
+ Allow Some
+ Allow Some
682,261
6% of mentions
No Directives
377,713
3% of mentions
Average Crawl Delay
30
(when set)