YetiBot
Avg Crawl Delay (when set) 1157s
Mentions
5,146,664
0.39% of hostnames
Disallow All
4,202
0% of mentions
Allow
258
0% of mentions
Disallow All
+ Allow Some
+ Allow Some
1
0% of mentions
Disallow Some
5,141,001
99% of mentions
Disallow Some
+ Allow Some
+ Allow Some
115
0% of mentions
No Directives
1,087
0% of mentions
Average Crawl Delay
1157
(when set)