Pandalytics
Avg Crawl Delay (when set) 148s
Mentions
7,452,657
0.52% of hostnames
Disallow All
169,995
2% of mentions
Allow
60
0% of mentions
Disallow All
+ Allow Some
+ Allow Some
449
0% of mentions
Disallow Some
7,281,105
97% of mentions
Disallow Some
+ Allow Some
+ Allow Some
264
0% of mentions
No Directives
782
0% of mentions
Average Crawl Delay
148
(when set)