serpstatbot
Avg Crawl Delay (when set) 78s
Mentions
1,183,164
0.08% of hostnames
Disallow All
1,074,076
90% of mentions
Allow
74,497
6% of mentions
Disallow All
+ Allow Some
+ Allow Some
39
0% of mentions
Disallow Some
17,870
1% of mentions
Disallow Some
+ Allow Some
+ Allow Some
357
0% of mentions
No Directives
16,318
1% of mentions
Average Crawl Delay
78
(when set)