Seznambot
Avg Crawl Delay (when set) 292s
Mentions
5,978,318
0.41% of hostnames
Disallow All
531,894
8% of mentions
Allow
12,075
0% of mentions
Disallow All
+ Allow Some
+ Allow Some
1,199
0% of mentions
Disallow Some
5,382,393
90% of mentions
Disallow Some
+ Allow Some
+ Allow Some
37,646
0% of mentions
No Directives
13,096
0% of mentions
Average Crawl Delay
292
(when set)