LinkedInBot
Avg Crawl Delay (when set) 9s
Mentions
254,960
0.02% of hostnames
Disallow All
21,423
8% of mentions
Allow
101,426
39% of mentions
Disallow All
+ Allow Some
+ Allow Some
23,777
9% of mentions
Disallow Some
18,467
7% of mentions
Disallow Some
+ Allow Some
+ Allow Some
57,886
22% of mentions
No Directives
31,971
12% of mentions
Average Crawl Delay
9
(when set)