Most obscure user-agents

User-Agent Mentions
(%)
(%)
Sgworm 1 0.0% 1 100% 0 0 0 0 0 0
Googlebot-Arabic 1 0.0% 0 0% 1 0 0 0 0 0
RakutenMarketingBot 1 0.0% 1 100% 0 0 0 0 0 0
MaintainBot 1 0.0% 0 0% 1 0 0 0 0 0
AdsBot Google Mobile Apps 1 0.0% 0 0% 0 0 0 0 1 0
BLP_168 1 0.0% 1 100% 0 0 0 0 0 0
Crescent-Internet-ToolPak-HTTP-OLE-Control-v.1.0 1 0.0% 1 100% 0 0 0 0 0 0
Aqzc Bot 1 0.0% 1 100% 0 0 0 0 0 0
J-Browser 1 0.0% 1 100% 0 0 0 0 0 0
pagepeekergg 1 0.0% 0 0% 0 0 1 0 0 0
migrants.in 1 0.0% 1 100% 0 0 0 0 0 0
StarProse Referrer Advertising System 2004 1 0.0% 1 100% 0 0 0 0 0 0
cEasy GutFinder 1 0.0% 0 0% 0 0 0 0 1 0
PermitAIBot 1 0.0% 0 0% 1 0 0 0 0 0
Python reguests 1 0.0% 0 0% 0 0 0 0 1 0
LineBotUserAgent 1 0.0% 0 0% 1 0 0 0 0 0
Crowbot 1 0.0% 1 100% 0 0 0 0 0 0
zzzz 1 0.0% 1 100% 0 0 0 0 0 0
---------->Robots.txt Plugin For Wapkiz 1 0.0% 0 0% 0 0 0 0 1 0
SeeAIBot 1 0.0% 0 0% 1 0 0 0 0 0
ec2-3-149-213-206.us-east-2.compute.amazonaws.com 1 0.0% 1 100% 0 0 0 0 0 0
*Disallow wp-admin 1 0.0% 0 0% 0 0 0 1 0 0
LaMDA-Bot 1 0.0% 0 0% 1 0 0 0 0 0
Baykov Ilya Sergeevich 1 0.0% 1 100% 0 0 0 0 0 0
facilityaccessing 1 0.0% 0 0% 0 0 0 1 0 0
pipe-catcher 1 0.0% 1 100% 0 0 0 0 0 0
Notion-Bot 1 0.0% 0 0% 1 0 0 0 0 0
Feedspot-Bot 1 0.0% 0 0% 1 0 0 0 0 0
TsraBot 1 0.0% 0 0% 0 0 1 0 0 0
PardotBot 1 0.0% 0 0% 0 0 0 1 0 0
faq me 1 0.0% 0 0% 0 0 1 0 0 0
Ddvw Bot 1 0.0% 1 100% 0 0 0 0 0 0
preact 1 0.0% 0 0% 1 0 0 0 0 0
feedbackify 1 0.0% 0 0% 1 0 0 0 0 0
TwengaBot Disallow : Crawl-delay : 0 1 0.0% 0 0% 0 0 0 0 1 0
Student Membership Login 1 0.0% 0 0% 0 0 1 0 0 0
wxWidgets 1 0.0% 1 100% 0 0 0 0 0 0
Boaxxe 1 0.0% 1 100% 0 0 0 0 0 0
crawl-agent 1 0.0% 1 100% 0 0 0 0 0 0
custom-async 1 0.0% 1 100% 0 0 0 0 0 0
vu-server-health-scanner 1 0.0% 1 100% 0 0 0 0 0 0
SquidClamAV_Redirector 1.x.x 1 0.0% 0 0% 0 0 0 0 1 0
KoalaWriter 1 0.0% 0 0% 0 0 1 0 0 0
Scaricare Demon/3.2.0.8 1 0.0% 1 100% 0 0 0 0 0 0
SimilarWebAnalyzer 1 0.0% 1 100% 0 0 0 0 0 0
AllAbout 1 0.0% 0 0% 1 0 0 0 0 0
lookiethere16 1 0.0% 1 100% 0 0 0 0 0 0
Go-http-client-bad-bot 1 0.0% 1 100% 0 0 0 0 0 0
twilio 1 0.0% 0 0% 1 0 0 0 0 0
Paviik 1 0.0% 1 100% 0 0 0 0 0 0
fedineko-crabo 1 0.0% 1 100% 0 0 0 0 0 0
BuiltWith-Bot 1 0.0% 0 0% 1 0 0 0 0 0
SellTheTrend 1 0.0% 1 100% 0 0 0 0 0 0
MaliciousBotX 1 0.0% 1 100% 0 0 0 0 0 0
LinkHarvester 1 0.0% 1 100% 0 0 0 0 0 0
product-search-83-99-151-71.geedo.com 1 0.0% 1 100% 0 0 0 0 0 0
MNSBot-news 1 0.0% 1 100% 0 0 0 0 0 0
DescribeBot 1 0.0% 0 0% 1 0 0 0 0 0
PinGeneratorBot 1 0.0% 0 0% 1 0 0 0 0 0
elementskit_content-sitemap.xml 1 0.0% 1 100% 0 0 0 0 0 0
ShoppingFeed 1 0.0% 1 100% 0 0 0 0 0 0
*replytocom 1 0.0% 0 0% 0 0 1 0 0 0
defibot 1 0.0% 0 0% 1 0 0 0 0 0
LTgZBH9oyDvy5p03Rgkiw 1 0.0% 0 0% 1 0 0 0 0 0
acciona 1 0.0% 1 100% 0 0 0 0 0 0
phillipspoem 1 0.0% 0 0% 0 0 0 1 0 0
dlcjianzhu.com 1 0.0% 1 100% 0 0 0 0 0 0
alamy 1 0.0% 1 100% 0 0 0 0 0 0
TigApiBot 1 0.0% 0 0% 1 0 0 0 0 0
Clay 1 0.0% 1 100% 0 0 0 0 0 0
MinimizeBot 1 0.0% 0 0% 1 0 0 0 0 0
a01.vip 1 0.0% 0 0% 0 0 0 0 1 0
Qwantbot-prod96533 1 0.0% 1 100% 0 0 0 0 0 0
ActivateAIBot 1 0.0% 0 0% 1 0 0 0 0 0
liveup 1 0.0% 1 100% 0 0 0 0 0 0
Rwgo Bot 1 0.0% 1 100% 0 0 0 0 0 0
AnyScale 1 0.0% 0 0% 0 0 0 1 0 0
automatedtraffic4free* 1 0.0% 1 100% 0 0 0 0 0 0
KagiAPI 1 0.0% 1 100% 0 0 0 0 0 0
nog 1 0.0% 1 100% 0 0 0 0 0 0
LingoliaBot 1 0.0% 0 0% 0 0 0 1 0 0
DataForSeoBot clark-crawler2/Nutch-1.19-SNAPSHOT 1 0.0% 1 100% 0 0 0 0 0 0
webhubsites.com 1 0.0% 1 100% 0 0 0 0 0 0
Llama-web 1 0.0% 1 100% 0 0 0 0 0 0
Epwn Bot 1 0.0% 1 100% 0 0 0 0 0 0
Bicl Bot 1 0.0% 1 100% 0 0 0 0 0 0
Google Mobile AdsBot 1 0.0% 0 0% 1 0 0 0 0 0
mindman 1 0.0% 1 100% 0 0 0 0 0 0
Alexandrova.school 1 0.0% 0 0% 1 0 0 0 0 0
static-23-234-93-37.cust.tzulo.com 1 0.0% 1 100% 0 0 0 0 0 0
bingbot-CN 1 0.0% 1 100% 0 0 0 0 0 0
blackcurve 1 0.0% 1 100% 0 0 0 0 0 0
Crossref-Bot 1 0.0% 0 0% 1 0 0 0 0 0
child-proofing-a-phone 1 0.0% 1 100% 0 0 0 0 0 0
guzzlehttp7 1 0.0% 1 100% 0 0 0 0 0 0
Lodeight 1 0.0% 1 100% 0 0 0 0 0 0
rawdog 1 0.0% 1 100% 0 0 0 0 0 0
BrainlyBot 1 0.0% 0 0% 1 0 0 0 0 0
Facebook-AI-Research 1 0.0% 1 100% 0 0 0 0 0 0
Bot de Archive.org 1 0.0% 1 100% 0 0 0 0 0 0

Download

The full dataset is available under a Creative Commons Attribution 4.0 International license.