Robot

User Agent Families

Nutch (18 user agent strings)

YandexBot (8 user agent strings)

NimbleCrawler (7 user agent strings)

ichiro (6 user agent strings)

boitho.com-dc (5 user agent strings)

CazoodleBot (5 user agent strings)

ccubee (5 user agent strings)

SeznamBot (5 user agent strings)

BecomeBot (4 user agent strings)

flatlandbot (4 user agent strings)

Googlebot (4 user agent strings)

MQbot (4 user agent strings)

MSNBot (4 user agent strings)

MSRBOT (4 user agent strings)

SBIder (4 user agent strings)

spbot (4 user agent strings)

yacybot (4 user agent strings)

Yahoo! (4 user agent strings)

Yahoo! JAPAN (4 user agent strings)

AboutUsBot (3 user agent strings)

80legs (3 user agent strings)

Daumoa (3 user agent strings)

EDI (3 user agent strings)

findlinks (3 user agent strings)

Girafabot (3 user agent strings)

LemurWebCrawler (3 user agent strings)

mozDex (3 user agent strings)

oBot (3 user agent strings)

Speedy (3 user agent strings)

Sproose (3 user agent strings)

Steeler (3 user agent strings)

Vagabondo (3 user agent strings)

WebarooBot (3 user agent strings)

YodaoBot (3 user agent strings)

ZyBorg (3 user agent strings)

Falconsbot (2 user agent strings)

gonzo (2 user agent strings)

Krugle (2 user agent strings)

LapozzBot (2 user agent strings)

Accoona-AI-Agent (2 user agent strings)

AhrefsBot (2 user agent strings)

Almaden (2 user agent strings)

Baiduspider (2 user agent strings)

baypup (2 user agent strings)

Bigsearch.ca (2 user agent strings)

BlogPulse (2 user agent strings)

CatchBot (2 user agent strings)

Covario-IDS (2 user agent strings)

DataFountains (2 user agent strings)

del.icio.us-thumbnails (2 user agent strings)

FacebookExternalHit (2 user agent strings)

ia_archiver (2 user agent strings)

IlTrovatore-Setaccio (2 user agent strings)

IRLbot (2 user agent strings)

Kalooga (2 user agent strings)

Link Valet Online (2 user agent strings)

LinkWalker (2 user agent strings)

Mail.Ru (2 user agent strings)

MJ12bot (2 user agent strings)

MojeekBot (2 user agent strings)

MyFamilyBot (2 user agent strings)

NaverBot (2 user agent strings)

NetResearchServer (2 user agent strings)

NextGenSearchBot (2 user agent strings)

NG-Search (2 user agent strings)

OOZBOT (2 user agent strings)

owsBot (2 user agent strings)

Plukkie (2 user agent strings)

Sirketce/Busiverse (2 user agent strings)

Snapbot (2 user agent strings)

sogou spider (2 user agent strings)

Spinn3r (2 user agent strings)

Szukacz (2 user agent strings)

thumbshots-de-Bot (2 user agent strings)

TurnitinBot (2 user agent strings)

Twiceler (2 user agent strings)

VMBot (2 user agent strings)

VoilaBot (2 user agent strings)

WatchMouse (2 user agent strings)

WebAlta Crawler (2 user agent strings)

GarlikCrawler (2 user agent strings)

SEOENGBot (2 user agent strings)

Acorn (1 user agent strings)

aiHitBot (1 user agent strings)

cityreview (1 user agent strings)

discobot (1 user agent strings)

DKIMRepBot (1 user agent strings)

EnaBot (1 user agent strings)

Forschungsportal (1 user agent strings)

GeonaBot (1 user agent strings)

HeartRails_Capture (1 user agent strings)

heritrix (1 user agent strings)

iaskspider (1 user agent strings)

JadynAveBot (1 user agent strings)

Kakle Bot (1 user agent strings)

linksmanager_bot (1 user agent strings)

Mp3Bot (1 user agent strings)

MultiCrawler (1 user agent strings)

NetcraftSurveyAgent (1 user agent strings)

Orbiter (1 user agent strings)

PageBitesHyperBot (1 user agent strings)

Scarlett (1 user agent strings)

Tagoobot (1 user agent strings)

Theophrastus (1 user agent strings)

ThumbShots-Bot (1 user agent strings)

VWBot (1 user agent strings)

ZoomSpider (ZSEBOT) (1 user agent strings)

192.comAgent (1 user agent strings)

Aboundexbot (1 user agent strings)

Acoon-Robot (1 user agent strings)

adressendeutschland.de (1 user agent strings)

AdsBot-Google (1 user agent strings)

aippie (1 user agent strings)

Amagit.COM (1 user agent strings)

Amfibibot (1 user agent strings)

amibot (1 user agent strings)

AntBot (1 user agent strings)

arachnode.net (1 user agent strings)

archive.org_bot (1 user agent strings)

Ask Jeeves/Teoma (1 user agent strings)

BabalooSpider (1 user agent strings)

BDFetch (1 user agent strings)

bingbot (1 user agent strings)

bitlybot (1 user agent strings)

Blaiz-Bee (1 user agent strings)

botmobi (1 user agent strings)

Butterfly (1 user agent strings)

ChangeDetection (1 user agent strings)

Charlotte (1 user agent strings)

CligooRobot (1 user agent strings)

Combine (1 user agent strings)

Crawler4j (1 user agent strings)

csci_b659 (1 user agent strings)

DealGates Bot (1 user agent strings)

DomainDB (1 user agent strings)

DotBot (1 user agent strings)

e-SocietyRobot (1 user agent strings)

ejupiter.com (1 user agent strings)

envolk (1 user agent strings)

EvriNid (1 user agent strings)

Exabot (1 user agent strings)

ExactSEEK (1 user agent strings)

FAST Enterprise Crawler (1 user agent strings)

FAST MetaWeb Crawler (1 user agent strings)

Findexa Crawler (1 user agent strings)

Flatland Industries Web Spider (1 user agent strings)

FlightDeckReportsBot (1 user agent strings)

FlipboardProxy (1 user agent strings)

FollowSite Bot (1 user agent strings)

Francis (1 user agent strings)

FurlBot (1 user agent strings)

FyberSpider (1 user agent strings)

genieBot (1 user agent strings)

Giant/1.0 (1 user agent strings)

Gigabot (1 user agent strings)

GingerCrawler (1 user agent strings)

GOFORITBOT (1 user agent strings)

Hailoobot (1 user agent strings)

HatenaScreenshot (1 user agent strings)

HiddenMarket (1 user agent strings)

HolmesBot (1 user agent strings)

ICC-Crawler (1 user agent strings)

IlseBot (1 user agent strings)

IlTrovatore (1 user agent strings)

Jambot (1 user agent strings)

Jyxobot (1 user agent strings)

Kongulo (1 user agent strings)

KRetrieve (1 user agent strings)

L.webis (1 user agent strings)

LexxeBot (1 user agent strings)

LinguaBot (1 user agent strings)

Linguee Bot (1 user agent strings)

LinkAider (1 user agent strings)

livedoor ScreenShot (1 user agent strings)

lmspider (1 user agent strings)

magpie-crawler (1 user agent strings)

Metaspinner/0.01 (1 user agent strings)

MetaURI (1 user agent strings)

miniRank (1 user agent strings)

MLBot (1 user agent strings)

moba-crawler (1 user agent strings)

Motoricerca-Robots.txt-Checker (1 user agent strings)

Najdi.si (1 user agent strings)

Netintelligence LiveAssessment (1 user agent strings)

NetWhatCrawler (1 user agent strings)

NG (1 user agent strings)

noyona (1 user agent strings)

NPBot (1 user agent strings)

NuSearch Spider (1 user agent strings)

OrgbyBot (1 user agent strings)

OsObot (1 user agent strings)

page_verifier (1 user agent strings)

Panscient web crawler (1 user agent strings)

Peew (1 user agent strings)

Pingdom GIGRIB (1 user agent strings)

Pogodak.co.yu (1 user agent strings)

Pompos (1 user agent strings)

PostPost (1 user agent strings)

psbot (1 user agent strings)

Qirina Hurdler (1 user agent strings)

Qseero (1 user agent strings)

Qualidator.com Bot (1 user agent strings)

Quantcastbot (1 user agent strings)

quickobot (1 user agent strings)

R6 bot (1 user agent strings)

RedBot (1 user agent strings)

Robots_Tester (1 user agent strings)

Robozilla (1 user agent strings)

RSSMicro.com RSS/Atom Feed Robot (1 user agent strings)

SAI Crawler (1 user agent strings)

ScollSpider (1 user agent strings)

Scooter (1 user agent strings)

ScoutJet (1 user agent strings)

Search Engine World Robots.txt Validator (1 user agent strings)

Search17Bot (1 user agent strings)

Sensis Web Crawler (1 user agent strings)

SEODat (1 user agent strings)

SEOkicks-Robot (1 user agent strings)

Shelob (1 user agent strings)

Shim-Crawler (1 user agent strings)

snap.com (1 user agent strings)

Snappy (1 user agent strings)

Sogou (1 user agent strings)

Sosospider (1 user agent strings)

SpokeSpider (1 user agent strings)

SSLBot (1 user agent strings)

StackRambler (1 user agent strings)

suggybot (1 user agent strings)

Surphace Scout (1 user agent strings)

SurveyBot (1 user agent strings)

SygolBot (1 user agent strings)

taptubot (1 user agent strings)

Thumbnail.CZ robot (1 user agent strings)

Thumbshots.ru (1 user agent strings)

TinEye (1 user agent strings)

TwengaBot (1 user agent strings)

UnwindFetchor (1 user agent strings)

updated (1 user agent strings)

virus_detector (1 user agent strings)

visbot (1 user agent strings)

void-bot (1 user agent strings)

voyager (1 user agent strings)

WebImages (1 user agent strings)

wikiwix-bot (1 user agent strings)

Willow Internet Crawler (1 user agent strings)

WinkBot (1 user agent strings)

WinWebBot (1 user agent strings)

WIRE (1 user agent strings)

woriobot (1 user agent strings)

www.fi crawler (1 user agent strings)

wwwster (1 user agent strings)

Yanga (1 user agent strings)

Yoono Bot (1 user agent strings)

YoudaoBot (1 user agent strings)

YowedoBot (1 user agent strings)

Zeusbot (1 user agent strings)

^Nail (1 user agent strings)

HuaweiSymantecSpider (1 user agent strings)

BacklinkCrawler (1 user agent strings)

bixolabs (1 user agent strings)

linkdex.com (1 user agent strings)

MetaGeneratorCrawler (1 user agent strings)

MnoGoSearch (1 user agent strings)

NerdByNature.Bot (1 user agent strings)

RankurBot (1 user agent strings)

Setoozbot (1 user agent strings)

sistrix (1 user agent strings)

StatoolsBot (1 user agent strings)

Yaanb (1 user agent strings)

YRSpider (1 user agent strings)

ZookaBot (1 user agent strings)

HostTracker.com (1 user agent strings)