200PleaseBot
360Spider
4seohuntBot
ABCdatos BotLink
Aboundex
Aboundexbot
AboutUsBot
AdsBot-Google
Ahoy! The Homepage Finder
AhrefsBot
aiHitBot
AMZNKAssocBot
Arachnophilia
ArchitextSpider
archive.org_bot
arks
asterias
BaiduSpider
BDFetch
Big Brother
Bingbot
BingPreview
bjaaland
BlackWidow
BLEXBot
BlogPulse
bspider
CatchBot
ccbot
ChangeDetection
Cliqzbot
Custo
Daumoa
discoverybot
DotBot
dumbot
EmailSiphon
EmailWolf
envolk
ExaBot
Ezooms
facebook
facebookexternalhit
facebot
findlinks
Gaisbot
GetRight
geturl
Gigabot
Girafabot
Googlebot
grapeshot
grub
Harvest
heritrix
Holmes
HTTrack
Huaweisymantecspider
ia_archiver
ichiro
Informant
jeeves
larbin
Linguee Bot
linkcheck
LinkedInBot
linkscan
LinkWalker
magpie-crawler
Mediapartners-Google
MJ12bot
Mnogosearch
moget
MojeekBot
momspider
motor
MSIECrawler
msnbot
MSRBot
NaverBot
NetMechanic
nomad
Nutch
oBot
Ocelli
Offline Explorer
Openfind data gatherer
PagePeeker
parsijoo
PerMan
pioneer
psbot
Robozilla
Roverbot
Scooter
ScoutJet
SemrushBot
SeznamBot
SiteSnagger
SolomonoBot
Sosospider
spanner
Speedy
Speedy Spider
spiderman
SuperBot
SurveyBot
Technoratibot
TeleportPro
Titan
TurnitinBot
Twiceler
UnisterBot
UnwindFetchor
VoilaBot
voyager
WBSearchBot
WebCopier
Webinator
weblayers
WebmasterWorld Extractor
WebmasterWorldForumBot
webmirror
WebReaper
WebStripper
WebVac
webwalk
WebWalker
WebWatch
WebZIP
Wget
WhoWhere Robot
Xaldon_WebSpider
Yandex
YandexBot
YandexDirect
Yodaobot
Zeus
Zookabot
ZyBorg