bot
crawl
infoseek
inktomi
frooglebot
googlebot
gooru
msnbot
alexa
alltheweb
alkaline
almaden.ibm.com
appie
arachnophilia
aretha
architext
ask jeeves
askjeeves
asterias
augurfind
auresys
backrub
bdcindexer
bigbrother
bjaaland
blackwidow
blindekuh
bloodhound
bobby
boris
brightnet
cassandra
cgireader
churl
cmc
collective
combine
core
cosmos
cruiser
cusco
cyberspyder
deweb
digger
digout4u
directhit
docomo
download_express
dwcp
ebiness
echo
e-collector
eit
emacs
esther
evliyacelebi
ezresult
fdse
felix
ferret
fetchrover
fido
finnish
fireball
fouineur
francoroute
funnelweb
gama
gazz
gcreep
geturl
golem
grapnel
griffon
gromit
gulliver
harvest
havindex
holmes
hometown
htdig
htmlgobble
hyperdecontextualizer
ia_archiver
ibm
iconoclast
ilse
imagelock
incywincy
informant
intelliagent
internetseer
iron33
javabee
jeeves
jobo
jubii
jumpstation
justview
katipo
kdd
kilroy
kit_fireball
labelgrabber.txt
lachesis
larbin
legs
linkchecker
linkidator
linkscan
linkwalker
lockon
lycos
magpie
mantraagent
marvin
mattie
mediafox
mercator
merzscope
meshexplorer
mixcat
moget
monster
motor
muscatferret
myweb
ncsa
nederland.zoek
netcarta
netcraft
netmechanic
netoskop
netscoop
newscan-online
ng/1.0
nhse
nomad
northstar
nzexplorer
occam
octopus
onet
openfind
osis-project
packrat
pageboy
parasite
patric
pegasus
perignator
perman
petersnews
phantom
piltdownman
pimptrain
pioneer
pitkow
plumtreewebaccessor
portalb
raven
rbse
redalert
rhcs
roadrunner
robbie
robi
robofox
robozilla
rules
scooter
search
senrigan
seventwentyfour
sgscout
shaggy
sidewinder
sleek
slurp
steeler
szukacz
t-h-u-n-d-e-r-s-t-o-n-e
teoma
tkwww
turnitin
ultraseek
urlck
vagabondo
yahoo
valkyrie
webquest
wisenutbot
zao/0
zyborg/1.0