搜索引擎机器人的名称
Googlebot
google
Baiduspider
BaiDuSpider
msnbot 或 MSNBOT MSNBot
Isaac Ding
P.Arthur
Yahoo!+Slurp
sohu-search
SpiderMan =(yahoo)
Gaisbot
psbot
MSIECrawler
SBL-BOT
Mediapartners-Google
BecomeBot
8fang.net
Gigabot
Spider.NET
Wget
HaoRanSoft
Swoogle
Ultraseek
Java
LinkWalker
Openfind 或Openbot
AIBOT
Nutch
Lycos
Robozilla
crawler
Web Indexing Robot
SurveyBot 2.3 (Whois Source)
FAST-WebCrawler
Scooter
Slurp
Alexa
WISENutbot
IBM_Planetwide
Turn It In
larbin
Jeeves
crawl
Voila
appie
Google AdSense
spider
robot
BBot
NewzCrawler
=============================
以下未验证
--------------------------------------------------------------------------------

AbachoBOT=Abacho.com
abcdatos_botlink=Abcdatos.com
http://www.abcdatos.com/botlink/=Abcdatos.com
AESOP_com_SpiderMan=Aesop.com
ah-ha.com crawler (crawler@ah-ha.com)=ah-ha.com
ia_archiver=Archive.org
Scooter=Altavista.com
Mercator=Altavista.com
Scooter2_Mercator_3-1.0=Altavista.com
roach.smo.av.com-1.0=Altavista.com
Tv_Merc_resh_26_1_D-1.0=Altavista.com
AltaVista-Intranet=Altavista.co.uk
jan.gelin@av.com=Altavista.co.uk
FAST-WebCrawler=alltheweb.com
crawler@fast.no=alltheweb.com
Acoon Robot=acoon.de
antibot=antisearch.net
Atomz=atomz.com
Buscaplus Robi=buscaplus.com
CanSeek/=canseek.ca
support@canseek.ca=canseek.ca
ChristCRAWLER=christcrawler.com
Crawler=crawler.de
admin@crawler.de=crawler.de
DaAdLe.com ROBOT/=daadle.com
RaBot=daum.net
Agent-admin/=daum.net
phortse@hanmail.net=daum.net

[1] [2] [3] [4] [5] [6] [7] 下一页

上一篇:中国汽车资源网杨锁民：网络寒冬时下海

下一篇:中搜告别搜索市场转身个人门户