来源:自学PHP网 时间:2014-12-11 18:04 作者: 阅读:次
[导读] ...
等号前面是搜索机器人的代号、访问名,等号后面是所代表搜索引擎、网站。 AbachoBOT=Abacho.com abcdatos_botlink=Abcdatos.com http://www.abcdatos.com/botlink/=Abcdatos.com AESOP_com_SpiderMan=Aesop.com ah-ha.com crawler (crawler@ah-ha.com)=ah-ha.com ia_archiver=Archive.org Scooter=Altavista.com Mercator=Altavista.com Scooter2_Mercator_3-1.0=Altavista.com roach.smo.av.com-1.0=Altavista.com Tv_Merc_resh_26_1_D-1.0=Altavista.com AltaVista-Intranet=Altavista.co.uk jan.gelin@av.com=Altavista.co.uk FAST-WebCrawler=alltheweb.com crawler@fast.no=alltheweb.com Acoon Robot=acoon.de antibot=antisearch.net Atomz=atomz.com Buscaplus Robi=buscaplus.com CanSeek/=canseek.ca support@canseek.ca=canseek.ca ChristCRAWLER=christcrawler.com Crawler=crawler.de admin@crawler.de=crawler.de DaAdLe.com ROBOT/=daadle.com RaBot=daum.net Agent-admin/=daum.net phortse@hanmail.net=daum.net contact/jylee@kies.co.kr=kies.co.kr DeepIndex=deepindex.com DittoSpyder=ditto.com Jack=domanova.co.uk Speedy Spider=entireweb.com ArchitextSpider=excite.com ArchitectSpider=excite.com Arachnoidea=euroseek.net arachnoidea@euroseek.net=euroseek.net EZResult=ezresults.com Fast PartnerSite Crawler=fastsearch.net FAST Data Search Crawler=fastsearch.net KIT-Fireball=fireball.de FyberSearch=fybersearch.com GalaxyBot=galaxy.com geckobot=geckobot.com GenCrawler=gendoor.com GeonaBot=geona.com Googlebot=Google.com googlebot@googlebot.com=Google.com google=Google.com moget/2.0=goo.ne.jp moget@goo.ne.jp=goo.ne.jp Aranha=girafa.com Slurp.so/1.0=Yahoo slurp@inktomi.com=Yahoo Slurp/2.0j=Yahoo www.inktomisearch.com=Yahoo Slurp/2.0-KiteHourly=Yahoo Slurp/2.0-OwlWeekly=Yahoo spider@aeneid.com=Yahoo Slurp/3.0-AU=Yahoo |
自学PHP网专注网站建设学习,PHP程序学习,平面设计学习,以及操作系统学习
京ICP备14009008号-1@版权所有www.zixuephp.com
网站声明:本站所有视频,教程都由网友上传,站长收集和分享给大家学习使用,如由牵扯版权问题请联系站长邮箱904561283@qq.com