Almaden http://www.almaden.ibm.com/cs/crawler [fc3] Almaden c01 http://www.almaden.ibm.com/cs/crawler [c01] Amfibibot 0.06 Amfibibot/0.06 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com) AnswerBus AnswerBus (http://www.answerbus.com/) AOL 3.0 Mozilla/2.0 (Compatible; AOL-IWENG 3.0; Win16) Appie 1.1 appie 1.1 (www.walhello.com) Argus 1.1 Argus/1.1 (Nutch; http://www.simpy.com/bot.html; feedback at simpy dot com) Ask Jeeves Teoma Mozilla/2.0 (compatible; Ask Jeeves/Teoma) ASPseek 1.2.10 ASPseek/1.2.10 ASPseek 1.2.12 ASPseek/1.2.12 AvantGo 3.2 Mozilla/3.0 (compatible; AvantGo 3.2) BaiDuSpider Baiduspider+(+http://www.baidu.com/search/spider.htm) BDFetch BDFetch Big Brother Big Brother (http://pauillac.inria.fr/~fpottier/) Boitho-dc 0.4 boitho.com-dc/0.4 ( http://www.boitho.com/dcbot.html ) Boitho-dc 0.5 boitho.com-dc/0.5 ( http://www.boitho.com/dcbot.html ) Boitho-dc 0.66 boitho.com-dc/0.66 ( http://www.boitho.com/dcbot.html ) BorderManager 3.0 Mozilla/4.0 (compatible; BorderManager 3.0) BruinBot BruinBot (+http://webarchive.cs.ucla.edu/bruinbot.html) Cerberian Drtrs Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.1-Build-13) Cerberian Drtrs Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.1-Build-16) Cerberian Drtrs Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.1-Build-17) Cerberian Drtrs Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.2-Build-0) Clushbot 2.1 Clushbot/2.1 (+http://www.clush.com/bot.html) Clushbot 3.21 Clushbot/3.21-BinaryFury (+http://www.clush.com/bot.html) Clushbot 3.23 Clushbot/3.23-BinaryFury (+http://www.clush.com/bot.html) Clushbot 3.24 Clushbot/3.24-BinaryFury (+http://www.clush.com/bot.html) Clushbot 3.6 Clushbot/3.6-BinaryFury (+http://www.clush.com/bot.html) Clushbot 3.9 Clushbot/3.9-BinaryFury (+http://www.clush.com/bot.html) ConveraCrawler 0.1 CrawlConvera0.1 (CrawlConvera@yahoo.com) ConveraCrawler 0.1 CrawlConvera0.1 (www.authoritativeweb.com) ConveraCrawler 0.2 ConveraCrawler/0.2 ConveraCrawler 0.5 ConveraCrawler/0.5 (+http://www CydralSpider 1.9 CydralSpider/1.9 (Cydral Web Image Search; http://www.cydral.com) DoCoMo 1.0 DoCoMo/1.0/P504iS/c10/TB Dual Proxy Dual Proxy Dumbot Dumbot(version 0.1 beta - dumbfind.com) Dumbot Dumbot(version 0.1 beta - http://www.dumbfind.com/dumbot.html) EmailSiphon EmailSiphon E-SocietyRobot e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/) FastBug FastBug http://www.ay-up.com FAST Enterprise Crawler 6 FAST Enterprise Crawler/6 (www.fastsearch.com) FAST-WebCrawler 3.4 FAST-WebCrawler/3.4/PartnerSite (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler) FAST-WebCrawler 3.8 FAST-WebCrawler/3.8 (crawler at trd dot overture dot com; http://www.alltheweb.com/help/webmaster/crawler) Favicon favicon finder at http://iconsurf.com/ Favicon favicon monitor at http://iconsurf.com/ Filangy 0.01 Filangy/0.01-beta (Filangy; http://www.nutch.org/docs/en/bot.html; filangy-agent@filangy.com) Filangy 1.01 Filangy/1.01 (Filangy; http://www.filangy.com/filangyinfo.jsp?inc=robots.jsp; filangy-agent@filangy.com) Filangy 1.01 Filangy/1.01 (Filangy; http://www.nutch.org/docs/en/bot.html; filangy-agent@filangy.com) Findlinks 0.82 findlinks/0.82 (+http://wortschatz.uni-leipzig.de/findlinks/) Findlinks 0.87 findlinks/0.87 (+http://wortschatz.uni-leipzig.de/findlinks/) Findlinks 0.89 findlinks/0.89 (+http://wortschatz.uni-leipzig.de/findlinks/) FindLinks 0.71 FindLinks/0.71 (+http://wortschatz.uni-leipzig.de/findlinks/) Fluffy the spider Mozilla/3.0 (compatible; Fluffy the spider; http://www.searchhippo.com/; info@searchhippo.com) FusionBot Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com; http://www.pgts.com.au/; +http://www.galaxy.com/info/crawler.html) FyberSpider FyberSpider (+http://www.fybersearch.com/fyberspider.php) Gaisbot 3.0 Gaisbot/3.0+(robot@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php) Gazz 5.0 gazz/5.0 (gazz@nttr.co.jp) Generic Generic GeonaBot 1.0 GeonaBot 1.0; http://www.geona.com/ GeonaBot 1.1 GeonaBot/1.1; http://www.geona.com/ GetRight 4.5 GetRight/4.5e Gigabot 1.0 Gigabot/1.0 Girafabot Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; Girafabot; girafabot at girafa dot com; http://www.girafa.com) Goldfire Server Goldfire Server Googlebot 2.1 Googlebot/2.1 (+http://www.googlebot.com/bot.html) Googlebot 2.1 Googlebot/2.1 (+http://www.google.com/bot.html) Googlebot 2.1 Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) Googlebot-Image 1.0 Googlebot-Image/1.0 Googlebot-Image 1.0 Googlebot-Image/1.0 (+http://www.googlebot.com/bot.html) Googlebot Test Googlebot/Test (+http://www.googlebot.com/bot.html) Grub-client 0.3.0 Mozilla/4.0 (compatible; grub-client-0.3.0; Crawl your own stuff with http://grub.org) Grub-client 1.0.3 Mozilla/4.0 (compatible; grub-client-1.0.3; Crawl your own stuff with http://grub.org) Grub-client 1.0.5 Mozilla/4.0 (compatible; grub-client-1.0.5; Crawl your own stuff with http://grub.org) Grub-client 1.3.7 Mozilla/4.0 (compatible; grub-client-1.3.7; Crawl your own stuff with http://grub.org) Grub-client 1.4.3 Mozilla/4.0 (compatible; grub-client-1.4.3; Crawl your own stuff with http://grub.org) Grub-client 1.5.3 Mozilla/4.0 (compatible; grub-client-1.5.3; Crawl your own stuff with http://grub.org) Grub-client 2.3 Mozilla/4.0 (compatible; grub-client-2.3) Hatena Antenna 0.4 Hatena Antenna/0.4 (http://a.hatena.ne.jp/help) Html Link Validator Html Link Validator (www.lithopssoft.com) Httpget 5.2.2 httpget-5.2.2 HTTrack 3.0x Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98) Ia_archiver ia_archiver Ichiro 1.0 ichiro/1.0 (ichiro@nttr.co.jp) IconSurf 2.0 IconSurf/2.0 favicon monitor (see http://iconsurf.com/robot.html) Iltrovatore-Setaccio Iltrovatore-Setaccio Iltrovatore-Setaccio 0.3 Iltrovatore-Setaccio/0.3-dev (Indexing; http://www.iltrovatore.it/bot.html; info@iltrovatore.it) Iltrovatore-Setaccio 1.2 Iltrovatore-Setaccio/1.2 (It-bot; http://www.iltrovatore.it/bot.html; info@iltrovatore.it) IlTrovatore-Setaccio IlTrovatore-Setaccio (+http://www.iltrovatore.it) IlTrovatore-Setaccio 0.03 IlTrovatore-Setaccio/0.03-dev (Indexing; http://www.iltrovatore.it/bot.html; info@iltrovatore.it) IlTrovatore-Setaccio 1.2 IlTrovatore-Setaccio/1.2-dev (Indexing; http://www.iltrovatore.it/bot.html; info@iltrovatore.it) IlTrovatore-Setaccio 1.2 IlTrovatore-Setaccio/1.2 (Indexing; http://www.iltrovatore.it/bot.html; bot@iltrovatore.it) IlTrovatore-Setaccio 1.2 IlTrovatore-Setaccio/1.2 (Indexing; http://www.iltrovatore.it/bot.html; info@iltrovatore.it) IlTrovatore-Setaccio 1.2 IlTrovatore-Setaccio/1.2 (It-bot; http://www.iltrovatore.it/bot.html; info@iltrovatore.it) Indy Library Mozilla/3.0 (compatible; Indy Library) InelaBot 0.2 InelaBot/0.2 (+http://inelegant.org/bot) Infoseek SideWinder 2.0B Infoseek SideWinder/2.0B (Linux 2.4 i686) Inktomi slurp Mozilla/5.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html) InternetLinkAgent 3.1 InternetLinkAgent/3.1 IRLbot 1.0 IRLbot/1.0 (+http://irl.cs.tamu.edu/crawler) Istarthere http://www.istarthere.com (spider@istarthere.com) Java 1.4.0 Java1.4.0 JoBo 1.3 JoBo/1.3 (http://www.matuschek.net/jobo.html) Knowledge 0.2 Knowledge.com/0.2 Knowledge 0.3 Knowledge.com/0.3 Larbin larbin_extended (larbin@oktie.com) Larbin larbin_test (nobody@airmail.etn) Larbin 2.6.3 larbin_2.6.3 (andreas.beder@chello.at) Larbin 2.6.3 larbin_2.6.3_for_(http://cosco.hiit.fi/search/) (Tomi.Silander@hiit.fi) Larbin 2.6.3 larbin_2.6.3_for_(http://cosco.hiit.fi/search/) Tomi.Silander@hiit.fi Larbin 2.6.3 larbin_2.6.3_for_(http://cosco.hiit.fi/search/) (tsilande@hiit.fi) Larbin 2.6.3 larbin_2.6.3_for_(http://cosco.hiit.fi/search/) tsilande@hiit.fi Larbin 2.6.3 larbin_2.6.3 (larbin2.6.3@unspecified.mail) Larbin 2.6.3 larbin_2.6.3 larbin2.6.3@unspecified.mail Libwww-MGET 1.0 libwww-MGET/1.0 libwww/5.2.8 Libwww-perl 5.50 libwww-perl/5.50 Libwww-perl 5.51 libwww-perl/5.51 Libwww-perl 5.53 libwww-perl/5.53 Libwww-perl 5.63 libwww-perl/5.63 Libwww-perl 5.64 libwww-perl/5.64 Libwww-perl 5.65 libwww-perl/5.65 Libwww-perl 5.68 libwww-perl/5.68 Libwww-perl 5.69 libwww-perl/5.69 Libwww-perl 5.74 libwww-perl/5.74 Libwww-perl 5.75 libwww-perl/5.75 Libwww-perl 5.76 libwww-perl/5.76 Libwww-perl 5.800 libwww-perl/5.800 Libwww-perl 5.801 libwww-perl/5.801 Libwww-perl 5.802 libwww-perl/5.802 Libwww-perl 5.803 libwww-perl/5.803 LimeBot 1.0 LimeBot/1.0 (+www.cruiselime.com/LimeBot.php) LinkLint-checkonly 2.3.5 LinkLint-checkonly/2.3.5 Linknzbot Linknzbot/ (+http://www.linknz.co.nz/robot.php) Linknzbot 2004 Linknzbot 2004/(+http://www.linknz.co.nz/robot.php) Links SQL Links SQL (http://gossamer-threads.com/scripts/links-sql/) LNSpiderguy LNSpiderguy Lwp-request 1.35 lwp-trivial/1.35 Lwp-request 1.36 lwp-trivial/1.36 Lwp-request 2.01 lwp-request/2.01 Mediapartners-Google 2.1 Mediapartners-Google/2.1 Mediapartners-Google 2.1 Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html) Microsoft URL Control Microsoft URL Control - 6.00.8169 Microsoft URL Control Microsoft URL Control - 6.00.8862 MozDex 0.04 mozDex/0.04-dev (mozDex; http://www.mozdex.com/bot.html; spider@mozdex.com) MozDex 0.05 mozDex/0.05-dev (mozDex; http://www.mozdex.com/bot.html; spider@mozdex.com) Mozilla Mozilla/4.0 (compatible; Netcraft Web Server Survey) MS Data Access Microsoft Data Access Internet Publishing Provider Cache Manager MS Data Access Microsoft Data Access Internet Publishing Provider DAV MS Data Access Microsoft Data Access Internet Publishing Provider DAV 1.1 MS Data Access Microsoft Data Access Internet Publishing Provider Protocol Discovery MS FrontPage 4.0 Mozilla/2.0 (compatible; MS FrontPage 4.0) MS FrontPage 4.0 MSFrontPage/4.0 MS FrontPage 5.0 Mozilla/2.0 (compatible; MS FrontPage 5.0) MS FrontPage 5.0 MSFrontPage/5.0 MSIECrawler Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0; MSIECrawler) MSIECrawler Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; MSIECrawler) MSIECrawler Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MSIECrawler) Msnbot 0.11 msnbot/0.11 (+http://search.msn.com/msnbot.htm) Msnbot 0.3 msnbot/0.3 (+http://search.msn.com/msnbot.htm) Msnbot 1.0 msnbot/1.0 (+http://search.msn.com/msnbot.htm) MSProxy 2.0 MSProxy/2.0 MysteryBot Mozilla/3.01 (compatible;) NaverBot 1.0 NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com) NaverBot_dloader 1.5 NaverBot_dloader/1.5 NetNoseCrawler 2.0 Mozilla/4.0 (compatible; MSIE 5.0; NetNose-Crawler 2.0; A New Search Experience: http://www.netnose.com) NetResearchServer NetResearchServer(http://www.look.com) NetResearchServer 2.9 NetResearchServer/2.9(loopimprovements.com/robot.html) NetResearchServer 3.4 NetResearchServer/3.4(loopimprovements.com/robot.html) NextGenSearchBot 1 NextGenSearchBot 1 (for information visit http://www.eliyon.com/NextGenSearchBot) None none NPBot NPBot (http://www.nameprotect.com/botinfo.html) NuSearch Spider NuSearch Spider www.nusearch.com NutchBot 0.05 NutchCVS/0.05-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net) NutchBot 0.05 NutchCVS/0.05 (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net) NutchBot 0.06 CreativeCommons/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net) Obot Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; obot) Obot oBot Ocelli 1.3 Ocelli/1.3 (http://www.globalspec.com/Ocelli) OmniExplorer_Bot 1.07 OmniExplorer_Bot/1.07 (+http://www.omni-explorer.com) Internet Categorizer OmniExplorer_Bot 1.07 OmniExplorer_Bot/1.07 (+http://www.omni-explorer.com) Job Crawler Openbot 3.0 Openbot/3.0+(robot@monkia.com.tw;+http://gais.cs.ccu.edu.tw/robot.php) Openbot 3.0 Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html) Openbot 3.0 Openfind data gatherer, Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html) Patwebbot Patwebbot (http://www.herz-power.de/technik.html) PEERbot PEERbot www.peerbot.com PipeLiner 0.3 pipeLiner/0.3a (PipeLine Spider; http://www.pipeline-search.com/webmaster.html; webmaster@pipeline-search.com) Pompos 1.3 Pompos/1.3 http://dir.com/pompos.html Portal Manager 0.7 Portal Manager 0.7 Psbot 0.1 psbot/0.1 (+http://www.picsearch.com/bot.html) QuepasaCreep QuepasaCreep ( crawler@quepasacorp.com ) RixBot RixBot (http://www.oops-as.no/rix/) RoboPal RoboPal (http://www.findpal.com/) Robozilla 1.0 Robozilla/1.0 RPT-HTTPClient 0.3 RPT-HTTPClient/0.3-3 SafariBookmarkChecker 1.25 SafariBookmarkChecker/1.25 (+http://www.coriolis.ch/) SafariBookmarkChecker 1.26 SafariBookmarkChecker/1.26 (+http://www.coriolis.ch/) Scooter 3.3 Scooter/3.3 Scooter 3.3 Scooter/3.3_SF Scrubby 2.1 Scrubby/2.1 (http://www.scrubtheweb.com/abs/meta-check.html) Scrubby 2.2 Scrubby/2.2 (http://www.scrubtheweb.com/) Search Agent 1.0 Search Agent 1.0 Seekbot 1.0 Seekbot/1.0 (http://www.seekbot.net/bot.html) HTTPFetcher/0.3 Seekbot 1.0 Seekbot/1.0 (http://www.seekbot.net/bot.html) RobotsTxtFetcher/1.0 (XDF) Sensis.au Web Crawler Sensis.com.au Web Crawler (search_comments\at\sensis\dot\com\dot\au) Sitecheck InternetSeer.com Sohu-search sohu-search SpeedySpider Mozilla/4.0 (compatible; SpeedySpider; www.entireweb.com) SpurlBot 0.2 Mozilla/5.0 (compatible; SpurlBot/0.2) Sqworm 2.9.85 Sqworm/2.9.85-BETA (beta_release; 20011115-775; i686-pc-linux-gnu) Szukacz 1.5 Szukacz/1.5 (robot; www.szukacz.pl/jakdzialarobot.html; info@szukacz.pl) Tarantula Tarantula Experimental Crawler TheSuBot 0.1 TheSuBot/0.1 (www.thesubot.de) TheSuBot Beta thesubot-beta-www.thesubot.de Thumbshots-de-Bot thumbshots-de-Bot (Version: 1.02, powered by www.thumbshots.de) TulipChain 6.02 TulipChain/6.02 (http://ostermiller.org/tulipchain/) Java/1.4.2_03 (http://apple.com/) Mac_OS_X/10.3.3 RPT-HTTPClient/0.3-3 TulipChain 6.03 TulipChain/6.03 (http://ostermiller.org/tulipchain/) Java/1.4.2_05 (http://java.sun.com/) Windows_XP/5.1 RPT-HTTPClient/0.3-3 TurnitinBot 2.0 TurnitinBot/2.0 (http://www.turnitin.com/robot/crawlerinfo.html) TurnitinBot 2.0 TurnitinBot/2.0 http://www.turnitin.com/robot/crawlerinfo.html TutorGigBot 1.5 TutorGigBot/1.5 ( +http://www.tutorgig.info ) Tutorial Crawler 1.4 Tutorial Crawler 1.4 (http://www.tutorgig.com/crawler) Unchaos_crawler 2.0.2 unchaos_crawler_2.0.2 (search.engine@unchaos.com) unknown AnsearchBot unknown arianna.libero.it Linux/2.4.9-34smp (linux) unknown LeechGet 2004 (www.leechget.net) Updated 0.1 updated/0.1beta (updated.com; http://www.updated.com; crawler@updated.om) USyd-NLP-Spider USyd-NLP-Spider (http://www.it.usyd.edu.au/~vinci/bot.html) Vspider vspider W3C-checklink 3.6.2.3 W3C-checklink/3.6.2.3 libwww-perl/5.64 W3C-checklink 3.9.2 W3C-checklink/3.9.2 [3.17] libwww-perl/5.79 W3C-checklink 4.0 W3C-checklink/4.0 [4.4] libwww-perl/5.800 W3C-checklink 4.1 W3C-checklink/4.1 [4.14] libwww-perl/5.800 W3C_Validator 1.305.2.109 W3C_Validator/1.305.2.109 libwww-perl/5.79 W3C_Validator 1.305.2.12 W3C_Validator/1.305.2.12 libwww-perl/5.64 W3C_Validator 1.305.2.137 W3C_Validator/1.305.2.137 libwww-perl/5.79 W3C_Validator 1.305.2.148 W3C_Validator/1.305.2.148 libwww-perl/5.800 W3C_Validator 1.305.2.148 W3C_Validator/1.305.2.148 libwww-perl/5.803 WebFilter Robot 1.0 WebFilter Robot 1.0 Webinator-indexer 2.56 Mozilla/3.0 (compatible; Webinator-indexer.cyberalert.com/2.56) WebRACE 1.1 WebRACE/1.1 (University of Cyprus, Distributed Crawler) WebSauger 1.20 WebSauger 1.20b WebSearch 3.0.1 WebSearch.COM.AU/3.0.1 (The Australian Search Engine; http://WebSearch.COM.AU; Search@WebSearch.COM.AU) Webwombat www.webwombat.com.au Webyield robot webyield robot (http://www.webyield.net/search/search.pl) Wget 1.5.3 Wget/1.5.3 Wget 1.5.3.1 Wget/1.5.3.1 Wget 1.7 Wget/1.7 Wget 1.8.1 Wget/1.8.1 Wget 1.8.1 Wget/1.8.1+cvs Wget 1.8.2 Wget/1.8.2 Wget 1.9 Wget/1.9 Wget 1.9.1 Wget/1.9.1 WWWeasel 1.00 WWWeasel Robot v1.00 (http://wwweasel.de) Xenu Link Sleuth 1.1a Xenu's Link Sleuth 1.1a Xenu Link Sleuth 1.2b Xenu Link Sleuth 1.2b Xenu Link Sleuth 1.2f Xenu Link Sleuth 1.2f Xenu Link Sleuth 1.2d Xenu Link Sleuth 1.2d Xenu Link Sleuth 1.2e Xenu Link Sleuth 1.2e Yahoo-MMCrawler Yahoo-MMCrawler/3.x (mms dash mmcrawler dash support at yahoo dash inc dot com) Yahoo! Slurp Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) YottaCars_Bot 4.12 YottaCars_Bot/4.12 (+http://www.yottacars.com) Car Search Engine Zao-Crawler Zao-Crawler Zeus 3140 Zeus 3140 Webster Pro V2.9 Win32 ZipppBot 0.11 ZipppBot/0.11 (ZipppBot; http://www.zippp.net; webmaster@zippp.net) ZoomSpider ZoomSpider - wrensoft.com ZyBorg 1.0 Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.dlc@looksmart.net; http://www.WISEnutbot.com) ZyBorg 1.0 Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.zyborg@looksmart.net; http://www.WISEnutbot.com) ZyBorg 1.0 Mozilla/4.0 compatible ZyBorg/1.0 (wn-12.zyborg@looksmart.net; http://www.WISEnutbot.com) ZyBorg 1.0 Mozilla/4.0 compatible ZyBorg/1.0 (wn-1.zyborg@looksmart.net; http://www.WISEnutbot.com) ZyBorg 1.0 Mozilla/4.0 compatible ZyBorg/1.0 (wn-2.zyborg@looksmart.net; http://www.WISEnutbot.com) ZyBorg 1.0 Mozilla/4.0 compatible ZyBorg/1.0 (wn.zyborg@looksmart.net; http://www.WISEnutbot.com) -------------------------- ANOTHER LIST - MAY BE REDUNDENT ------------------------------- googlebot=Google.com slurp@inktomi=Hot Bot ask jeeves=Ask Jeeves lycos=Lycos.com whatuseek=What You Seek ia_archiver=Archive.org msn.com=msn.com :robot/1.0=Neofonie.de 0.1_hseo(at)cs.rutgers.edu=Rutgers.edu AbachoBOT (Mozilla compatible)=Crawler.de AbachoBOT=Crawler.de abcdatos_botlink=Abcdatos.com About/0.1libwww-perl/5.47=About.com abot/0.1=Abot.com abot/0.1 (abot; http://www.abot.com; abot@abot.com)=Abot.com accoona=Accoona.com AcoiRobot=Acoi Picture Robot Acoon Robot v1.50.001=Acoon.de Acoon Robot v1.52=Acoon.de Acoon Robot=Accon.de ActiveWorlds/3.xx=ActiveWorlds.com admin@crawler.de=Crawler.de admin@maxbot.com=maxbot.com ADSARobot=ADSARobot AESOP_com_SpiderMan=Aesop.com agadine/1.x.x=Agada.de Agent-admin/=Daum.net ah-ha.com crawler (crawler@ah-ha.com)=Ah-ha.com ah-ha.com crawler=Ah-ha.com Aladin/3.324=Aladin.de Aleksika Spider/1.0=Aleksika.de AlkalineBOT/1.3=Vestris.com AlkalineBOT/1.4=Vestris.com AlkalineBOT=AlkalineBOT Allesklar/0.1 libwww-perl/5.46=Allesklar.de AltaVista-Intranet=Altavista.co.uk AmfibiBOT=Amfibi.com Amiga-AWeb/3.4.167SE=AWeb.com amzn_assoc=Amazon.com AnswerChase PROve x.0=AnswerChase.com AnswerChase x.0=AnwserChase.com AnswerChase=AnswerChase.com Antibot=AntiSeach.net antibot-V1.1.5/i586-linux-2.2=AntiSeach.net AnzwersCrawl/2.0=Anzwers A-Online Search=Jet2Web.com Aport=Aport.ru appie 1.1=Walhello.com appie=Walhello.com arachnoidea@euroseek.net=Euroseek.net Arachnoidea=Euroseek.com Aranha=Girafa.com ArchitectSpider=Excite.com archive.org_bot=Archive.org archive_org=Archive.org ask jeeves=Ask Jeeves ask.24x.info=Ask.24x.info ASPSeek/1.2.5=ASPSeek.org ASPseek/1.2.9d=ASPSeek.com ASPSeek/1.2.x=ASPSeek.org ASPSeek/1.2.xa=ASPSeek.org ASPseek/1.2.xx=ASPseek.org ASPSeek/1.2.xxpre=ASPSeek.org ASPSeek=ASPSeek.org asterias/2.0=SingingFish.com Asterias=SingingFish.com AtlocalBot=Atlocal.com AtlocalBot/1.1 +(http://www.atlocal.com/local-web-site-owner.html)=Atlocal.com Atomz/1.0=Atomz.com Atomz=Atomz.com Augurfind=Augurnet.ch augurnfind V-1.x=Augurnet.ch autohttp=Elsop.com AV Fetch 1.0=Altavista.com AVSearch=Altavista.com AVSearch-3.0=Altavista.com AxmoRobot=Axmo.com Baiduspider+=Baidu.com BaiDuSpider=Baidu.com BanBots/1.2=Banbots.com BarraHomeCrawler=BarraHome.com bdcindexer_2.6.2=Business.com BDFetch=Brandimensions.com BDNcentral Crawler v2.3=Bdncentral.com beautybot/1.0=Cosmoty.com Bilbo/2.3b-UNIX=Biblo Bot BlackWidow=BlackWidow Bot Blaiz-Bee/1.0 (+http://www.blaiz.net)=Blaiz.net Blaiz-Bee/1.0=Blaiz.net BlitzBOT@tricus.net (Mozilla compatible)=Blitzsuche.rp-online.de BlitzBOT@tricus.net=Blitzsuche.rp-online.de BlogBot/1.x=Blogdex.net BlogBot=Blogdex.net blogWatcher_Spider/0.1=Blogwatcher.pi.titech.ac.jp Bloglines Title Fetch/1.0 (http://www.bloglines.com)=Bloglines.com boitho.com-dc/0.xx=Boitho.com boitho.com-robot/1.x=Boitho.com BSDSeek/1.0=Inktomi.com BullsEye=Intelliseek.com bumblebee@relevare.com=Relevare.com Buscaplus Robi/1.0=Buscaplus.com Buscaplus Robi=Buscaplus.com CanSeek/=Cansee.ca ChristCRAWLER 2.0=Christcrawler.com ChristCRAWLER=Christcrawler.com CipinetBot=Cipinet.com citenikbot/=Cenik.co.uk ClariaBot/1.0=Searchscout.com Claymont.com=Claymont.com CLIPS-index=Cips-index.imag.fr Clushbot/3.3-BinaryFury (+http://www.clush.com/bot.html)=Clush.com Clushbot/3.3-BinaryFury=Clush.com Combine/x.0=Combine Bot Computer_and_Automation_Research_Institute_Crawler=Research Bot contact/jylee@kies.co.kr=Kies.co.kr Convera Internet Spider V6.x=Convera.com cosmos/0.8_(robot@xyleme.com)=Xyleme.com cosmos/0.9_(robot@xyleme.com)=Xyleme.com cosmos=Xyleme.com C-PBWF-ip3000.com-crawler=IP3000.com CrawlConvera0.1=Converna.net Crawler (cometsearch@cometsystems.com)=Findwhat.com Crawler admin@crawler.de=Crawler.de Crawler V 0.2.x admin@crawler.de=Crawler.de crawler@alexa.com=Alexa.com crawler@brainbot.com=Brainbot.com crawler@fast.no=Alltheweb.com Crawler=Crawler.de CrawlerBoy Pinpoint.com=Pinpoint.com CrawlerBoy=Pinpoint.com CrocCrawler= CrocCrawler.com Custom Spider www.bisnisseek.com /1.0=Bisnisseek.com DaAdLe.com ROBOT/=Daadle.com DataparkSearch/4.xx=DataparkSearch.com DaviesBot/1.7=Wholeweb.net DaviesBot=Wholeweb.net dbDig=Prairielandconsulting.com DBrowse 1.4b=DBrowse Bot DBrowse 1.4d=DBrowse Bot dCSbot/1.1=Openmarket.com DeepIndex=DeepIndex.com DeepIndexer.ca=DeepIndex.com deepweb=Deepweb.com Demo Bot DOT 16b= Btopenworld.com DiaGem/=Skyrocket.gr.jp DiaGem/1.1 (http://www.skyrocket.gr.jp/diagem.html)=Skyrocket.gr.jp DiaGem/1.1=Skyrocket.gr.jp Diamond/1.0=Searchscout.com Digger/1.0 JDK/1.3.0rc3=Diggit.com Digimarc WebReader=Digimarc.com DigOut4U=Arisem.com DIIbot/1.2=Digital-Integrity.com DIIbot=Digital-Integrity.com DittoSpyder=Ditto.com dloader(NaverRobot)/=Naver.com dtSearchSpider=Dtsearch.com Dumbot(version 0.1 beta - dumbfind.com)=Dumbfind.com Dumbot(version 0.1 beta)=Dumbfind.com dumrobo(NaverRobot)/=Naver.com EARTHCOM.info/1.4beta=Earthcom.info EasyDL/3.02=Keywen.com EasyDL/3.03=Keywen.com EasyDL/3.04=Keywen.com EasyDL/3.xx http://keywen.com/Encyclopedia/Bot=Keywen.com EasyDL/3.xx=Keywen.com EchO!/2.0=Voila.com egothor/3.0a (+http://www.xdefine.org/robot.html)=Xdefine.com egothor/3.0a=Xdefine.com EgotoBot/4.8=Egoto.com Enterprise_Search/1.0.xxx=Innerprise.net Enterprise_Search/1.0=Innerprise.net erik@malfunction.org=Malfunction.org EroCrawler=Erocrawler.com ES.NET_Crawler/2.0=Innerprise.net eseek-larbin_2.6.2=Exactseek.com ESISmartSpider=Travel-Finder.com ExactSeek Crawler/0.1=Exactseek.com exactseek-crawler-2.63=Exactseek.com Exalead NG/MimeLive Client=Exabot.com Excalibur Internet Spider V6.5.4=Excalib.com ExperimentalHenrytheMiragoRobot=Mirago.co.uk EyeCatcher (Download-tipp.de)/1.0=Download-tipp.de EyeCatcher=Download-tipp.de EZResult=Ezresults.com Fast Crawler Gold Edition=Alltheweb.com FAST Data Search Crawler=Alltheweb.com FAST Enterprise Crawler 6 (Experimental)=Alltheweb.com FAST Enterprise Crawler 6 used by FAST (FAST)=Alltheweb.com FAST Enterprise Crawler 6 used by FAST=Alltheweb.com FAST Enterprise Crawler 6=Alltheweb.com FAST Enterprise Crawler/6 (www.fastsearch.com)=Alltheweb.com FAST Enterprise Crawler/6=Alltheweb.com FAST FirstPage retriever (compatible; MSIE 5.5; Mozilla/4.0)=Alltheweb.com FAST FirstPage retriever=Alltheweb.com Fast PartnerSite Crawler=Alltheweb.com FastCrawler 3.0.1 (crawler@1klik.dk)=Alltheweb.com FastCrawler 3.0.1=Alltheweb.com FAST-WebCrawler/2.2.10=Altheweb.com FAST-WebCrawler/2.2.6=Altheweb.com FAST-WebCrawler/2.2.7=Altheweb.com FAST-WebCrawler/2.2.8=Altheweb.com FAST-WebCrawler/3.2 test=Altheweb.com FAST-WebCrawler/3.2=Altheweb.com FAST-WebCrawler/3.3=Altheweb.com FAST-WebCrawler/3.4/Nirvana=Altheweb.com FAST-WebCrawler/3.4/PartnerSite=Altheweb.com FAST-WebCrawler/3.5=Altheweb.com FAST-WebCrawler/3.6/FirstPage=Altheweb.com FAST-WebCrawler/3.6=Altheweb.com FAST-WebCrawler/3.7/FirstPage=Altheweb.com FAST-WebCrawler/3.7=Altheweb.com FAST-WebCrawler/3.8/Fresh=Altheweb.com FAST-WebCrawler/3.8=Altheweb.com FAST-WebCrawler/3.x Multimedia (mm dash crawler at fast dot no)=Altheweb.com FAST-WebCrawler/3.x Multimedia=Altheweb.com FAST-WebCrawler=Alltheweb.com Faxobot/1.0=FaXo.com Felix - Mixcat Crawler=Mixcat.com Felix=Mixcat.com FFC Trap Door Spider=Frequentfinders.com fido/1.0 Harvest/1.4.pl2=Planet Search FinaleRobot=expressus.com FindAnISP.com_ISP_Finder_v99a=FindAnISP.com FineBot=Finesearch.com Firefly/1.0 (compatible; Mozilla 4.0; MSIE 5.5)=Fireball.de Firefly/1.0=Fireball.de FlickBot 2.0 RPT-HTTPClient/0.3-3=DivX.com Fluffy the spider=SearchHippo.com Flunky=Metacarta.com Francis/1.0 (francis@neomo.de http://www.neomo.de/)=Neomo.de Francis/1.0=Neomo.de FreeFind.com-SiteSearchEngine/1.0=Freefind.com FyberSearch=Fybersearch.com FyberSpider=Fybersearch.com Gagglebot=Gagglebot GAIS Robot/1.0B2=Seed.net.tw Gaisbot/3.0+=Seed.net.tw Gaisbot/3.0=Seed.net.tw GalaxyBot/1.0 (http://www.galaxy.com/galaxybot.html)=Galaxy.com GalaxyBot/1.0=Galaxy.com GalaxyBot=Galaxy.com GammaSpider/1.0=Gammasite.com gazz/1.0=Infobee.ne.jp gazz@nttrd.com=Infobee.ne.jp Geckobot=Geckobot.com geckobot=Geckobot.com GenCrawler=Gendoor.com generic_crawler/01.0217/=Cmu.edu GentleSpider=Research.att.com GeonaBot=Geona.com GigaBaz=Brainbot.com GigaBazVStheWeb=Brainbot.com GigaBlast=Gigablast.com Gigabot/1.0=Gigablast.com Gigabot=Gigablast.com GigabotSiteSearch/2.0 (sitesearch.gigablast.com)=Gigablast.com GigabotSiteSearch/2.0=Gigablast.com Giskard=oralco.com GNODSPIDER=Gnod.net Goblin/0.9 (http://www.goguides.org/)=Goguides.org Goblin/0.9.x (http://www.goguides.org/goblin-info.html)=Goguides.org Goblin/0.9.x=Goguides.org Goblin/0.9=Goguides.org GoForIt.com=Goforit.com Goofer/0.2=Wanadoo.fr Google=Google.com Googlebot/1.0=Google.com Googlebot/2.1= Google.com Googlebot/Test=Google.com googlebot@googlebot.com=Google.com Googlebot=Google.com Googlebot-Image/1.0=Google.com Image Bot GrigorBot 0.8=Grigor.biz grub crawler(http://www.grub.org)=Grub.com grub-client=Grub.org gsa-crawler (Enterprise; GID-01422; jplastiras@google.com)=Google.com gsa-crawler (Enterprise; GID-01742;gsatesting@rediffmail.com)=Google.com gsa-crawler=Google.com Gulliver/1.2=Northernlight.com Gulliver/1.3=Northernlight.com Gulliver=Northernlight.com Gulper Web Bot 0.2.4=Gulper Bot Gulper Web Bot=Gulper Bot Hatena Antenna/0.4 (http://a.hatena.ne.jp/help#robot)=a.hatena.ne.jp Hatena Antenna/0.4=a.hatena.ne.jp HeinrichderMiragoRobot=Mirago.de HenrytheMiragoRobot=Mirago.co.uk HenryTheMiragoRobot=Mirago.co.uk Hippias/0.9 Beta= Hippias Bot holmes/x.x=Morfeo.centrum.cz HomePageSearch(hpsearch.uni-trier.de)=Hpsearch.uni-trier.de Homerbot: www.homerweb.com=Homerweb.com Homerbot=Homerweb.com htdig/3.1.6 (http://computerorgs.com)=Computerorgs.com htdig/3.1.x (root@localhost)=Htdig.org htdig/3.1.x=Htdig.org http://www.abcdatos.com/botlink/=Abcdatos.com Hubater=Hubat.com ia_archiver/1.6=Archive.org ia_archiver=Archive.org IAArchiver-1.0=Archive.org icsbot-0.1=Icseoul.org ideare - SignSite/1.x=Ideare.com Ideare - SignSite=Ideare.com IlTrovatore-Setaccio (+http://www.iltrovatore.it)=Iltrovatore.it Iltrovatore-Setaccio/0.3-dev=Iltrovatore.it IlTrovatore-Setaccio/1.2=Iltrovatore.it iltrovatore-setaccio/1.2-dev=Iltrovatore.it IlTrovatore-Setaccio=Iltrovatore.it IncyWincy=Incywincy.com IndexTheWeb.com Crawler7=IndexTheWeb.com Inet library=Inetlibrary.com info@searchhippo.com=Searchhippo.com InfoFly/1.0 (http://www.versions-project.org/)=Versions-project.org InfoFly/1.0= Versions-project.org InfoSeek Sidewinder/0.9=Infoseek.com InfoSeek Sidewinder/1.0A= Infoseek.com InfoSeek Sidewinder/1.1A= Infoseek.com Infoseek SideWinder/1.45 (Compatible; MSIE 10.0; UNIX)= Infoseek.com Infoseek SideWinder/1.45= Infoseek.com Infoseek SideWinder/2.0B (Linux 2.4 i686)= Infoseek.com Infoseek SideWinder/2.0B= Infoseek.com InfoSeek Sidewinder=infoseek.com Inktomi Search=Yahoo.com Inktomi=Yahoo.com InnerpriseBot/1.0 (http://www.innerprise.com/)=Innerprise.net InnerpriseBot/1.0=Innerprise.net InsumaScout=InsumaScout Internet Ninja 6.0=Dti.ne.jp InternetSeer.com= InternetSeer.com InternetSeer=InternetSeer InternetSeer=InternetSeer.com ip3000.com=ip3000.com ip3000.com-crawler=ip3000.com IPiumBot laurion(dot)com=Laurion.com ipiumBot=Laurion.com Iron33=Verno.ueda.info.waseda.ac.jp Jabot/6.x (http://odin.ingrid.org/)=Ingrid.org Jabot/6.x=Ingrid.org Jabot/7.x.x (http://odin.ingrid.org/)=Ingrid.org Jabot/7.x.x=Ingrid.org Jack=Domanova.co.uk jan.gelin@av.com=Altavista.co.uk jeeves=Ask Jeeves Jetbot/1.0=Jeteye.com JoocerBot=Joocer.com Jyxobot/x=Jyxo.cz Katriona=Katriona KE_1.0/2.0 libwww/5.2.8=Voila.fr Kenjin Spider=Kenjin.ne.jp KIT_Fireball/2.0=Fireball.de KIT-Fireball/2.0 (compatible; Mozilla 4.0; MSIE 5.5)=Fireball.de KIT-Fireball/2.0=Fireball.de KIT-Fireball=Fireball.de Knowledge.com/0.x=Knowledge.com Kototoi/0.1=s.u-tokyo.ac.jp kuloko-bot/0.2=Kuloko.com kuloko-bot/0.x=Kuloko.com Kulokobot=Kuloko.com kulturarw3/0.1=National Library of Sweden LEIA/3.01pr (LEIAcrawler; [SNIP])=Gseek.com LEIA=Gseek.com LexiBot=Lexibot.com LNSpiderguy=Lexis-nexis.com Look.com=Look.com lwp-trivial/1.27=Search4free.com lwp-trivial/1.34=Search4free.com Lycos_Spider_(T-Rex)/3.0=Lycos.com Lycos_Spider_(T-Rex)=Lycos.com lycos=Lycos.com Mackster( http://www.ukwizz.com )=Ukwizz.com Mackster=Ukwizz.com Mag-Net=Wind.it mailto:webcraft@bea.com=Beasys.com mammoth/1.0 (+http://www.sli-systems.com/)=Sli-Systems.com mammoth/1.0=Sli-Systems.com MantraAgent=Looksmart.com mapper@teradex.com=Mapper.teradex.com Mariner/5.1b [de] (Win95; I;Kolibri gncwebbot)=Kolibri.de Mariner/5.1b= Kolibri.de Martini=Looksmart.com Marvin v0.3=Marvin Bot marvin/infoseek=Webseek.de marvin-team@webseek.de=Webseek.de Mata Hari/2.00=Lexibot.com MediaCrawler-1.0 (Experimental)=Mediacrawler.de MediaCrawler-1.0=Mediacrawler.de Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html)=Google.com Adsense Mediapartners-Google/2.1=Google.com Adsense MediaSearch/0.1=Www.fi MegaSheep v1.0 (www.searchuk.com internet sheep)=SearchUK.com MegaSheep v1.0=SearchUK.com Mercator=Altavista.com Mercator=Altavista.com Mercator-1.x=Altavista.com Mercator-2.0=Altavista.com Mercator-Scrub-1.1=Altavista.com metabot=Metabot Metaspinner/0.01=Meta-Spinner.de MFC_Tear_Sample=Microsoft.com MicrosoftPrototypeCrawler=Microsoft.com Minibot=Minibot MiracleAlphaTest=Nec.co.jp MnogoSearch/3.2.xx=mNoGoSearch.org moget/2.0=Goo.ne.jp moget/2.1 (moget@goo.ne.jp)=Goo.ne.jp moget/2.1=Goo.ne.jp moget@goo.ne.jp=Goo.ne.jp Mole2/1.0=Intags.de Morris - Mixcat Crawler (+http://mixcat.com)=Mixcat.com Morris - Mixcat Crawler=Mixcat.com Morris=Mixcat.com Mouse-House/7.4=Spidermonkey.ca mozDex/=Mozdex.com mozDex/0.04-dev=Mozdex.com Mozilla (Mozilla@somewhere.com)=Somewhere.com Mozilla/2.0 (compatible; Ask Jeeves)=Ask Jeeves Mozilla/2.0 (compatible; EZResult -- Internet Search Engine)=DirectHit.com Mozilla/3.0 (compatible; MuscatFerret/1.5.4; claude@euroferret.com)=Euroferret.com Mozilla/3.0 (compatible; MuscatFerret/1.5; olly@muscat.co.uk)=Euroferret.com Mozilla/3.0 (compatible; MuscatFerret/1.6.x; claude@euroferret.com)=Euroferret.com Mozilla/3.01 (Compatible; Links2Go Similarity Engine)=Links2go.com Mozilla/4.0 (compatible; FastCrawler3, support-fastcrawler3@fast.no)=AllTheWeb.com Mozilla/4.0 (compatible; grub-client-2.x)=Grub.org Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) TrueRobot; 1.5=Echo.com Mozilla/4.0 (compatible; SpeedySpider; www.entireweb.com)=EntireWeb.com Mozilla/4.0 (compatible; www.galaxy.com)=Galaxy.com Mozilla/4.0 [en] (Ask Jeeves Corporate Spider)=Ask Jeeves Mozilla/4.0(compatible; Zealbot 1.0)=LookSmart.com Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot)=MSN.com Mozilla/5.0 wgao@genieknows.com=GenieKnows.com MP3Bot=mp3bot.de MSNBOT/0.1=MSN.com msnbot=MSN.com MSN=MSN.com MultiText/0.1=MultiText MultiText=MultiText MuscatFerret=Webtop.com NationalDirectoryAddURL/1.0=NationalDirectory.com NationalDirectory-SuperSpider=Nationaldirectory.com NationalDirectory-WebSpider/1.3=NationalDirectory.com Nazilla=Websmostlinked.com NEC Research Agent=NEC Research Agent NetCruiser=NetCruiser NetResearchServer(http://www.look.com)=Look.com NetResearchServer=Look.com NetZippy=Netzippy.com NextopiaBOT=Nextopia.com NG/1.0=Exabot.com Noago Spider=Noago.com NPBot=NameProtect.com NPBot-1/2.0=NameProtect.com NP/0.1=NameProtect.com NP/0.1 (NP; http://www.nameprotect.com; npbot@nameprotect.com)=NameProtect.com nttdirectory_robot=Navi.ocn.ne.jp Nutch=Nutch.org NutchCVS/0.0x-dev=Nutch.org NutchOrg/0.0x-dev=Nutch.org NutchOrg=Nutch.org NZBot=NavigationZone.com ObjectsSearch/0.01=ObjectsSearch.com oBot ((compatible;Win32))=Cobion.com oBot=Cobion.com OliverPerry=Claymont.com OntoSpider/1.0 libwww-perl/5.65=Ontospider.i-n.info OntoSpider/1.0=Ontospider.i-n.info OntoSpider=Ontospider.i-n.info Openbot/=Openfind.com.tw Openbot/3.0+=Openfind.com.tw Openbot/3.0=Openfind.com.tw Opencola=Opencola.com Openfind piranha=Openfind.com Openfind Robot/1.1A2=Openfind.com.tw OpenTextSiteCrawler/2.9.2=Opentext.net Oracle Ultra Search=Oracle.com Oxxbot1=Oxxfordinfo.com Pansophica=Pansophica ParaSite/1.0b (http://www.ianett.com/parasite/)=Ianett.com ParaSite/1.0b=Ianett.com pd02_1.0.0 pd02_1.0.0@dzimi@post.sk=Post.sk peerbot=Peerbot.com Phoaks=Phoaks phortse@hanmail.net=Daum.net PICgrabber=PICgrabber PicoSearch/=PicoSearch.com PicoSearch/1.0=PicoSearch.com PictureOfInternet=PictureOfInternet PintaSpider=PintaSpider pipeLiner/0.10=Pipeline-Search.com pipeLiner=Pipeline-Search.com Pita=Pita Bot Pizilla++ ver 2.45=He.net PJspider/3.0 (pjspider@portaljuice.com; http://www.portaljuice.com)=Portaljuice.com PJspider/3.0=Portaljuice.com PJspider=Portaljuice.com polybot 1.0 (http://cis.poly.edu/polybot/)= PolyBot polybot 1.0=PolyBot PolyBot=PolyBot Pompos/1.x http://dir.com/pompos.html=Dir.com Pompos/1.x pompos@iliad.fr=Iliad.fr Pompos/1.x=Free.fr Popdexter/1.0=Popdex.com PortalBSpider/2.0 (spider@portalb.com)=Portalb.com PortalBSpider/2.0=Portalb.com Project XP5 [2.03.07-111203]= XP5 Bot Project XP5=XP5 Bot PROve AnswerBot 4.0=Answerchase.com psbot/0.1 (+http://www.picsearch.com/bot.html)=Picsearch.com psbot/0.1=Picsearch.com psbot=Picsearch.com Qango.com Web Directory (http://www.qango.com/)=Qango.com Qango.com Web Directory= Qango.com QPCreep Test Rig ( We are not indexing, just testing ) =Quepasa.com QPCreep Test Rig=Quepasa.com QuepasaCreep ( crawler@quepasacorp.com )=Quepasa.com QuepasaCreep v0.9.1x=Quepasa.com QuepasaCreep=Quepasa.com QueryN Metasearch=Queryn.com rabaz (rabaz at gigabaz dot com)=Brainbot.com Rabaz=Brainbot.com RaBot=Daum.net ramBot xtreme x.x=Intersearch.de Reaper [2.03.10-031204] (http://www.sitesearch.ca/reaper/)=Sitesearch.ca Reaper [2.03.10-031204]=Sitesearch.ca Reaper/2.0x (+http://www.sitesearch.ca/reaper)=Sitesearch.ca Reaper/2.0x=Sitesearch.ca Reaper=Sitesearch.ca roach.smo.av.com-1.0=Altavista.com roach.smo.av.com-1.0=Altavista.com RoboCrawl (www.canadiancontent.net)=CanadianContent.net RoboCrawl=CanadianContent.net Robot/www.pj-search.com=PJ-Search.com Robot@SuperSnooper.Com=SuperSnooper.com robot@xyleme.com=Xyleme.com robot-master@expressus.com=Expressus.com robot-response@openfind.com.tw=Openfind.com.tw Robozilla/1.0=Dmoz.org Rotondo/3.1 libwww/5.3.1=Qualigo.de ru-robot=Rutgers.edu Scooter/1.0 scooter@pa.dec.com=Altavista.com Scooter/1.0=Altavista.com Scooter/1.1 (custom)=Altavista.com Scooter/2.0 G.R.A.B. V1.1.0 =Altavista.com Scooter/2.0 G.R.A.B. X2.0=Altavista.com Scooter/3.3.QA.pczukor=Altavista.com Scooter/3.3.vscooter=Altavista.com Scooter/3.3_SF=Altavista.com Scooter/3.3=Altavista.com Scooter_bh0-3.0.3=Altavista.com Scooter_trk3-3.0.3=Altavista.com Scooter=Altavista.com Scooter2_Mercator_3-1.0=Altavista.com Scooter2_Mercator_x-x.0=Altavista.com Scooter-3.0.EU=Altavista.com Scooter-3.0.FS=Altavista.com Scooter-3.0.HD=Altavista.com Scooter-3.0.VNS=Altavista.com Scooter-3.0QI=Altavista.com Scooter-3.2.BT=Altavista.com Scooter-3.2.DIL=Altavista.com Scooter-3.2.EX=Altavista.com Scooter-3.2.JT=Altavista.com Scooter-3.2.NIV=Altavista.com Scooter-3.2.SF0=Altavista.com Scooter-3.2.snippet=Altavista.com Scooter-3.2=Altavista.com Scooter-3.3dev=Altavista.com Scooter-ARS-1.1=Altavista.com Scooter-ARS-1.1-ih=Altavista.com scooter-venus-3.0.vns=Altavista.com Scooter-W3.1.2=Altavista.com Scooter-W3-1.0=Altavista.com Scrubby/=Scrubtheweb.com search.at V1.2=Search.at search.ch V1.4.2=Search.ch search.ch V1.4=Search.ch SearchExpress Spider0.99=SearchExpress.com Searchit-Now Robot/2.2 (+http://www.searchit-now.co.uk)=Searchit-now.co.uk Searchit-Now Robot/2.2=Searchit-now.co.uk SearchSpider.com/1.1=Searchspider.com Searchspider/=Searchspider.com Searchspider/1.2=Searchspider.com sebastien.ailleret@inria.fr=Inria.fr Seeker.lookseek.com=Lookseek.com SeznamBot/1.0=Seznam.cz SeznamBot/1.0 (+http://fulltext.seznam.cz/)=Seznam.cz Shark=Openfind.com sherlock_spider=Sherlock.com.cn SightQuestBot/=Sightquest.com SiteSpider +(http://www.SiteSpider.com/)=Sitespider.com SiteSpider=Sitespider.com SiteXpert=Xtreeme.com Skampy/0.9.x= Skaffe.com Skimpy/0.x=Skaffe.com Slarp/0.1=Only.com Slider_Search_v1-de=Slider.com Slurp.so/1.0= Yahoo.com Slurp/2.0j=Yahoo.com Slurp/2.0-KiteHourly=Yahoo.com Slurp/2.0-OwlWeekly=Yahoo.com Slurp/3.0-AU=Yahoo.com slurp@inktomi.com=Yahoo.com slurp@inktomi= Yahoo.com Slurp=Yahoo.com SlySearch/1.0=Turnitin.com SlySearch/1.x=Turnitin.com SlySearch=Turnitin.com speedfind ramBot xtreme 8.1=Speedfind.de speedfind ramBot xtreme=Speedfind.de Speedy Spider=EntireWeb.com Speedy Spider (Beta/x.x; speedy@entireweb.com)=EntireWeb.com Speedy_Spider (http://www.entireweb.com)=EntireWeb.com Speedy_Spider=EntireWeb.com Spida/0.1=Only.com Spider TraficDublu=Traficdublu.ro Spider/maxbot.com admin@maxbot.com=Maxbot.com Spider/maxbot.com=Maxbot.com spider@aeneid.com=Yahoo.com Spider_Monkey/=Spidermonkey.ca spider_monkey=Spidermonkey.ca SpiderMonkey/7.x=Spidermonkey.ca Sqworm/2.9.81-BETA (beta_release; 20011102-760; i686-pc-linux-gnu)=Aol.com Sqworm=Aol.com Steeler/1.x (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)=Steeler Bot Steeler/1.x=Steeler Bot Steeler=Steeler Bot Suchbot=Suchbot.de Suchknecht.at-Robot=Suchknecht.at super-robot@super.navi.ocn.ne.jp=Navi.ocn.ne.jp support@canseek.ca=Canseek.ca Surfnomore Spider v1.1=Surfnomore.com SwissSearch V1.2=SwissSearch SynoBot=Synomia.fr TaWWWantula=TaWWWantula teoma_admin@hawkholdings.com=Teoma.com teoma_agent1=Teoma.com TeraCrawl=TeraCrawl Teradex_Mapper=Mapper.teradex.com The Informant=The Informant TheSuBot/0.1 (www.thesubot.de)=TheSuBot.de TheSuBot/0.1=TheSuBot.de Toutatis 2.5-2=Hoppa.com Toutatis 3.3 (hoppa.com)=Hoppa.com Toutatis 4-19.6 (hoppa.com)=Hoppa.com TurnitinBot/x.x (http://www.turnitin.com/robot/crawlerinfo.html)=Turnitin.com TurnitinBot/x.x=Turnitin.com TurnitinBot=Turnitin.com Tutorial Crawler=Tutorgig.com Tv_Merc_resh_26_1_D-1.0=Altavista.com Tv_Merc_resh_26_1_D-1.0=Altavista.com TygoBot=Tygo.com UCmore=Ucmore.com UdmSearch=Mnogosearch.org UK Searcher Spider=Uksearcher.co.uk Ultraseek=Infoseek.com unlostBot=Unlost.com updated/0.1beta=Updated.com URLBlaze=Urlblaze.net UrlScope=UrlScope Vagabondo/1.x MT (webagent@wise-guys.nl)=Wise-guys.nl Vagabondo/2.0 MT (webagent at wise-guys dot nl)=Wise-guys.nl Vagabondo/2.0 MT (webagent@NOSPAMwise-guys.nl)=Wise-guys.nl Vagabondo/2.0 MT=Wise-guys.nl Vagabondo=Wise-guys.nl vspider=Verity.com webbandit/4.xx.0=WebBandit Webbandit=WebBandit Webclipping.com=WebClipping.com webcollage/1.xx=WebCollage.com webcollage=WebCollage.com WebCompass=WebCompass WebCrawler/3.0 Robot libwww/5.0a=WebCrawler WebCrawler-AddURL/2.0=WebCrawler WebFindBot(http://www.web-find.com)=Web-find.com WebFindBot=Web-find.com WebGather=WebGather WebGenie=WebGenie webmaster@intags.de=Intags.de whatUseek_winona/3.0=Whatuseek.com whatuseek=Whatuseek.com WhizBang! Lab=Whizbanglabs.com WIRE WebRefiner=Wire.co.uk wisenutbot=Looksmart.com WSCbot=WorldSearchCenter.com www.inktomisearch.com=Yahoo.com www.WebWombat.com.au=Webwombat.com.au YahooSeeker/CafeKelsa=Yahoo.com Yandex=Yandex.com Yellopet-Spider=YellowPet.com YottaShopping_Bot/4.12=YottaShopping.com Zao/0.1 (http://www.kototoi.org/zao/)=Zao Bot Zao/0.1=Zao Bot Zao/0.2=Zao Bot Zao-Crawler=Zao Bot Zippy v2.0 - Zippyfinder.com=Zippyfinder.com ZyBorg=Wisenut.com ---------------------------------- ALSO SEE http://www.robotstxt.org/wc/robots.html --------------------------------------