Educational CyberPlayGround ®☰ Menu

Only a Partial, Not Updated list of Spiders

SECURITY
# 100hot
# 2kCity
# Acoon
# Ahoy! The Homepage Finder
# Aitai.ne.jp
# Aladin
# Alexa
# Ia_archiver
# AltaVista.com/.net
# AltaVista.DE
# AV Babelfish
# Amadillo
# Anagrarobot
# Ananzi
# Anzwers
# AOL Netfind
# Apidom (Guadeloupe)
# Internet Archiver
# Ask Jeeves
# Aspider
# atweb.com
# Auresys
# Backrub
# Baidu
# Bellnet
# BizSearch
# BlackSpider
# BlackWidow
# Blitzsuche
# BlueWindow
# Business interactive
# CACTVS Chemistry Spider
# Carter.bnf.fr
# cyveillance.com
# Columbus-Finder
# Combine System
# Companiesonline
# Concentric
# ConceptBot
# Crawler
# Crawler V 0.2.2 admin@crawler.de
# CS HKUST WISE
# DeWeb
# Directhit
# Eclipze
# Elzer
# Esoterica
# Eule
# EuroFerret (MuscatFerret)
# EuroOne
# EuroSeek
# Excite (ArchitextSpider)
# FAST (alltheweb.com)
# FunkyCat
# Felix IDE
# FetchRover
# FindLink.com
# findquick.com
# Fireball
# Fish search
# Flix
# Fouineur
# Robot Francoroute
# FunnelWeb
# galaxy
# gasta
# Germany.net
# Google
# Goo
# GoZero Search
# Hämähäkki
# Harvest
# HI (HTML Index) Search
# Hitsearch
# HKU WWW Octopus
# HotBot
# HotWired
# HTDig
# IBM_Planetwide
# ICQ
# ILSE
# Imagelock
# IncyWincy
# Incor
# Infomak
# InfoNavigator
# Informant
# Infoseek.com
# Infoseek.co.jp
# Inktomi
# Inquirus
# IntelliAgent
# Inter-Fux
# Inter2001
# Internet Portal 3000
# Intersearch (.at/.de)
# Israeli-search
# ISpi Crawler
# JAYDE.COM
# JAYDE.DE
# jblue
# Job Robot (Jobot)
# Jubii
# JumpStation
# Kansmen
# Kolibri
# LIBWWW-PERL
# Lotse
# LWP-TRIVIAL
# Lycos
# Lygo
# Magpie
# mande (Ecuador)
# Mcmail
# Mercator
# MerzScope
# Metager
# Microsoft.com
# Mirago
# Mister-Jack
# Motor
# Nathan
# NationalDirectory
# NDV
# Nederland.zoek
# NetCarta WebMap Engine
# Netscape Catalog Robot
# NetScoop
# Netseek
# NetPlaza (NEC-MeshExplorer)
# NHSE Web Forager
# Hit-Net
# Nomad
# NorthernLight
# NorthStar Robot
# The NWI Robot
# NTT Cyberspace Laboratories
# Nzexplorer
# Oberland Net
# Occam
# onlinepilot.de
# Openfind
# Open Text
# Peregrinator
# Phantom
# Pioneer
# PGP Key Agent
# Planetsearch
# Portal Juice
# psi.net
# Qango
# RBSE Spider
# Resume Robot
# Rex
# Robbie the Robot
# Roverbot
# SafetyNet Robot
# SavvySearch
# Scrubtheweb
# SearchExpress
# SearchKing
# SearchMil.com
# Searchopolis
# Senrigan
# SEVENtwentyfour Inc. Services
# SG-Scout
# Simmany Robot Ver1.0
# SiteTech-Rover
# Slider
# Smart Spider
# Spanner
# speedfind
# Splat! Search
# Spry Wizard Robot
# Spider
# SuperSnooper
# Szukacz (PL)
# Ussenioropen
# Suchmaschine.de
# SuperSnooper
# Teoma
# Thunderstone
# TitIn
# t-online (Infoseek)
# TITAN
# UCSD Crawl
# Valkyrie
# Vcommunities.com
# Verno
# Virtualpromote
# Vision-Search
# Voila
# VWbot
# vancouver-webpages.com
# W8 Search
# Web Wombat
# Wisewire
# W3M2
# Web21
# WebBandit Web Spider
# Web Core
# WebCrawler
# Web.de
# whatUseek
# WhoWhere Robot
# Wild Ferret Web Hopper
# Wise Wire Widow
# Wissenschaft-Channel
# Witch
# Wolong
# The World Wide Web Worm
# WWW-Collector
# Yeehaa



Various unresolved Spider IDs

# Microsoft URL Control
# antarcti.ca
# mannheim.dialin-gw.net
# tange.org
# mousa.dcs.ed.ac.uk
# pvt.sk
# ip178.zurich28.pub-ip.ch.psi.net
# srv.t-online.de
# cw01.ko1.srv.t-online.de
# cw02.ko1.srv.t-online.de
# cw03.ko1.srv.t-online.de
# cw04.ko1.srv.t-online.de
# wingate.el-stift-bir.umwelt-campus.de
# Newsalert
# visual ramBot xtreme 6.7.5


WARNING

# Browser User Agent
# Simulator to detect
# phantom/cloaking pages.
# Can't harm shadowSniper,
# but *DO NOT UNCOMMENT*!
#---------
# straylight.netmeridian.com
# 170.1.55.131


# Google
googlebot.com
# Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/)
c1.googlebot.com
209.185.253.169
# Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/)
c2.googlebot.com
209.185.253.167
# Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/)
c3.googlebot.com
209.185.253.168
# Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/)
c4.googlebot.com
209.185.253.170
209.185.253.171
c5.googlebot.com
209.185.253.172
c6.googlebot.com
209.185.253.173
c7.googlebot.com
209.185.253.174
c8.googlebot.com
209.185.253.175

SAMPLE ENTRIES:


# FetchRover
www.engsoftware.com/fetch.htm
192.41.15.30
# Fireball
fireball.de
# KIT-Fireball/2.0
hardrock.fireball.de
193.7.255.21
# KIT-Fireball/2.0
rap.fireball.de
193.7.255.130

© Educational CyberPlayGround ® All rights reserved world wide.