Web Resources.

Menu

Search Engine Spiders List

Introduction

Search Engine Spiders are used by search engines to index web sites for their databases.

To obtain information about other user agents not listed here go back to User Agent Info Home and select another user agent category.

Alphabetical Index

Clicking on any entry will take you to this robot's detailed description.

[ A B C D E F G H I J K L M N O P Q R S T U V W X Y Z other ]

A

User Agent Name Deployed by
Acoon Robot v1.01 (www.acoon.de) Acoon
AltaVista Intranet V1.0 AltaVista Search Intranet PX V1.0 webmaster@messebasel.ch Messe Basel
AltaVista Intranet V1.0 bluewindow.ch webmaster@bluewin.ch sear.ch
AltaVista Intranet V1.0 pta.at webmaster@pta.at search.at
AltaVista Intranet V1.0 Re-Index webmaster@bluewin.ch sear.ch
AltaVista Intranet V2.0 pta.at webmaster@pta.at search.at
AltaVista Intranet V2.0 Sear.ch ccc@bluewin.ch sear.ch
AltaVista Intranet V2.0 www.altavista.de search-support@altavista.de AltaVista Deutschland
AnzwersCrawl/2.0 (anzwerscrawl@anzwers.com.au; http://faq.anzwers.com.au/anzwerscrawl.html) Anzwers
Arachnoidea (arachnoidea@euroseek.com) EuroSeek
ArchitextSpider Excite

F

User Agent Name Deployed by
fido/1.0 Harvest/1.4.pl2 PlanetSearch

G

User Agent Name Deployed by
GAIS Robot/1.0B2 seednet
Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/) Google
Gulliver/1.2 Northern Light

I

User Agent Name Deployed by
Infoseek Sidewinder/0.9 Infoseek

K

User Agent Name Deployed by
KIT_Fireball/2.0 Fireball

L

User Agent Name Deployed by
lwp-trivial/1.27 Search 4 Free
Lycos_Spider_(T-Rex)/3.0 Lycos

M

User Agent Name Deployed by
Mozilla/2.0 (compatible; EZResult -- Internet Search Engine) EZResult
Mozilla/2.0 (compatible; T-H-U-N-D-E-R-S-T-O-N-E) Thunderstone
Mozilla/3.0 (compatible; MuscatFerret/1.4.1; olly@muscat.co.uk) EuroFerret
Mozilla/3.0 (compatible; MuscatFerret/1.5.2; olly@muscat.co.uk) EuroFerret
Mozilla/3.0 (compatible; MuscatFerret/1.5.3; olly@muscat.co.uk) EuroFerret
Mozilla/3.01 (Win95; I) Infoseek
Mozilla/4.04 [de] (Win95; I ;Kolibri gncwebbot) Kolibri Online
Mozilla/4.04 [de] (Win95; I ;Nav; Kolibri gncwebbot) Kolibri Online

S

User Agent Name Deployed by
Scooter/1.0 AltaVista
Scooter/1.0 scooter@pa.dec.com AltaVista
Scooter/1.1 (custom) AltaVista
Scooter/2.0 G.R.A.B. X2.0 AltaVista
Scooter/2.0 G.R.A.B. V1.1.0 AltaVista
search.at V1.2 search.at
sexsearcher Sexsearcher
Slurp/2.0 (slurp@inktomi.com; http://www.inktomi.com/slurp.html) Hotbot
Slurp.so/1.0 (slurp@inktomi.com; http://www.inktomi.com/slurp.html) Hotbot
SwissSearch V1.2 SwissSearch

T

User Agent Name Deployed by
The Informant The Informant

U

User Agent Name Deployed by
Ultraseek Infoseek

W

User Agent Name Deployed by
WebCrawler/3.0 Robot libwww/5.0a WebCrawler
WebCrawler-AddURL/2.0 WebCrawler
WiseWire WiseWire
WiseWire-Alpha-1.0 WiseWire
WiseWire-Alpha-Spider WiseWire
WiseWire-Alpha12-Spider971219a WiseWire
WiseWire-Alpha12-Spider(971223a) WiseWire
WiseWire-HotSpider-1.0 WiseWire
WiseWire-Spider WiseWire
WiseWire-Spider-1.0 WiseWire
WiseWire-Spider2 WiseWire
WiseWire-Widow-1.0 WiseWire
WiseWire-Widow-1.0r WiseWire
WiseWire-Widow-1.0-ALPHA12 WiseWire

Non-Alphanumerical / Empty Strings

User Agent Name Deployed by
[empty] Lycos


-----------------------------------------------------------

URL: http://www.siteware.ch/webresources/useragents/spiders/
Last updated: August 25, 1999 by [an error occurred while processing this directive]

Copyright © 1997-2005 by Christoph Rüegg.
All rights reserved.  [ Copyright Information ] [ Privacy Statement ]