 |
|
Search Engine Spiders List
Introduction
Search Engine Spiders are used by search engines to index web sites for their databases.
To obtain information about other user agents not listed here go back to User Agent Info Home and select another user agent category.
Alphabetical Index
Clicking on any entry will take you to this robot's detailed description.
[ A B C D E F G H I J K L M N O P Q R S T U V W X Y Z other ]
A | |
| User Agent Name | Deployed by |
|---|---|
| Acoon Robot v1.01 (www.acoon.de) | Acoon |
| AltaVista Intranet V1.0 AltaVista Search Intranet PX V1.0 webmaster@messebasel.ch | Messe Basel |
| AltaVista Intranet V1.0 bluewindow.ch webmaster@bluewin.ch | sear.ch |
| AltaVista Intranet V1.0 pta.at webmaster@pta.at | search.at |
| AltaVista Intranet V1.0 Re-Index webmaster@bluewin.ch | sear.ch |
| AltaVista Intranet V2.0 pta.at webmaster@pta.at | search.at |
| AltaVista Intranet V2.0 Sear.ch ccc@bluewin.ch | sear.ch |
| AltaVista Intranet V2.0 www.altavista.de search-support@altavista.de | AltaVista Deutschland |
| AnzwersCrawl/2.0 (anzwerscrawl@anzwers.com.au; http://faq.anzwers.com.au/anzwerscrawl.html) | Anzwers |
| Arachnoidea (arachnoidea@euroseek.com) | EuroSeek |
| ArchitextSpider | Excite |
F | |
| User Agent Name | Deployed by |
| fido/1.0 Harvest/1.4.pl2 | PlanetSearch |
G | |
| User Agent Name | Deployed by |
| GAIS Robot/1.0B2 | seednet |
| Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/) | |
| Gulliver/1.2 | Northern Light |
I | |
| User Agent Name | Deployed by |
| Infoseek Sidewinder/0.9 | Infoseek |
K | |
| User Agent Name | Deployed by |
| KIT_Fireball/2.0 | Fireball |
L | |
| User Agent Name | Deployed by |
| lwp-trivial/1.27 | Search 4 Free |
| Lycos_Spider_(T-Rex)/3.0 | Lycos |
M | |
| User Agent Name | Deployed by |
| Mozilla/2.0 (compatible; EZResult -- Internet Search Engine) | EZResult |
| Mozilla/2.0 (compatible; T-H-U-N-D-E-R-S-T-O-N-E) | Thunderstone |
| Mozilla/3.0 (compatible; MuscatFerret/1.4.1; olly@muscat.co.uk) | EuroFerret |
| Mozilla/3.0 (compatible; MuscatFerret/1.5.2; olly@muscat.co.uk) | EuroFerret |
| Mozilla/3.0 (compatible; MuscatFerret/1.5.3; olly@muscat.co.uk) | EuroFerret |
| Mozilla/3.01 (Win95; I) | Infoseek |
| Mozilla/4.04 [de] (Win95; I ;Kolibri gncwebbot) | Kolibri Online |
| Mozilla/4.04 [de] (Win95; I ;Nav; Kolibri gncwebbot) | Kolibri Online |
S | |
| User Agent Name | Deployed by |
| Scooter/1.0 | AltaVista |
| Scooter/1.0 scooter@pa.dec.com | AltaVista |
| Scooter/1.1 (custom) | AltaVista |
| Scooter/2.0 G.R.A.B. X2.0 | AltaVista |
| Scooter/2.0 G.R.A.B. V1.1.0 | AltaVista |
| search.at V1.2 | search.at |
| sexsearcher | Sexsearcher |
| Slurp/2.0 (slurp@inktomi.com; http://www.inktomi.com/slurp.html) | Hotbot |
| Slurp.so/1.0 (slurp@inktomi.com; http://www.inktomi.com/slurp.html) | Hotbot |
| SwissSearch V1.2 | SwissSearch |
T | |
| User Agent Name | Deployed by |
| The Informant | The Informant |
U | |
| User Agent Name | Deployed by |
| Ultraseek | Infoseek |
W | |
| User Agent Name | Deployed by |
| WebCrawler/3.0 Robot libwww/5.0a | WebCrawler |
| WebCrawler-AddURL/2.0 | WebCrawler |
| WiseWire | WiseWire |
| WiseWire-Alpha-1.0 | WiseWire |
| WiseWire-Alpha-Spider | WiseWire |
| WiseWire-Alpha12-Spider971219a | WiseWire |
| WiseWire-Alpha12-Spider(971223a) | WiseWire |
| WiseWire-HotSpider-1.0 | WiseWire |
| WiseWire-Spider | WiseWire |
| WiseWire-Spider-1.0 | WiseWire |
| WiseWire-Spider2 | WiseWire |
| WiseWire-Widow-1.0 | WiseWire |
| WiseWire-Widow-1.0r | WiseWire |
| WiseWire-Widow-1.0-ALPHA12 | WiseWire |
Non-Alphanumerical / Empty Strings | |
| User Agent Name | Deployed by |
| [empty] | Lycos |
Last updated: August 25, 1999 by
| Copyright © 1997-2005 by Christoph Rüegg. | |
| All rights reserved. | [ Copyright Information ] [ Privacy Statement ] |