|
String
|
Description
|
| Mozilla |
Unknown robots from diff. IPs |
| Mozilla (libwhisker/2.4) |
libwhisker - HTTP client and utility - Perl library |
| Mozilla (Mozilla@somewhere.com) |
http://www.somewhere.com robot |
| Mozilla 4.0(compatible; BotSeer/1.0; +http://botseer.ist.psu.edu) |
BotSeer search engine for robots.txt |
| Mozilla/1.1 (compatible; MSPIE 2.0; Windows CE) |
PDA Pocket IE 2.x Windows CE |
| Mozilla/1.10 [en] (Compatible; RISC OS 3.70; Oregano 1.10) |
Oregano browser for RISC OS |
| Mozilla/1.22 (compatible; MSIE 2.0d; Windows NT) |
IE 2.x WinNT |
| Mozilla/1.22 (compatible; MSIE 5.01; PalmOS 3.0) EudoraWeb 2 |
EudoraWeb 2.0 browser (Eudora Internet Suite) for PalmOS |
| Mozilla/2.0 |
Dummy user agent - i.e. used by Namo Web Editor |
| Mozilla/2.0 (compatible; AOL 3.0; Mac_PowerPC) |
AOL Mac |
| Mozilla/2.0 (Compatible; AOL-IWENG 3.0; Win16) |
AOL Win 3.x |
| Mozilla/2.0 (compatible; Ask Jeeves) |
Ask Jeeves /Teoma robot |
| Mozilla/2.0 (compatible; Ask Jeeves/Teoma) |
Ask Jeeves /Teoma robot |
| Mozilla/2.0 (compatible; Ask Jeeves/Teoma; http://about.ask.com/en/docs/about/webmasters.shtml) |
Ask Jeeves /Teoma robot |
| Mozilla/2.0 (compatible; Ask Jeeves/Teoma; http://sp.ask.com/docs/about/tech_crawling.html) |
Ask Jeeves /Teoma robot |
| Mozilla/2.0 (compatible; EZResult -- Internet Search Engine) |
Direct Hit Robot |
| Mozilla/2.0 (compatible; MS FrontPage x.0) |
MS Frontpage x.x web editor |
| Mozilla/2.0 (compatible; MSIE 2.1; Mac_PowerPC) |
IE 2.x Mac Power PC |
| Mozilla/2.0 (compatible; MSIE 3.02; Update a; AK; Windows NT) |
IE 3.x WinNT |
| Mozilla/2.0 (compatible; MSIE 3.02; Update a; AOL 3.0; Windows 95) |
IE 3.x AOL Win95 |
| Mozilla/2.0 (compatible; MSIE 3.0; AK; Windows 95) |
IE 3.x Win95 |
| Mozilla/2.0 (compatible; MSIE 3.0; Windows 3.1) |
IE 3.x Win 3.1 |
| Mozilla/2.0 (compatible; MSIE 3.0B; Win32) |
IE 3.x WinXP |
| Mozilla/2.0 (compatible; NEWT ActiveX; Win32) |
Borland Delphi .OCX component used by WebCollector email harverster |
| Mozilla/2.0 (compatible; T-H-U-N-D-E-R-S-T-O-N-E) |
Thunderstone's Webinator Web indexing program |
| Mozilla/2.0 compatible; Check&Get 1.1x (Windows 98) |
Check&Get bookmark and link checking tool |
| Mozilla/2.01 (Win16; I) |
Netscape 2.x Win3.x International |
| Mozilla/2.02Gold (Win95; I) |
Netscape 2.x Gold Win95 |
| Mozilla/3.0 (compatible) |
Faked user agent for diff. purposes i.e.: - some download manager - E-mail harvesting |
| Mozilla/3.0 (compatible; AvantGo 3.2) |
AvantGo PDA browser |
| Mozilla/3.0 (compatible; Fluffy the spider; http://www.searchhippo.com/; info@searchhippo.com) |
Searchhippo robot |
| Mozilla/3.0 (compatible; HP Web PrintSmart 04b0 1.0.1.34) |
HP Web PrintSmart (discontinued) - web page printing software |
| Mozilla/3.0 (compatible; Indy Library) |
Internet Direct Library for Borland (often used as e-mail address collector and mass mailing tool) |
| Mozilla/3.0 (compatible; Linkman) |
Outertechs Linkman bookmark tool |
| Mozilla/3.0 (compatible; MuscatFerret/1.5.4; claude@euroferret.com) |
Euroferret robot |
| Mozilla/3.0 (compatible; MuscatFerret/1.5; olly@muscat.co.uk) |
Euroferret robot |
| Mozilla/3.0 (compatible; MuscatFerret/1.6.x; claude@euroferret.com) |
Euroferret robot |
| Mozilla/3.0 (compatible; netart generator/1.0; libwww-perl/5.64) |
Netart Generator - script generated random websites |
| Mozilla/3.0 (compatible; NetPositive/2.2) |
NetPositive BEOS browser |
| Mozilla/3.0 (compatible; Opera/3.0; Windows 3.1) v3.1 |
Opera 3.x Win3.x |
| Mozilla/3.0 (compatible; Opera/3.0; Windows 95/NT4) 3.2 |
Opera 3.x Win95/NT |
| Mozilla/3.0 (compatible; PerMan Surfer 3.0; Win95) |
Perman Surfer bookmark tool |
| Mozilla/3.0 (compatible; REL Software Web Link Validator 2.x) |
Web Link Validator link validation software |
| Mozilla/3.0 (compatible; scan4mail (advanced version) http://www.peterspages.net/?scan4mail) |
Scan4Mail online mail extraction service |
| Mozilla/3.0 (compatible; ScollSpider; http://www.webwobot.com) |
WebWobot UK search engine robot (82.43.129.2xx) |
| Mozilla/3.0 (compatible; Web Link Validator 2.x)Web Link Validator http://www.relsoftware.com/ link validation software |
Web Link Validator link validation software |
| Mozilla/3.0 (compatible; WebCapture x.x; Auto; Windows) |
Xelios Web Capture (now Wysigot) website downloading tool (Discontinued) |
| Mozilla/3.0 (compatible; Webinator-DEV01.home.iprospect.com/2.56) |
Iprospect search engine positioning using Thunderstone's Webinator |
| Mozilla/3.0 (compatible; Webinator-indexer.cyberalert.com/2.56) |
CyberAlert's Media Monitor using Thunderstone's Webinator |
| Mozilla/3.0 (Compatible;Viking/1.8) |
Viking server user/client |
| Mozilla/3.0 (DreamPassport/3.0) |
One of DC-Sakuras download manager user-agent names |
| Mozilla/3.0 (INGRID/3.0 MT; webcrawler@NOSPAMexperimental.net; http://aanmelden.ilse.nl/?aanmeld_mode=webhints) |
Ilse Netherlands robot (62.69.178.xx) |
| Mozilla/3.0 (Liberate DTV 1.1) |
Liberate DTV server suite / TV-emulator |
| Mozilla/3.0 (Planetweb/2.100 JS SSL US; Dreamcast US) |
Planetweb 2.1 Browser (discontinued) for Dreamcast |
| Mozilla/3.0 (Slurp.so/Goo; slurp@inktomi.com; http://www.inktomi.com/slurp.html) |
http://www.goo.ne.jp /Inktomi robot |
| Mozilla/3.0 (Slurp/cat; slurp@inktomi.com; http://www.inktomi.com/slurp.html) |
Inktomi (Hotbot-Lycos-NBCi) robot - 72.30.61.xx(x) |
| Mozilla/3.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html) |
Inktomi (Hotbot-Lycos-NBCi) robot - 72.30.61.xx(x) |
| Mozilla/3.0 (Vagabondo/1.1 MT; webcrawler@NOSPAMwise-guys.nl; http://webagent.wise-guys.nl/) |
WiseGuys robot Netherland - 82.94.216.2 |
| Mozilla/3.0 (Vagabondo/1.x MT; webagent@wise-guys.nl; http://webagent.wise-guys.nl/) |
WiseGuys robot Netherland - 82.94.216.2 |
| Mozilla/3.0 (Vagabondo/2.0 MT; webcrawler@NOSPAMexperimental.net; http://aanmelden.ilse.nl/?aanmeld_mode=webhints) |
Ilse Netherlands robot |
| Mozilla/3.0 (Vagabondo/2.0 MT; webcrawler@NOSPAMwise-guys.nl; http://webagent.wise-guys.nl/) |
WiseGuys robot Netherland - 82.94.216.2 |
| Mozilla/3.0 (Win16; I) |
Netscape 3.x Win3.x |
| Mozilla/3.0 (Win95; I) |
Netscape 3.x Win95 |
| Mozilla/3.0 (WinNT; I) |
Netscape 3.x WinNT |
| Mozilla/3.0 (WorldGate Gazelle 3.5.1 build 11; FreeBSD2.2.8-STABLE) |
Netscape 3.x FreeBSD |
| Mozilla/3.0 (X11; I; OSF1 V4.0 alpha) |
Netscape 3.x OSF1 V4.0 alpha |
| Mozilla/3.0 NAVIO_AOLTV (11; 13; Philips; PH200; 1; R2.0C36_AOL.0110OPTIK; R2.0.0139d_OPTIK) |
AOL Web TV |
| Mozilla/3.0 WebTV/1.2 (compatible; MSIE 2.0) |
WebTV |
| Mozilla/3.01 (compatible; AmigaVoyager/2.95; AmigaOS/MC680x0) |
Amiga Voyager Browser Amiga |
| Mozilla/3.01 (Compatible; Links2Go Similarity Engine) |
Links2Go robot |
| Mozilla/3.01 (compatible; Netbox/3.5 R92; Linux 2.2) |
Netgem Netbox cable modem TV Box Linux |
| Mozilla/3.01-C-MACOS8 (Macintosh; I; PPC) |
Netscape 3.x Mac |
| Mozilla/3.01Gold (X11; I; Linux 2.0.32 i486) |
Netscape 3.x Linux |
| Mozilla/3.01Gold (X11; I; SunOS 5.5.1 sun4m) |
Netscape 3.x SunOS |
| Mozilla/3.01SGoldC-SGI (X11; I; IRIX 6.3 IP32) |
Netscape 3.x Irix |
| Mozilla/3.04 (compatible; ANTFresco/2.13; RISC OS 4.02) |
ANT Fresco Browser Risc OS |
| Mozilla/3.04 (compatible; NCBrowser/2.35; ANTFresco/2.17; RISC OS-NC 5.13 Laz1UK1309) |
NCBrowser ANT Fresco Browser Risc OS |
| Mozilla/3.04 (compatible;QNX Voyager 2.03B ;Photon) |
QNX OS Voyager embedded browser |
| Mozilla/3.x (I-Opener 1.1; Netpliance) |
I-Opener (was www.netpliance.com/) web PC |
| Mozilla/4.0 |
Yahoo Mindset: Intent-driven Search (66.228.182.1xx) |
| Mozilla/4.0 (agadine3.0) www.agada.de |
Agada search (Germany) robot |
| Mozilla/4.0 (Compatible); URLBase 6 |
URLBase 6 bookmark manager |
| Mozilla/4.0 (compatible: AstraSpider V.2.1 : astrafind.com) |
Astrafind! adult search robot (66.98.252.xx) |
| Mozilla/4.0 (compatible; Vagabondo/2.2; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/) |
WiseGuys robot Netherland - 82.94.216.2 |
| Mozilla/4.0 (compatible; Vagabondo/4.0Beta; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/) |
WiseGuys robot Netherland - 82.94.216.2 |
| Mozilla/4.0 (compatible; <a href=http://www.reget.com>ReGet Deluxe 5.1</a>; Windows NT 5.1) |
ReGet Deluxe! download manager |
| Mozilla/4.0 (compatible; Advanced Email Extractor v2.xx) |
Advanced Email Extractor e-mail collector (spam bot) |
| Mozilla/4.0 (compatible; Arachmo) |
Arachmo Spider - web site file extraction tool |
| Mozilla/4.0 (compatible; BorderManager 3.0) |
Novell Border Manager security suite |
| Mozilla/4.0 (compatible; BOTW Spider; +http://botw.org) |
Best of the Web directory link checking |
| Mozilla/4.0 (compatible; B_L_I_T_Z_B_O_T) |
Blitzsuche Germany robot |
| Mozilla/4.0 (compatible; Cerberian Drtrs Version-3.2-Build-0) |
Content Control from Blue Coat |
| Mozilla/4.0 (compatible; Check&Get 3.0; Windows NT) |
Check&Get bookmark manager, web change monitor and archiver |
| Mozilla/4.0 (compatible; ChristCrawler.com ChristCrawler@ChristCENTRAL.com) |
Christcentral.com Christcrawler (was www.christcrawler.com) |
| Mozilla/4.0 (compatible; crawlx, crawler@trd.overture.com) |
Yahoo Search Marketing crawler (68.142.211.1xx) |
| Mozilla/4.0 (compatible; DAUMOA-video; +http://ws.daum.net/aboutkr.html) |
DAUMOA - Daum search Korea robot (211.115.109.xxx) |
| Mozilla/4.0 (compatible; DepSpid/5.0x; +http://about.depspid.net) |
DepSpid distributed web crawler for link dependencies |
| Mozilla/4.0 (compatible; DnloadMage 1.0) |
Download Mage download manager |
| Mozilla/4.0 (compatible; FastCrawler3 support-fastcrawler3@fast.no) |
Fast/Alltheweb crawler |
| Mozilla/4.0 (compatible; FDSE robot) |
Fluid Dynamics Search Engine (FDSE) robot used by Abadoor.de |
| Mozilla/4.0 (compatible; GPU p2p crawler http://gpu.sourceforge.net/search_engine.php) |
GPU Distributed Search Engine crawler |
| Mozilla/4.0 (compatible; grub-client-0.2.x; Crawl your stuff with http://grub.org) |
Grub open source crawler |
| Mozilla/4.0 (compatible; grub-client-0.3.x; Crawl your own stuff with http://grub.org) |
Grub open source crawler |
| Mozilla/4.0 (compatible; grub-client-2.x) |
Grub open source crawler used by Looksmart ( 64.241.242.xx) |
| Mozilla/4.0 (compatible; ibisBrowser) |
ibisBrowser Japanese mobile browser |
| Mozilla/4.0 (compatible; ICS 1.2.xxx) |
Novell iChain Cool Solutions caching |
| Mozilla/4.0 (compatible; IE-Favorites-Check-0.5) |
IE Favorites Check - Bookmark manager |
| Mozilla/4.0 (compatible; Iplexx Spider/1.0 http://www.iplexx.at) |
Iplexx Austria (webhosting company) logfile spamming bot |
| Mozilla/4.0 (compatible; KeepNI web site monitor) |
KeepNi Monitors - Web site monitoring / link checking tool |
| Mozilla/4.0 (compatible; Link Utility; http://net-promoter.com) |
NetPromoter Link Utility link checking tool |
| Mozilla/4.0 (compatible; Lotus-Notes/5.0; Windows-NT) |
Lotus Notes 5.0 browser |
| Mozilla/4.0 (compatible; MSIE 4.01; AOL 4.0; Windows 98) |
IE 4.x AOL Win98 |
| Mozilla/4.0 (compatible; MSIE 4.01; Mac_PowerPC) |
IE 4.x Mac Power PC |
| Mozilla/4.0 (compatible; MSIE 4.01; MSIECrawler; Windows 95) |
Internet Explorer 4.0 URL check |
| Mozilla/4.0 (compatible; MSIE 4.01; Vonna.com b o t) |
Vonna search robot |
| Mozilla/4.0 (compatible; MSIE 4.01; Windows 95) |
IE 4.x Win95 |
| Mozilla/4.0 (compatible; MSIE 4.01; Windows CE; MSN Companion 2.0; 800x600; Compaq) |
IE PDA Browser Windows CE |
| Mozilla/4.0 (compatible; MSIE 4.01; Windows CE; PPC; 240x320; SPV M700; OpVer 19.123.2.733) OrangeBot-Mobile 2008.0 (mobilesearch.support@orange-ftgroup.com) |
Orange France robot for mobiles |
| Mozilla/4.0 (compatible; MSIE 4.01; Windows CE; PPS; 240x320) |
IE for Windows CE on a PocketPC (HP iPAQ) |
| Mozilla/4.0 (compatible; MSIE 4.01; Windows NT Windows CE) |
IE PDA Browser Windows CE |
| Mozilla/4.0 (compatible; MSIE 4.01; Windows NT) |
IE 4.x WinNT |
| Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 4.0 Robot) Microsoft |
diff. IPs / services i.e.: - Microsoft server information robot (see link) - Okanagan Internet Junction web filter (robot) |
| Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; Site Server 3.0 Robot) ACR |
Unknown robot from American College of Radiology (ACR) running MS Site Server |
| Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; Site Server 3.0 Robot) Indonesia Interactive |
Indonesia Interactive Web-portal robot on MS Site Server |
| Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; Site Server 3.0 Robot) WebQuest Designs |
Webquestdesigns hosting |
| Mozilla/4.0 (compatible; MSIE 5.01; Windows 95) via <B>Avirt Gateway Server</B> v4.0 |
Avirt Gateway proxy server |
| Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0) (samualt9@bigfoot.com) |
Metacarta.com (66.28.xx.xxx) robot |
| Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0; NetCaptor 6.5.0RC1) |
NetCaptor IE browser addon |
| Mozilla/4.0 (compatible; MSIE 5.0; AOL 5.0; Windows 95; DigExt; Gateway2000; sureseeker.com) |
IE 5.x AOL Win95 Sureseeker search plugin |
| Mozilla/4.0 (compatible; MSIE 5.0; Mac_PowerPC; AtHome021) |
IE 5.x Mac PowerPC AtHome user |
| Mozilla/4.0 (compatible; MSIE 5.0; NetNose-Crawler 2.0; A New Search Experience: http://www.netnose.com) |
www.netnose.com crawler |
| Mozilla/4.0 (compatible; MSIE 5.0; Win32) via proxy gateway CERN-HTTPD/3.0 libwww/2.17 |
WinXP via CERN httpd proxy server |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) TrueRobot; 1.5 |
Echo.com robot |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot BETA 1.2 (http://www.voila.com/) |
Voila.fr robot |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot; 1.6 |
Voila.fr robot |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows ME) Opera 5.11 [en] |
WinME Opera 5.x |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows ME; Link Checker 2.x.xx http://www.kyosoft.com) |
Kyosoft's Link Checker |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt; DTS Agent |
Beijing Express Email Address Extractor via DHCP Data Transport Services (DTS) |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; Girafabot; girafabot at girafa dot com; http://www.girafa.com) |
Girafa (browser plug-in) robot |
| Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com; www.psychedelix.com) |
Galaxy robot (63.121.41.xxx) |
| Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com; www.psychedelix.com/; http://www.galaxy.com/info/crawler.html) |
Galaxy robot (63.121.41.xxx) |
| Mozilla/4.0 (compatible; MSIE 5.0; YANDEX) |
Yandex Search Russia link checking (213.180.206.2xx) |
| Mozilla/4.0 (compatible; MSIE 5.5; AOL 4.0; Windows 98; GoBeez (www.gobeez.com)) |
Gobeez starting page plugin |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows 95; Transmission Segment; Hotbar 2.0) |
IE 5.5 Win95 Hotbar plug-in |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Crazy Browser 1.x.x) |
Crazy Browser - IE based tabbed Browser |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; KITV4.7 Wanadoo) |
Wanadoo Internet services |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; SAFEXPLORER TL) |
Safexplorer (safexplorer.com - site is offline) kids browser |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; SYMPA; Katiesoft 7; SimulBrowse 3.0) |
Katiesoft Scroll (ex www.katiesoft.com now discarded) & SimulBrowse (ex www.simulbrowse.com now dead) IE browser plugins |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Win 9x 4.90; BTinternet V8.1) |
Windows ME BTOpenworld Internet services |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Win 9x 4.90; MSIECrawler) |
Windows ME Internet Explorer URL check |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; obot) |
Cobion Germany Brand Protection Services robot |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; QXW03018) |
Cobion Germany Brand Protection Services robot |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Active Cache Request |
IE 5.5 Win2000 / user agent |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Fetch API Request |
Maybe: - MS Internet Security & Acceleration Server (ISA) cache refreshing request (see link) or - IE 5.5 Win2000 probably with some (website) API request component (see 2nd link) - suspected as email-harvester / site scanning tool (see http://www.byte.com/documents/s=493/byt20010208s0001/index.htm |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; .NET CLR 1.0.3705) |
IE 5.5 Win2000 with MS.NET SDK |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; AIRF) |
IE 5.5 Win2000 / user agent w. AI RoboForm (AIRF) password manager |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; AspTear 1.5) |
AspTear URL fetching program component / Download32.com spider |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; N_o_k_i_a) |
Nokia.com network |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; T312461) RPT-HTTPClient/0.3-3E |
Unknown Object Sciences Corp. robot using the HTTPClient |
| Mozilla/4.0 (compatible; MSIE 6.0 compatible; Asterias Crawler v4; +http://www.singingfish.com/help/spider.html; webmaster@singingfish.com); SpiderThread Revision: 3.10 |
Singingfish media spider (64.12.186.2xx) via AOL search |
| Mozilla/4.0 (compatible; MSIE 6.0; AOL 9.0; Windows 98; .NET CLR 1.1.4322; MEGAUPLOAD 2.0) |
Megaupload Mega Manager - Download manager toolbar for IE |
| Mozilla/4.0 (compatible; MSIE 6.0; AOL 9.0; Windows NT 5.1; SV1; HbTools 4.7.2) |
Hotbar IE graphical skin |
| Mozilla/4.0 (compatible; MSIE 6.0; MSIE 5.5; Windows NT 5.1) Skampy/0.9.x [en] |
Skaffe.com directory link checker |
| Mozilla/4.0 (compatible; MSIE 6.0; TargetSeek/1.0; +http://www.targetgroups.net/TargetSeek.html) |
TargetSeek Crawler concerning electronics industry product announcements |
| Mozilla/4.0 (compatible; MSIE 6.0; Win32) WebWasher 3.0 |
IE 6.0 WebWasher ad filter |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98) REL Software Web Link Validator 2.x) |
Web Link Validator link validation software |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98) Web Link Validator 2.x) |
Web Link Validator link validation software |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Net M@nager V3.02 - www.vinn.com.au) |
IE 6.0 Netmanager IE add-on |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; support@illumit.com; http://www.illumit.com/Products/weblight/) |
WebLight web analyzer & link checker |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90; http://www.Abolimba.de) |
Abolimba Multibrowser - IE based browser |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; Lunascape 2.1.3) |
Lunascape IE based browser (Japan) |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Google Wireless Transcoder;) |
Google wireless transcoder (GWT) proxy for rewriting websites for mobiles |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; ODP entries t_st; http://tuezilla.de/t_st-odp-entries-agent.html) |
Tüzilla (Germany) - ODP link checking using Robozilla |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; ODP links test; http://tuezilla.de/test-odp-links-agent.html) |
Tüzilla (Germany) - ODP link checking using Robozilla |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; ZoomSpider.net bot; .NET CLR 1.1.4322) |
ZoomSpider.Net indexing robot for several directorys |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) (dns_admin@c-a-s-h.com) |
unknown robot from 64.246.44.xx |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Covac UPPS Cathan 1.2.5;) |
Covac Software UPPS (Universal PHP Proxy Server) - free public proxy server |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Crayon Crawler; snprtz|T04056566514940; (R1 1.5)) |
GetNetWise Crayon Crawler web filter |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Deepnet Explorer) |
Deepnet Explorer - IE based browser |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; heritrix/1.3.0 http://www.cs.washington.edu/research/networking/websys/) |
Heritrix Internet Archive's open-source web project used by Analysis Projects at UW |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Hotbar 3.0) |
IE 6x WinXP Hotbar plug-in |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; iOpus-I-M) |
IE 6x WinXP iOpus Internet Macros - Internet-based macro recorder |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; iRider 2.21.1108; FDM) |
iRider - IE based browser / Free Download Manager (FDM) |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; KKman3.0) |
KKman http://www.kkman.com/ - Japanese IE based browser |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MathPlayer2.0) |
IE 6x WinXP MathPlayer mathematical notation plugin |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Maxthon) |
Maxton (ex MyIE2) - IE based browser |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; PeoplePal 3.0; MSIECrawler) |
IE 6x WinXP peoplepc online PeoplePal IE toolbar |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312461; IOpener Release 1.1.04) |
IE 6x WinXP / I-Opener (was www.netpliance.com/) web PC |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; QihooBot 1.0 qihoobot@qihoo.net) |
Qihoo search (China) robot |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SIMBAR Enabled; InfoPath.1) |
SimBar IE toolbar for accessing The Sims sites / Infopath IE form & spreadsheet plugin |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; StumbleUpon.com 1.760; .NET CLR 1.1.4322) |
IE 6x WinXP Stumble Upon IE toolbar |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Embedded Web Browser from: http://bsalsa.com/; MSIECrawler) |
Balsa Productions embedded web browser package for Borland Delphi |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; http://www.changedetection.com/bot.html ) |
ChangeDetection robot for web page monitoring |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322) |
IE 6x WinXP also used by WebSite Pro HTML editor |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; DX-Browser 5.0.0.0) |
DX-Browser - German IE based browser |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; FunWebProducts; ezPeer+ v1.0 Beta (0.4.1.98); ezPeer+ v1.0 (0.5.0.00); .NET CLR 1.1.4322; MSIECrawler) |
ezPeer+ P2P IE addon |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; IBP; .NET CLR 1.1.4322) |
Axandra IBP website promotion software ? |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; MRA 4.3 (build 01218)) |
MRA = Mail.ru Agent - Instant Messenger / VoIP |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) |
MSN Search robot (207.46.89.xx) |
| Mozilla/4.0 (compatible; MSIE 7.0; Win32) Link Commander 4.0 |
Link Commander bookmark manager |
| Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; bgft) |
IE 7.0 - WinXP |
| Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; GTB5; User-agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; http://bsalsa.com) ; .NET CLR 2.0.50727) |
GTB = Google Toolbar Internet Explorer add-on |
| Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; Tablet PC 2.0) |
MSIE 7.0 *and* Trident token used by Internet Explorer 8 in compatibility view mode |
| Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 1.1.4322; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648) |
Internet Explorer 8 |
| Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0) |
IE 8.0 (beta) on Win Vista |
| Mozilla/4.0 (compatible; MSIE enviable; DAUMOA 2.0; DAUM Web Robot; Daum Communications Corp., Korea; +http://ws.daum.net/aboutkr.html) |
DAUMOA - Daum search Korea robot (211.115.109.xxx) |
| Mozilla/4.0 (compatible; MSIE is not me; DAUMOA/1.0.1; DAUM Web Robot; Daum Communications Corp., Korea) |
DAUMOA - Daum search Korea robot (211.115.109.xxx) |
| Mozilla/4.0 (compatible; NaverBot/1.0; http://help.naver.com/delete_main.asp) |
Naver Search Korea Naverbot |
| Mozilla/4.0 (compatible; Netcraft Web Server Survey) |
Netcraft webserver info |
| Mozilla/4.0 (compatible; NetPromoter Spider;http://www.net-promoter.com/) |
NetPromoter Link Utility link checking tool |
| Mozilla/4.0 (compatible; Opera/3.0; Windows 4.10) 3.51 [en] |
Opera 3.x WinNT |
| Mozilla/4.0 (compatible; Powermarks/3.5; Windows 95/98/2000/NT) |
Powermarks bookmark manager |
| Mozilla/4.0 (compatible; RSS Popper) |
RSS Popper - MS Outlook RSS reader plugin |
| Mozilla/4.0 (compatible; SiteKiosk 4.0; MSIE 5.0; Windows 98; SiteCoach 1.0) |
SiteKiosk public terminal browser |
| Mozilla/4.0 (compatible; SpeedySpider; www.entireweb.com) |
Entireweb Search Speedyspider (62.13.25.xxx) |
| Mozilla/4.0 (compatible; SPENG) |
SiteProbe - website status checking |
| Mozilla/4.0 (compatible; SuperCleaner 2.xx; Windows 98) |
Super Cleaner privacy tool (bookmark checking) |
| Mozilla/4.0 (compatible; Synapse) |
Synapse - Apache web service for processing XML documents |
| Mozilla/4.0 (compatible; WebCapture 3.0; Windows) |
Web2PDF - Adobe Acrobat plugin for site traversal and other services for the Web Capture feature |
| Mozilla/4.0 (compatible; Win32; WinHttp.WinHttpRequest.5) |
Windows HTTP Services (WinHTTP / XML-parser) |
| Mozilla/4.0 (compatible; WSN Links) |
WSN Links PHP directory software |
| Mozilla/4.0 (compatible; www.euro-directory.com; urlchecker1.0) |
Euro Directory (German / Austrian) directory link checking |
| Mozilla/4.0 (compatible; www.galaxy.com) |
Galaxy robot |
| Mozilla/4.0 (compatible; www.linkguard.com Linkguard Online 1.0; Windows NT) |
Linkguard.com link validation (service is offline) |
| Mozilla/4.0 (compatible; Y!J; for robot study; keyoshid) |
Yahoo Search Japan robot (203.141.52.) |
| Mozilla/4.0 (compatible; Yahoo Japan; for robot study; kasugiya) |
Yahoo Japan robot (202.93.76.xx) |
| Mozilla/4.0 (compatible;MSIE 6.0; Windows NT 5.0; H010818) |
Faked IE id string used by DeepTrawl link checking tool |
| Mozilla/4.0 (fantomBrowser) |
spoofed referer by Fantomaster (Multiblocker) anonymity products |
| Mozilla/4.0 (fantomCrew Browser) |
spoofed referer by Fantomaster (Multiblocker) anonymity products |
| Mozilla/4.0 (hhjhj@yahoo.com) |
unknown robot from - 64.57.223.40 - 66.28.233.xxx (cogentco.com) |
| Mozilla/4.0 (JemmaTheTourist;http://www.activtourist.com) |
Activtourist Jemma spider |
| Mozilla/4.0 (MobilePhone PM-8200/US/1.0) NetFront/3.x MMP/2.0 |
NetFront (v3.x) for Pocket PC (here on Sanyo PM-8200 cell phone) |
| Mozilla/4.0 (MobilePhone SCP-5500/US/1.0) NetFront/3.0 MMP/2.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html) |
Google robot from 66.249.66.xxx |
| Mozilla/4.0 (MobilePhone SCP-5500/US/1.0) NetFront/3.0 MMP/2.0 FAKE (compatible; Googlebot/2.1; http://www.google.com/bot.html) |
Google robot from 66.249.66.xxx |
| Mozilla/4.0 (Mozilla; http://www.mozilla.org/docs/en/bot.html; master@mozilla.com) |
Unknown robot from Mozilla.org |
| Mozilla/4.0 (Sleek Spider/1.2) |
ASI - Any Search Info robot |
| Mozilla/4.0 compatible FurlBot/Furl Search 2.0 (FurlBot; http://www.furl.net; wn.furlbot@looksmart.net) |
Furl (Looksmart) online bookmark tool robot |
| Mozilla/4.0 compatible ZyBorg/1.0 (wn.zyborg@looksmart.net; http://www.WISEnutbot.com) |
Wisenut robot |
| Mozilla/4.0 compatible ZyBorg/1.0 (ZyBorg@WISEnutbot.com; http://www.WISEnutbot.com) |
Wisenut robot |
| Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.zyborg@looksmart.net; http://www.WISEnutbot.com) |
Wisenut robot |
| Mozilla/4.0 compatible ZyBorg/1.0 for Homepage (ZyBorg@WISEnutbot.com; http://www.WISEnutbot.com) |
Wisenut robot |
| Mozilla/4.0 efp@gmx.net |
Unknown robot from 66.230.140.xx (argon.oxeo.com) maybe an e-mail collector |
| Mozilla/4.0 WebTV/2.6 (compatible; MSIE 4.0) |
WebTV |
| Mozilla/4.0 [en] (Ask Jeeves Corporate Spider) |
Ask / Ask Jeeves robot |
| Mozilla/4.0(compatible; Zealbot 1.0) |
LookSmart spider |
| Mozilla/4.01 (compatible; NORAD National Defence Network) |
HideMe - Web based anonymous proxy server service |
| Mozilla/4.01 [en](Win95;I) |
Some download manager spoofing Netscape 4.01 |
| Mozilla/4.02 [en] (X11; I; SunOS 5.6 sun4u) |
Netscape 4.x SunOS 5.6 |
| Mozilla/4.04 (compatible; Dulance bot; +http://www.dulance.com/bot.jsp) |
Dulance Bot - Dulance automated price comparison engine |
| Mozilla/4.04 [en] (X11; I; HP-UX B.10.20 9000/712) |
Netscape 4.x HP-Unix |
| Mozilla/4.04 [en] (X11; I; IRIX 5.3 IP22) |
Netscape 4.x IRIX |
| Mozilla/4.05 (Macintosh; I; 68K Nav) |
Netscape 4.x Macintosh 68k |
| Mozilla/4.05 (Macintosh; I; PPC Nav) |
Netscape 4.x Macintosh PowerPC |
| Mozilla/4.05 [en] (X11; I; SunOS 4.1.4 sun4m) |
Netscape 4.x SunOS 4.1.4 |
| "Mozilla/4.08 [en] (Win98; U ;Nav)" [Spaces are not mistakes]Help->About: "Version 4.08 [en]-98306" |
Someone copied the help function in the referrer field ? |
| Mozilla/4.08 [en] (WinNT; U) |
Netscape 4.x WinNT |
| Mozilla/4.0_(compatible;_MSIE_5.0;_Windows_95)_TrueRobot/1.4 libwww/5.2.8 |
Echo.com robot |
| Mozilla/4.0_(compatible;_MSIE_5.0;_Windows_95)_VoilaBot/1.6 libwww/5.3.2 |
Voila.fr robot |
| Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98) |
HTTrack Offline Browser |
| Mozilla/4.5 (compatible; iCab 2.5.3; Macintosh; I; PPC) |
iCab MAC Web browser MAC Power PC |
| Mozilla/4.5 (compatible; OmniWeb/4.0.5; Mac_PowerPC) |
OmniWeb 4.x.x Mac browser |
| Mozilla/4.5 (compatible; OmniWeb/4.1-beta-1; Mac_PowerPC) |
OmniWeb 4.x.x Mac browser |
| Mozilla/4.5 RPT-HTTPClient/0.3-2 |
different IPs using the HTTPClient library (mostly link checking) |
| Mozilla/4.5 [en]C-CCK-MCD {RuralNet} (Win98; I) |
RuralNet Internet Services |
| Mozilla/4.5b1 [en] (X11; I; Linux 2.0.35 i586) |
Netscape 4.x Linux |
| Mozilla/4.6 [en] (http://www.cnet.com/) |
Cnet robot for Search.com (216.239.114.xx) |
| Mozilla/4.61 [de] (OS/2; I) |
Netscape 4.x OS/2 |
| Mozilla/4.61 [en] (X11; U; ) - BrowseX (2.0.0 Windows) |
BrowseX cross-platform browser |
| Mozilla/4.7 |
Nameprotect (12.148.196.128 - 12.148.196.255) snoopbot |
| Mozilla/4.7 (compatible; http://eidetica.com/spider) |
Eidetica earch and text mining spider |
| Mozilla/4.7 (compatible; Intelliseek; http://www.intelliseek.com) |
Intelliseek (64.158.138.xx) robot |
| Mozilla/4.7 (compatible; OffByOne; Windows 98) Webster Pro V3.2 |
OffByOne Browser |
| Mozilla/4.7 (compatible; Whizbang) |
WhizBang! Labs information extraction robot |
| Mozilla/4.7 (compatible; WhizBang; http://www.whizbang.com/crawler) |
WhizBang! Labs information extraction robot |
| Mozilla/4.7 [en](BecomeBot@exava.com) |
BecomeBot - Becomecom shopping search (64.124.85.xx(x)) |
| Mozilla/4.7 [en](Exabot@exava.com) |
Exabot - exava shopping search (64.124.85.xx(x)) |
| Mozilla/4.7 [en]C-CCK-MCD {Yahoo;YIP052400} (Win95; I) |
unknown |
| Mozilla/4.72 [en] (BACS http://www.ba.be) |
http://www.ba.be robot |
| Mozilla/4.72C-CCK-MCD Caldera Systems OpenLinux [en] (X11; U; Linux 2.2.14 i686) |
Netscpape 4.7x Caldera Open Linux Pentium III |
| Mozilla/4.75C-ja [ja] (X11; U; OSF1 V5.1 alpha) |
Netscape 4.7x Japan OSF1 alpha |
| Mozilla/4.76 (Windows 98; U) Opera 5.12 [en] |
Opera 5.x Win 98 |
| Mozilla/4.76 [en] (X11; U; FreeBSD 4.4-STABLE i386) |
Netscape 4.7x FreeBSD |
| Mozilla/4.76 [en] (X11; U; SunOS 5.7 sun4u) |
Netscape 4.7x SunOS |
| Mozilla/4.77C-SGI [en] (X11; U; IRIX 6.5 IP32) |
IRIX 6.5 |
| Mozilla/5.0 |
GigaMedia / NTT DoCoMo robot |
| Mozilla/5.0 (+http://www.eurekster.com/mammoth) Mammoth/0.1 |
Eurekster Swicki community search using SLI-Systems site search engine Mammoth |
| Mozilla/5.0 (+http://www.sli-systems.com/) Mammoth/0.1 |
SLI Systems mammoth robot |
| Mozilla/5.0 (Clustered-Search-Bot/1.0; support@clush.com; http://www.clush.com/) |
Clush search robot |
| Mozilla/5.0 (compatible) GM RSS Panel X |
Greasemonkey RSS panel Firefox plugin |
| Mozilla/5.0 (compatible; +http://www.evri.com/evrinid) |
Evri search robot |
| Mozilla/5.0 (compatible; Abonti/0.8 - http://www.abonti.com) |
Abonti WebSearch beta robot |
| Mozilla/5.0 (compatible; AnsearchBot/1.x; +http://www.ansearch.com.au/) |
Ansearch Australian search robot |
| Mozilla/5.0 (compatible; archive.org_bot/1.10.0 +http://www.loc.gov/minerva/crawl.html) |
The Library of Congress Minerva crawler |
| Mozilla/5.0 (compatible; archive.org_bot/1.13.1x http://crawler.archive.org) |
Heritrix - The Internet Archive's open-source crawler (207.241.225.2xx) |
| Mozilla/5.0 (compatible; archive.org_bot/1.5.0-200506132127 http://crawler.archive.org) Hurricane Katrina |
Heritrix - The Internet Archive's open-source crawler |
| Mozilla/5.0 (compatible; Ask Jeeves/Teoma; http://about.ask.com/en/docs/about/webmasters.shtml) |
Ask Jeeves /Teoma robot |
| Mozilla/5.0 (compatible; BanBots/2.0b; Fetch; +http://www.banbots.com) |
Project BanBots Perl script robot |
| Mozilla/5.0 (compatible; BecomeBot/1.23; http://www.become.com/webmasters.html) |
BecomeBot - Become.com shopping search (64.124.85.xx(x)) |
| Mozilla/5.0 (compatible; BecomeBot/1.xx; MSIE 6.0 compatible; http://www.become.com/webmasters.html) |
BecomeBot - Become.com shopping search (64.124.85.xx(x)) |
| Mozilla/5.0 (compatible; BecomeBot/2.0beta; http://www.become.com/webmasters.html) |
BecomeBot - Become.com shopping search (64.124.85.xx(x)) |
| Mozilla/5.0 (compatible; BecomeBot/2.x; MSIE 6.0 compatible; http://www.become.com/site_owners.html) |
BecomeBot - Become.com shopping search (64.124.85.xx(x)) |
| Mozilla/5.0 (compatible; BecomeJPBot/2.3; MSIE 6.0 compatible; +http://www.become.co.jp/site_owners.html) |
BecomeBot - Become.com shopping search (64.124.85.xx(x)) |
| Mozilla/5.0 (compatible; BlogRefsBot/0.1; http://www.blogrefs.com/about/bloggers) |
BlogRefsBot.com blog robot |
| Mozilla/5.0 (compatible; Bot; +http://pressemitteilung.ws/spamfilter |
Pressemitteilungen Webservice RSS / news crawler (Germany) |
| Mozilla/5.0 (compatible; BuzzRankingBot/1.0; +http://www.buzzrankingbot.com/) |
BuzzRanking internet content analysis |
| Mozilla/5.0 (compatible; Charlotte/1.0b; charlotte@betaspider.com) |
Charlotte indexing spider for Searchme / Wikiseek |
| Mozilla/5.0 (compatible; Charlotte/1.0b; http://www.searchme.com/support/) |
Charlotte indexing spider for Searchme / Wikiseek |
| Mozilla/5.0 (compatible; Crawling jpeg; http://www.yama.info.waseda.ac.jp) |
Unknown graphics crawler or downloading agent from Yamana Laboratory - Waseda Univerity Japan (133.9.238.xx) |
| Mozilla/5.0 (compatible; Custo 3 (Netwu.com); Windows NT 5.1) |
Custo web site spidering tool (link checking) |
| Mozilla/5.0 (compatible; de/1.13.2 +http://www.de.com) |
De.com German travel related search via Amazon Web Services |
| Mozilla/5.0 (compatible; Diffbot/0.1; +http://www.diffbot.com) |
Diffbot beta - RSS and news feed crawler |
| Mozilla/5.0 (compatible; DNS-Digger-Explorer/1.0; +http://www.dnsdigger.com) |
DNS-Digger - DNS server neighbourhood search |
| Mozilla/5.0 (compatible; DNS-Digger/1.0; +http://www.dnsdigger.com) |
DNS-Digger - DNS server neighbourhood search |
| Mozilla/5.0 (compatible; EARTHCOM.info/2.01; http://www.earthcom.info) |
Earthcom (Czech Republic) search robot (194.108.39.xx) |
| Mozilla/5.0 (compatible; EARTHCOM/2.2; +http://enter4u.eu) |
enter4u / Earthcom.info search (Czech Republic) |
| Mozilla/5.0 (compatible; egothor/8.0g; +http://ego.ms.mff.cuni.cz/) |
Prague Faculty of Mathematics and Physics using Egothor open source crawler |
| Mozilla/5.0 (compatible; Exabot Test/3.0; +http://www.exabot.com/go/robot) |
Exalead (France) search robot (193.47.80.xx) |
| Mozilla/5.0 (compatible; FatBot 2.0; http://www.thefind.com/main/CrawlerFAQs.fhtml) |
TheFind.com - Shopping search robot |
| Mozilla/5.0 (compatible; Galbot/1.0; +http://www.galbot.com/bot.html) |
Galbot tagging robot (beta) - Denmark |
| mozilla/5.0 (compatible; genevabot http://www.healthdash.com) |
Geneva Single-Site Search Engine used by Healthdash health search |
| Mozilla/5.0 (compatible; Google Desktop) Paros/3.2.12 |
Paros - a Java based HTTP/HTTPS proxy |
| Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html) |
Google robot |
| mozilla/5.0 (compatible; heritrix/1.0.4 http://innovationblog.com) |
Unknown robot using Heritrix |
| Mozilla/5.0 (compatible; heritrix/1.10.2 +http://i.stanford.edu/) |
The Stanford University InfoLab robot using Heritrix |
| Mozilla/5.0 (compatible; heritrix/1.12.1 +http://newstin.com/) |
Newstin news feed search using Heritrix |
| Mozilla/5.0 (compatible; heritrix/1.12.1 +http://www.page-store.com) |
Page-store.com vertical search via Amazon Web Services |
| Mozilla/5.0 (compatible; heritrix/1.12.1 +http://www.page-store.com) [email:paul@page-store.com] |
Page-store.com vertical search via Amazon Web Services |
| mozilla/5.0 (compatible; heritrix/1.3.0 http://archive.crawler.org) |
Heritrix Internet Archive's open-source web project |
| Mozilla/5.0 (compatible; heritrix/1.4.0 +http://www.chepi.net) |
Chepi Beta search Spain (194.116.240.1xx) using Heritrix |
| Mozilla/5.0 (compatible; heritrix/1.4t http://www.truveo.com/) |
Truveo data mining robot using Heritrix |
| Mozilla/5.0 (compatible; heritrix/1.5.0 http://www.l3s.de/~kohlschuetter/projects/crawling/) |
L3S WebCrawling Project (Germany) using Heritrix |
| Mozilla/5.0 (compatible; heritrix/1.5.0-200506231921 http://pandora.nla.gov.au/crawl.html) |
Pandora Internet Archive crawler (Australia) using Heritrix |
| Mozilla/5.0 (compatible; heritrix/1.6.0 http://www.worio.com/) |
WORIO (beta) search for computer scientists and programmers using Heritrix open-source crawler |
| Mozilla/5.0 (compatible; heritrix/1.7.0 +http://www.greaterera.com/) |
greatarea.com website collection project using Heritrix |
| Mozilla/5.0 (compatible; Heritrix/1.8.0 http://www.hanzoarchives.com) |
hanzo:web social web archiving service |
| Mozilla/5.0 (compatible; heritrix/1.x.x +http://www.accelobot.com) |
Accelobot - Accelovation Market Discovery software robot |
| Mozilla/5.0 (compatible; heritrix/2.0.0-RC1 +http://www.aol.com) |
Unknown AOL robot using Heritrix |
| Mozilla/5.0 (compatible; Hermit Search. Com; +http://www.hermitsearch.com) |
Hermits Search.com - Products and service search robot |
| Mozilla/5.0 (compatible; http://www.IsMySiteUp.Net/bot/ ) |
IsMySiteUp? - Online website monitoring service |
| Mozilla/5.0 (compatible; http://www.UptimeAuditor.com/bot/ ) |
UptimeAuditor - real time web monitoring |
| Mozilla/5.0 (compatible; HyperixScoop/1.3; +http://www.hyperix.com) |
Hyperix vertical search crawler |
| Mozilla/5.0 (compatible; iaskspider/1.0; MSIE 6.0) |
Unknown robot (reads robots.txt) from chinatelecom (219.142.78.xx) |
| Mozilla/5.0 (compatible; IDBot/1.0; +http://www.id-search.org/bot.html) |
ID-Search.org - Russian search project |
| Mozilla/5.0 (compatible; InterseekWeb/3.x) |
Najdi.si (Slovenia) search using Interseek/Web Interseek/API Search Engine |
| Mozilla/5.0 (compatible; Jim +http://www.hanzoarchives.com) |
hanzo:web social web archiving service |
| Mozilla/5.0 (compatible; Konqueror/2.0.1; X11); Supports MD5-Digest; Supports gzip encoding |
Konqueror 2.0.x X11 |
| Mozilla/5.0 (compatible; Konqueror/2.1.1; X11) |
Konqueror 2.1.x X11 |
| Mozilla/5.0 (compatible; Konqueror/2.2.2) |
Konqueror 2.2.x |
| Mozilla/5.0 (compatible; Konqueror/2.2.2; Linux 2.4.14-xfs; X11; i686) |
Konqueror 2.2.x Linux |
| Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko) (Exabot-Thumbnails) |
Exalead (France) search robot (193.47.80.xx) |
| Mozilla/5.0 (compatible; LemSpider 0.1) |
Lemur Consulting LemIR spider |
| Mozilla/5.0 (compatible; LinksManager.com_bot http://linksmanager.com/linkchecker.html) |
Linksmanager.com online link checking service |
| Mozilla/5.0 (compatible; LinkStash Bookmark Manager; http://www.xrayz.co.uk/) |
LinkStash Bookmark Manager |
| Mozilla/5.0 (compatible; MojeekBot/2.0; http://www.mojeek.com/bot.html) |
Mojeek Search Preview robot (217.155.205.xx) |
| Mozilla/5.0 (compatible; MOSBookmarks/v2.6-Plus; Link Checker) |
Joomla!/Mambo component - MosBookmarks (bot) link checking |
| Mozilla/5.0 (compatible; MSIE 6.0; Podtech Network; crawler_admin@podtech.net) |
PodTech entertainment and video network crawler |
| Mozilla/5.0 (compatible; OnetSzukaj/5.0; http://szukaj.onet.pl) |
onet.pl Szukaj (Search) robot (213.180.128.1xx) |
| Mozilla/5.0 (compatible; PagestackerBot; http://www.pagestacker.com) |
Pagestacker online bookmark service |
| Mozilla/5.0 (compatible; PalmeraBot; http://www.links24h.com/help/palmera) Version 0.001 |
PalmeraBot - Links24h.com search engine robot |
| Mozilla/5.0 (compatible; PEAR HTTP_Request class; http://feed.moo.jp/) |
FeedMo feed search (Japan) using Pear HTTP |
| Mozilla/5.0 (compatible; Phonifier; +http://www.phonifier.com) |
PHONifier mobile access to web content |
| Mozilla/5.0 (compatible; pmoz.info ODP link checker; +http://pmoz.info/doc/botinfo.htm) |
pmoz.info ODP link checking bot |
| Mozilla/5.0 (compatible; pogodak.ba/3.x) |
Pogodak search (Slovenia) robot via Interseek |
| Mozilla/5.0 (compatible; Pogodak.hr/3.1) |
Pogodak search (Slovenia) robot via Interseek |
| Mozilla/5.0 (compatible; Proximic crawler; +http://www.proximic.com/en/about-us/contact-us.html) |
Proximic Publisher Widget - RSS and news content generator |
| Mozilla/5.0 (compatible; PWeBot/3.1; http://www.programacionweb.net/robot.php) |
ProgramacionWeb.net PWeBot crawler (Argentina) |
| Mozilla/5.0 (compatible; Quantcastbot/1.0; www.quantcast.com) |
Quantcast - Open Internet Ratings Service |
| Mozilla/5.0 (compatible; robtexbot/1.0; http://www.robtex.com/ ) |
robtex - Multi-RBL check and AS-numbercheck |
| Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) |
ScoutJet (Blekko) search web crawler |
| Mozilla/5.0 (compatible; Scrubby/2.2; http://www.scrubtheweb.com/) |
Scrub the web robot (66.93.156.xx) |
| Mozilla/5.0 (compatible; ShunixBot/1.x.x +http://www.shunix.com/robot.htm) |
Shunixbot (France) beta / test semantic web indexing robot |
| Mozilla/5.0 (compatible; ShunixBot/1.x; http://www.shunix.com/bot.htm) |
Shunixbot (France) beta / test semantic web indexing robot |
| Mozilla/5.0 (compatible; SkreemRBot +http://skreemr.com) |
Skreemr - Audio search engine |
| Mozilla/5.0 (compatible; SnapPreviewBot; en-US; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9 |
Snap Firefox Search Plugin |
| Mozilla/5.0 (compatible; SpurlBot/0.2) |
Spurl.net bookmark service & search engine (84.40.30.xxx) |
| Mozilla/5.0 (compatible; SummizeBot +http://www.summize.com) |
Summize - Opinion and review search robot |
| Mozilla/5.0 (compatible; SYCLIKControl/LinkChecker;) |
Syclik Control web content management system |
| Mozilla/5.0 (compatible; Synoobot/0.9; http://www.synoo.com/search/bot.html) |
Synoo web directory robot |
| Mozilla/5.0 (compatible; Theophrastus/x.x; http://users.cs.cf.ac.uk/N.A.Smith/theophrastus.php) |
Theophrastus Internet Spider for a basic search engine project |
| Mozilla/5.0 (compatible; TridentSpider/3.1) |
Interseek - Java search engine technology used for Pogodak search |
| Mozilla/5.0 (compatible; Vagabondo/2.1; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/) |
WiseGuys robot |
| Mozilla/5.0 (compatible; Windows NT 5.0; phpwebbrainBot/0.1 - http://www.monsterli.ch/phpwebbrain/) |
phpwebbrain online bookmark service (Germany) |
| Mozilla/5.0 (compatible; worio bot heritrix/1.10.0 +http://worio.com) |
WORIO (beta) search for computer scientists and programmers using Heritrix open-source crawler |
| Mozilla/5.0 (compatible; WoW Lemmings Kathune/2.0;http://www.wowlemmings.com/kathune.html) |
Kathune spider for World of Warcraft guild data. Used to power WoW Lemmings |
| Mozilla/5.0 (compatible; XTbot/1.0v; +http://www.externaltest.com) |
eXternalTest - Server and online services monitoring |
| Mozilla/5.0 (compatible; Yahoo! DE Slurp; http://help.yahoo.com/help/us/ysearch/slurp) |
Yahoo / Inktomi search robot |
| Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html) |
Inktomi robot (202.160.180.xxx) for Yahoo China |
| Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) |
Inktomi robot for Yahoo (via 66.196.xx.xxx) |
| Mozilla/5.0 (compatible; YesupBot/1.0; +http://www.yesup.net/bot.html) |
Yesup Seo - Toronto SEO Service |
| Mozilla/5.0 (compatible; Yoono; http://www.yoono.com/) |
Yoono - community based search (193.110.140.xxx / 194.0.179.[x]xx) |
| Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; ) |
Youdao search (China) robot |
| Mozilla/5.0 (compatible; Zenbot/1.3; +http://zen.co.za/webmasters/) |
Zenbot robot for the Southern African Zen search service |
| Mozilla/5.0 (compatible; zermelo +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] |
Powerset Natural Language Search crawler (under development) using Heritrix via Amazon Web Services |
| Mozilla/5.0 (compatible;archive.org_bot/1.7.1; collectionId=316; Archive-It; +http://www.archive-it.org) |
Heritrix - The Internet Archive's open-source crawler (207.241.225.2xx) |
| Mozilla/5.0 (compatible;archive.org_bot/heritrix-1.9.0-200608171144 +http://pandora.nla.gov.au/crawl.html) |
Wayback Machine Internet Archive crawler |
| Mozilla/5.0 (compatible;FindITAnswersbot/1.0;+http://search.it-influentials.com/bot.htm) |
FindITAnswers - Search engine for software developers |
| Mozilla/5.0 (compatible;MAINSEEK_BOT) |
Mainseek search (Poland) robot |
| Mozilla/5.0 (Gecko/20070310 Mozshot/0.0.20070628; http://mozshot.nemui.org/) |
MozShot - Technical demo to take screenshot of any URL |
| Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9b5) Gecko/2008032619 Firefox/3.0b5 |
Mozilla Firefox 3.0 beta (Gran Paradiso) for MacOS |
| Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.0.1) Gecko/20021219 Chimera/0.6 |
Chimera browser (Mozilla/Gecko engine) - now Camino Mac PowerPC |
| Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.0.1) Gecko/20030306 Camino/0.7 |
Camino browser (Mozilla/Gecko engine) - ex Chimera Mac PowerPC |
| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-US) AppleWebKit/xx (KHTML like Gecko) OmniWeb/v5xx.xx |
OmniWeb 5.x.x Mac OS X browser |
| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/xxx.x (KHTML like Gecko) Safari/12x.x |
Safari 1.2x browser (Mozilla/Gecko engine) MAC OS X |
| Mozilla/5.0 (Macintosh; U; PPC; en-US; rv:0.9.2) Gecko/20010726 Netscape6/6.1 |
Netscape 6.x Mac PowerPC |
| Mozilla/5.0 (research@mediatrec.com) |
unknown robot from gw.ocg-corp.com |
| Mozilla/5.0 (Sage) |
Sage - RSS and Atom feed reader extension for Mozilla Firefox |
| Mozilla/5.0 (Slurp/cat; slurp@inktomi.com; http://www.inktomi.com/slurp.html) |
Inktomi (Hotbot-Lycos - NBCi etc.) robot |
| Mozilla/5.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html) |
Inktomi (Hotbot-Lycos - NBCi etc.) robot |
| Mozilla/5.0 (SunOS 5.8 sun4u; U) Opera 5.0 [en] |
Opera 5.x SunOS |
| Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) |
Twiceler experimental web crawler |
| Mozilla/5.0 (Version: xxxx Type:xx) |
Some spambot from Romania (82.208.139.1xx & 86.123.65.xx) - Maybe email harvesting |
| Mozilla/5.0 (wgao@genieknows.com) |
GenieKnows.com search robot (64.5.245.xx / 64.5.220.xxx) |
| Mozilla/5.0 (Windows; U; Win98; en-US; rv:0.9.2) Gecko/20010726 Netscape6/6.1 |
Netscape 6.x Win98 |
| Mozilla/5.0 (Windows; U; Win98; en-US; rv:x.xx) Gecko/20030423 Firebird Browser/0.6 |
Firebird browser (Mozilla/Gecko engine) - ex Phoenix Win98 |
| Mozilla/5.0 (Windows; U; Win9x; en; Stable) Gecko/20020911 Beonex/0.8.1-stable |
Beonex Communicator browser (Mozilla/Gecko engine) |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.7) NimbleCrawler 1.11 obeys UserAgent NimbleCrawler For problems contact: crawler_at_dataalchemy.com |
Healthline health related search robot (72.5.115.xx) |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/525.19 (KHTML, like Gecko) Chrome/0.2.153.1 Safari/525.19 |
Google Chrome browser based on WebKit (Safari) |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.5) Gecko/20060731 Firefox/1.5.0.5 Flock/0.7.4.1 |
Flock web browser built on Mozilla technologies |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.4/Megaupload x.0 |
Megaupload Mega Manager - Download manager plugin for Firefox |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008092215 Firefox/3.0.1 Orca/1.1 beta 3 |
Orca browser - based on Gecko |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:x.x.x) Gecko/20041107 Firefox/x.x |
Firefox browser (Mozilla/Gecko engine) - ex Firebird WinXP |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:x.xx) Gecko/20030504 Mozilla Firebird/0.6 |
Firebird browser (Mozilla/Gecko engine) - ex Phoenix WinXP |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:x.xxx) Gecko/20041027 Mnenhy/0.6.0.104 |
Mnenhy - enhanced mail & news Mozilla based browser |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com) |
Voila.fr robot |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com) |
Voila.fr robot |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9b5) Gecko/2008032620 Firefox/3.0b5 |
Mozilla Firefox 3.0 beta (Gran Paradiso) for Win |
| Mozilla/5.0 (Windows; U;XMPP Tiscali Communicator v.10.0.1; Windows NT 5.1; it; rv:1.8.1.3) Gecko/20070309 Firefox/2.0.0.3 |
Tiscali Communicator - Online services suite |
| Mozilla/5.0 (Windows;) NimbleCrawler 1.12 obeys UserAgent NimbleCrawler For problems contact: crawler@health |
Healthline health related search robot (72.5.115.xx) |
| Mozilla/5.0 (Windows;) NimbleCrawler 1.12 obeys UserAgent NimbleCrawler For problems contact: crawler@healthline.com |
Healthline health related search robot (72.5.115.xx) |
| Mozilla/5.0 (X11; Linux i686; U;rv: 1.7.13) Gecko/20070322 Kazehakase/0.4.4.1 |
Kazehakase - Gecko based browser (Japan) |
| Mozilla/5.0 (X11; U; Linux 2.4.2-2 i586; en-US; m18) Gecko/20010131 Netscape6/6.01 |
Netscape 6.x Linux |
| Mozilla/5.0 (X11; U; Linux i686; de-AT; rv:1.8.0.2) Gecko/20060309 SeaMonkey/1.0 |
SeaMonkey browser suite (ex Mozilla) on Linux |
| Mozilla/5.0 (X11; U; Linux i686; en-GB; rv:1.7.6) Gecko/20050405 Epiphany/1.6.1 (Ubuntu) (Ubuntu package 1.0.2) |
Epiphany (Mozilla/Gecko engine) browser Linux |
| Mozilla/5.0 (X11; U; Linux i686; en-US; Nautilus/1.0Final) Gecko/20020408 |
Nautilus (developed by Eazel.com) 1.x Browser Linux |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:0.9.3) Gecko/20010801 |
Mozilla (Gecko) 0.9x browser Linux |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2b) Gecko/20021007 Phoenix/0.3 |
Phoenix 0.3 browser (Mozilla/Gecko engine) - now Firebird Linux |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.6) Gecko/20040413 Epiphany/1.2.1 |
Epiphany (Mozilla/Gecko engine) browser Linux |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7 SnapPreviewBot |
Snap Firefox Search Plugin |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1) Gecko/20061129 BonEcho/2.0 |
Bon Echo Alpha - developer preview of future Firefox browser |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.1) Gecko/20061205 Iceweasel/2.0.0.1 (Debian-2.0.0.1+dfsg-2) |
IceWeasel - the GNU version of the Firefox browser |
| Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9a8) Gecko/2007100619 GranParadiso/3.0a8 |
Mozilla Firefox 3.0 beta (Gran Paradiso) for Linux |
| Mozilla/5.0 Galeon/1.0.2 (X11; Linux i686; U;) Gecko/20011224 |
Galeon 1.x Browser Linux |
| Mozilla/5.0 gURLChecker/0.x.x (Linux) |
gURLChecker - GNOME link checking tool |
| Mozilla/5.0 URL-Spider |
URL Spider - used by usww.net |
| Mozilla/5.0 usww.com-Spider-for-w8.net |
W8net spider |
| Mozilla/5.0 wgao@genieknows.com |
GenieKnows.com search robot (64.5.245.xx / 64.5.220.xxx) |
| Mozilla/5.0 whoiam [http://www.axxus.de/] |
axxus.de German business directory |
| Mozilla/5.0 [en] (compatible; Gulper Web Bot 0.2.4 www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot) |
Yuntis : Collaborative Web Resource Categorization and Ranking Project robot |