| id | SignatureString |
| 1 | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Google Wireless Transcoder;) |
| 2 | Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) |
| 3 | Mozilla/5.0 (compatible; woriobot heritrix/1.10.0 +http://worio.com) |
| 4 | msnbot/1.1 (+http://search.msn.com/msnbot.htm) |
| 5 | msnbot/1.0 (+http://search.msn.com/msnbot.htm) |
| 6 | Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) (via babelfish.yahoo.com) |
| 7 | MSNBOT |
| 8 | Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot) |
| 9 | Yaln xkrqd werol |
| 10 | UMBC-Memeta |
| 11 | msnbot-media/1.0 (+http://search.msn.com/msnbot.htm) |
| 12 | EnaBot/1.1 (http://www.enaball.com/crawler.html) |
| 13 | Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) |
| 14 | Mozilla/4.0 (compatible; Netcraft Web Server Survey) |
| 15 | EnaBot/1.2 (http://www.enaball.com/crawler.html) |
| 16 | LinkWalker/2.0 |
| 17 | SurveyBot/2.3 (Whois Source) |
| 18 | Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko) (Exabot-Thumbnails) |
| 19 | Sphere Scout&v4.0 (beta) - scout at sphere dot com |
| 20 | Pingdom GIGRIB (http://www.pingdom.com) |
| 21 | Telligent.Components (Microsoft Windows NT 5.2.3790 Service Pack 2; .NET CLR 2.0.50727.1378;) |
| 22 | Mediapartners-Google |
| 23 | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) |
| 24 | Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html) |
| 25 | FeedHub FeedFetcher/1.0 (http://www.feedhub.com) |
| 26 | MagpieRSS/0.7 (+http://magpierss.sf.net) |
| 27 | FeedHub FeedDiscovery/1.0 (http://www.feedhub.com) |
| 28 | Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) |
| 29 | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) |
| 30 | Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/) |
| 31 | boitho.com-dc/0.82 ( http://www.boitho.com/dcbot.html ) |
| 32 | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) |
| 33 | Mozilla/2.0 (compatible; Ask Jeeves/Teoma) |
| 34 | |
| 35 | libwww-perl/5.805 |
| 36 | psbot/0.1 (+http://www.picsearch.com/bot.html) |
| 37 | Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) |
| 38 | boitho.com-dc/0.85 ( http://www.boitho.com/dcbot.html ) |
| 39 | boitho.com-dc/0.86 ( http://www.boitho.com/dcbot.html ) |
| 40 | BoardReader/1.0 (http://boardreader.com/info/robots.htm) |
| 41 | Mozilla/5.0 (compatible; Googlebot/2.1;+http://www.google.com/bot.html) |
| 42 | Mozilla/5.0 (compatible; woriobot +http://worio.com) |
| 43 | larbin_2.6.3 cha16@cs.sfu.ca |
| 44 | Telligent.Components (Microsoft Windows NT 6.0.6001 Service Pack 1; .NET CLR 2.0.50727.1434;) |
| 45 | larbin_2.6.3 larbin2.6.3@unspecified.mail |
| 46 | User-Agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; MS-RTC LM 8) |
| 47 | User-Agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR 1.1.4322; .NET CLR 2.0.50727; InfoPath.2) |
| 48 | mozilla/5.0 (compatible; RTGI; http://rtgi.fr/) |
| 49 | User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) |
| 50 | vxbd9shxtysevxosdppujoufmfxc vrvg |
| 51 | ydvBwkeymkvylaybyhtw7roptd7gop7kaxqbds |
| 52 | ajSitemap ( www.web-max.ca/freeware/ajSitemap ) |
| 53 | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) |
| 54 | libwww-perl/5.79 |
| 55 | Jyxobot/1 |
| 56 | Wngloxcqt gtvzwu uixlgrfw |
| 57 | Jaoxbm wysbmqgv yokrb |
| 58 | Ibvncmoy jgnri vsokcwpem |
| 59 | Jdothpr talgcvbk nogarzmkj |
| 60 | Apple-PubSub/65 |
| 61 | Firefox |
| 62 | bot/1.0 (bot; http://; bot@bot.bot) |
| 63 | REAP-crawler Nutch/Nutch-1.0-dev (Reap Project; http://reap.cs.cmu.edu/REAP-crawler/; Reap Project) |
| 64 | TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html) |
| 65 | BlueDragon |
| 66 | ia_archiver |
| 67 | Xenu Link Sleuth 1.2j |
| 68 | EmailSearch |
| 69 | libwww-perl/5.803 |
| 70 | libwww-perl/5.810 |
| 71 | IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler/) |
| 72 | Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+) |
| 73 | Nokia6682/2.0 (3.01.1) SymbianOS/8.0 Series60/2.6 Profile/MIDP-2.0 configuration/CLDC-1.1 UP.Link/6.3.0.0.0 (compatible;YahooSeeker/M1A1-R2D2; http://help.yahoo.com/help/us/ysearch/crawling/crawling-01.html) |
| 74 | Snoopy v1.2.3 |
| 75 | Telligent.Components (Microsoft Windows NT 6.0.6001 Service Pack 1; .NET CLR 2.0.50727.3031;) |
| 76 | Spider |
| 77 | TheRarestParser/0.2a |
| 78 | veoh-??0 service (NT 5.1; IE 7.0.5730.11; en-US Windows) |
| 79 | libwww-perl/5.53 |
| 80 | Nokia6300/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi find.mobi/bot.html find@mtld.mobi) |
| 81 | Mozilla/4.0 compatible ZyBorg/1.0 (ZyBorg@WISEnutbot.com; http://www.WISEnutbot.com) |
| 82 | Mozilla/5.0 (compatible; woriobot support [at] worio [dot] com +http://worio.com) |
| 83 | Mozilla/5.0 (compatible; BecomeBot/3.0; +http://www.become.com/site_owners.html) |
| 84 | SygolBot http://www.sygol.com |
| 85 | msnbot-media/1.1 (+http://search.msn.com/msnbot.htm) |
| 86 | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) One-time, weeklong image crawl |
| 87 | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) |
| 88 | MLBot (www.metadatalabs.com/mlbot) |
| 89 | Mozilla/5.0 (MrCarlito-0.1 http://www.mrcarlito.com/spider.html) |
| 90 | Mozilla/5.0 (compatible; heritrix/1.12.1 +http://netarkivet.dk/website/info.html) |
| 91 | Mozilla/5.0 (compatible; heritrix/2.0.0 +http://seekda.com) |
| 92 | findlinks/1.1.4-beta1 (+http://wortschatz.uni-leipzig.de/findlinks/) |
| 93 | findlinks/1.1.3-beta9 (+http://wortschatz.uni-leipzig.de/findlinks/) |
| 94 | Feedfetcher-Google; (+http://www.google.com/feedfetcher.html) |
| 95 | Mozilla/5.0 (compatible; heritrix/${pom.version} +http://seekda.com) |
| 96 | Gsypzqrl owkxfuigs lkpwa |
| 97 | Juqxchal ldcophyk tlynca |
| 98 | libwww-perl/5.812 |
| 99 | feedfinder/1.371 Python-urllib/1.17 +http://www.aaronsw.com/2002/feedfinder/ |
| 100 | veoh-??0 service (NT 5.1; IE 7.0.5730.13; en-US Windows) |
| 101 | libwww-perl/5.64 |
| 102 | Grub/2.0 (Grub.org crawler; http://www.grub.org/; bot@grub.org) |
| 103 | Nokia6300/2.0 (05.50) Profile/MIDP-2.0 Configuration/CLDC-1.1 (botmobi http://find.mobi/bot.html abuse@mtld.mobi) |
| 104 | DotBot/1.0.1 (http://www.dotnetdotcom.org/#info, crawler@dotnetdotcom.org) |
| 105 | dandirbot |
| 106 | Mozilla/5.0 (compatible; WebDataCentreBot/1.0; +http://WebDataCentre.com/) |
| 107 | PHP version tracker (http://www.nexen.net/phpversion/bot.php) |