Crawler User Agents

This is a complete listing of Crawler user agents. Click on the user agent to view detailed information about it.

User agent Software OS Layout engine Popularity
Baidu Spider 2.0 -- Very common
BingBot 2.0 -- Very common
Pinterest Bot 0.2 -- Very common
Googlebot 2.1 -- Very common
DuckDuckGo Favicons Bot 1.0 -- Very common
Majestic-12 Distributed Search Bot 1.4 -- Very common
Google Favicon Crawler -- Very common
Yahoo! Slurp Web Crawler Bot -- Common
Google's Media Partners system (AdSense) -- Common
Sogou "Search Dog" 4 -- Common
Pinterest Bot 0.2 -- Common
Proximic Search -- Common
Yandex Search Bot 3 -- Common
Googlebot 2.1 -- Common
Google Favicon Crawler -- Common
TwitterBot 1.0 -- Common
Ahrefs Backlink Research Bot 5.2 -- Common
Pinterest Bot -- Common
Majestic-12 Distributed Search Bot 1.4 -- Common
Google Favicon Crawler -- Common
TweetMeme Bot 4 -- Common
Majestic-12 Distributed Search Bot 1.4 -- Common
Grapeshot Bot 2.0 -- Common
360Spider -- Common
ExaLead Crawler 3 -- Common
OpenSiteExplorer Crawler -- Common
ADmantX Platform Semantic Analyzer -- Common
DomainTools SurveyBot 2.3 -- Common
MeanPath Bot 1.0 -- Common
YodaoBot Search Bot 1.0 -- Average
Genieo Bot 1.0 -- Average
MSN Bot 2.0b -- Average
Sosospider Search Bot -- Average
Googlebot 2.1 -- Average
360Spider -- Average
Pinterest Bot -- Average
Squider Bot 0.01 -- Average
Facebook Bot 1.1 -- Average
Yahoo! Slurp Web Crawler Bot -- Average
Yahoo! Slurp Web Crawler Bot -- Average
Googlebot Mobile 2.1 -- Average
BingPreview 1.0b -- Average
Googlebot Mobile 2.1 -- Average
ADmantX Platform Semantic Analyzer -- Average
Majestic-12 Distributed Search Bot 1.4 -- Average
Sosospider Search Bot 2.0 -- Average
360Spider -- Average
Google+ Snippet Fetcher -- Average
ExB Language Crawler 2.1 -- Average
Facebook Bot 1.1 -- Average
Yahoo! Slurp Web Crawler Bot -- Average
Googlebot 2.1 -- Average
Yahoo! Slurp Web Crawler Bot -- Average
ADmantX Platform Semantic Analyzer -- Average
ADmantX Platform Semantic Analyzer -- Average
NetSeer Crawler 2.0 -- Average
Googlebot 2.1 -- Average
Googlebot 2.1 -- Average
Jike Spider Bot -- Average
Ahrefs Backlink Research Bot 5.1 -- Average
CareerBot Search Crawler 1.1 -- Average
ADmantX Platform Semantic Analyzer -- Average
Googlebot 2.1 -- Average
360Spider -- Average
NewsBot 2.1 -- Average
360Spider -- Average
BingBot 2.0 -- Average
360Spider -- Average
Googlebot Mobile 2.1 -- Average
Ahrefs Backlink Research Bot 5 -- Average
Yandex Search Bot 3 -- Average
ADmantX Platform Semantic Analyzer -- Average
Googlebot -- Average
Google+ Snippet Fetcher -- Average
Google's Media Partners system (AdSense) 2.1 -- Average
Googlebot 2.1 -- Average
Googlebot 2.1 -- Average
MSN Bot 2.0b -- Average
Ahrefs Backlink Research Bot 4 -- Average
Panscient Crawler -- Average
Googlebot 2.1 -- Average
Gnip UnwindFetchor Crawler 1.0 -- Average
BingBot 2.0 -- Average
Yahoo! Slurp Web Crawler Bot -- Average
Facebook Bot 1.1 -- Average
MSN Bot 1.1 -- Uncommon
360Spider -- Uncommon
Search Crawler Bot -- Uncommon
Majestic-12 Distributed Search Bot 1.4 -- Uncommon
Yahoo! Slurp Web Crawler Bot -- Uncommon
ExaLead Crawler 3 -- Uncommon
Google+ Snippet Fetcher -- Uncommon
Topsy Butterfly Robot 1.0 -- Uncommon
VoilaBot Beta 1.2 -- Uncommon
NutraSpace Search 1.2 -- Uncommon
Yahoo! Slurp Web Crawler Bot -- Uncommon
Yahoo! Slurp Web Crawler Bot -- Uncommon
TweetMeme Bot 3 -- Uncommon
TelegramBot -- Uncommon
MSN Bot -- Uncommon

More features coming soon!

This read out of user agents is brand new! Soon we're going to add:

  • Adding refinement: eg in-app browser on Windows
  • A Percentage breakdown: eg: Chrome is x% Desktop, y% Mobile