list of: Spiderbots in ASC order (not db order)
No. Name User Agent
1360Spider360Spider
2meanpathbot
3Applebot
4facebookexternalhit
5Googlebot
6PInterest
7XTwitterbot
8Jetmon
9slurp
10YandexBot
11AddThisAddThis
12adsbotadsbot
13AhrefsAhrefsBot
14Alexaia_archiver
15AmazonbotAmazonbot
16Archive.org archive.org
17Axiosaxios
18BaiduBaiduspider
19BarkrowlerBarkrowler
20Bingbingbot
21BingpreviewBingPreview
22BLEXbotBLEXBot
23BytespiderBytespider
24CCBotCCBot
25CheckHostCheckHost
26CliqzbotCliqzbot
27CloudEndureCloudEndure
28CloudEndureCloudEndure Scanner
29COMODOCOMODO SSL Checker
30CompanybookCompanybook-Crawler
31DeuSuDeuSu
32DiscordDiscordbot
33DomainSigmaCrawlerDomainSigmaCrawler
34DotBotDotBot
35DuckDuckGoDuckDuckBot
36ExaBotExaBot
37Glutenfree Gluten Free Crawler
38GrammarlyGrammarly
39HubPagesHubPages
40James BOTJames BOT
41Linkdexlinkdexbot
42Mail.RUMail.RU_Bot
43Majestic 12MJ12Bot
44MegaIndexMegaIndex
45MojeekMojeekBot
46MSNMsnBot
47NerdyNerdyBot
48NimbostratusNimbostratus-Bot
49NutchNutch
50oBotoBot
51Omgiliomgili
52PagesInventoryPagesInventory
53PaperLiBotPaperLiBot
54PetalBotPetalBot
55PingdomPingdom.com_bot
56proximicproximic
57ScrapyScrapy
58SemrushSemrushBot
59SeznamSeznamBot
60SiteCheckerSiteChecker
61SogouSogou
62SPspbot
63SurveyBotSurveyBot
64TKAIThe Knowledge AI
65trendictiontrendictionbot
66TrendsmapResolverTrendsmapResolver
67UptimeRobotUptimeRobot
68vBSEOvBSEO
69WebTarantulaWebTarantula
70XoviXoviBot
71XYZbotXYZbot
72YakYak
73ZoombotZoomBot
74ZuperlistBotZuperlistBot