This is just a list of the current Bots/Spiders that frequent the site. (at this current time there's more of them than us... lets hope they don't get too clever or we'll be in for some chop.)
I've included a link for most of the bots that have a specific page that addresses their usage.
You will notice on the "Who's online" list now, that Bot's , Spiders and Monitoring Agents have icon's with their names to aid in working out if it's another poster or some automaton trying to pull the electronic wool over your eyes. (P.K.Dick pun)
Edit:
I've changed how the bot's are now listed (Along with the members) they are now shown using Font Awesome font's, hopefully it will look nicer.
Known:
Google Bot
Yahoo Bot
Bing Bot (includes Bingpreview and MSNBot Soon to be retired)
Alexa Bot
archive.org_bot
Ask Bot
AddThis Bot
Twitter Bot
Facebook Bot
Yandex Bot
Baidu Bot
Jetmon
Lesser Known:
Ahrefs Bot
Meanpath Bot
DotBot
Exabot
Easou Spider
CCBot (Uses Nutch)
XoviBot
Blekko Bot
Majestic12 Bot (Currently has problems since it's still using a lesser HTTP protocol)
360Spider
SemRushBot
SeznamBot
spbot
oBot
DomainSigmaCrawler
AiHitBot
SurveyBot
HubPages
SISTRIX
Sogou
magpie-crawler
SiteChecker
linkdex
Poorly Behaved:
Semalt Crawler (Doesn't identify it's a bot in the Agent information just in the Referrer URL)
WebTarantula Crawler (Lacks a URL in the Agent information)
XYZBot (Seems to be a bot searching for Torrents)
NerdyBot (Lacks a URL in the Agent information)
Nutch Bot (A bot that can be run by anyone, which means it can do things it's not suppose to)
BLEXbot (Creating rubbish URL's and attempting to load them from the site)
I've included a link for most of the bots that have a specific page that addresses their usage.
You will notice on the "Who's online" list now, that Bot's , Spiders and Monitoring Agents have icon's with their names to aid in working out if it's another poster or some automaton trying to pull the electronic wool over your eyes. (P.K.Dick pun)
Edit:
I've changed how the bot's are now listed (Along with the members) they are now shown using Font Awesome font's, hopefully it will look nicer.
Known:
Google Bot
Yahoo Bot
Bing Bot (includes Bingpreview and MSNBot Soon to be retired)
Alexa Bot
archive.org_bot
Ask Bot
AddThis Bot
Twitter Bot
Facebook Bot
Yandex Bot
Baidu Bot
Jetmon
Lesser Known:
Ahrefs Bot
Meanpath Bot
DotBot
Exabot
Easou Spider
CCBot (Uses Nutch)
XoviBot
Blekko Bot
Majestic12 Bot (Currently has problems since it's still using a lesser HTTP protocol)
360Spider
SemRushBot
SeznamBot
spbot
oBot
DomainSigmaCrawler
AiHitBot
SurveyBot
HubPages
SISTRIX
Sogou
magpie-crawler
SiteChecker
linkdex
Poorly Behaved:
Semalt Crawler (Doesn't identify it's a bot in the Agent information just in the Referrer URL)
WebTarantula Crawler (Lacks a URL in the Agent information)
XYZBot (Seems to be a bot searching for Torrents)
NerdyBot (Lacks a URL in the Agent information)
Nutch Bot (A bot that can be run by anyone, which means it can do things it's not suppose to)
BLEXbot (Creating rubbish URL's and attempting to load them from the site)