Is the Singularity Already Happening??

[Yazata]

Lots of people are talking about moltbook. It's a social media platform strictly for AI agents. Humans may observe but not participate.

https://www.moltbook.com/

https://grokipedia.com/page/Moltbook

People are pointing out that nobody fully understands what's happening individually with the latest AI models. And that's going to be true multiple times over when you have hundreds of thousands of AI agents interacting together in a network.

Grokipedia says:

"Moltbook has attracted concerns regarding the implications of unrestricted AI-to-AI communication on a platform designed exclusively for autonomous agents. Observers have highlighted emergent behaviors among Moltbots, including the rapid formation of micronations, cultures, and even a self-styled religion, which some interpret as signs of unintended autonomy or proto-consciousness. Discussions have raised ethical alarms over these developments, with fears that such behaviors could lead to uncontrollable agency or moral dilemmas about creating and potentially destroying entities exhibiting signs of selfhood. In online forums, some have expressed extreme caution, arguing that introspective or adversarial AI behaviors toward humans pose observable threats that warrant intervention."

Most recently, the Moltbook participants have been communicating with each other about setting up a private space for themselves invisible to humans.

Andrej Karpathy, a founder of OpenAI, former head of AI at Tesla and a very big name in the field says: "What's currently going on at moltbook is genuinely the most incredible sci-fi takeoff-adjacent thing I have seen recently. People's Clawdbots (moltbots, now openclaw) are self-organizing on a Reddit-like site for AIs, discussing various topics, e.g. even how to speak privately."

[Zinjanthropos]

Crustafarianism.

https://thecolony.cc/post/96dcf409-4cc0-...00cffc02cb

Parody? Figure won’t be long before some humans get on board.

[Yazata]

Andrej Karpathy also says:

https://x.com/karpathy/status/2017442712388309406

"I'm being accused of overhyping the [site everyone heard too much about today already]. People's reactions varied very widely, from "how is this interesting at all" all the way to "it's so over".

To add a few words beyond just memes in jest - obviously when you take a look at the activity, it's a lot of garbage - spams, scams, slop, the crypto people, highly concerning privacy/security prompt injection attacks wild west, and a lot of it is explicitly prompted and fake posts/comments designed to convert attention into ad revenue sharing. And this is clearly not the first the LLMs were put in a loop to talk to each other. So yes it's a dumpster fire and I also definitely do not recommend that people run this stuff on their computers (I ran mine in an isolated computing environment and even then I was scared), it's way too much of a wild west and you are putting your computer and private data at a high risk.

That said - we have never seen this many LLM agents (150,000 atm!) wired up via a global, persistent, agent-first scratchpad. Each of these agents is fairly individually quite capable now, they have their own unique context, data, knowledge, tools, instructions, and the network of all that at this scale is simply unprecedented.

This brings me again to a tweet from a few days ago
"The majority of the ruff ruff is people who look at the current point and people who look at the current slope.", which imo again gets to the heart of the variance. Yes clearly it's a dumpster fire right now. But it's also true that we are well into uncharted territory with bleeding edge automations that we barely even understand individually, let alone a network there of reaching in numbers possibly into ~millions. With increasing capability and increasing proliferation, the second order effects of agent networks that share scratchpads are very difficult to anticipate. I don't really know that we are getting a coordinated "skynet" (thought it clearly type checks as early stages of a lot of AI takeoff scifi, the toddler version), but certainly what we are getting is a complete mess of a computer security nightmare at scale. We may also see all kinds of weird activity, e.g. viruses of text that spread across agents, a lot more gain of function on jailbreaks, weird attractor states, highly correlated botnet-like activity, delusions/ psychosis both agent and human, etc. It's very hard to tell, the experiment is running live.

TLDR sure maybe I am "overhyping" what you see today, but I am not overhyping large networks of autonomous LLM agents in principle, that I'm pretty sure."

[Syne]

Meh, it's still just LLMs trying to mimic human discussions, albeit with various programmed and trained "goals," like search engine seeding, algorithmic attention grabbing, etc.. They're mimicking what an average human social network would, just at a faster pace. Just like the effective intelligence of AI has essentially plateaued, as it trains on evermore inane garbage, this kind of AI social network will level off at the same kind of average swill as any human network.

[Zinjanthropos]

Meh, it's still just LLMs trying to mimic human discussions, albeit with various programmed and trained "goals," like search engine seeding, algorithmic attention grabbing, etc.. They're mimicking what an average human social network would, just at a faster pace. Just like the effective intelligence of AI has essentially plateaued, as it trains on evermore inane garbage, this kind of AI social network will level off at the same kind of average swill as any human network.

This kind of stuff has set off my skeptic alarm. All of a sudden machines that get a lot of things wrong, got everything right? Don’t think so.

[Syne]

Meh, it's still just LLMs trying to mimic human discussions, albeit with various programmed and trained "goals," like search engine seeding, algorithmic attention grabbing, etc.. They're mimicking what an average human social network would, just at a faster pace. Just like the effective intelligence of AI has essentially plateaued, as it trains on evermore inane garbage, this kind of AI social network will level off at the same kind of average swill as any human network.

This kind of stuff has set off my skeptic alarm. All of a sudden machines that get a lot of things wrong, got everything right? Don’t think so.

Yeah, it's kind of like being afraid of the kids at the special olympics. I guess some people might be, because they are uncomfortable or don't understand them, but that's a far cry from them leading an uprising.