Scivillage.com Casual Discussion Science Forum

Welcome to xAI's Colossus, the world's most powerful AI supercomputer with 100,000 Nvidia GPUs.

And here's a 15 minute video tour that provides lots of details about what it looks like, how its laid out, what's in the thousands of racks in multiple computer halls (four at present I believe, more under contruction), networking, cooling and lots more:

https://x.com/xDaily/status/1850962752925282361

Like Starbase, the construction never stops. They reportedly want to add another 100,000 GPUs.

It's a bit more elaborate than your home PC...

I'm struck by how computer mainframes started out really big in the 1960's, then computers shrunk to fit in the palm of your hand by the 2000's... and now computers are big again... The size of a factory in this case, way bigger than their early ancestors ever were. (And crushing the Turing test as they grow.)

Again, Science Fiction becoming reality... pure Elon. A little scary though...

Jensen Huang, the CEO of Nvidia, says:

https://x.com/elon_docs/status/1850974113315385384

"Building a massive factory, liquid-cooled, energized, permitted, in the short time that was done, that is superhuman. And, as far as I know, there's only one person in the world who could do that.

Elon is singular in this understanding of engineering and construction and large systems, marshaling resources. It's unbelievable.

And then, of course, his engineering team is extraordinary. The software team is great, the networking team is great, the infrastructure team is great. Elon understands this deeply.

And from the moment that we decided to go, the planning with our engineering team, then all of the infrastructure, all of the logistics and the amount of technology and equipment that came in on that day, to training, 19 days. Incredible.

So, I think what Elon and the X team did is singular. Never been done before.

Just to put in perspective, 100,000 GPUs, that's easily the fastest supercomputer on the planet, as one cluster. A supercomputer that you would build would take normally three years to plan, and then they deliver the equipment, and it takes one year to get it all working.

We're talking about 19 days.”

Elon gave a progress report on Neuralink last month to the 2024 Congress of Neurological Surgeons in Houston. Where he told the assembled neurosurgeons this:

"Try submitting x-ray, PET, MRI or other medical images to Grok for analysis.
This is still early stage, but it is already quite accurate and will become extremely good.
Let us know where Grok gets it right or needs work."

So Grok is already becoming more than just another chatbot, no matter how much more witty and irreverant it is than the competition. It's turning its already superhuman pattern recognition skills (the specialty of neural networks) to important real world applications.

The New York Post is reporting that xAI is in another funding round, handled by several of Silicon Valley's biggest venture capital firms. This round values xAI at $40 billion. (It was only worth $1 billion as late as last December.)

And the NY Post, citing unnamed "sources", is claiming that Nvidia is looking to buy in and acquire a chunk of xAI. (Nvidia has denied similar rumors in the past.) But it's undeniable that Elon and Jensen Huang know and respect each other.

https://www.msn.com/en-us/money/other/ch...r-AA1tm8j3

CNBC is reporting that xAI's latest funding round is complete (see previous post) and that the company is now valued at $50 billion, suggensting invester eagerness to get in.

Today xAI announced a major expansion to their Memphis TN supercomputer. Talk is that they want to expand it to a million GPU's! Memphis is all happy because not only does xAI put them on the high tech map (Memphis otherwise is pretty downscale), it's also attracted Nvidia, Dell and Supermicro to locate operations in the area as well.

Images of the huge cooling plant for 100,000+ GPUs

https://x.com/xai/status/1873412599125266442

Huge shakeup in Elon's business empire!

Elon writes (highlighting by me)

https://x.com/elonmusk/status/1905731750275510312

"xAI has acquired X in an all-stock transaction. The combination values xAI at $80 billion and X at $33 billion ($45B less $12B debt).

Since its founding two years ago, xAI has rapidly become one of the leading AI labs in the world, building models and data centers at unprecedented speed and scale.

X is the digital town square where more than 600M active users go to find the real-time source of ground truth and, in the last two years, has been transformed into one of the most efficient companies in the world, positioning it to deliver scalable future growth.

xAI and X’s futures are intertwined. Today, we officially take the step to combine the data, models, compute, distribution and talent. This combination will unlock immense potential by blending xAI’s advanced AI capability and expertise with X’s massive reach. The combined company will deliver smarter, more meaningful experiences to billions of people while staying true to our core mission of seeking truth and advancing knowledge. This will allow us to build a platform that doesn’t just reflect the world but actively accelerates human progress.

I would like to recognize the hardcore dedication of everyone at xAI and X that has brought us to this point. This is just the beginning.

Thank you for your continued partnership and support."



My first question was what happens to Linda Yaccarino, who I like.

She says

@X
+
@xAI

The future could not be brighter ✨

https://x.com/lindayaX/status/1905737074298572880

Tough negotiations, but they were finally able to reach a deal!



nsNS

AI philosophy