Here’s Grok:
edit: or should this say “meet Grok you future AI overlord”
This is utterly wild. Thanks for posting it, Patrick.
Only 122 days to build it with over 100,000+ GPU’s. Meanwhile the largest supercomputers with only 1/4 the GPU’s would take many years to build. I do wonder if the power consumption ratio is comparable, though.
I remember nVidia was an emerging GPU creator for graphics cards across the late 90’s and onward. When AI software tech materialized and was designed for leveraging the architecture of a GPU… it was like nVidia won the lottery. Unbelievable how the company was vaulted up like that. It’s like if you had a large amount of Apple stock at $22 a share back in 1997…
say what you will about Musk. Love him or hate him, you have to admit he gets stuff done.
To be fair, it’s the engineers who came up with the modular construct that they just kept repeating and chaining… Who knows what the expense was. The advantage Musk has is that he can put all the money needed upfront. No monthly allotment spread out over a long period of time.
Bottom line for someone like Elon is you can reach a critical mass of assets and pretty much do whatever you want.
In particular, I appreciate how his ventures have played off one another. Tesla is better because of both Starlink and SpaceX. He can do robotics because of Tesla. The Boring Co. is more interesting and dynamic because of SpaceX and Tesla.
And now he’ll be able to expand all his ventures because of xAI Colossus.
Bezos has done a remarkable job of horizontal integration with Amazon, but I don’t think anybody compares to Musk when it comes to leveraging technologies to enhance his various pursuits.