Maja Hitij / Getty Images / Getty Images
The race for AI supremacy is once again accelerating as xAI CEO Elon Muskannounced via Twitterthat his company successfully brought its Colossus AI training bunch , which Musk bills as the world ’s “ most potent , ” online over the weekend .
This weekend , the@xAIteam bring our Colossus 100k H100 training bunch online . From start to finish , it was done in 122 days .
Maja Hitij/Getty Images / Getty Images
Colossus is the most muscular AI training system in the world . Moreover , it will double in size to 200k ( 50k H200s ) in a few months .
Excellent …
& mdash ; Elon Musk ( @elonmusk)September 2 , 2024
“ This weekend , the @xAI squad make for our Colossus 100k H100 training bunch online . From start to finish , it was done in 122 days . Colossus is the most powerful AI preparation system in the reality . Moreover , it will double in size of it to 200k ( 50k H200s ) in a few months . Excellent employment by the team , Nvidia and our many better half / suppliers , ” Musk wrote in a post on X.
Musk ’s “ most muscular ” call is base on the number of GPUs employed by the system . With 100,000 Nvidia H100s drive it , Colossus is estimated to be large than any other AI system developed to date .
Musk began purchasing tens of chiliad of GPUsin April 2023to accelerate his company ’s AI efforts , soon afterpenning an open lettercalling for an industrywide , six month “ pause ” on AI evolution . In March of that year , Musk claimedthat the company would leverage AI to “ detect & highlight handling of public popular opinion ” on Twitter , though the GPU supercomputer will likely also be leveraged to civilise its large language modelling ( LLM),Grok .
Grok was introduced by xAI in 2023 in response to the achiever of competition like ChatGPT , Gemini , Llama 3.1 , and Claude . The company release the updatedGrok-2as a genus Beta in August . “ We have introduced Grok-2 , positioning us at the vanguard of AI development , ” xAI wrote in a recentblogpost . “ Our nidus is on advancing center reasoning capability with our new compute cluster . We will have many more developments to share in the coming month . ”
Musk claims that he can also develop Tesla into “ a leader in AI & robotics , ” however , a late report card fromCNBCsuggests that Musk has been deviate shipments of Nvidia ’s extremely try - after GPUs from the galvanizing automaker to xAI and Twitter . Doing so could delay Tesla ’s sweat to put in the compute resources needed to develop its sovereign vehicle engineering and the Optimus humanoid robot .
“ Elon prioritizing X H100 GPU cluster deployment at X versus Tesla by redirecting 12k of shipped H100 GPUs originally slated for Tesla to X rather , ” an Nvidia memo from December obtained by CNBC reads . “ In exchange , original ten orders of 12k H100 slate for [ January ] and June to be redirected to Tesla . ”
