next BIG future

next BIG future

XAI Completes Nvidia 100K Training Cluster and Will Double in Months

NextBigFuture's avatar
NextBigFuture
Sep 03, 2024
∙ Paid
Share

This weekend, the xAI team brought the Colossus 100k H100 training cluster online. From start to finish, it was done in 122 days.

Colossus is the most powerful AI training system in the world. Moreover, it will double in size to 200k (50k H200s) in a few months.

Keep reading with a 7-day free trial

Subscribe to next BIG future to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 Nextbigfuture
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture