Gavin Baker, an xAI investor and hedge fund manager, explains the main problems that OpenAI and the others has was they believed they could not make more than 32000 h100s share the same memory and work coherently using current networking. Elon and then xAI team went to first principles and figured out scaling to 100k chips and 200k chips. The scaling la…
Keep reading with a 7-day free trial
Subscribe to next BIG future to keep reading this post and get 7 days of free access to the full post archives.