next BIG future

next BIG future

Jensen Predicts AI Inference Will Be 1 Billion Times Larger

By Brian Wang

NextBigFuture's avatar
NextBigFuture
Oct 15, 2024
∙ Paid
Share

Nvidia says that machine learning and agents will take over computer programming.

Jensen says distributed AI inference will have to work in order to meet the demand for inference.

AI inference will reflect upon getting the answer 10,000 times. Chain of reasoning and reflection and other intensification of compute for the answers.

This will make AI inferenc…

Keep reading with a 7-day free trial

Subscribe to next BIG future to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 Nextbigfuture
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture