next BIG future

next BIG future

New AI Algorithm Can Reduce LLM Energy Usage by 80-95%

NextBigFuture's avatar
NextBigFuture
Oct 22, 2024
∙ Paid
Share

New Linear-complexity Multiplication (L-Mul) algorithm claims it can reduce energy costs by 95% for element-wise tensor multiplications and 80% for dot products in large language models. It maintains or even improving precision compared to 8-bit floating point operations.

By replacing complex floating-point multiplication with integer addition

Solution i…

Keep reading with a 7-day free trial

Subscribe to next BIG future to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 Nextbigfuture
Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture