Neural scaling laws
Subject in Technology
Neural scaling laws has come up in 1 episode across 1 podcast in TMT, including Lex Fridman Podcast. 1 person has made recorded remarks about it.
What people said
Jensen HuangNvidia CEO who described GPUs as fungible, durable revenue-generating assets
Huang rejects the notion that inference is easy, arguing that inference is thinking and is compute-intensive.
“And that was always illogical to me because inference is thinking. And I think thinking is hard. Thinking is way harder than reading”
Lex Fridman Podcast: #494 – Jensen Huang: NVIDIA – The $4 Trillion Company & the AI Revolution (Mar 23, 2026) · Listen from 30:28
Huang argues that because most training data will be synthetic, AI training is now limited by compute rather than data.
“Training is no longer limited by data. It's now limited by compute. And the reason for that is most of the data is synthetic”
Lex Fridman Podcast: #494 – Jensen Huang: NVIDIA – The $4 Trillion Company & the AI Revolution (Mar 23, 2026) · Listen from 29:14
Podcasts
- Lex Fridman Podcast · 1 episode
Episodes
#494 – Jensen Huang: NVIDIA – The $4 Trillion Company & the AI RevolutionLex Fridman Podcast · Mar 23, 2026
Lex Fridman interviews NVIDIA CEO Jensen Huang on extreme co-design, CUDA, AI scaling laws, supply chains, power, China, TSMC, jobs, AGI and mortality.