Why Scale Will Not Solve AGI | Vishal Misra - The a16z Show

a16z
00:46:24 Report Issue
Loading transcript... Click for full transcript

Chapters & Sections (22) ▼

0:00 Limitations of Large Language Models for AGI chapter 2
2:18 Mathematical Model of Large Language Models
4:16 Probabilistic Distribution in Language Models
6:05 Limitations of Large Language Models (LLMs) chapter 1
8:15 The Limitations of Scaling for AGI
11:11 In-Context Learning Mechanisms in LLMs chapter 1
14:07 Bayesian Inference in Machine Learning
16:34 Proving AGI Scalability with Token Probe chapter 2
19:03 Evaluating AI Model Memorization Limits
20:50 Mechanisms Behind AI Model Performance
22:47 Limitations of Large Language Models in AGI chapter 2
25:52 AGI and the Limitations of Scaling
27:15 Limitations of Deep Learning in Causal Reasoning
28:52 Limitations of Deep Learning in AGI chapter 2
30:17 Limitations of Scaling in AGI Development
32:12 Limitations of Newtonian Mechanics in Explaining Reality
34:18 Limitations of Large Language Models in AGI chapter 1
37:37 AGI Definition and Requirements
38:59 Hacking Plasticity in Large Language Models chapter 3
41:50 The Limitations of Scaling in AGI Research
43:20 Progress in LLMs and Deep Learning
45:08 Advancing AGI Research Beyond Scaling Limits

More from a16z

See All ›
The $700 Billion AI Productivity Problem No One's Talking About56m

The $700 Billion AI Productivity Problem No One's Talking About

a16z
Ben Horowitz and Ali Ghodsi: How to Run a $100 Billion Business1h 4m

Ben Horowitz and Ali Ghodsi: How to Run a $100 Billion Business

a16z
Why AI Moats Still Matter (And How They've Changed)50m

Why AI Moats Still Matter (And How They've Changed)

a16z
The History of The Fintech Industry, Explained45m

The History of The Fintech Industry, Explained

a16z
How OpenAI Builds for 800 Million Weekly Users: Model Specialization and Fine-Tuning53m

How OpenAI Builds for 800 Million Weekly Users: Model Specialization and Fine-Tuning

a16z
Seeing The Future from AI Companions to Personal Software50m

Seeing The Future from AI Companions to Personal Software

a16z
The Secret Marketing Strategy That Built a16z: From Zero to Legendary VC Firm58m

The Secret Marketing Strategy That Built a16z: From Zero to Legendary VC Firm

a16z
Keith Rabois: Israel, OpenAI, Opendoor, and DOGE47m

Keith Rabois: Israel, OpenAI, Opendoor, and DOGE

a16z
The Lawyerly Society vs. The Engineering State: Who Owns the Future?1h 3m

The Lawyerly Society vs. The Engineering State: Who Owns the Future?

a16z
Robinhood CEO: Making Everyone An Owner1h 3m

Robinhood CEO: Making Everyone An Owner

a16z
Ben Horowitz and Ali Ghodsi: How to Run a Billion-Dollar Business1h 8m

Ben Horowitz and Ali Ghodsi: How to Run a Billion-Dollar Business

a16z
He Built a $3B+ Company. This is his next BIG IDEA.56m

He Built a $3B+ Company. This is his next BIG IDEA.

a16z

Trending Now

Dr. Steven Greer on UFO Evidence, Trump, Living E.T. & Underground Government (Full Interview)1h 20m

Dr. Steven Greer on UFO Evidence, Trump, Living E.T. & Underground Government (Full Interview)

djvlad
Joe Rogan Experience #2507 - Harland Williams3h 13m⏭ 2

Joe Rogan Experience #2507 - Harland Williams

The Joe Rogan Experience
Donald Trump Unleashed: Bibi, "Are You Effing Crazy?!"48m⏭ 1

Donald Trump Unleashed: Bibi, "Are You Effing Crazy?!"

Pod Force One with Miranda Devine
Byron Allen: From Paperboy To Billionaire1h 40m⏭ 3

Byron Allen: From Paperboy To Billionaire

The Adam Carolla Show
Nikola Tesla Fell In Love With A Pigeon31m⏭ 1

Nikola Tesla Fell In Love With A Pigeon

The Rest Is Science
Buck50 | Episode 16 | Pop the Trunk1h 22m

Buck50 | Episode 16 | Pop the Trunk

Vinnie Paz
The BIG Payoff | The Church of What's Happening Now1h 16m⏭ 4

The BIG Payoff | The Church of What's Happening Now

Joey Diaz
Lamorne Morris 7.0 (New Girl, Spider-Noir) on TYSO - #3561h 50m⏭ 3

Lamorne Morris 7.0 (New Girl, Spider-Noir) on TYSO - #356

Rick Glassman
Koe Wetzel: The Glow Up Nobody Saw Coming47m

Koe Wetzel: The Glow Up Nobody Saw Coming

Dumb Blonde Podcast
Latto Talks 'Big Mama,' Motherhood, 21 Savage, Drake, Ice Spice, Cardi B + More18m

Latto Talks 'Big Mama,' Motherhood, 21 Savage, Drake, Ice Spice, Cardi B + More

Breakfast Club Power 105.1 FM
“NEW Evidence!” - Randall Carlson on Ancient History’s Most LOST Civilization & Catastrophes | 4304h 6m⏭ 2

“NEW Evidence!” - Randall Carlson on Ancient History’s Most LOST Civilization & Catastrophes | 430

Julian Dorey
JRE MMA Show #180 with Daniel Rodriguez2h 15m⏭ 2

JRE MMA Show #180 with Daniel Rodriguez

The Joe Rogan Experience

Transcript

Loading transcript...