Sholto Douglas & Trenton Bricken — How LLMs actually think
Descripción del Episodio
Had so much fun chatting with my good friends Trenton Bricken and Sholto Douglas on the podcast.
No way to summarize it, except:
This is the best context dump out there on how LLMs are trained, what capabilities they're likely to soon have, and what exactly is going on inside them.
You would be shocked how much of what I know about this field, I've learned just from talking with them.
To the extent that you've enjoyed my other AI interviews, now you know why.
So excited to put this out. Enjoy! I certainly did :)
Watch on YouTube. Listen on Apple Podcasts, Spotify, or any other podcast platform.
There's a transcript with links to all the papers the boys were throwing down - may help you follow along.
Follow Trenton and Sholto on Twitter.
Timestamps
(00:00:00) - Long contexts
(00:16:12) - Intelligence is just associations
(00:32:35) - Intelligence explosion & great researchers
(01:06:52) - Superposition & secret communication
(01:22:34) - Agents & true reasoning
(01:34:40) - How Sholto & Trenton got into AI research
(02:07:16) - Are feature spaces the wrong way to think about intelligence?
(02:21:12) - Will interp actually work on superhuman models
(02:45:05) - Sholto’s technical challenge for the audience
(03:03:57) - Rapid fire
Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
Episodios Recientes
Más podcasts de Sociedad y Cultura
Ver toda la categoría →
Market Maker
By shows
The AmplifyME Market Maker Podcast makes finance fun and easy to understand. Hosted by LinkedIn Top Voice Anthony Cheung, alongside trader-turned-founder Piers Curran and former investment banker and entrepreneur Stephen Barnett, each week they break down the biggest market stories and trends shaping the global economy. Get real insight, build your commercial awareness and learn how markets really work, with top guests from leading banks, hedge funds and asset managers sharing their expertise, career journeys and advice.
Unhedged
By shows
Katie Martin, Robert Armstrong and other markets nerds at the Financial Times explain the big ideas behind what’s happening in finance right now. Every Tuesday and Thursday.<hr><p style='color:grey; font-size:0.75em;'> Hosted on Acast. See <a style='color:grey;' target='_blank' rel='noopener noreferrer' href='https://acast.com/privacy'>acast.com/privacy</a> for more information.</p>
Lemonade Stand
By shows
Three guys with the expertise to run a lemonade stand explain the world of business. a podcast by Aiden, Atrioc, and DougDoug. Part of the Vox Media Podcast Network.
Finect Talks
By shows
<a href="https://go.ivoox.com/wv/premios26?c=6406" target="_blank">¡Vótame en los Premios iVoox 2026!</a> <br>Finect Talks, el podcast que te ayuda a invertir mejor. Hablamos de ahorro e inversión de una forma entretenida y con un invitado semanal. https://www.finect.com/
La Burrera
By shows
Cuando parece que varios amigos alcanzan un punto de risa de no retorno, siempre hay un punto más allá. Pere Aznar, Ana Morgade e Iggy Rubín, junto a un invitado, competirán por ver quién dice \u0022la más gorda\u0022 sobre un tema.
AM
By shows
El resumen informativo de The Voice Village, dirigido por Conchi Gil, producido por Ricardo Villa y narrado por Conchi Gil y Dani Gutierrez. Una producción de The Voice Village. De lunes a viernes, a las 7:30 AM. @amelpodcast
Estas Rica
By shows
Estás Rica Podcast es el close friends más hot de Dani Sayan: artista intensa, graduada de psicología y cero paciencia para el autoengaño. Aquí se habla de deseo, apego, ambición, poder personal y caos emocional… con humor picante, verdades incómodas y vibes de “sí soy sensible, pero también peligrosa”. Vienes a sentirte vista, removida y un poquito atacada. Sales más clara, más rica y con menos ganas de conformarte. Dedicado a mujeres, hombres, personas no binaries, y cualquier ser que quiera mejorar en todo aspecto. Y cuando el universo deja de ser místico y se convierte en programas, la transformación se hace práctica: si quieres ir más profundo, los programas viven en estasrica.com.
Not Just A Terrible Story
By shows
When Stacie Love married her former high school teacher, she thought it was a whirlwind romance. Two decades later, she discovered the truth behind the day their lives unraveled: a federal search, an unseen investigation, and a story far darker than she ever knew. Not Just A Terrible Story is a six-part investigation into one woman’s search for the truth, the scourge of alleged educator sexual misconduct, and a culture of complicity that protected predators for decades.