Paul Christiano — Preventing an AI takeover
Descripción del Episodio
Paul Christiano is the world’s leading AI safety researcher. My full episode with him is out!
We discuss:
- Does he regret inventing RLHF, and is alignment necessarily dual-use?
- Why he has relatively modest timelines (40% by 2040, 15% by 2030),
- What do we want post-AGI world to look like (do we want to keep gods enslaved forever)?
- Why he’s leading the push to get to labs develop responsible scaling policies, and what it would take to prevent an AI coup or bioweapon,
- His current research into a new proof system, and how this could solve alignment by explaining model's behavior
- and much more.
Watch on YouTube. Listen on Apple Podcasts, Spotify, or any other podcast platform. Read the full transcript here. Follow me on Twitter for updates on future episodes.
Open Philanthropy
Open Philanthropy is currently hiring for twenty-two different roles to reduce catastrophic risks from fast-moving advances in AI and biotechnology, including grantmaking, research, and operations.
For more information and to apply, please see the application: https://www.openphilanthropy.org/research/new-roles-on-our-gcr-team/
The deadline to apply is November 9th; make sure to check out those roles before they close.
Timestamps
(00:00:00) - What do we want post-AGI world to look like?
(00:24:25) - Timelines
(00:45:28) - Evolution vs gradient descent
(00:54:53) - Misalignment and takeover
(01:17:23) - Is alignment dual-use?
(01:31:38) - Responsible scaling policies
(01:58:25) - Paul’s alignment research
(02:35:01) - Will this revolutionize theoretical CS and math?
(02:46:11) - How Paul invented RLHF
(02:55:10) - Disagreements with Carl Shulman
(03:01:53) - Long TSMC but not NVIDIA
Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
Episodios Recientes
Más podcasts de Sociedad y Cultura
Ver toda la categoría →
Psycho Politics with George Conway
By shows
<div>American politics has gone a little psycho, and George Conway is here to make sense of it. Joined by friends, colleagues, and expert guests, George digs into the legal battles, political fights, elections, personalities, and power struggles shaping American politics, from Trump and the courts to primaries, the future of democracy, and whatever fresh absurdity is consuming Washington.</div>
Market Maker
By shows
The AmplifyME Market Maker Podcast makes finance fun and easy to understand. Hosted by LinkedIn Top Voice Anthony Cheung, alongside trader-turned-founder Piers Curran and former investment banker and entrepreneur Stephen Barnett, each week they break down the biggest market stories and trends shaping the global economy. Get real insight, build your commercial awareness and learn how markets really work, with top guests from leading banks, hedge funds and asset managers sharing their expertise, career journeys and advice.
Unhedged
By shows
Katie Martin, Robert Armstrong and other markets nerds at the Financial Times explain the big ideas behind what’s happening in finance right now. Every Tuesday and Thursday.<hr><p style='color:grey; font-size:0.75em;'> Hosted on Acast. See <a style='color:grey;' target='_blank' rel='noopener noreferrer' href='https://acast.com/privacy'>acast.com/privacy</a> for more information.</p>
Lemonade Stand
By shows
Three guys with the expertise to run a lemonade stand explain the world of business. a podcast by Aiden, Atrioc, and DougDoug. Part of the Vox Media Podcast Network.
Finect Talks
By shows
<a href="https://go.ivoox.com/wv/premios26?c=6406" target="_blank">¡Vótame en los Premios iVoox 2026!</a> <br>Finect Talks, el podcast que te ayuda a invertir mejor. Hablamos de ahorro e inversión de una forma entretenida y con un invitado semanal. https://www.finect.com/
La Burrera
By shows
Cuando parece que varios amigos alcanzan un punto de risa de no retorno, siempre hay un punto más allá. Pere Aznar, Ana Morgade e Iggy Rubín, junto a un invitado, competirán por ver quién dice \u0022la más gorda\u0022 sobre un tema.
AM
By shows
El resumen informativo de The Voice Village, dirigido por Conchi Gil, producido por Ricardo Villa y narrado por Conchi Gil y Dani Gutierrez. Una producción de The Voice Village. De lunes a viernes, a las 7:30 AM. @amelpodcast