Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI compute
Descripción del Episodio
Dylan Patel, founder of SemiAnalysis, provides a deep dive into the 3 big bottlenecks to scaling AI compute: logic, memory, and power.
And walks through the economics of labs, hyperscalers, foundries, and fab equipment manufacturers.
Learned a ton about every single level of the stack. Enjoy!
Watch on YouTube; read the transcript.
Sponsors
* Mercury has already saved me a bunch of time this tax season. Last year, I used Mercury to request W-9s from all the contractors I worked with. Then, when it came time to issue 1099s this year, I literally just clicked a button and Mercury sent them out. Learn more at mercury.com.
* Labelbox noticed that even when voice models appear to take interruptions in stride, their performance degrades. To figure out why, they built a new evaluation pipeline called EchoChain. EchoChain diagnoses voice models’ specific failure modes, letting you understand what your model needs to truly handle interruptions. Check it out at labelbox.com/dwarkesh.
* Jane Street is basically a research lab with a trading desk attached – and their infrastructure backs this up. They’ve got tens of thousands of GPUs, hundreds of thousands of CPU cores, and exabytes of storage. This is what it takes to find subtle signals hidden deep within noisy market data. If this sounds interesting, you can explore open positions at janestreet.com/dwarkesh.
Timestamps
(00:00:00) – Why an H100 is worth more today than 3 years ago
(00:24:52) – Nvidia secured TSMC allocation early; Google is getting squeezed
(00:34:34) – ASML will be the #1 constraint for AI compute scaling by 2030
(00:55:47) – Can't we just use TSMC's older fabs?
(01:05:37) – When will China outscale the West in semis?
(01:16:01) – The enormous incoming memory crunch
(01:42:34) – Scaling power in the US will not be a problem
(01:54:44) – Space GPUs aren't happening this decade
(02:14:07) – Why aren't more hedge funds making the AGI trade?
(02:18:30) – Will TSMC kick Apple out from N2?
(02:24:16) – Robots and Taiwan risk
Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
Episodios Recientes
Más podcasts de Sociedad y Cultura
Ver toda la categoría →
Dumb Blonde
By shows
<p>Asking the questions others are afraid to. Bunnie XO host of the Dumb Blonde podcast – the ultimate destination for comedy, trending and lifestyle. Get ready to dive into hilarious discussions about relationships, trauma, embarrassing moments, and all the realness life throws at us. Join Bunnie every week to laugh, relate, and embrace your inner healing.</p>
The Snare
By shows
In 1996, 18-year-old Angie Dodge is found brutally murdered in her Idaho Falls home. Police zero in on a suspect and put a man behind bars. But as the years pass, doubts emerge about whether the real killer was ever caught. Leading the fight for answers is an unlikely advocate: Angie’s own mother, who embarks on a decades-long mission to uncover the truth. A six-part series from 20/20 and ABC Audio, hosted by Maggie Rulli. New episodes Tuesdays.
Joy 101 with Hoda Kotb
By shows
<p>Joy is essential.</p> <p>And it's also elusive. You can't order it, borrow it, or simply hope it into life.</p> <p>But now, there's a new and exciting way to start your journey toward a more joyful existence: The Joy 101 Podcast with Hoda!</p> <p>Best known for her Emmy-winning work and co-anchoring <em>Today,</em> Hoda Kotb infuses her authenticity, curiosity, and warmth into conversations with the world’s most fascinating people. Entertainment legends, sport icons, wellness experts, and everyday folks will share how they find, allow, and experience joy. Hoda will offer her own tips and takes on seeking a more balanced, harmonious life. </p> <p>If you're craving inspiration, support, and useful tools to maximize your joy, tune in to these candid, uplifting, and moving on-air chats.</p> <p>Joy after a breakup, joy as an empty-nester, joy after loss, joy as a caretaker — Hoda's new podcast will speak to you.</p> <p>Joy 101 with Hoda Kotb, an iHeartPodcast.</p>
La Silla: On The Record
By shows
Cada semana contamos movidas de poder en Colombia a través de la voz de sus protagonistas. Un podcast de La Silla Podcasts.
Dinero Más Inteligente
By shows
El dinero no solo se gana, se entiende. <br /> En El Dinero Más Inteligente, Valeria Ovalle presenta la economía y Juan Carlos Herrera la conecta al mundo de inversiones. Una conversación entre razón y estrategia para entender el mundo financiero sin complicaciones. <br /> By GBM <br /> Síguenos en <b><a href="https://www.instagram.com/gbmplus_?igsh=czBzOG5mazBwMmlj&utm_source=qr">Instagram</a><b>.</b></b>
Lo que NO se habla con Fer Flores
By shows
Contenidos para construir una Humanidad con H mayúscula con perspectiva psicoanalista, médica, legal, antropológica y espiritual.
After the Whistle with Brendan Hunt and Rebecca Lowe
By shows
<p>Rebecca Lowe (Fox Sports) and Brendan Hunt (‘Ted Lasso’) are teaming up again to take on the 2026 World Cup! They’ll ride an emotional roller coaster together as 48 teams play 104 action-packed matches across the U.S., Canada, and Mexico. They’ll bring you all the joy and the drama, the hope and the heartbreak — and help you understand the matchups and personalities that will make this the biggest sporting and cultural event of our lifetimes</p><p>‘After the Whistle With Brendan Hunt and Rebecca Lowe’ is an Apple News Original podcast presented by Verizon.</p>
