Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI compute
Descripción del Episodio
Dylan Patel, founder of SemiAnalysis, provides a deep dive into the 3 big bottlenecks to scaling AI compute: logic, memory, and power.
And walks through the economics of labs, hyperscalers, foundries, and fab equipment manufacturers.
Learned a ton about every single level of the stack. Enjoy!
Watch on YouTube; read the transcript.
Sponsors
* Mercury has already saved me a bunch of time this tax season. Last year, I used Mercury to request W-9s from all the contractors I worked with. Then, when it came time to issue 1099s this year, I literally just clicked a button and Mercury sent them out. Learn more at mercury.com.
* Labelbox noticed that even when voice models appear to take interruptions in stride, their performance degrades. To figure out why, they built a new evaluation pipeline called EchoChain. EchoChain diagnoses voice models’ specific failure modes, letting you understand what your model needs to truly handle interruptions. Check it out at labelbox.com/dwarkesh.
* Jane Street is basically a research lab with a trading desk attached – and their infrastructure backs this up. They’ve got tens of thousands of GPUs, hundreds of thousands of CPU cores, and exabytes of storage. This is what it takes to find subtle signals hidden deep within noisy market data. If this sounds interesting, you can explore open positions at janestreet.com/dwarkesh.
Timestamps
(00:00:00) – Why an H100 is worth more today than 3 years ago
(00:24:52) – Nvidia secured TSMC allocation early; Google is getting squeezed
(00:34:34) – ASML will be the #1 constraint for AI compute scaling by 2030
(00:55:47) – Can't we just use TSMC's older fabs?
(01:05:37) – When will China outscale the West in semis?
(01:16:01) – The enormous incoming memory crunch
(01:42:34) – Scaling power in the US will not be a problem
(01:54:44) – Space GPUs aren't happening this decade
(02:14:07) – Why aren't more hedge funds making the AGI trade?
(02:18:30) – Will TSMC kick Apple out from N2?
(02:24:16) – Robots and Taiwan risk
Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
Episodios Recientes
Más podcasts de Sociedad y Cultura
Ver toda la categoría →
Ad Propositum
By shows
Bienvenidas y bienvenidos al podcast de Adpropositum, mi espacio auditivo para acompañarte a conectarte con tu propósito ayudándote a eliminar los obstáculos para acceder a una vida autentica y con sentido. Aqui reflexionaremos y aprenderemos en torno a la vida, el amor, el sufrimiento, el proposito y lo valioso. Un lugar construido para que lo compartas con otros y para que ademas de acceder a mis podcast, tambien encuentres mis medicinas auditivas para el alma.
Modo Taoísmo
By shows
Obtén inspiración para poseer el poder de alcanzar la grandeza y desbloquear todo tu potencial. Solo necesitas motivación y orientación para superar obstáculos y llevar una vida con propósito.
BAJO LOS PALOS by FLEXICAR
By shows
Bajo los Palos es un podcast presentado por Iker Casillas, donde las conversaciones van más allá del fútbol. En cada episodio, Iker invita a diferentes personalidades para hablar sobre experiencias de vida, aprendizajes y reflexiones, creando un espacio cercano y auténtico. Un viaje lleno de historias inspiradoras, desde dentro y fuera del terreno de juego.
Park Predators
By shows
Explore the dark side of the world’s most beautiful places with investigative journalist and park enthusiast Delia D’Ambra. Each week, Delia guides you deep into national parks and forests across the globe, uncovering stories where nature’s breathtaking beauty has masked sinister secrets. From infamous cases that made headlines to little-known crimes that still need answers, Delia’s relentless pursuit of the truth takes her through archives and remote landscapes to reveal the hidden darkness haunting these natural wonders. Because sometimes, the most beautiful places hide the darkest secrets. This is Park Predators.
Monólogo de Alsina
By shows
Escucha y lee todas las noticias del programa. En directo de L-V de 6 a 12:30
Martes De Misterio
By shows
Casos reales de misterio y horror. Testimonios en primera persona. Entrevistas e investigaciones. Conduce: Martín Echevarría (@martinderadio). Cada Martes un episodio estreno para que puedas oír desde cualquier dispositivo. Si tienes una historia para contarnos éstos son nuestros contactos: +54 9 223 6155802 (Whatsapp Producción) // @martesdemisterio (Instagram) // mail: [email protected]
El Cartel de La Mega
By shows
Dirigido por Daniel Trespalacios. Es reconocido por su formato innovador que mezcla entretenimiento, interacción con los oyentes y temas paranormales.