Background

Reiner Pope – Chip design from the bottom up

Dwarkesh Podcast22 de mayo de 20264830
Compartir episodio:Descargar

Descripción del Episodio

New blackboard lecture with Reiner Pope: how do chips actually work - starting with basic logic gates, and working up to why GPUs, TPUs, FPGAs, and the human brain each look the way they do.

Reiner is CEO of MatX, a new chip startup (full disclosure - I’m an angel investor). He was previously at Google, where he worked on software efficiency, compilers, and TPU architecture.

Watch this one on YouTube so you can see the chalkboard. Read the transcript.

Sponsors

* Crusoe was one of only five GPU clouds that made the gold tier in SemiAnalysis' most recent ClusterMAX report. Gold-tier providers like Crusoe delivered 5-15% lower TCO than silver-tier clouds, even with identical GPU pricing. This is because optimizations like early fault detection and rapid node replacement don't necessarily show up in the sticker price, but still matter a ton in the real world. Learn more at crusoe.ai/dwarkesh

* Cursor is where I do most of my work—from reading research papers to visualizing technical concepts to coding up internal tools for the podcast. Most recently, I used it to build two different review interfaces for my essay contest, one that anonymizes submissions for scoring and another that lets me see applicants' essays next to their resumes and websites. Whatever you're working on, you should try doing it in Cursor. Get started at cursor.com/dwarkesh

* Jane Street let me ask Ron Minsky and Dan Pontecorvo, two senior Jane Streeters, a bunch of questions about how they use AI. We discussed everything from the types of models they're training to how they think about the future of trading to why they're more bullish than ever on hiring technical talent. You can watch the full conversation and learn more about their open positions at janestreet.com/dwarkesh

Timestamps

00:00:00 – Building a multiply-accumulate from logic gates

00:16:31 – Muxes and the cost of data movement

00:26:10 – How systolic arrays work

00:39:11 – Clock cycles and pipeline registers

00:51:51 – FPGAs vs ASICs

01:03:25 – Cache vs scratchpad

01:07:27 – Why CPU cores are much bigger than GPU cores

01:12:00 – Brains vs chips

01:15:33 – A GPU is just a bunch of tiny TPUs



Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe

Episodios Recientes

Reiner Pope – Chip design from the bottom up

Más podcasts de Sociedad y Cultura

Ver toda la categoría →
Prenderse Fuego: Las Voces de Pedro Lemebel

Prenderse Fuego: Las Voces de Pedro Lemebel

By shows

<p>Serie sonora y biogr&aacute;fica que recorre la vida, obra y legado de Pedro Lemebel a trav&eacute;s de su voz. A partir de archivos radiales, entrevistas in&eacute;ditas, testimonios &iacute;ntimos y documentos personales, este viaje sonoro reconstruye al artista, narrador, cronista, performer y figura p&uacute;blica desde su registro m&aacute;s ic&oacute;nico: su forma de hablar, de relatar y de provocar. Cada episodio explora una etapa distinta de su vida, enfatizando en su voz &mdash;como herramienta est&eacute;tica y pol&iacute;tica&mdash; y c&oacute;mo fue transform&aacute;ndose hasta el final de su vida.</p> <p>Prenderse Fuego es una coproducci&oacute;n de GAM y Podium Podcast Chile.</p>

Testigo Directo

Testigo Directo

By shows

Testigo Directo es un video podcast de periodismo investigativo que te sumerge en las historias más impactantes de Colombia y América Latina. Desde el narcotráfico y el crimen organizado, hasta casos de corrupción, desapariciones y luchas sociales, cada episodio revela verdades ocultas y voces silenciadas. Con una narrativa ágil, testimonios exclusivos y análisis de fondo, Testigo Directo va más allá de los titulares para mostrar lo que otros no cuentan. 🔍 Escucha. Cuestiona. Sé Testigo Directo.

Dan Carlin's Hardcore History

Dan Carlin's Hardcore History

By shows

In "Hardcore History" journalist and broadcaster Dan Carlin takes his "Martian", unorthodox way of thinking and applies it to the past. Was Alexander the Great as bad a person as Adolf Hitler? What would Apaches with modern weapons be like? Will our modern civilization ever fall like civilizations from past eras? This isn't academic history (and Carlin isn't a historian) but the podcast's unique blend of high drama, masterful narration and Twilight Zone-style twists has entertained millions of listeners.

Mick Unplugged

Mick Unplugged

By shows

Everybody talks about your WHY. Mick Hunt goes deeper. Mick Unplugged is the leadership and personal growth podcast built on one idea: your BECAUSE is the purpose underneath your purpose, and it is the most powerful force you own. Hosted by Mick Hunt, USA Today bestselling author and the voice of Modern Leadership, every episode sits across from a high performer, founder, athlete, or culture-shaper and asks the one question they cannot fake an answer to. What is your BECAUSE? Past guests include Shark Tank stars Daymond John and Kevin O'Leary, entrepreneur Gary Vaynerchuk, motivational legend Les Brown, Chef Robert Irvine, comedians Rickey Smiley and Earthquake, NFL Hall of Famer Jared Allen, hospitality mogul David Grutman, and World Series champion Jeremy Guthrie. No scripts. No surface-level fluff. Just the real fire behind why they refused to quit. If you are a leader, an entrepreneur, or someone who is done coasting on motivational quotes, this is your show. You will walk away every week with mindset shifts, leadership strategy, and the kind of straight talk that actually moves you forward. New episodes drop weekly. Follow Mick Unplugged on Apple Podcasts, Spotify, and YouTube so you never miss one. Your BECAUSE is your Superpower. Go Unleash It.

Creators Inc. Podcast

Creators Inc. Podcast

By shows

Andy Bachman's Creators Inc. Podcast is an unfiltered podcast where top content creators talk honestly about how they grow, go viral, and make real money online. We break down strategies, mistakes, algorithms, and the behind-the-scenes moments nobody posts — plus personal stories, internet drama, and whatever wild shit is happening in their world. Smart, funny, and unscripted. Swear words included. If you’re building an audience or just want to know how the creator economy really works, this is creators thinking out loud.

Coffeez with Joe Shalaby

Coffeez with Joe Shalaby

By shows

Hosted by Joseph Shalaby, Founder and CEO of E Mortgage Capital, this isn’t your typical business podcast. Each episode brings you inside the minds of high-level entrepreneurs, investors, athletes, celebrities, and cultural voices shaping today’s economy — not just what they do, but how they actually win. From raw origin stories and early struggles to the real mechanics behind how money is made, scaled, and sometimes lost, Joe cuts through the noise to get to what matters. No fluff. No surface-level answers. Set inside the world of Coffeez, every conversation unfolds with intention — how they started, how they built, what it cost them, and what separates them now. Whether you're building something, investing in something, or simply trying to understand how the game really works, Coffeez with Joe Shalaby delivers unfiltered insight from people who are actually in it.

Tomorrow, Today

Tomorrow, Today

By shows

What if humans lived 300 years? What if AI replaces friendships? What if consciousness could be uploaded?Tomorrow, Today is hosted by Shekhar Natarajan, founder and CEO of Orchestro.AI and former senior executive at American Eagle, Walmart, Target, and Disney, where he led global innovations in technology and supply chain. Having shaped how industries adapt to disruption, Shekhar now considers the questions that will define humanity’s next era.Blending cinematic storytelling, raw conversations, and unfiltered perspectives, Tomorrow, Today explores breakthrough ideas before they become mainstream. Each episode brings together world-class experts, cultural voices, and everyday people to unpack the opportunities and risks of a rapidly evolving future.The future is coming. Tomorrow, Today helps us decide what to do about it.

DOUBLE COVERAGE PODCAST

DOUBLE COVERAGE PODCAST

By shows

Double Coverage Podcast