Find shows
you love
Build your personal media library. Follow your favorite people, shows, and topics
Andrej Karpathy — AGI is still a decade away
The Andrej Karpathy episode.
During this interview, Andrej explains why reinforcement learning is terrible (but everything else is much worse), why AGI will just blend into the previous ~2.5 centuries of 2% GDP growth, why self driving took so long to crack, and what he sees as the future of education.
It was a pleasure chatting with him.
Watch on YouTube; read the transcript.
Sponsors
* Labelbox helps you get data that is more detailed, more accurate, and higher signal than you could get by default, no matter your domain or training paradigm. Reach out today at labelbox.com/dwarkesh
* Mercury helps you run your business better. It’s the banking platform we use for the podcast — we love that we can see our accounts, cash flows, AR, and AP all in one place. Apply online in minutes at mercury.com
* Google’s Veo 3.1 update is a notable improvement to an already great model. Veo 3.1’s generations are more coherent and the audio is even higher-quality. If you have a Google AI Pro or Ultra plan, you can try it in Gemini today by visiting https://gemini.google
Timestamps
(00:00:00) – AGI is still a decade away
(00:29:45) – LLM cognitive deficits
(00:40:05) – RL is terrible
(00:49:38) – How do humans learn?
(01:06:25) – AGI will blend into 2% GDP growth
(01:17:36) – ASI
(01:32:50) – Evolution of intelligence & culture
(01:42:55) - Why self driving took so long
(01:56:20) - Future of education
Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
Satya Nadella — How Microsoft is preparing for AGI
As part of this interview, Satya Nadella gave Dylan Patel (founder of SemiAnalysis) and me an exclusive first-look at their brand-new Fairwater 2 datacenter.
Microsoft is building multiple Fairwaters, each of which has hundreds of thousands of GB200s & GB300s. Between all these interconnected buildings, they’ll have over 2 GW of total capacity. Just to give a frame of reference, even a single one of these Fairwater buildings is more powerful than any other AI datacenter that currently exists.
Satya then answered a bunch of questions about how Microsoft is preparing for AGI across all layers of the stack.
Watch on YouTube; read the transcript.
Sponsors
* Labelbox produces high-quality data at massive scale, powering any capability you want your model to have. Whether you’re building a voice agent, a coding assistant, or a robotics model, Labelbox gets you the exact data you need, fast. Reach out at labelbox.com/dwarkesh
* CodeRabbit automatically reviews and summarizes PRs so you can understand changes and catch bugs in half the time. This is helpful whether you’re coding solo, collaborating with agents, or leading a full team. To learn how CodeRabbit integrates directly into your workflow, go to coderabbit.ai
To sponsor a future episode, visit dwarkesh.com/advertise.
Timestamps
(00:00:00) - Fairwater 2
(00:03:20) - Business models for AGI
(00:12:48) - Copilot
(00:20:02) - Whose margins will expand most?
(00:36:17) - MAI
(00:47:47) - The hyperscale business
(01:02:44) - In-house chip & OpenAI partnership
(01:09:35) - The CAPEX explosion
(01:15:07) - Will the world trust US companies to lead AI?
Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
Sarah Paine — How Russia sabotaged China's rise
In this lecture, military historian Sarah Paine explains how Russia—and specifically Stalin—completely derailed China’s rise, slowing them down for over a century.
This lecture was particularly interesting to me because, in my opinion, the Chinese Civil War is 1 of the top 3 most important events of the 20th century. And to understand why it transpired as it did, you need to understand Stalin’s role in the whole thing.
Watch on YouTube; read the transcript.
Sponsors
Mercury helps you run your business better. It’s the banking platform we use for the podcast — we love that we can see our cash balance, AR, and AP all in one place. Join us (and over 200,000 other entrepreneurs) at mercury.com
Labelbox scrutinizes public benchmarks at the single data-row level to probe what’s really being evaluated. Using this knowledge, they can generate custom training data for hill climbing existing benchmarks, or design new benchmarks from scratch. Learn more at labelbox.com/dwarkesh
To sponsor a future episode, visit dwarkesh.com/advertise.
Timestamps
(00:00:00) – How Russia took advantage of China’s weakness
(00:22:58) – After Stalin, China’s rise
(00:33:52) – Russian imperialism
(00:45:23) – China’s and Russia’s existential problems
(01:04:55) – Q&A: Sino-Soviet Split
(01:22:44) – Stalin’s lessons from WW2
Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
Thoughts on AI progress (Dec 2025)
Read the essay here.
Timestamps
00:00:00 What are we scaling?
00:03:11 The value of human labor
00:05:04 Economic diffusion lag is cope00:06:34 Goal-post shifting is justified
00:08:23 RL scaling
00:09:18 Broadly deployed intelligence explosion
Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
Planet Money vs. the NBA’s tanking problem
Tanking has gotten especially egregious this year. Even NBA Adam Silver has called out teams for tanking. He recently announced that league bigwigs are considering “every possible remedy” to “align incentives.”
Today on the show — Planet Money fixes the NBA’s tanking problem by … fixing the NBA draft. We get solutions from Hockey Hall of Famer Jayna Hefford, World Cup Champion Sam Mewis, and long-time NBA analyst Zach Lowe.
Handles for the NBA fans in the episode: thevoiceofevan, fullcourtblitz, ashleynevel, igotnxtpodcast, finesse.wes, basketballsavant, and mikedaddino__.
Live event info and tickets here / Pre-order the Planet Money book and get a free gift. / Subscribe to Planet Money+
Listen free: Apple Podcasts, Spotify, or the NPR app
Facebook / Instagram / TikTok / Our weekly Newsletter
This episode was hosted by Keith Romer and Erika Beras. It was produced by James Sneed with an assist from Sam Yellowhorse Kesler. It was edited by Jess Jiang and fact-checked by Sierra Juarez. Alex Goldmark is our executive producer.
To manage podcast ad preferences, review the links below:
See pcm.adswizz.com for information about our collection and use of personal data for sponsorship and to manage your podcast sponsorship preferences.
Learn more about sponsor message choices: podcastchoices.com/adchoices
NPR Privacy Policy
JRE MMA Show #175 with Shakur Stevenson
How cosplaying Ancient Rome led to the scientific revolution
Renaissance history is so much wilder and weirder than you would have expected. Very fun chatting with Ada Palmer (historian, novelist, and composer based at the University of Chicago).
Some especially fascinating things I learned from the conversation and her excellent book, Inventing the Renaissance:
Not only did Gutenberg go bankrupt in the 1450s (after inventing the printing press), but so did the bank that foreclosed on him, and so did his apprentices. This is because paper was still very expensive, and so you had to make this big upfront CAPEX decision to print a batch of 300 copies of a book - say the Bible. But he’s in a small landlocked German town where only priests are allowed to read the Bible - so he sells maybe 7 copies. It’s only when this technology ends up in Venice, where you can hand 10 copies to each of 30 ship captains going to 30 different cities, that it starts taking off.
Speaking of which, the printing revolution wasn’t just one single discrete event, just as the computer revolution has been this whole century of going from mainframes -> personal computers -> phones -> social media, each with different and accelerating social impact. Books came first, but they’re slow to print, and made in small batches. The real revolution is pamphlets - much faster, much harder to censor. Pamphlet runners are how you can have Luther’s 95 Theses go from Wittenberg to London in 17 days.
So much other wild stuff from this episode. For example, did you know that the largest and best-funded experimental laboratory in 17th century Europe was very likely the Roman one run by inquisitors? Ada jokes that the Inquisition accidentally invented peer review. The focus of the Inquisition is really misunderstood - it was obsessed with catching dangerous new heretics like Lutherans and Calvinists - it only executed one person for doing science.
And this leads Ada to make an observation that I think is really wise: the authorities and censors are always worried about the exact wrong things given 20/20 hindsight. When Inquisition raids an underground bookshop during the French Enlightenment, they don’t mind the Rousseau, Voltaire, and Encyclopédie, but they lose their minds about some Jansenist treatises about the technical nature of the Trinity.
More broadly, a lesson for me from this episode is that it’s just really hard to shape history in the specific way that you want to impact things. One of the most famous medieval scholars is this guy Petrarch. He survives the Black Death in the 1340s, watches his friends die to plague and bandits, and says: our leaders are selfish and terrible, we need to raise them on the Roman classics so they’ll act like Cicero. So Europe pours money into finding ancient manuscripts, building libraries, and educating princes on classical virtues. Those princes grow up and fight bigger, nastier wars than ever before with new deadlier technology. And this, combined with greater urbanization and endemic plague, results in European life expectancy decreasing from 35 in the medieval period to 18 during the Renaissance (the period which we in retrospect think of as a golden age but which many people living through it thought of as the continuation of the dark ages that had persisted since the fall of Rome).
Anyways, the libraries Petrarch inspires stick around, the printing press makes them accessible to everyone, and 200 years later a generation of medical students is reading Lucretius and asking “what if there are atoms and that’s how diseases work?” which eventually leads to germ theory, vaccines, and a cure for the Black Death (Ada has longer more involved explanation of how cosplaying the Romans results through a series of many steps to the scientific revolution). Petrarch wanted to produce philosopher-kings that shared his values. Instead he created a world that doesn’t share his values at all but can cure the disease that destroyed his.
Watch on YouTube; read the transcript.
Sponsors
* Jane Street is still waiting on someone to solve their backdoor puzzle… They’re accepting submissions until April 1st and have set aside $50,000 for the best attempts. Separately, applications are live for Jane Street’s summer ML internships in NY, London, and Hong Kong. Go check all of this out at janestreet.com/dwarkesh.
* Labelbox can help ensure your agents don’t need to rely on overspecified prompts. They tailor real-world scenarios to whatever domain you’re focused on, and they make sure the data you train on rewards real understanding, not just instruction-following. Learn more at labelbox.com/dwarkesh
* Mercury’s personal accounts let you add users, issue cards, and customize permissions. This is super useful for sharing finances with a partner, a roommate… or even an OpenClaw agent. And, if you’re already a Mercury Business user, your personal account is free! See terms and conditions below, and learn more at mercury.com/personal-banking
Eligible Mercury Business users who apply for and maintain a Mercury Personal account may have their Mercury Personal subscription fee waived provided they remain a user on an active Mercury Business account in good standing. Standard Mercury Platform Subscription fees will apply if they no longer meet eligibility requirements, including but not limited to no longer being associated with an eligible Mercury Business account, or if the program is modified or terminated. Mercury may modify or discontinue this offering at any time and will provide notice as required by law. See Subscription Terms for full details.
* To sponsor a future episode, visit dwarkesh.com/advertise.
Timestamps
(00:00:00) - How cosplaying Ancient Rome led to the Renaissance
(00:28:49) - How Florence’s weird republic worked
(00:38:13) - How the Medicis took over Florence
(00:58:12) - Why it was so hard for Gutenberg to make any money off the printing press
(01:17:34) - Why the industrial revolution didn’t happen in Italy
(01:23:02) - The slow diffusion of paper through Europe
(01:41:21) - The Inquisition accidentally invented peer review
Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
