Podcast Episode Summary
Main Topic: The future of energy and its impact on the development of artificial intelligence (AI).
Key Points:
Participants:
Takeaways:
How will we feed the 100s of GWs of extra energy demand that AI will create over the coming decade? On this episode, Casey Handmer (Caltech PhD, former NASA JPL, founder & CEO of Terraform Industries) walks me through how we can pull it off, and why he thinks a major part of this energy singularity will be powered by solar. His views are contrarian, but he came armed to defend them.
Watch on YouTube; listen on Apple Podcasts or Spotify.
SPONSORS
- Lighthouse helps frontier technology companies like Cursor and Physical Intelligence navigate the U.S. immigration system and hire top talent from around the world. Lighthouse handles everything for you, maximizing the probability of visa approval while minimizing the work you have to do. Learn more at lighthousehq.com/employers
- To sponsor a future episode, visit dwarkesh.com/advertise.
TIMESTAMPS
(00:00:00) – Why doesn’t China win by default?
(00:08:28) – Why hyperscalers choose natural gas over solar
(00:18:01) – Solar's astonishing learning rates
(00:27:02) – How to build 50,000 acre solar-powered data centers
(00:40:24) – Environmental regulations blocking clean energy
(00:44:04) – Batteries replacing the grid
(00:49:14) – GDP is broken, AGI's true value must be measured in total energy use
(00:58:45) – Silicon wafers in space with one mind each
Dwarkesh Patel
Today I'm interviewing Casey Hanmer. Casey has worked on a bunch of cool things. Caltech PhD on some gravitational wave black hole gimmick stuff, then Hyperloop, then the Jet Propulsion Laboratory at NASA, and now he is founder and CEO of Terraform Industries. Casey, welcome.
Casey Handmer
Thank you. It's great to be here finally.
Dwarkesh Patel
Big picture question I'm interested in, to the extent that AI just ends up being this big industrial race, who can build the most solar panels, who can build the most batteries, who can build the most GPUs and transmission lines and transformers and et cetera, et cetera. This is not what the U.S. is known for, at least in recent decades. This is exactly what China is known for, right, where they have like 20x the amount of yearly solar manufacturing the U.S. has. Obviously, we have extra controls right now, but over time, SMIC will catch up to TSMC's leading edge. So what is the story exactly of how the United States wins this? Like, why does China just not win by default? Do you think that China is better at capital allocation than the United States? Do you think the Chinese business environment is better for business than in the United States? I think you're going to make these first principles argument about these other industries where they're killing it, but, like, it doesn't seem to have hampered BYD. Well, people say,
Casey Handmer
look, they're so much better at building high-speed trains than the United States. Right. I would never, like, hold up a flag saying I'm really good at building high-speed trains. Like, that is just a sign that you're really bad at capital allocation. Like, why would you devote in 2025... so much industrial effort and money, right?
Dwarkesh Patel
They're devoting a lot to solar overcapacity, which, in your opinion, is the key to future industrial growth. Accidentally correct. They call the most important thing correct, right?
Casey Handmer
We should count for something. Well, they're in a similar situation to Europe, but unlike the United States. So the United States... is the luckiest goddamn country on earth because it's surrounded on two sides by oceans and on the other two sides by like friendly allies, right? China's surrounded by 15 countries who are mostly hostile to it, right? With no good like mountain ranges or rivers or anything to really separate them. And then they get all their oil, almost all their oil from the Middle East, right? In countries that they don't control, don't have strong diplomatic relationships with on fleets of oil tankers that they can't defend because their navy doesn't have the ability to operate effectively in the Indian Ocean.
Dwarkesh Patel
But you're working on this, right? If you get synthetic fuels working at Terraform... Personally, yes. Doesn't that asymmetrically help China? Which might be fine. It does. It absolutely asymmetrically helps China.
Casey Handmer
We're not currently working with China. We don't plan to, but the physics is very obvious. And synthetic fuels have been around for 100 years. There are projects in China right now working on synthetic fuels. It would not surprise me if they were... thinking pretty seriously about this.
Dwarkesh Patel
Just to spell out for the audience, if China has all this electricity production, and the bottleneck is that only a third of final energy use in a modern economy comes from electricity. The rest, you need gas and whatever to transport things. Or coal. They use a lot of coal. Right. And what Casey is inventing is the technology to turn that electricity, which only can supply a third of end uses right now, into synthetic fuels, which can supply 100% of the electricity your civilization needs. So then China's energy advantage then becomes overwhelming.
Casey Handmer
This technology levels the playing field. It levels the playing field a lot. Right. But at the end of the day, China still contains the poorest Chinese people anywhere on Earth. Never underestimate the capacity for an autocratic dictatorship to shoot itself in the foot.
Dwarkesh Patel
I don't know. I agree that they've obviously made bad decisions, but even if you have the poorest Chinese people anywhere in the world, they can still be quite rich. You know, like Singapore's rich or whatever. Also, there's parts of China which actually contain quite rich Chinese people. So you had to compare not all of China against the U.S., but Shanghai and Guangdong against the United States. So you can have a part of China that is as big as America and as wealthy as America and as innovative as America.
Casey Handmer
Like the Indian middle class is larger than the U.S. middle class.
Dwarkesh Patel
But also it's not nowhere near as wealthy. Whereas there are parts of China which are humongous, which are actually as wealthy as the United States and in many cases as innovative, etc.
Casey Handmer
Yeah. No, I'm saying don't underestimate it. But at the same time, like, you know, we want to find the truth here. Right. And the truth is, like, we should not count the United States out of the battle and just give up. We're very much still in the race now, provided we don't, you know, take extra effort to shoot ourselves in the foot. So right now, we are export controlling chips for the purpose of we want to keep our AI lead or
Dwarkesh Patel
stay in the lead in AI. And we recognize this is a key input in our ability to compete in AI. So we are going to export control China's ability to have these chips. Energy is also a key input in this AI race. And if China wanted to do the converse of what we're doing to them with these cheap imports, what they would do to us is to export control solar and batteries.
Casey Handmer
It would be asymmetrical. It would hurt them worse than us. If they deter us? Yeah, well, China obviously depends upon, like, the U.S. export market for its economic dynamism, right? And the United States, it's going to hurt both parties to, like, sever the link. But if you sever the link completely, China's ability to make advanced chips right now is, like, basically not there, whereas the United States can make them. And the United States' ability to make solar arrays is embryonic, but it's, you know, it's actually not that far behind China's, right? It's maybe five years behind. If we decided we want to produce 100 gigawatts of solar capacity every single year. We're already on track to do that.
Dwarkesh Patel
Okay. Is it going to be as cheap as it is to do in China?
Casey Handmer
My views on this are somewhat different from the mainstream, which is great because this is a podcast. So the mainstream view would say, well, China has cheaper labor. which is no longer true, because they're compared to Mexico. And it's got lower environmental regulations, which is true, and that it is more business friendly, which is absolutely crazy. I've never heard, like, there's no way you could justify that, like, your company having to have a, like, inspector from the CCP on its board who, like, harasses you about Xi Jinping every day, like, helps you do your business. And also, like, the rule of law is not great. So, like, you're constantly having to pay bribes to people in order to stay in business. Right. The idea that the United States cannot compete against that with, like, mostly or fully automated solar panel manufacturing in the United States, which has cheaper natural gas by far, abundant oil, abundant human resources, great financial capacity, you know, world-leading automation, et cetera, et cetera, is crazy. Like, we could literally copy place solar manufacturing factories.
Dwarkesh Patel
How much additional... solar power capacity do you think we could be putting on that's manufactured in the U.S. by 2028?
Casey Handmer
This is a good question. When Russia invaded Ukraine, I thought, ah, finally, the Europeans will see sense. And they'll pull the trigger on, we need to localize production of solar panels from dirt to the finished module, which is roughly a four-stage process. They didn't. So they're still paying Russia a billion dollars a day for the privilege of being invaded. But at the time, I thought they could probably do that in about two years. And I think the United States could probably do that in two years or less. if you started today like it's currently 11 o'clock so like we're going to start cutting checks by noon um and and yeah i think you could you could ramp up pretty quickly a lot of technology already exists here it's not like it has to be reinvented from scratch it's mostly a case of like putting in phone call to all the different manufacturers here in germany and so on and saying we need you to 10 exercise your factory starting today blank check go
Dwarkesh Patel
I guess a lot of your predictions seem to be not predictions, but more like if we had World War II levels of motivation, if we had Manhattan level project level intensity around being a specific thing, how fast could we do it? Which is like if Elon was running government, how fast could it happen?
Casey Handmer
It was for a for a brief period there.
Dwarkesh Patel
Maybe then we should put it like, if Elon ran the government like he ran SpaceX, as opposed to the question of like, okay, what is actually practically likely to happen given that we are not treating it with World War II level intensity?
Casey Handmer
So if you look at XAI, which Elon is involved in, obviously, what are they actually focusing on right now? They're focused on the chips, because they understand the key bottleneck is the chips, not the solar power. Because even if Trump puts in a 200% tariff on Chinese solar, and we're not able to bypass it via Vietnam or something, It's still a bargain. It doesn't matter. Like, if you need solar to run your data center, it doesn't hurt in terms of the overall cost picture. It doesn't matter at all. What matters is having the chips at, like, competitive capabilities per chip and enough of them, you know, installed in your PCBs, in your data centers, hooked up to your liquid cooling, ready to go, right?
And that's actually something that, you know, Elon and his companies are great at. It's like figuring out this mass production, semi-automated mass production process. They've got this facility in Texas, which is making the Starlink receivers completely automated. At what point does like, oh, we don't have a solar panel factory become on the critical path, right? I very much doubt it's ever going to be on the critical path. There's dozens and dozens of manufacturers of solar panels worldwide that are all competing against each other.
Dwarkesh Patel
So you're a big solar bull. Right now, the hyperscalers are making decisions about the data centers that they're building. They're giving one gigawatt, two gigawatts, in Meta's case, five gigawatts, how they're going to be actually powered. And the people with actual money on the line are choosing natural gas. And it's not like they can't see the learning rate. I mean, they're building things which will be online in 28 or 30 or something. So why are they wrong?
Casey Handmer
And you're right. I mean, that's their job. They probably know more about it than I do. But no, in all seriousness, if you're like XAI right now trying to build Colossus One Data Center in downtown Memphis, right, you want to get it done super fast. So you're like, what are all the different things we need? What are the factors of production to build this? We need a building. Well, we don't have time to build a building. We'll buy a building. Okay, and we'll adapt it. We need power. We need thermal cooling. That stuff you can deliver on a truck, because that's what they did. You need access to gas.
They had access to gas there. They could tap into a local gas line. And actually, if you can tap into a gas line, generally speaking, you can get enough power. The energy transmission capacity of your regular gas delivery pipelines is way, way higher than electricity overhead lines, and it's easy to upgrade or whatever. And so if you're in this situation right now, you say, well, are we constrained by our ability to go and rent gas turbines? And no, they're not, because there was enough available. Once, maybe twice, right? But at a certain point, you realize, well, as you grow, you start to touch all these additional constraints.
And some of those constraints include gas availability. So there's a lot of chat about doing this in Pennsylvania, for example, where there's quite a lot of stranded gas in parts of Texas. But at the same time, the United States is gearing up in its ability to export natural gas overseas. So the price will not be infinitely low forever. You start to run into constraints around turbine manufacturing rate, around transformer production rate, around grid capacity, and also kind of running into problems where the AIs and the humans who depend on legacy electricity production and delivery utilities are kind of competing with each other.
We just saw this recent Ford auction in PJM result in in like kind of very high, like unsustainably high prices for consumers who depend on cheap electricity to like heat and cool their houses and have general prosperity. So if you kind of look far enough in the future, you say, well, you can just turn up the dial arbitrarily high. You can say, well, we're going to put in a gigawatt a year. Well, we can meet that constraint with gas turbines. We're not going to run out of natural gas at one gigawatt per year indefinitely. What if we're doing five gigawatts per year? What if we're doing 50 gigawatts per year?
What if we're doing 100 gigawatts per year? You can just break the situation. Does that make sense? Not to reach prematurely for analogies, but But like Henry Kaiser set up the shipyard in Richmond, just down the road here in San Francisco, over near Berkeley. And initially making ships for the British. And then by the end of the war, four separate shipyards operating in parallel to the point where like he was bottlenecked on his supply of steel because steel was rare enough in the war because everyone was using it for different things. that Kaiser Industries went off and built not only a steel mill, but also a steel mine.
They went and started digging rocks out of the ground to turn into ships. And it's the same sort of situation you have here, where these massive industrial verticals, and here I'm quite bullish on XAN in particular because the Elon Cinematic Universe has just done so much industrial stuff compared to the Googles and Metas of this world. can kind of reach all the way through down into primary material supply if they need to. The reason that these current plans are being done based on natural gas is that
Dwarkesh Patel
this is a sort of like...
Casey Handmer
Well, PGM has all kinds of different sources of power, right? They have nuclear as well. They have gas, they have coal, all kinds of stuff. And actually, this price here is probably driven... more by the delivery cost growth than by the generation cost growth, if that makes sense. So when you pay your utility bill, the cost is sometimes broken down by like a delivery cost and a generation cost, sometimes importation costs and things. And so the delivery cost is the cost of basically what it costs the utility to build and maintain all the power lines that connect all the houses to all the power plants in some gigantic area divided by your marginal usage with all kinds of other complicated rules designed to make it fairer.
And the problem that we see, and the reason that PG&E here in California, for example, is perpetually on the brink of bankruptcy, is that even though the cost of an additional solar panel or additional wind turbine or additional gas turbine or whatever is relatively cheap, getting that power to your house is actually really expensive. Why? Because you've got, you know, generally like unionized labor that has to build and maintain power lines in areas that already have built up infrastructure. So you have like multiple collisions, whether this is like a power pole on your own street or like building a new transmission line, which requires you to like eminent domain land.
So you're in court for like Years and years and years, spending public money litigating against other people who are also spending public money to litigate against you on behalf of other interest groups and so on and so forth. And then you've got wildfires. And it's just like the poster child for Balmocos disease. So one of the reasons that we're going to see large-scale pruning of these grids is that we just can't afford under our current regulatory regime to maintain. When you say pruning, are you just like everything will just go off-grid? Yeah. Well, I mean, it's fairly clear to me that for really large captive loads like data centers or aluminum refineries or whatever, you're going to have to build your own power plant for them, which is how it used to work.
If you had an aluminum plant back in the day, you would be building your own power plant for it as well. Seems inefficient to have redundant power plants at every single industrial... Let me paint a grand vision for you. It would seem inefficient, but actually, like, if you are sensitive to the cost of power expressed maybe in, like, supply elasticity or something like that, you just have to do it. There's no two ways about it. Like, is it inefficient for the XIA Colossus data center to have its own captive power plant, which it does, right, on the backs of a bunch of trucks in their parking lot?
No, it's not inefficient. It's the cheapest way for them to get power.
Dwarkesh Patel
Okay, but big picture question. Across different kinds of ISOs, like from Texas to Pennsylvania to whatever, people are building data centers which will not be online for many years, and they're choosing natural gas. What's going on? Well, I think we haven't completely exhausted the supply of the turbines relative to GPUs. And do you have some estimate of when we'll run out of? Because we can also make more turbines, right?
Casey Handmer
Well, I think everything before about 2030 is spoken for at this point. Yeah, you could make more turbines. The funny thing is, it's actually relatively expensive, I think, to spool up additional production of these turbines, for example. So actually, here's one thing you have to grapple with sooner or later. Conventional power generation is a steam engine. So, you have some kind of chemical that you find inside the Earth that is out of chemical equilibrium with the atmosphere, and you burn it and it makes heat. It could be coal, it could be gas, oil, whatever. You're going to be the true birds and bees here.
Yeah, exactly. And it makes heat, and you boil water, and the water goes through some kind of mechanical contrivance that creates motion, and then that motion twists a magnet and generates an electrical field, which then pushes electrons down wires, which then push electrons through a series of gates that then approximate thinking. It's kind of complicated. But the key step in this, which is converting heat into electricity, in the most efficient, most common, and this is the same if it's a nuclear plant or a gas plant, combined cycle plant or a coal plant or whatever, is what's called a Brayton cycle.
A jet engine on an aircraft is a Brayton cycle as well. And just any time you have a Brayton cycle with a bunch of inconel spinning at high speed, it's just going to cost you a bunch of money. Sorry, because it's inherently inefficient or what?
Dwarkesh Patel
It's just inherently expensive to build. Okay. What is the cost of, so like GE makes these 100 megawatt gas turbines, right?
Casey Handmer
I guess, yeah. I don't actually know what the retail price is. I would suspect that if their price is flexible, it would have gone up a lot. But if I recall correctly, it's like 35 bucks a megawatt hour is just the flag for cost for 35 bucks a megawatt hour just for just for the Brayton cycle. Right. So we're not talking about the fuel. We're not talking about the heat exchangers. We're not talking about, you know, the cooling ponds or anything like that. Just just the amortized cost of the high speed, high temperature spinning components is 35 bucks a megawatt hour. Do you think the hyperscalers are being irrational, or do they have some reason?
Oh, to be clear, they don't care about cost. For cost of power, this seems extremely, like, it's very counterintuitive. So for, like, Grandma Kettle in Pennsylvania, she's very sensitive to electricity cost, and we don't really want her to, like, suffer in her retirement from... unaffordable electricity costs and like having to sit there shivering like that's not the image that we want at the same time like what what is the what is the economic value to you of using i don't know claude or grok or whatever you use like on a monthly basis yeah but like it's obviously much more than the subscription but like is it like 10 times more than the subscription maybe yeah okay let's say so let's say the subscription is on the order of 10 bucks the value is on the order of 100 bucks no actually probably like 100 and a thousand how much does it cost XAI or Anthropic or whatever to serve your usage.
Dwarkesh Patel
The marginal variable cost of serving it. In electricity, it's less than 10% of the actual cost of...
Casey Handmer
Well, their cost of serving it is maybe a buck per million tokens or something like that. And the cost of electricity is about 10% of that. So it's like 10 cents of electricity is generating $1,000 worth of economic value. So it's very obvious that Anthropic could be like, our electricity cost basis is increased by a factor of 100. And now instead of paying $0.10 on your $100 bill for power, you're paying $10. So we're putting your subscription up to $110 for an electricity capacity charge. And then they could go out and buy turbines for prices that would make your eyes water. OK.
Dwarkesh Patel
So then why are we going to get the solar future? Like in 2032, we're going to have hundreds of gigawatts of extra demand for data centers. And at that point, most of it's coming from solar. And why is that? Well, there aren't enough turbines being manufactured. But also, I think in the early 2000s, we can probably overlay the graph of like how many turbines are being manufactured. Like right now, we're at historical. They've ramped up basically to like the early 2000s right again. But I don't know, you got to make more solar panels as well, right? Like there will be supply elasticities for both solar and natural gas. Is there some reason to think that It's worse for the supply chain involved in having a natural gas-powered data center than a solar?
Casey Handmer
Yeah, I do. The learning rate for natural gas is nowhere near steep as solar, which just tells you that it's much easier to make solar panels. There are actually very few manufactured products which are easier to make. The right solar coefficient is 43%. So every time we double communal production, we get a 43% reduction in cost.
Dwarkesh Patel
And what is the basis of... Like, why are we finding 43% worth of things that can be made cheaper or more efficient every single year? Well, I mean,
Casey Handmer
roughly speaking, there's like 10,000 manufacturing process engineers working on this full time.
Dwarkesh Patel
That could be true of any process, right? But no other process sees the kinds of learning rates. It's not simply true. That's all they're saying.
Casey Handmer
Yeah, so in order to sustain this over a long period of time, you obviously need to have demand elasticity that exceeds your learning rate. So otherwise, after a couple of booms, you would saturate your market at the current price and you'd have no additional growth. But in this case, roughly every two years, we're doubling production, two and a half years doubling production. The price is coming down by a factor of 40%, so roughly 20%, 15%, 20% per year. And then just as a result of that price reduction, demand skyrockets by probably six times more than that additional marginal production capacity increase. And this is one point where I'll say, actually, the pros, so-called pros, are definitely wrong. Conventional wisdom is like, oh, solar demand is going to saturate this week. It's going to saturate. We've got a graph here somewhere that's like, this year is it. It's never going to grow anymore. And instead, it's just like blasting out the top of the graph. And this conventional wisdom is wrong. It is not only the case that solar adoption production price decreases are continuing, they're accelerating, and the rate that they're accelerating is still accelerating.
Dwarkesh Patel
Wait, sorry. The rate that it's accelerating is accelerating? Yes. As measured in the total fraction of energy that's coming from solar? In the sense that its fitness for the markets that it is being produced for is
Casey Handmer
increasing over time. So it is still extremely early. We're still at the Apple II computer era of solar.
Dwarkesh Patel
Backing up, the story is that the reason solar is getting cheaper is because there's a lot of demand for more solar, and that demand can sustain economies of scale or whatever is going on. Yes. I'm going to go on a limb here and agree with Elon Musk on this. Then shouldn't that also be true of... gas turbines and transformers and power stations and whatever else that's required for the non-solar future? Because, like, even there, we're expecting AI to drive up demand for power regardless of the source. So to the extent the story for solar becoming cheaper over time is just that, like, well, demand will go off and that will drive efficiencies. Why isn't that true for...
Casey Handmer
Well, let's say you're a bank and you're trying to decide whether to lend, I don't know, like, gee, a bunch of money to, like, expand production of the gas turbines. Yeah. You can write them the check today, and then they'll start scaling up their factories, and then they'll start to see the benefits of that in three or four or five years. You don't know if the AI bubble will have burst by then. You don't know if China will have invaded Taiwan by then. You don't know if Siemens or Philips or someone will have out-competed you. You don't know if GE's major looming structural problems will cause it to be unable to compete, as it has in the past. You also don't know. In order to make that money back, you have to then operate that plant at that capacity for 20 years. And if I was looking at the same charts as they're looking at right now, I'd say, what are the odds that in 25 years' time, we can produce gas turbines at a price that is relevant in a world where solar is already at its current price and batteries at a price where they're already. You cannot win. I think there was actually a similar discussion a couple years back or a year back
Dwarkesh Patel
when AI people were like, no, AI is real. This is going to happen. And then SK Hynix, Samsung, etc. were like, we're not ramping up HBM production because like, oh, HBM is used largely for AI workloads. And if this demand doesn't continue, then our manufacturing Additional manufacturing capacity for HBM will not have been worth it. And there was another bottleneck with co-host. What happened after that?
Casey Handmer
Did they end up indeed ramping up their production? I think so. Well, so when someone says we can't do it, we won't do it. No way, no how. I mean, not in the US. What they're saying is write me a check. Right. Right. And they did. And now Samsung's coming on board in the States to build T6 with XAI, I think. So like they all got there in the end.
Dwarkesh Patel
Maybe it's worth going into the numbers, right? So right now, 43% of U.S. data center power consumption is from natural gas. And basically, you think asymptotically that will be like 100% solar? If you go to like 2040?
Casey Handmer
Yeah. So I mean, obviously, like legacy production coal and stuff is going to retire over time. Right. And if a gas plant is still making money, people will keep operating it. But at a certain point, like, it is the case right now that operating a coal plant costs more than building a new solar plant. So it's just cheaper to turn it off. So, yeah, I want to know what the... And obviously capacity is going to increase a lot. So that helps to dilute the existing production.
Dwarkesh Patel
And also the... The amount of use is going to increase a bunch, right? The amount of data center use of energy will just be exponentially higher. So the new stock matters a lot as compared to the existing stocks. Anyway, so I want to know, 2027, what fraction is natural gas? 2030, what fraction is natural gas versus solar? For new load or for the whole? Let's say new load. For new load. 2035, etc. Basically, like, okay, if eventually you're right that we'll pave the Earth and solar panels to sustain our quadrillions of AI souls, what is the pace of that? Well, I think the question to ask is, like, what is the major constraint on that ramp-up?
Casey Handmer
Right. And then everything else is just drafting behind. And I suspect that the hardest thing to make will always be the silicon, like the GPUs. So the question is really, how quickly does TSMC ramp up its production of GPUs? And that's a question for you, not for me.
Dwarkesh Patel
I'll just use some numbers that AI 2027 used for their compute forecast, which even if you don't buy their singularity thing, I think they did a reasonably good job with crunching the numbers on their compute forecast. And I think they said there's on the order of 10 million H100 equivalents in the world today. And I think they said by 2028, there'd be 100 million. Mm-hmm. So basically 10x more H100 equivalents in the world. About a kilowatt each, something like that? Yeah. Yeah.
Casey Handmer
Okay. So it's like 100 gigawatts.
Dwarkesh Patel
Right.
Casey Handmer
Okay. And that's, I mean, that sounds roughly right. You're not the first person to give me a call and ask me about this. I'll put it that way. I'm not going to name names, but like pretty much all the names you've heard of have given me a call and said like, we know that you're a minority voice on the paper that came out recently with scale microgrids talking about how you could do 90% solar, 10% gas. And I said, you can go all the way 100% solar. I wrote a blog post about it. And so they always call me up and say it. What about this? And they're all talking like five gigawatts in the next few years. So that's just like 90 plus percent solar for just those. So I think within a few years, we'll probably see that like the majority of new DCs that are going in will be mostly solar. Within, sorry, how long? Let's say by, let's see, 2027, majority of new DCs going in at that point would be mostly solar.
Dwarkesh Patel
Going in as in like new?
Casey Handmer
As in groundbreaking at that point. But if you're groundbreaking in 27, you're probably like planning it now, right?
Dwarkesh Patel
Oh, that's why they're calling me.
Casey Handmer
My consulting fees are extremely affordable. But really, I don't have deep visibility because I'm not in the same room with the meta people as to when we're going to hit the wall on Transformers and when we're going to hit the wall on just how much municipal peak load can we shave off, which is the latest thing that's been doing the rounds, which it turns out. There's a handful of places in the United States, and by handful, I mean literally handful, where there might have used to be an aluminum smelt. There's a bunch of latent capacity in the grid, And there's also a bunch of generators on the grid that are notionally turned down, and they operate at, say, 40%, 50% capacity factor.
But they max out at about 80% capacity factor, because you've got to bring them down for maintenance pretty often, right? Especially if they're old. And so they're saying, well, we could pay you just to operate this old coal plant or something at higher capacity. It'll go down this power line to this place where the smelter used to be. We'll set up there, and then we promise to curtail when you need the power, which basically means they just have a massive captive battery plant as well, which is fine. You just buy that until it arrives on a truck. The major advantage of doing that over the Peel solar play is that the power is already there.
So there's no risk there. And then you don't need a massive amount of land. The problem with the solar approach is that there's no two ways about it. It's a farming operation. You need a huge amount of land. The total amount of land that you're using, less than 1% is under batteries, under roads, under data center structures, et cetera, et cetera. It's mostly solar.
Dwarkesh Patel
Right, okay. So let's get into what this, if you've got a five gigawatt plant you want to build. Yes. Break down the numbers for me in how much land in terms of solar you need to farm this out. And especially, I was talking to... somebody in this space, and they said, look, the big problem is not... Obviously, the cost of energy for these data centers is a small fraction of the total cost. Most of the cost is going towards chips. So then the issue is just, can you make the energy available? And they were saying, even those solar panels themselves, you can acquire. The issue is getting that much contiguous land and getting the permitting to... interconnected or whatever the word is, is like apparently a big hassle. Yep.
Casey Handmer
It's kind of a nightmare.
Dwarkesh Patel
Yeah. And so they're like, well, at that point, is it actually easier than just getting on the grid? But yeah, if you need tens of thousands of acres of solar, where can you do that and get like... Basically in Texas.
Casey Handmer
I mean, like... There's this very popular misconception that like there's not enough land to do solar. Right. Right. This is garbage. If you've ever flown in an aircraft in the United States and you've ever looked out the window, you'd be like, oh, wow, look, there's a lot of land you could put solar on, especially west of like 110. Yeah. Right. Does it need to be flat or no? No, it doesn't matter. Like, do trees grow on mountain slopes? So it doesn't matter. And the total amount of land, so just for reference, Nevada is something like 80 million acres or something like that. So just Nevada, which is like 90% federal land, is 80 million acres. And I would never say that we should sacrifice Nevada to the AI and pave the entirety of Nevada from one wall to the other. But I just saw a bunch of things in my feed the last couple of days that like, You know, Vegas is falling apart.
Dwarkesh Patel
Really?
Casey Handmer
Well, like, the boomers are retiring. No one goes there anymore. People would go to see, like, the 100 million acres of solar. Yeah, okay. So 5 gigawatt plant. So even if you did it in Nevada? You can do it anywhere. You can do it anywhere you can find the land. People say, well, you can't do this in Europe because Europe doesn't have solar power. Europe has solar power. I've been to Europe in summer. It's, like, sunny for, like, 20 hours a day. It's a bit seasonal, right? But that's not a big deal.
Dwarkesh Patel
Wait, I mean, it is because energy is a small fraction of the cost. You care more about making sure the chips are running all the time, right?
Casey Handmer
Yeah, so in practice what happens is, let's say Europe hypothetically awakens from its slumber and decides it wants to participate in AI. Okay, I hope it does. They say, well, we're going to have to put 100 gigawatts down on solar at some point to build these data centers. It'll most likely be in Southern Europe. Spain is not particularly heavily populated. That's a great place to start. So we put in 100 gigawatts of solar data center in Spain. And then in order to achieve... Basically, if you're spending AI hyperscaling money on your GPUs, you want to have four nines of uptime in order to maximize your tokens per dollar spent.
Tokens per dollar spent on the entire project, not just on that. This is a very subtle point. I can go into vast detail on it later on, maybe. But let's just say you need four nines of uptime. In order to achieve four nines of uptime in the middle of winter, you need to have a lot of solar overbuilt. Is solar overbuilt a bad thing? No. Is the fact that we produce 40% more food than we need a bad thing? No. It's much better than producing 40% less than we need. And it just means that, effectively, you have a giant captive power plant attached to a data center that... 99.9% of the time produces more power than it needs, and 99% of the time produces much more power than it needs.
And that can now actually be the source of power that the local utility, instead of being like, naughty, naughty data center, you must disconnect. When we tell you to, they say, hey, data center, I notice you've got like a bunch of power you're not using 360 days of the year. Would you mind ever so much if we threw a power cable over the wall and we powered our entire town? off your spare power at like essentially zero marginal cost plus whatever residential batteries that we need in addition to local power supply. Brian Potter had a good analogy in his blog post about this where he's like,
Dwarkesh Patel
I don't know, my MacBook has a terabyte of storage and I use like 100 gigabytes. And I just got the terabyte version because it's cheap enough and I might need it at some point that it's worth it. And so you're seeing solar gets so cheap that it's the way we'll treat hard drive space. Just get a bunch of excess.
Casey Handmer
Yeah. But also, like, the market will be made at the place, like, the new marginal, like, consumption and production. Right? So, like... All the people who are working in this space right now are like, oh, I'm in the business of delivering power or storing power. I'm going to serve the AI market because that's where all the growth is occurring. That's where all of US GDP growth is occurring right now. I guess you didn't answer the question of, yes, theoretically, we could do this. But is it going to be possible to get the permitting to have tens of thousands of
Dwarkesh Patel
acres of contiguous land?
Casey Handmer
It doesn't need to be contiguous. Well, I mean, it helps if it's contiguous. It doesn't need to be convex. Um, so this is, you know, you can have a bit over here and a bit over there and you can wire them together relatively easily. In fact, in the limit, in the limit, you have fields upon fields of solar arrays with... Tell me your dream case. Okay. Fields, just solar arrays as far as I can see. And then within the solar arrays, roughly in the middle of them, you have your, your batteries and your...
Dwarkesh Patel
I play Factorio, I remember this. I remember this optimal layout of batteries and solar.
Casey Handmer
Yeah, you've got your batteries and you've got your data centers. So in terms of ground floor area, it's roughly, let's say, 10% racks, 10% access to the racks, maybe like... 50% batteries stacked up on top of each other and the rest is cooling. Something like that in terms of what sits in the centralized node, right? And that could be 100 megawatts or it could be 10 gigawatts, depending on how you want to scale this. But then all you need to connect that to the outside world is like an optical fiber. an optical fiber cable, which you can string up on poles, you can run underground, you could even use microwave links if you really wanted to. You could use Starlink if you really wanted to. I don't know what the... Starlink would be fast enough. I'm not sure if it's like capacity is high enough. You could use laser links if you really needed to. And that's it. It's like this completely self-contained world of like... Because it's off-grid. Yeah, of computation that occurs off-grid, like on private land somewhere in the backwoods of Texas where like no one lives and no one will ever live because it's completely inhospitable to humans.
Dwarkesh Patel
In terms of the ratios, it's one trend that was impressed upon me is that the power density of racks is increasing a lot. Yes. As the flops per GPU are increasing. It's like a megawatt per rack is what they're heading to now, which just seems bananas to me. I think it was even more than that. But yeah, yeah.
Casey Handmer
So let's get concrete here for a second. Let's say you got one rack, and it's one megawatt. And I'll leave the cooling to someone who specializes in air conditioners. But it's basically throw air conditioners at the problem. And then you have batteries. So in order to get four nines of uptime on this, you need, in South Texas, you actually need less than this. But let's just say 24 hours worth of battery storage. Because that means it'll get you through two bad nights in a row, basically. And actually, it turns out that you can significantly decrease power consumption with a very small reduction in overall compute.
So if you've got like three really bad days in a row or something, you can actually just like, you can dial back your power usage quite a lot without compromising your inference or training. Okay, so you've got, say, a Tesla Powerwall, something like four megawatt hours. So one megawatt rack, and then six Tesla mega packs, each of which is roughly one truckload worth of stuff. So like one truckload worth of rack and then like six truckloads worth of batteries. And then in order to operate this at an average power of one megawatt, your solar arrays in Texas would be something like 25% utilization.
So on average, you know, if the sun came up every day and the day was the same length all the time, you would need four megawatts of solar arrays, which is about four acres of land. But in practice, because you're aiming for four nines instead of like one nine, you need an overbuild about two and a half X. So you've got about 10 acres of solar. So 10 acres of solar, six truckloads of batteries, one truckload of data center and some cooling stuff.
Dwarkesh Patel
For how big of a data center?
Casey Handmer
One megawatt. That's just a one megawatt rack. So 10 acres, one megawatt. Kind of situation at four nines. Yeah, so if you want five gigawatts, then that's 5,000 times 10, so 50,000 acres. And actually, at larger scale, you can probably cut all those numbers down by 10, 20%, but on that order. And like 50,000 acres sounds like a lot.
Dwarkesh Patel
It does sound like a lot.
Casey Handmer
Is it not? The amount of land put aside for Oak Ridge was 100,000 acres. The amount of land put aside for Hanford was about 100,000 acres.
Dwarkesh Patel
What's Hanford?
Casey Handmer
Hanford was where they made plutonium in the Manhattan Project. Okay.
Dwarkesh Patel
But I don't know how big that was.
Casey Handmer
It was about 100,000 acres. Okay. I mean, is it like, oh, this is so small, and then you're like, oh, but it's 100,000 acres? Well, so the reason they, and it's still largely unpopulated now because it's a national laboratory, but the reason they did that was they thought, oh, we're going to need four... piles to produce plutonium. These are not, um, these are not nuclear reactors that produce exothermal energy. So you can't actually make nuclear power with them, but you're making plutonium with them. And then in the end, they only needed two, I think. And they wanted them spaced out because they thought like they might just like spontaneously like explode and a bunch of other facilities and plants and stuff as well. Austin Vernon had an interesting blog post where he said that if you allow for – if you have like diesel generators or something which can take over the generation for
Dwarkesh Patel
– like 10 percent of the generation during these – you know, with a winter or something. Yeah, yeah. then you can have a 60% reduction in the amount of solar panels you need to install because you don't need to plan for that contingency.
Casey Handmer
Yeah, yeah. So basically there's a balance here. So this is not a very complicated optimization problem. Like for people who do optimization problems for fun, this is how you do it. You start off with a bunch of NREL data on what your solar abundance is in this particular part of the world. And then you just start throwing solar panels and batteries at it. over the course of a one-year simulation until you hit the number of nines you want. And then to an extent, you can trade the amount of panels and the amount of batteries you've got back and forth, and there's a very, very broad optimum. Or you can throw in a third thing like a diesel backup or a gas turbine or whatever. The issue here is,
Dwarkesh Patel
look, if Meta or Microsoft or whoever just wants to get something off the ground, this might be... low OPEX to have this huge solar farm, but high CAPEX, where you need to hire like 30,000 people to go out in the middle of a desert and install 50,000 acres worth of solar panels. And they're like, why would I not just buy like 50 gas turbines instead? Why don't I just outbid like Microsoft or Meta outbids Google or something for the
Casey Handmer
last gas turbine that's available that year? Yeah, I mean, totally. The thing that I think Meta has realized is like, It's like Zuck is running out of time to spend his money to win. The CapEx is not crazy high. Just to be clear, like the CapEx is still dominated by just the GPUs.
Dwarkesh Patel
Right.
Casey Handmer
Right. So like how much does five gigawatts worth of GPUs cost? I don't know if my numbers will be wrong, but like 250 billion or something. Yeah. 250 billion. Sounds about right. Yeah. Okay. So like is 50,000 acres going to cost $250 billion in Texas?
Dwarkesh Patel
That's so much money. I did the math in my head.
Casey Handmer
That's a lot of money. Maybe hundreds of millions of dollars, something like that. So it's literally 0.1% of the cost is land. How much does a megawatt of solar cost? Well, if you go and ask the usual suspects, they'll tell you a million dollars. But this is one of the things that breaks my brain at Terraform, which is my day job, which is that the modules themselves, without tariffs, would be like $0.08 a watt. So that's like $80,000. $0.08 a watt? Yeah. But they're like a dollar a watt, including installation and everything. Including installation and everything. But the panels are the magic part. They're the thing that turns sunlight into pure electrical energy at 25% efficiency. Everything else should be less than that. If you want to work on that project, come and work with us at Terraform, because we're very cost sensitive. We'll give you an opportunity to chill, don't worry.
Dwarkesh Patel
Constantly.
Casey Handmer
But... No, in all seriousness, the central takeaway is that the hyperscalers are not power cost sensitive. They are power availability sensitive. And for all these things, you just run into this supply elasticity wall at the rates of increase that we're talking about. And solar is by far the best option for... fire hosing energy at a given problem.
Speaker 4
Right.
Casey Handmer
Because it rains down from the sky.
Dwarkesh Patel
If you're running a frontier technology company, you know how essential it is to recruit the world's best talent. But this requires navigating the Byzantine U.S. immigration system. Not only do you not have the time to deal with this yourself, you just don't have the tacit knowledge to maximize the probability of success. But given how critical exceptional talent is, you can't take any risks with visa approval. You need to work with the best. Lighthouse handles everything better and faster than you possibly could, and they do it all with minimal input from you. Lighthouse knows the nooks and crannies of the immigration machine.
They know how to frame publications and awards, or how to structure comp comparisons versus benchmarks, and how to put everything together into the most compelling story possible. And they've even optimized the tiny details, like the tone they use when they draft support letters to help U.S. immigration officials understand the importance of tech and startups. Companies like Cursor, Together AI, and Physical Intelligence are all already working with Lighthouse. You can join them by visiting lighthousehq.com slash employers. All right, back to Casey. Between the fact that the, um... Maybe solar prices will go down and the fact that demand is going to go up.
Do you think electricity prices are likely to rise? Yes. But electricity prices at this point are a reflection of a regulatory irrationality, right?
Casey Handmer
And it's the same situation in Europe and Australia, for that matter. Like, your prices will rise until you've had enough. And you say, no, we demand that you allow us to take advantage of... power technology that's been invented in the last 50 years. In terms of things that are causing us to lose to China, tariffs are neither here nor there because, as we've discussed, we're not sensitive to cost on power. But the environmental regulations that are actively preventing us from deploying renewable energy in the United States Like this is the reason Texas is winning. Texas is out deploying California 10 to 1. The regulatory environment around solar is just insane. It's insane. The regulatory environment. Okay. So in the United States, part of the reason that solar has not been deployed at massive scale yet is that a bunch of laws went into action in the early 1970s that were intended to protect our environment. And that makes a lot of sense. And our environment's a great thing. We should protect it.
Dwarkesh Patel
I mean, I think people will be familiar with NEPA and whatever, but like how is it especially impacting solar? Well, let's say you've got a bunch of private land out in the middle of nowhere, right?
Casey Handmer
And you want to build it, solar on it. You'll probably end up triggering NEPA, right? At which point you now have to do what is not in the law, but considered necessary under current regulations, which is like your four-year environmental impact review, which generates so much paper that just the environmental impact of producing the report, because you have to cut down trees to make paper... is more than the environmental impact of just deploying the solar like this is bonkers it is crazy town right uh the thing that drives me particularly crazy in southern california is that just because solar is kind of new and off-grid solar is very new unless you're very very careful you end up getting regulated as though you're trying to build a chemical plant even though it's a solar array and the impact of solar around desert is arguably positive because it shades the ground and improves like soil moisture retention um If you wanted to reverse desertification, you would basically just place all the panels on it, and that would pay for the process.
But you end up having to go through more stringent environmental review process than if you just wanted to grade the whole thing and cover it in concrete. Or grade it and then park a bunch of old rusting cars that are dropping oil into the aquifer. Which, in many cases, you don't need a permit for at all. But to build the solar, you have to go through this whole process. And if there's one thing that anyone listening to this can do, it would be like... have a categorical exemption for solar deployment or just like if I put money in an escrow account that says like if after 20 years we have to pull this out like we'll pull the solar out of the desert and it goes back to being desert right I will do that in a heartbeat but like if I have to hire another biologist for $10,000 to be like Well, on that 40 acre plot, we found a tuft of grass, which we believe might be a critical, you know, one of the 20 species that this particular species of bee sometimes eats.
And the species of bee is not technically endangered, but it might be at some point in the future. Therefore, you can't deploy there, even though it's like zoned, unrestricted industrial and it's sandwiched between a rocket test stand and like a chemical plant, for example, in an industrial part of the desert. I will like, I'm going to become the joker. It is insane. It is like, I just think we need to be a bit balanced about this. I don't want it to drive species into extinction, but the meta problem here is if we don't move our industrial stack off fossil fuels in 10 or 20 years, first of all, we'll get poor the same way UK did, right?
Because they ran out of coal, basically. And the second thing is we'll get poor because we'll flood our coastal cities in Florida underneath climate change. We need solar synthetics for that part. We also need to do sulfur injection and a couple other things. Yeah. People will point out that transmission line growth has been stuck in a rut for
Dwarkesh Patel
decades, and we have all these bottlenecks in terms of substations and transformers, et cetera, et cetera. Why will this not hamper this abundant solar future?
Casey Handmer
That's a really great question. So actually, you and I had a conversation along these lines almost two years ago when we first met, and And it caused me to go and write a blog post. So this is a good way of thinking about it.
Dwarkesh Patel
I think there's another blog post you wrote, though, which was also to our conversation we had, which is how to feed the AIs.
Casey Handmer
That's much more recent, yeah. That was after dinner, I think. And to be fair, I usually am fairly clear in my blog posts if I'm posting or if I'm serious. But this one, actually, I'm dead serious on. It's actually the one where I'm... it's like the most out of the money bed as well. Like everyone else that I consider to be like a respectable forecaster in this area disagrees with me on it. So that's one side. Well, so the grid, we know where the grid is expensive. It's a lot of wires strung up in like hard to reach places that are hard to maintain, especially as, you know, the workforce ages and regulations and all the rest and eminent domain and so on and so forth.
Okay. So grid's not going to get cheaper anytime soon or easier to build. And if you look at the projections of like how much grid, you know, DOE would have us needing to build in the next 10 years versus how much actually being built, it's like, it's not even in the same order of magnitude. So you say, well, are we totally screwed? The answer is no, we're not totally screwed because batteries actually do the same job that the grid does. But this is kind of weird to hear me out. The grid transports power from one place to another. It transports almost instantaneously at the speed of light. So it's actually performing a spatial arbitrage.
So the idea being that right outside the local nuclear power plant, power is really cheap because they make a lot of it. And in your house, power is really expensive because you don't have a power plant in your house. And you pay the intermediator a small fee and they allow this trade to take place. And that's basically how the grid works. And until quite recently, the only way we had of meaningfully storing electricity on the grid was pumped hydro. And that only works in a handful of places in limited capacity. And it doesn't work all that well. The efficiency is not great. Now we have batteries.
Batteries store power at one time of day and they release it at another time of day. So batteries are performing a temporal arbitrage, an arbitrage over time. But they can be local or they can be more remote. I think we'll end up seeing batteries next to the solar rays and batteries in the middle of the grid at substations and batteries on the sites of existing power plants that get turned off and batteries in your house and batteries everywhere in between. One way of thinking of this is what is your per capita allocation of batteries in kilograms per head? And like when you and I were much younger...
Speaker 1
you know,
Casey Handmer
the lithium-ion battery was in a cell phone, say, so you're like, I don't know, 10 grams per person or something. And nowadays, half the people in this town drive Teslas, so your per capita allocation of lithium-ion battery is... 100 kilograms or something like that. So we're talking like four or five ohms of increase of total battery per person. That trend is only going to continue. And then you say, well, okay, we've got batteries that are performing this temporal arbitrage and the sun comes up every day, right? So like the power swing from like midday you're otherwise curtailing the solar array to dusk when everyone's watching TV and cooking dinner or running the air conditioners to cool off in the evening is very predictable, right?
Whereas like, oh, we had like... Really bad weather, so we had to use the power line that runs to the extra power plants over by Hoover Dam or something. It doesn't get used nearly as much. Or like its peak utilization is almost never. Which means that the utilization of the batteries is on average, like let's say 300 days a year, and the utilization of your most expensive grid, highest voltage grid assets is much, much lower. And that includes like the substations and transformers and stuff that serve that. So it's a really bad position to be in if you're a grid operator. Because you've got this aging existing thing that the batteries are cannibalizing, the batteries are being installed behind the meter, you don't have a say in whether they're being installed, how they're being used.
All you know is that you're that your utilization of your asset where you get to charge top dollar for it is just dropping year after year after year after year as the same time as your operating costs are increasing year after year after year. So it's just very clear that like the average distance the electron is going to travel between generation and consumption is going to decrease in the future pretty radically. It's already decreasing. It's going to continue to decrease.
Dwarkesh Patel
The difference is that I mean, it's especially helpful for solar, but like solar is the one that's most intermittent. You can predict the amount of solar power you're going to get in three days pretty accurately because of weather prediction. But you can't like buy more batteries. You can't like change the amount of batteries you have.
Casey Handmer
Well, actually, in the limit, you can, because you can put them on trucks and drive them around. So there could be a capacity market for batteries, where you drive them around to people who need them at a pinch. In practice, it's going to be cheaper just to double the size of your battery, because batteries are going to get cheaper and cheaper and cheaper and cheaper. But what it does mean is you can say, well, I know that I'm going to have three low days. So I will start curtailing now by 5% so I don't have to curtail by 50% in three days. And then overall for the whole year, I'll only curtail, you know, five hours. So I'm still at four nines instead of having to curtail 24 hours because I can't predict the weather.
Dwarkesh Patel
OK, so let's assume you're right. And then, I mean, I think at some point you will be right. Like maybe we disagree about, sorry, I'm not qualified to disagree. Maybe you and some other person might disagree about what year it happens. But I think it's hard to deny that in the asymptote, our civilization is headed towards lots of energy used for AI and a lot of that coming from solar. Mm-hmm. In that asymptote, I want to get the crazy nerd sci-fi, like, what does our civilization look like? What is happening in this, you know? Kadeshev, level one. Yeah. Let's wait till we get to turning the entire Earth into an AI factory, but more like, I don't know, the 2030s, where you've gotten multiple people who are building...
On the order of 5 gigawatt or 10 gigawatt sites, the value of the hardware is dependent on its complement, which is the software, right? Like right now, AI models are fine. And so the hardware they're running on, the economic value they can generate is sort of bottlenecked by how good the software is. But if you actually had AGI, if you had like a human level intelligence or maybe even better. Ideally better, yeah. Yeah. Running on an H100. That H100 is worth a lot, right? Like we're paying a lot for humans to do work. Right now, I don't think AI is that valuable. Like the models themselves aren't super, super valuable in terms of just pure economic value, right?
Open AI is generating on the order of 10 billion ARR or 20 billion ARR. That sucks. It's terrible. How can they sleep at night? I know. But for context, McDonald's and Kohl's generate more. yearly revenue than that. But I think the promise of AGI is to automate human labor. Human labor generates on the order of $60 trillion of economic value. Or that's how much is paid out in wages to labor around the world, right? So that's what AGI can do. And even if you curtail it to just white collar work, that's still tens of trillions of dollars of value. So once we have models which are actually human level, they will be worth at least that pending the fact that you can build them.
Casey Handmer
Well, I don't think we should constrain ourselves to being like, oh, well, maybe there'll be some fraction of current payroll, right? Because that's kind of a very contingent on humans being humans thing. Yeah, no, I think that's a lower bound, to be clear. Oh, yeah, lower bound for sure. But, like, if you think about, like, someone trying to, like, estimate the upper bound for the market value, the market cap of, like, Caterpillar, right? Based on, like, well, it takes, you know, this many men and, like, burrows and wheelbarrows to, like, dig a trench. And so, you know, it couldn't be more than that, right?
But actually... you know, one way to think about the industrial revolutions is every time you figure out industrial revolution, what you're doing is you're finding some way of like bypassing a constraint or bypassing a bottleneck and the bottleneck prior to what we call the industrial revolution was, uh, metabolism, right? It's just like how much like oats can a human or a horse physically digest and then convert into useful mechanical output for, you know, their, their, um, their peasant overlord or whatever. And, and nowadays we would giggle to think that like, oh, the amount of food we produce is meaningful.
in the context of like the economic power of a particular country right um because 99 of the energy that we consume routes around our guts you know through the gas tanks of our cars and through our aircraft and you know grids and stuff like that interesting and so right now the ai revolution is about routing around cognitive constraints that in some ways writing, you know, like writing, printing press, computers, the internet have already allowed us to do to some extent. A credit card is a good example of something that routes around a cognitive constraint of like building up network of trust, right?
It's decentralized trust.
Dwarkesh Patel
Yeah, that's interesting. It's also really interesting, something that came up, and I want to credit James Bradbury and Guernwith making this interesting point when I was talking with them a couple of days ago, is if you measure it by GDP, AI's outputs might be underwhelming, right? One of the complaints that economists have about the internet is that it's hard to measure the consumer surplus that's created by the internet because a lot of the goods and services that are made available You pay zero for them, and so they don't show up in GDP. Well, it's the same with oil. Yeah, in that sense that it's only 1% of energy is like 1% of GDP.
Casey Handmer
Oil is like $8 trillion a year or something, right? Yeah. But if you said, well, one day we're going to consume 100 times more energy in the form of oil than in the form of food, and the per joule cost of food is, you know, whatever it is, the cost of a Big Mac, then oil should be like $800 trillion a year. a year, right? It's a hundred times, like per unit energy, oil, like gasoline is a hundred times cheaper than the cheapest food that humans can digest. So, so, so like, does that mean that we've like shot ourselves in the foot by using oil to run our economy? Right. because it's so cheap? Like, no. Right, right, right. And also, its fraction of GDP also doesn't correspond to how important it is.
Dwarkesh Patel
For example, oil is like 1% of GDP or something. But if you don't have oil, then you have these oil shocks, which cause double-digit decreases in GDP. So the elasticity of demand often matters more than its raw fraction contribution to GDP. But anyways, on the original point about AI, so... you're going to have this huge deflation of... So Gordon put it this way. He's like, if you imagine Dario's data center of geniuses, how is that showing up in GDP? Well, it would be the inputs, which are the chips, the energy, et cetera, and the outputs, which are just the tokens. And neither of those is going to be that astronomical in comparison to the value that data center of geniuses is producing.
So in terms of GDP numbers, like... if that data center of geniuses automates a bunch of, or at least complements a bunch of human work, et cetera, it might actually cause like a nominal decrease in GDP while at the same time contributing massively to what we might think of as the valuable stuff humanity or human civilization can produce. And so in the long run, it might make more sense to think of the size of our economy or the size of our civilization as the raw energy use that we do rather than GDP. Because again, GDP will see this huge deflation because the variable cost of running AI will just be pretty cheap as compared to like paying humans wages, et cetera.
I think we're at the point where like you've got a mixed economy with like
Casey Handmer
an AI doing my job and also a human doing my job.
Dwarkesh Patel
I love how this is the new way we use the phrase mixed economy.
Casey Handmer
Yeah. Then obviously I still have some pricing power relative to humans and the AI thus has pricing power, right? Yeah. But if it was the case that a new kind of job emerges that AI is really well adapted to, because it's not competing against humans for most of those roles, it'd be competing against the other labs, right? And so you'd actually see the cost pushed down to a small multiple of whatever the marginal production cost of those tokens is. That would be my guess. So I think it might be a mistake to assume that, well, if we're going to pay a top AI researcher $200,000 a year, well, let's say the sort of AI researcher that I could be, $200,000 a year, that if an AI comes along that's as good as me at that, even taking into account the fact that, realistically speaking, I only get,
Speaker 1
you know,
Casey Handmer
maybe 10 hours of really top cognitive work done a week, that it would also be worth $200,000, right? Obviously, it'd be worth much more than that in the sense of, like, you can copy-paste its output, and much less than that in the sense that, you know, whatever the marginal additional cost of spooling up H100s is. And so if some kind of role comes along that, like, the AIs are really well specialized at and outcompete the humans quickly, then we'd also expect to see that. both the cost of providing that service to drop drastically at the same time as the overall value generated in the economy by that service would increase a lot.
Dwarkesh Patel
Yeah, exactly. If we think that the value of cognition is going to be unbounded and the way to derive cognition, you can just, to the extent you think solar will eventually win, you can just you can derive it from how much land it takes to power an H-100 using solar panels. That is a very interesting derivation that like, okay, well, this is, at a minimum, we're going to just fill up all the land. I mean, at some point, you might have like declining marginal value of cognition or something, but...
Casey Handmer
We kind of discussed this earlier, but if you have like a megawatt of... 10 acres of land feeding one megawatt H100 or something that's generating, like, let's say a megawatt is 1,000 humans. So one acre is 1,000 humans worth of cognition. The implicit land value there is a lot higher than it is as, like, undeveloped desert, right? It's also a lot higher than it is as, like, the most productive farmland that humanity has ever had, right?
Dwarkesh Patel
And current hardware efficiencies... I don't know if it's worth spelling out. Basically, H100 has the same amount of flops as a human brain, but also uses way more energy than a human brain. It uses like 50x more energy.
Casey Handmer
Is that right?
Dwarkesh Patel
So 20 watts versus 1,000 watts. Human brain.
Casey Handmer
20 watts, yeah, it could be.
Dwarkesh Patel
We know hardware can be at least as efficient as the human brain. And the human brain can generate this many flops on 20 watts. So if you do that calculation, then that's 50x 1,000. So 50,000 AI souls off of... And it could easily be much more than that because neurons are much slower than
Casey Handmer
transistors, obviously. So probably 10 years ago, one of my friends reminded me, you know, like the way your phone saves power is it goes to sleep between you like tapping out hello. Like H, it takes a nap for like 10,000 cycles. It's kind of nuts. So just like humans, I think Elon's talked about this in the context of self-driving cars as well, which is like anything humans do is like glacially slow from the perspective of a computer. Yeah.
Dwarkesh Patel
Let's actually go back to the original point of like, I was explaining why I think it's plausible that there could be more than hundreds of gigawatts of extra demand from AI in the 2030s. I want to understand what that looks like in the real world. Like at that point has become basically this industrial problem of can you generate enough solar panels and solar modules and batteries and not to mention the chips themselves.
Casey Handmer
It's an industrial point and then there's a cultural point as well. let's start with the industrial point um i i want okay i want to know what the year 2035 looks like if if we've got agi and we're just bottlenecked by the ability to deploy it yeah so you can ask a question like what do you need in order to run like what is the minimum amount of matter that you need in order to perform this these calculations so so right now we're talking about like air racking and grid and transmission and a bunch of like isos and all that rest you don't need any of that stuff right and like Obviously, XAA is on top of this, because the first thing that Elon will always ask is, like, delete anything you don't absolutely need.
So what you actually need is a big slab of relatively cheap silicon to make the power, and then a small slab of relatively expensive silicon to do the thinking. And if it's in space, that's all you need, right? Because it's in the sun all the time, so you don't need a battery, right? But if you're on the Earth, you need a battery as well. So you need some interconnects. And you don't need a transformer, right? You don't even need a DC-DC converter. You can actually make do with buck converter or with relays or whatever to basically match the current output of your solar array with the charge state of your batteries and the power consumption of your, you know...
GPU or something but like a solar array about the size of this desk for example will generate about 500 watts in full sun so you can actually imagine like aliens who have different silicon technology stack building their systems as like an integrated solar array with you know a bit of a bit of you know, computranium in the middle, for example, on the same wafer. But that's basically all you need. On the same wafer, because it's all silicon. It's all silicon. It's all silicon all the way down. What's silicon made of? Well, it's an element that's chemically in the crust. There's no shortage of it.
Dwarkesh Patel
This is a great prompt for a sci-fi exercise, because especially in space, you don't need batteries, so you're just like... The prompt is the future TSMC just manufactures integrated solar.
Casey Handmer
And they can fly around, right? They're solar cells, right? And they're relatively dense, so they don't fly crazy fast, but they don't need to because they're immortal.
Dwarkesh Patel
Is this what the Dyson's rule made of, Casey? Is this going to be competeronium at the center of solar cells?
Casey Handmer
They can fly closer to the sun to get more power. up to their thermal limit, and they can fly further from the sun to go and explore, or fly to other planets or something. And they can adjust the orientation of the solar sail with LCD panels so that it can be integrated into the wafer itself. So that's actually, if you say, what's the post-human state? That's it.
Dwarkesh Patel
A solar sail with a silicon die in the middle for compute?
Casey Handmer
One human's worth of computation, one human brain can be simulated in roughly a square meter of silicon floating in space. How much are you? One square meter of silicon, like the thickness of a sheet of paper floating in space. That's a future human form. That's my final form. That's its raptor state. Yeah, that's assuming a little bit of software improvement, but I don't think that's...
Dwarkesh Patel
All that's assuming is software improvement. The Dyson Sphere, that's all it needs.
Casey Handmer
A little bit of tweaking of the algorithms. The area of the panel is kind of the variable there. Right. So you can ask, well, what do you need in order to make the silicon? Making solar arrays, making chips is a kind of multi-stage process, but basically you start off with silicates, which are rocks, ideally in a relatively pure form. You chemically reduce them. There's a couple of different processes that can do that, and then purify them into ideally six nines of purity for solar array, maybe nine nines for really nice computers. Silicone purity, and you can grow crystals, cut wafers, et cetera, et cetera. So then the constraint is like, well, how quickly can you convert the crust into enough silicon to support, you know, silicon thought? Yeah. What does the silicon ecosystem look like?
Dwarkesh Patel
Any thoughts?
Casey Handmer
Well, it's pretty quick. Like if you're like one kilowatt per square meter and then you use that just to like rip oxygens off the underlying dirt, you know, it doesn't take all that long to, you need about 20 microns of silicon to make a solar PV array. So...
Dwarkesh Patel
Like, from dirt, as you mean like actual dirt?
Casey Handmer
Yeah, actual dirt has plenty of silicon in it. So, for example, setting up a brand new silicon refinery takes about 18 months. Right. Right. But that's just with the current technology, right? I actually think... We may find ways. So one of the nice things is if you have infinite free solar power, approximately free solar power, you can revisit a bunch of legacy industrial processes that have been optimized for efficiency and say, well, what if we just use twice as much power and we just want to do them faster and cheaper? Less capex, less lead time, more power. Well, you can start solving problems.
It turns out that if you want to chemically reduce silicon, you can do it electrolytically, like with less efficiency and a bunch like under a hydrogen rich atmosphere or something. And then so one of the ways that silicon can be refined is by turning into silane, which is a silicon tetrahydride. I'm not really a chemist, but I think that's right. So SiH4, which is a gas. It's actually like methane, but one down on the periodic table. And don't breathe it, though. And then once it's a gas, you can filter it from all the contaminants, which don't form gases or can be separated by density, much like how uranium is sometimes enriched, but much, much less difficult.
And then heat it up to separate it back into pure silicon, where you can then precipitate out a...
Dwarkesh Patel
I mean, the reason I think this is interesting is because whenever people who are talking about the AI singularity, often their expertise is not in energy or physics or whatever. So they focus only on the cognitive elements of the singularity, which is like how much faster can we make AI smarter, et cetera. I think this is really interesting because... If we have unbounded cognition, which sets up both the ability to supply and to demand more energy, I'm very curious, what does the energy singularity look like? Where we're just trying to saturate as much energy that the Earth receives and turn it into cognition.
Casey Handmer
I hadn't thought about that before, but there's this idea that evolution resulted in this continual ramification and complexification of the thermodynamic gradient. So you start with very simple RNA-based organisms, and then you get this industrial economy. But it may be the case, and I don't have a strong reason to suspect one way or the other, that what we're seeing is the beginning stages of a collapse back towards the simplest possible thermodynamic to cognition stack, which is... We have fusion in stars and the inky blackness of space, and that provides our temperature gradient. And then the most efficient way to convert that into usable cognition is silicon. Like, literally electrons being pushed across the Fermi gap in a solar array and then taking the return path through some, like, set of gates, making decisions about things, and then, like, beaming lasers to their friends saying, hey, I just made up a new meme.
Dwarkesh Patel
That is an interesting concept. For four billion years, we've been increasing the sort of, like, variance and complexity of... creatures and then you might see like this big collapse um should i give you the opportunity to plug why uh why people should work for terraform yeah so actually just to give you introduction terraform is my day job it's a company i founded almost four years ago we are making synthetic natural gas from sunlight and air we are also working on other core primary materials stuff we also have a methanol
Casey Handmer
process methanol and methane together uh precursors to every hydrocarbon you could possibly want, another chemical, ammonia, processed steel, desalination, and we can also make cement and a few other things. So basically everything that the primary industry does except for glass and paper. We are hiring. Our jobs are available on terraformindustries.com. Yes, the website's meant to look like that because we're very cool. We are some... very special people. You know, I know a lot of smart people and I'm privileged to work with some of the smartest people I know. We're mostly mechanical engineers. I will never hire anyone who can't do math. I will never have the problem with astronomer because we don't have a head of HR.
Dwarkesh Patel
And also the CEO is not having an affair. Yeah.
Casey Handmer
Yeah, I mean, like, step one.
Dwarkesh Patel
I think that was a more crucial issue, Casey.
Casey Handmer
But like, heads of HR can get into trouble. I'm just saying, everyone does math. Terraform, it's very important to me that Terraform is the place that ambitious hardware people go to become the best they can be. Right. That is really important. I'm not it's not here to like check in and get your paycheck and like optimize some shiny widget. It's still a small team. It's still like one project per person kind of situation. And I will level you up like maybe not quite like Jensen taught you into greatness kind of situation. But like at times it's going to feel that way. And you get to work with the best people that there are, at least on the West Coast of the United States on this sort of thing. And it's also a unique company. I thought years ago, like by now I'll have competition. We don't. No one else is doing this except for a small startup in the UK. And so, you know, you get on the ground floor and it's going to be super cool technology. And eventually we get to go and build it all on Mars as well and like help our robot overlords make more of themselves out of dirt. It's pretty cool. Nice. Come work for us.
Dwarkesh Patel
Casey, thank you so much for coming on the podcast. Oh, thank you. It was fun. Yeah. Thank you for tuning in. I'll see you on the next one.