In December of 2024, the Chinese start-up DeepSeek shocked the world with the release of an AI model that appeared much cheaper to make and run than those from its American rivals. The company also open sourced its AI, meaning it released the blueprints of its model to the public.
Our guest this week is Misha Laskin. His start-up Reflection AI looks to be the prime counterweight to DeepSeek and a host of other open source Chinese models. Laskin argues that open source models can be just as good as the models developed by the likes of OpenAI, Google and Anthropic and that the West needs this to be the case.
Reflection has raised $2 billion and is valued at $8 billion, although the figures in AI have become so lofty as to almost feel meaningless at this point. That said, the company was able to raise so much money because of the pedigree of its team with a number of engineers, like Laskin, coming from DeepMind.
I have, in full confession, not been paying enough attention to open source models and the ways in which the Chinese models seem to have become the basis for a lot of corporate work in the US. Laskin dug in deep on this topic, and hopefully you’ll feel more up to speed after listening to the episode.
You can find the Core Memory podcast on all major platforms and on our YouTube channel.
Enjoy!
Our show is sponsored by Brex, the intelligent finance platform. Like thousands of ambitious, innovative companies, we run on Brex so we can spend smarter and move faster. And you can too. Learn more at www.brex.com/corememory
The podcast is also made possible by E1 Ventures, which backs the most ambitious founders and start-ups.
No summary for this episode yet.
Speaker 1
I think the mission of the company is far broader than that. It is to build a frontier open intelligence and make it accessible. Meaning, when we say frontier, there's no reason why open models should be any worse than closed models. Our intention is to build a new frontier lab that drives the frontier of knowledge in artificial intelligence, but doing it in an open way, in an open scientific way. So it's funny that we have to say open science, that's just science, but in an open scientific way and release the models, enable the community of researchers and developers to engage in how they develop and build a frontier lab with open intelligence at its core.
Speaker 2
Misha Laskin, how are you? I'm doing well, Ashley. Thanks for having me. Thank you for coming. Well, you've been in the news, I guess not immediate, but it's in the last month or two, isn't it, that you guys did your fundraising or...
Speaker 1
Yes. So it was announced last week.
Speaker 2
It was announced last week. Yeah. Okay. It is very recent. So you're co-founder and CEO of Reflection AI. You guys raised $2 billion. That's not shabby.
Speaker 1
Yeah. Definitely. You know, this thing that's happening, like in the progress of AI, uh, right. If you would have asked me five years ago or 10 years ago, I was a physics student that this is where, uh, AI would be. I would not have believed it.
Speaker 2
Yeah, well, I mean, we'll get into, we'll definitely get into all that. But I mean, just to like set some context, I mean, you guys, the big, the big part of the big message here is that you guys have raised a ton of money. You have a team with an incredible pedigree, some folks from all over the place, but a lot from DeepMind. You were at DeepMind. Your co-founder worked on AlphaGo quite intimately, crucially on that project. And so to sort of have this all-star team, I figure that's why you were able to raise quite a lot of money. And then you've got a bit of a different pitch, a different frame around what you're doing than DeepMind. um definitely than than the open ais of the world you you guys have come out and said you want to make this open model sort of in the open source vein um and and to to publish the weights of of your your models and so and you're kind of making the pitch that america needs we've had chinese companies deep sea cut all this attention um for for doing an open model and that we need something that's competitive Facebook's made open models, open AI kind of sort of is. And then I think does, and Mistral does.
Speaker 1
Yeah, Mistral is definitely an open model player.
Speaker 2
Okay. Okay. Okay. But this is, am I right in, this is some of the heart of, of what you guys are saying is makes you, makes you different.
Speaker 1
I think so. Certainly, it's become really important to produce great open models of American provenance that are competing or competitive with the Chinese ones. But I think the mission of the company is far broader than that. It is to build a frontier open intelligence and make it accessible. meaning when we say frontier, there's no reason why open models should be any worse than closed models. Our intention is to build a new frontier lab that drives the frontier of knowledge in artificial intelligence, but doing it in an open way, in an open scientific way. So it's funny that we have to say open science, it's just science, but in an open scientific way. and release the models, enable the community of researchers and developers to engage in how they develop, and build a frontier lab with open intelligence at its core. And I want to nerd out, but I also want to make this accessible to as many people as possible.
Speaker 2
So even just some of these basics that we're talking about, when we're talking about an open model versus a closed model, When companies, when we talk about weights, I mean, it's almost like these mathematical calculations, these numbers that are attributed to the neural network and how it will behave. And to some extent, this is like the secret sauce. You do all the training and you come out with these weights that make your model hopefully behave the way you want it to behave and do incredible things. And so some companies keep those proprietary into themselves. um, being able to be at the cutting edge of what these well-funded companies who have access to all this computer doing, but doing it in this more open way.
Why is it even, um, you know, I come from, I covered open source software for years and it was this very like ideological thing, especially in the late nineties, early two thousands, Microsoft was rising and, and there was a whole faction of people that were, you know, they saw code like, um, Like writing, like knowledge, this should not be contained within a company. You should be able to alter your computers as you see fit. This knowledge should be shareable. And they saw Microsoft as really like, it was almost a religious debate, right? Like they were evil for doing. proprietary code and man i mean i lived through that it was like emotional and people really cared i i haven't felt that same level of like enthusiasm and rhetoric and everything around open models you brought up science you know scientists tend to lean more in the open direction in my experience All right, what do we do at Core Memory?
We cover innovative, fast-moving, forward-thinking companies, which is why Core Memory is sponsored by Brex, because Brex is the intelligent finance platform for many of these companies, 30,000 companies from startups to the world's largest corporations. Rely on Brex's technology for their finances. They've got smart corporate cards, high yield business banking and expense automation tools that are fantastic. I hate doing my expenses and Brex's AIs and software run right through those expenses, figure out where we're spending money and take care of so much stuff for you so you don't have to waste your time on it yourself.
Go to brex.com slash core memory to learn more and just, you know, get with the program. Let's get going. Let's get out of this archaic finance software and move toward the future core memory and Brex. How do you come about it? Like, why is it, why is it intellectually, philosophically, technologically important to have these open weights? Is it apples to apples? Have I even started in the right place?
Speaker 1
I think it's definitely in the right place. I think the observation that In the build-out of software that there were these effectively closed proprietary software build-outs and a lot of developers pushed back because they believed that a lot of the code that powers core infrastructure should be in the public domain and it should be accessible and any developer should jump in and contribute into it, I think mimics the ideas of how science evolves. The reason we are here where we are today with AI is because of science that was done openly. When we think about the fundamental breakthroughs that power the models that are being trained today, it's self-attention, well, it's deep neural networks, self-attention, next token prediction, and reinforcement learning.
And obviously there are a lot of papers within each. But if those ideas were not in the public domain, then we probably would not be experiencing the boom that we are in today. So the fundamental progress in science and technology happens because things are done openly. And when we think about from an open source perspective, What operating system do most computers run on in the world? And it's Linux. I mean, yes, our consumer devices, maybe you're on an iOS or Microsoft. But when you look, if you just look at all the computers in the world, all the servers, and what are they running? They're mostly running Linux.
Speaker 2
Yeah, the infrastructure. Not even just the servers, but like all your... consumer electronics devices, your cars, most things that make the world function are probably running on some version of Linux.
Speaker 1
Right. And for mobile devices, it's Android. There are more Android devices in the world than iOS devices. Openness spreads and is accessible because everyone can build on top of it. The internet was an open protocol that spread around the world. And there is obviously a desire from a company that's commercial to build things out in a way that's incentivized with them effectively winning commercially. The current commercial rollouts have basically incentivized closed model development. It's not irrational that AI development in the West specifically or especially has been done in a closed way, but it is not the fundamentally best way to build out what is the most impactful technology of our time.
Openness is, I think, fundamental to this technology being both built out in a way where everyone can contribute to ideas of how you get new capabilities into it, but also from a safety perspective, I think it's a... You don't want safety research just to be concentrated among a few closed labs and 30 people within each that really think about safety. You want everyone to participate in that discourse. Now, the question is, how do you set up an entity that enables you to do that at scale, at frontier scale? So you're not kind of looking at small open models. You're looking at open models that are just as good as the best closed ones and sustain itself so that it can keep doing this.
I think that's the big question. Which was, and it was always a big question in, in Linux land, open source software land.
Speaker 2
It was like, who's funding the, I mean, it's a little bit different, but you know, much of that software was these supposed, it always got pitched as kind of like volunteers who are working on, on Linux. And, and some of that was true, but it really turned out companies like Google and IBM and, and you name it, Sun Microsystems, whoever were, were. paying decent salaries to people to work on this software and contribute it back. And so they had good jobs. And this was important to a lot of companies. And then it was always harder for some giants. I mean, Red Hat managed to create this model where they made money off supporting their software and services around it. But they were really like the biggest, you know, flagship example of somebody who succeeded off this model. So what's the, what is the chat? What's the equivalent in open source land? Because you've got, you've got what, I mean, you're up against five or six American foundational model companies that, that, that are selling all kinds of their software on these subscription services. I mean, do you do the same thing or is it, is there, um, sort of like there was with open source software, a slightly different play.
Speaker 1
It's a really good question, and this is where the analogy to previous waves of open source software breaks because previously open source was cheap to develop. I mean, it just required developers, really. And for that reason, you didn't necessarily need very large commercial entities around a lot of these projects. It's not that expensive for Google and some other companies to front the bill for some headcount that builds out Linux or some other piece of open source software. Well, of course, there's a long tail of contributors who are independently contributing to this stuff as well. The difference now is that models open or closed take a lot of money to train and so you can't you you can't do this in a way that is not commercial but the important thing is to ensure your commercial interests are aligned with the mission of the company so i think the big challenge is that uh If you don't think about those things in tandem, then it's a tail wagging the dog sort of situation where you'll start open, but then your product or your commercial business will take you in whatever direction you need to go.
And so far, each time that's happened, it's been closed. Open AI started with open artificial intelligence.
Speaker 2
We were kind of here not too long ago. I mean, at the beginning... open AI was meant to be this open counter to, to Google and DeepMind and then whoever else was coming. And then, but also to your earlier point, even every company that was working on AI in a meaningful way, we're publishing tons of papers. It was a lot of academics that had joined the labs and it's just, it's just in the last like four, three, four years where, where this started to close up a lot.
Speaker 1
Yeah. Yeah. And I think it's because the commercial interest pulled the companies where they needed to go. And I, I can understand where they're coming from. When OpenAI was founded, it took however long, half a decade to get to any point where the commercial structure was clear, probably seven years from its founding to ChatGPT. Of course, you can't predict what's going to happen seven years from now. You can start off with a certain intention, but then you strike gold and your product takes you, where your company follows the product. I think that every single large attempt at open intelligence in the field of AI has either not made it in the sense that it was just not resourced well enough to really punch at the frontier, or the commercial interests of the company took it down a closed path because there's no...
There has to be a reason why open intelligence matters for you commercially or for your product. That's why it's really important to set up both. The way I think of evolution of Commercialization of artificial intelligence is almost like a Maslow's hierarchy of needs that need to be met, starting with consumer. That's with ChatGPT and the initial kind of set of consumer products. Actually, before ChatGPT, there was Character AI, which was probably the first viral product built on top of a large language model. And that category has clearly been defined by a set of companies and prominently open AI.
And so the consumer need has been met. I think moving further upmarket, we have cloud APIs. So where Anthropic, Gemini, and the GPT APIs compete, these are closed model APIs that developers build products on top of. And I would say the primary consumer of that market is the startup. And the startups have now grown to be very big. So now these startups are, some of them are large enterprises. But I kind of think about that being like the Stripe for intelligence. In the same way that Stripe grew with Lyft and Uber, these APIs are growing with the startups that are building on top of them. And that brings us to the last category in Maslow's hierarchy of artificial intelligence, commercial needs.
And that is large enterprise. So once you move up market, and there's basically nothing else beyond there because, I mean, large enterprise, what's bigger? Very large enterprise. Yeah. So you have large enterprise. And at that point, that's when there's a transition point where open models start to become important from a commercial perspective. Because once artificial intelligence becomes a very large line item for you and is a core part of your IP platform, You start thinking about how do you optimize it? How do you bring it in-house? How do you run on your infrastructure? How do you keep your data from going to the closed model providers?
How do you customize the model? You want to be able to predict your costs and you want to be able to have ownership and customize the model. I think in part what's happened is that it took a while for the arc of commercialization of artificial intelligence to hit the point where large enterprises were ready for its adoption, because in a sense the slowest to move. Consumer happens first, then startups, and then large enterprises. I think now is the moment in time when there is a commercial structure where open intelligence is fully aligned with it. You guys would help those companies set this up and manage it and tweak it in that
Speaker 2
Red Hat model?
Speaker 1
I think that's roughly right, but much bigger because what you're providing is effectively the intelligence core that's going to power the company. If you are embedded as the intelligence core and the key provider, in the same way that there's the infrastructure AI core, like GPUs and infrastructure around them, you're now part of that as the intelligence core. There are a lot more things you need to do to make an open model useful to an ad customer. And you can, I mean, the, the very basic of it is that you serve an open model on their infrastructure via an API, but there are so many more things that you need to do to make it, to make it more universally useful. You need to help customize it. They want to probably build some internal agents around it. So you need to build, provide software for that. And there's, um, the surface area of value that you can then capture and go monetize with the open model at its core. Okay.
Speaker 2
Okay. So you, you're The open AIs, the Anthropics, the Googles, they're kind of keeping all this stuff within their walls and just renting it out as people want. And you guys would be helping companies actually build on top of AI themselves. And your technology would be at the heart of that.
Speaker 1
That's right. Not everyone needs to themselves have access to the models and build the intelligence itself or own it or customize it. I think the closed model strategy is great for startups when you're just getting started and you don't want to deal with all the infrastructure complexity. But once you're a very big consumer of artificial intelligence, then you actually want to own it. Once it becomes a very large line item, and you're spending a lot of money on it, then you won't... It's very similar to how many enterprises have repatriated their cloud workloads. They first built on top of a cloud provider, but then the bill became so large that it made sense for them to bring things back in-house. Okay, in sort of slightly changing gears for a second, I mean, it's been...
Speaker 2
When did DeepSeek hit? Was that like five or six months ago or is it longer than that?
Speaker 1
Well, V3 landed in December 2024. Okay. And that was like this big moment where people really woke up both to sort of the state of AI in China and then the techniques that they'd used to make it work.
Speaker 2
And then I guess the openness of it all. I remember in the weeks, you know, the first couple of weeks when it came out, there was all this panic and everything. And then I think it was Dario at Anthropic that wrote a paper. I think it was Dario. And if I remember right, he was arguing that, well, it wasn't quite as cheap as everybody thought because they'd been accessing GPUs they probably weren't supposed to have and probably spent a lot more on their infrastructure. Because part of the thing was like, oh my God, they've... they've learned so quickly from the U S cutting edge techniques, but they, and they've improved them and they've done it at a fraction of the cost. And, and, um, I mean, do we still now in hindsight, like what is, what does the world think of deep seek? Because, um, At least that moment, that month of people panicking and freaking out seems to have passed, at least in my mind, to some degree. So yeah, now in hindsight, what do we think about TPC? I think that we need to give credit where it is due and that it was an incredible
Speaker 1
accomplishment. Because what happened is that a group of basically high frequency traders, so quants in China, who did not have the storied large language model background like some of people who built out these labs in the US, found a way to replicate a lot of what was known internally in big labs or some version of it. I think the details are always different, but roughly these are the kinds of tricks that one would uncover at a frontier lab. And not only replicated without because these labs aren't open, so it's not like that information was really out there. Oftentimes there are papers in public where there's some information, but you need to know which ones to look for.
And so they replicated it at a great degree of excellence and shipped something with maybe not as few resources as they claimed, but still significantly less resources than the U.S. labs. That was not that far from the frontier. I think what they did was incredible. It was a wake-up call. I think that the reaction to it in terms of the panic was justified. I think the only thing that's happened is that now we're living in the world where open intelligence is being dominated by Chinese labs instead of DeepSeek. There's DeepSeek and then five more. And we've just gotten kind of gotten used to it.
So I actually think the panic is not high enough. Like it's kind of, you know, okay, now the world is the way it is. And, you know, we're importing Chinese models.
Speaker 2
So we got complacent or aren't thinking about this deeply enough.
Speaker 1
I think so. However, I would say that the, but we do see, I think, panic in the right places or maybe And the way I kind of think about this is, for example, in July, the White House released an AI action plan, which was... very much about this problem of what do we do about the fact that we're importing Chinese models into the US and building on top of that technology instead of exporting it to the rest of the world. What do we do about this? The plan was sort of a proposal for fixing this issue. I think the fact that the administration is taking this as a serious issue of national security is the right way to be thinking about it. I think that maybe while in the general public the panic has faded, I do think that we are seeing the right, I would say, strategic questions being asked. So, and I never paid enough attention, shamefully, to what Meta was doing on the open front.
Speaker 2
I mean, was DeepSeek that much better than the models Meta? Because Meta had spent tons of money, right? And resources. And for a while, I remember, was keeping up in a lot of ways with the proprietary... frontier models and was doing well on a lot of benchmarks. So we, I mean, it was deep seek that much ahead is, is meta still, even now that they've, they've kind of changed strategy is that's taken a backseat or.
Speaker 1
So deep seek was way better. I think deep seek was, you know, a kind of qualitative leap away from anything that was being produced outside of China, uh, meta included and. and apparently at a fraction of the cost. I think what was eye-opening was that Meadows has been and will be putting in just a crazy amount of capex into getting GPUs for training these models. DeepSeq was able to get away with a much more powerful model for certainly something that's a fraction of the cost. We never know how much, but there are export controls. The chips that Chinese labs get are not as good. Obviously, they have their internal chip economy that they're trying to build up.
but they're they're kind of playing they have um a disadvantage on the trip front and despite that disadvantage uh they're able to rise to the occasion with yeah when i mean it's probably to some degree helpful you have to figure out how to do things with less resources right and be more creative and and innovative sometimes yeah yeah yeah so i think that what was surprising is that Because American labs are mostly closed, people don't have a sense for what it takes to build these models. And DeepSeek was the first time that I can think of where a powerful model was released with the details of how it was trained.
And the details were surprising. Because oftentimes, I mean, something that surprises scientists that get into this is that When you're trained as a scientist, you're trained that it's all about breakthrough ideas that are oftentimes theoretical or mathematical. I was a theoretical physicist, and a lot of it was around how do you creatively find these completely new ideas to approach tough problems. That is true for the development of these large language models as well, but what surprises people is that the majority of those ideas are at the infrastructure engineering level. They're not so much at the, I need to invent a new theory of artificial intelligence or something like this.
They're very much at the infrastructure optimization level. DeepSeek, when the paper came out, half the innovations were how they coupled their algorithms to fit perfectly with the hardware that they had. I think it opened people's minds in terms of this set of problems that matters. The fact that that happened then and is not really happening outside of it. That's exactly the issue of why do we need an open science around this so that the community as a whole can be calibrated to the ideas that matter and be directed in their exploration so we can develop this technology together.
Speaker 2
And then part of the fear would be not only that U.S. companies are importing DeepSeq and working off it, but I mean, we would go back to this more fundamental thing that we talked about before is... if you look over the last 30, 40 years, the U.S. crown jewels are Windows and Oracle and these software layers that have spread through the entire world. And once you're on these things, you're sort of on them forever in some ways. And it's really powered the U.S. economy in a lot of ways. So I assume another fear would be not just the U.S. is importing these things, but other countries who have not spent the resources or can't on all these massive data centers and don't have the scientists to train these models, that some Chinese model becomes this de facto layer of AI to some degree.
Speaker 1
That's exactly it. That's actually the bigger fear. I think that's the bigger fear to importing this technology, because if we want to, we can always figure out ways of being domestically independent. But If a technology spreads around the world, then you can't really stop that. Exactly. You're saying that the protocol for the internet was developed here and spread around the world. Linux and Android were developed here and spread around the world. Technology is very much one of our greatest exports and national treasures. Now we're saying arguably the most impactful technology of our time, I think certainly of our time and arguably of the last century or something like this, is being developed right now. And we are losing ground in exporting it around the world. And so if we don't set the standard now and export it, then someone else will, and that game will be lost. So it's a very real problem that's happening right now.
Speaker 2
Okay, since day one, the Core Memory podcast has been supported by the fine people at E1 Ventures. They are a young and ambitious VC firm in Silicon Valley, investing in young and ambitious companies and people. Thank you so much to E1 Ventures for all your support. maybe i was just like not running in the right circles going back to some of the stuff i was talking about you know i used to go see bill gates speak and there would be protesters outside i mean all the free software people the open source people i mean this idea you know scott mcneely even i mean hardcore capitalists were up there like calling you know um well i think balmer steve balmer called linux a cancer i mean all this this stuff was very was so heightened um clearly you've created a company to try to combat this, but why is this not more of a religious and intellectual war this time around, or am I just missing what's going on and people really are quite animated about
Speaker 1
this? I think certainly in the research community, people are quite animated around this. It's a good question, but one thing is that AI research at scale is only accessible to a very small number of people. That might be part of it. I think that in the previous iteration of open source, a developer could quickly take something, fork something, and start building. In this instance, that's true if you do things at very small scale. At large scale, it's not just because of the... The table stakes are so high. Yeah. But it's a good question why, at least in the research community, it is very much the case that when we talk to candidates or our friends, that there's a real...
real need for open intelligence and open science. I think a lot of people miss the days of what Google Brain used to look like about a decade ago when self-attention was being invented and all these things were being done in the open. And I think maybe there's a sort of well, you know, it is what it is kind of thing because, well, we understand these things take a lot of money to fund and, uh, you have to make money, you have to generate revenue. So it makes sense why it would be closed because for the consumer and kind of cloud API products, there's, you know, opening these up only puts you at a competitive disadvantage.
So that might be part of it. Um, But I don't understand why. There are some people who are very vocal. I'd say particularly from within the government, people close to AI policy are very vocal. Obviously, there are some members in technology that are vocal. But by and large, I think that you're right. For some reason, it... I wish there was more of kind of community banding around it vocally, because that would help us kind of change the course of things.
Speaker 2
I feel like those, I'm remembering people like Richard Stallman, Eben Moglen, who was this lawyer who used to defend a lot of the free software stuff. Um, maybe like Lawrence Lessig, another lawyer to a degree, these, these, the intellectuals who would make these arguments around free and open source software. I feel like those similar figures now are largely kind of the doomer. Um, like I'm thinking of someone like Eliezer, you know, who the people who are. Where the energy is focused really seems where that passion, that intellectual energy is really on sort of is AI going to destroy us all or not in a little bit. Maybe that has sucked some of the energy away from this other question that is like intermingled in all this a bit.
Speaker 1
That is true. The notion of AI safety is a very emotionally charged thing because, well, you can imagine a whole spectrum of issues around safety, but where your mind first goes is the Terminator instance of a super intelligence that starts manipulating you. I think that there is a notion of among some members of the safety community that the safest way to develop AI is in this very closed setting. That is certainly kind of a sentiment that exists. And I think it comes from what I disagree with in that sentiment is that typically it's never the person outside of the closed lab that is saying, we need to develop the only way to do safety is in this closed way.
It's always the researcher within the closed lab. And effectively it's saying, I will figure out safety for you. I'll be one of the hundred people in the world who has a say on how to develop these safe models. And we'll figure it out and you're welcome. Yeah. And I find that to be very frightening because safety should be something that is in public discourse and that should not be gated. Every research institution should be able to contribute to safety discourse. Yeah. And the only way to do that is if you do the science and put the models in the open. Yeah. That's the only way to ensure that there's a diverse ecosystem around safety research.
Now, the argument from a closed model lab about why you need to do safety in a closed way is that, well, the models will get powerful enough where if you release the weights, then someone will take them and wreak havoc with them. I think that that argument has weight to it. That is something that I fear as well, that Once these models become capable, reflections models or a Chinese model, and more likely it's going to be a model outside of this company, ends up getting leaked. And then you have these powerful open weights that an adversary can take and start.
Speaker 2
Yeah, it's like you just released exactly how to make a nuclear bomb. Right.
Speaker 1
Now, the thing is that This is an inevitability that I believe will happen with or without us. I believe that there are five or six Chinese labs releasing great open models. It is inevitable that someone releases a powerful open model, and that should be part of the safety discourse. What do we do then? We can't just say, will be the closed lab that we won't, as a closed lab, will ensure safety by not releasing open models. Someone else will. Even if you do very careful, kind of know your customer deployments of an open model, because open doesn't mean that you, for some set of models, it means you put the link on hugging face and they're just freely deployable. But for very powerful ones, it could mean that you have a know your customer kind of access to it in the same way that when you set up a bank, you have to go through some checks before you do that. Even in the world where that happens, someone at some point is going to put a model on their thumb drive and release it somehow. So I think we need to be thinking about safety in this more holistic sense and addressing that problem directly rather than pretending it won't happen. It won't happen.
Speaker 2
It's interesting that China went this route. Is your working assumption that there's so many open models there because it's like some asymmetric form of getting distribution because the U.S. had already established such an early start in all this. ChatGPT is this big brand. And so this is a way to get people to pick up your product. Because I remember not so long ago, people would argue to me like, AI is not going to develop in China nearly as quickly as the U.S. because the Chinese government is actually like quite afraid of it because it can't really like control fully the results. It doesn't want some intelligence that's, you know, better than the government is at things and people know that. And so that it was going to, you know, keep very tight controls on how this technology developed and perhaps actually try to slow it down. And then now we see like you mentioned, I mean, this influx of open models there. Why do you think this approach took off in China? I think that it was deeply contextualized in what was happening in the States.
Speaker 1
There was this Narrative and I would say perception that the U.S. was just light years ahead of China when it comes to artificial general intelligence. We had both the closed model frontier, but then Meta was releasing the best open models, so we also had the open model frontier and nothing even close to our technology was coming from China. And I think that there's one world where, well, Chinese companies could have built that internally. And then maybe people in China would have known, but across the globe, They would not. Part of it, I think, was the founder DNA. I think that with DeepSeek, there was kind of a special founder and team that was already making a lot of money from their high-frequency trading product.
I think part of it is that they were able to do so and had, I think, I think it was coming from a place of sincerity, of just wanting to do something good for the world. But I also think that there are geopolitical influences around, because it's not just DeepSeek, there are five such companies. that were countered to what was happening in the US in order to exert influence on the world more broadly. And in some sense, if things continue the way that they do, I think we risk a winning the battle but losing the war sort of outcome where Yes, we have great businesses running on closed models, but the open model standard gets set by China and exported everywhere.
Then there can be large businesses built on top of that, which effectively we miss out on or don't really get to influence. It reminds me of how during the internet era, companies used to get a lot of users before monetizing. That's kind of what's happening right now with open intelligence. But then once you hit scale, like Google hit scale and then started introducing ads, well, then that became one of the biggest businesses in the world.
Speaker 2
Yeah. Okay. You guys raised $2 billion, staggering some. I was just at OpenAI this week, and I won't disclose the exact figures I was seeing in these meetings. It was around their data infrastructure build-out, but just incredible amounts of money that they're intending to spend on data centers in the coming years. I'm sure you've gotten this question before. It's just how do you possibly, as a... How do you possibly keep up with these companies at this point, given how much it just seems the more compute we throw these things, the better they do, and you've got to train them, and it costs huge sums of money. Are you guys arguing at Reflection that you have such a clever... group of engineers that you can kind of do what deep seek did and have these different techniques from everybody else to get the most out of these systems and do things in a different way. Um, is that is, are you, how do you keep up? Yeah.
Speaker 1
I definitely will say, I mean, certainly there's an excellent team here and we're driving innovation along the frontier of techniques of training these things. But I think even for DeepSeek, that was not enough. That's just one aspect of what it takes to build a new frontier lab that will be competitive. I think the other aspect is you have to be embedded in a moment in time where it's strategic for you to exist and where you'll be able to survive the releases that are not at the overall frontier. Every single lab, when it gets founded, it releases models that are the first models that I've yet to see a company that released a model that was playing at the foundation model game that was at the overall frontier.
It took Anthropic three generations of models to get there. It took XAI three generations of models to get there. And so each of these companies, when they've done this, there's been a strategic reason for them to exist. And DeepSeek included. What was launched in December of 2024 was DeepSeek V3. So that was their third iteration of the model. The reason we can exist and thrive in this specific moment in time is because of the vacuum and open intelligence that exists in the West and the states in particular. There's so much demand for open models right now that they do have to be capable. There's a minimum level of capability.
You have to be competitive with the Chinese models. But you don't yet have to be competitive with the overall frontier. And so you have kind of your foot in the door in that way, because what you need to build a new frontier lab is basically the team, capital and compute, and a strategic partner. Uh, and, and a commercial opportunity that will enable you to sustain kind of the capitalization rounds. And you need all those three things to happen for a new frontier lab to be built. And I think right now is the moment in time where that's possible with open intelligence.
Speaker 2
Okay. Okay. So you, you need to stay competitive, but, but there's just such a difference in your approach that, that, um, that can be effective to some degree in and of itself.
Speaker 1
I think so. And like, when we think about the way, uh, anthropic progressed, I mean, they were a language model company, just like opening eyes, language model company. And yes, there's a focus on coding, but that was not really discovered until, um, you know, later in, in like the generations of models that were being trained, uh, there were strategic reasons that I believe, um, made kind of Anthropic possible at that time, largely because it was the only other large language model startup out there and hyperscalers are placing their bets, right? With OpenAI and Microsoft and then Amazon and Anthropic. And I think each time an intelligence lab has been built like this. It's not just a talent. The talent is just kind of a baseline. If you don't have the talent, you can't even do it. But the talent is just a baseline for getting started. And then you need these other things to come in place for something generational to come out of it.
Speaker 2
Okay. I don't know if this question's cynical or not. This is... Just when I was doing my research for the episode, I mean, it seemed like you guys... You kind of came out of stealth mode and announced your existence in 2024. And the... initial wave of stories and the way you seem to be presenting yourself was we're going to go out and create agents and and we are going to go after coding first that we're going to make a better coding agent and and then we think we think the world at least this is my interpretation was was we think There could be a variety of agents and we're going to go off and build those. And then when you announced this new funding round, there was much more of this emphasis on the open models. Yeah. Was this like, is this a cynic could look back on this and sort of be like, oh, okay. They've adopted, you know, this, this rhetoric, um, because it feels sexy and this is like a better sales pitch than, than having yet another coding agent. Um, or was this always the master plan?
Speaker 1
Building an open intelligence company. Am I right on like some of those secrets? Building an open intelligence company, um, was not the initial master plan of, of what we were doing. Uh, When we started, we were betting that there would be other providers that build good open intelligence. We started early 2024, Lama 2 had been coming out then, Mistral launched, and there's this momentum around open models. We believed someone would build it. Our bet and mission as a company was that we're going to build frontier agentic models. And when we said coding, it was always because we believed coding was just the kind of skill that you need to build just a general agentic model, because the way a model will interface with software is through code.
So our mission, and this is what we told our employees when they came in and our initial investors, both through the seed and A, is that we're building super intelligent agentic models, so frontier agentic intelligence. Two things that, one, reinforcement learning as a technology is going to be the thing that will drive that frontier of knowledge. That's how we go from chatbots to agents. And that happened. And we are one of the early companies to witness that and see those results happening internally. And the other bet that we made was that there would be powerful open models coming from the US that we'd be able to train on.
That someone else would put the bill for getting these powerful pre-trained checkpoints, and we'd be able to train on top of them. That's why we naively thought we could do this with around $100 million. What ended up happening was that the reinforcement learning and coding bet turned out to be right. We don't even really say it as much anymore because now I think it's just obvious that frontier agentic models are coding models. That's what Claude is. When we say frontier open intelligence, we mean frontier agentic intelligence. That's kind of where the world is going. But what changed was that over the last year, the best open models came from China and not from the US.
That results in a very concrete problem for companies building on top of that intelligence, is that you can't sell it. When you go to an enterprise customer and you say, look at this capability, I've driven this capability in code. They say, that's really interesting, but then they find out that you're training on top of a Chinese model, and they say, well, we'll use it for a prototype, but we can't put it in production. Our evolution was that we realized, well, you either have to find the partner that will build the open intelligence, or you have to become that company. But becoming that company requires immense amounts of capital to even have a ticket to play the game.
So we did not start as an open intelligence company because we thought someone else would do it. But we evolved into one.
Speaker 2
Okay, that's interesting. I mean, it's got to be... I guess exhilarating and challenging and scary to kind of like go back to your existing investors and other investors and be like, uh, which we're tweaking the plan and we're going to need a lot more money, but it's going to be, it's going to be more awesome.
Speaker 1
Well, the interesting thing is that from internal perspective, everyone at the company was working on setting up a frontier language model training stack and building out reinforcement learning capabilities and making these models good at coding. From that perspective, our team just continues doing what they're doing and now expanding the capabilities and bringing in full-on pre- and post-training in-house. I think that From an investor perspective, I mean, ultimately we... We are quite... I mean, we're quite transparent with our investors and the board. And we have these discussions in open, right? That's kind of we're building this thing together. And so it didn't come as a surprise to anyone that this is what needed to happen.
Speaker 2
Okay. And you were born in Russia... grew up in Israel, were educated in, in Canada, at least in part, right?
Speaker 1
Uh, not in Canada.
Speaker 2
I got that wrong, right? You went, you ended up at Berkeley university.
Speaker 1
Yeah. I lived in so many places, uh, but I was born in Russia, uh, moved to Israel as a kid, then grew up in, uh, Washington state, Washington state. Sorry. That's right. That's right. Yeah. Uh, yeah. In the desert in Washington state. Uh, And then studied physics at Yale for, and then UChicago did my PhD there for theoretical physics. actually when I saw AlphaGo realized that I needed to get into AI and, uh, then did a postdoc at Berkeley where I sort of, uh, had a, it was my kind of two year bootcamp into getting onboarded as a researcher into frontier AI.
Speaker 2
Yeah. Yeah. Peter Beals, he's influenced many people and, and, and your co-founder, um, is Greek, I think like, isn't the other cynical take it's like, why, why does a, uh, a Greek guy and a Russian-Israeli guy care about, you know, the U.S. infrastructure over the next hundred years?
Speaker 1
I actually think that one is the opposite. This country is built by immigrants. And, you know, when we think about who's the biggest proponent right now of open intelligence and exporting it, it's Jensen. And he's Taiwanese. So, right, we are immigrants. And I've actually seen, I became an American citizen sometime in college. And my family is the only part of the family that moved to the States. And I've seen what the life rollouts are like in Russia and Israel. These are both countries that are at war. Completely different lives there. And I think that immigrants coming to this country are one or two standard deviations above the median in patriotism. Like it's Really incredible what this country can do for people coming in who are willing to work hard. You get to live the American dream, which is so much more incredible than the way your life can basically roll out in another country.
Speaker 2
Yeah, no, fair enough. When you were at DeepMind and you were working on, what was it, Gemini 1.5, I think?
Speaker 1
Yeah, the first one in 1.5.
Speaker 2
Yeah. I mean, what was it like internally? I remember when DeepMind was created and Google already seemed like the AI powerhouse around whatever AI was at that time in the sense that it had all these data centers, it had It was the only company that was doing really interesting things around automated translation and some early photo image recognition type things. And then it acquired DeepMind and it felt like DeepMind had run around the world, vacuuming up all the most interesting academics. I remember sitting back kind of being like, oh, well, they've won. Nobody else even really seems to be taking this remotely as seriously. Obviously, Elon and Sam and Greg Brogman, a bunch of other people had the same idea. They're like, we have to create some kind of counter to this, but, but you know, when you were within deep mind and, and you're working on Gemini, but chat GPT is taking off and opening eyes, having this sudden rise, what was like morale like inside of the company? And, and yeah, I was, I'm always curious what that must've felt like. It just, uh, this thing sort of came out of nowhere and all of a sudden open AI was the king of the AI world.
Speaker 1
Well, each AI company has its arc. And you always want to be in the golden era. And I would say that DeepMind's golden era was probably during AlphaGo days. Just incredible, yeah. Yeah. And that was what got me into AI. I wanted to be part of that arc, the golden era arc of a frontier lab and be contributing to breakthroughs that are happening at the frontier. So when someone else Drives a frontier and it happens under your nose when everything was in your control to Be that company because all of the inventions that opening I scaled up most of them came from from Google brain and deep mind so I think that you know, I can speak to, to my morale.
It was one, it was very exciting to be contributing to frontier language model research, but it was deeply unsatisfying catching up like that. It was unsatisfying. It's one thing to catch up when, uh, the initial set of things was out of your control. Uh, but it's another thing when you could have, you should have been right. The team and company that did this. So being in a mode where you are reactive rather than leading the field and where you're no longer really aligned with the, um, initial, like with the initial mission of the company, um, Right. And there can be, you know, people can say that the company has words around its mission, around its building AGI.
But when you're on the ground and you're kind of doing the work, you kind of feel what mission you're actually, right, what mission you're actually going after. And the mission of, you know, the mission of replicating something that someone else has done is just not, um, yeah, on its own, right. It was not, it was not that inspiring. Like obviously it has to be like stepping stones, but you, but you want to be leading the field.
Speaker 2
Yeah. And so in, and how, I mean, it feels like they've corrected to some degree and they had this big run where they were rolling out such a, impressive array of products. I mean, how do you think this got corrected? I mean, it was just, it was a matter of time or there was some call to arms, you know?
Speaker 1
Well, they're producing incredible models. And I was pretty confident that is what would happen. I mean, it's still the deepest bench of AI talent in the world. I think that many people don't realize how many talented people are at DeepMind. And so when some leave, like us, there are more people that are really good. So I think that one is that the talent bench is incredible. Obviously, there's a compute advantage with being fully integrated with TPUs. And the leadership is research leadership. Demis still runs the company. The people who are really, you know, leads of the projects were, you know, a lot of them were defined very early and saw through DeepQ Networks, AlphaGo, AlphaStar, right, that the people in leadership are researchers. And I think that that is really important. So I think that what DeepMind's been able to do is pretty incredible. They're producing really good models.
Speaker 2
Temes or in then Sergei kind of comes back and starts working. I mean, are either of them sort of like rah, rah, I don't picture them as, as big, um, speech makers, but maybe I'm, um, wrong. I mean, you know, at some point I just pictured someone being like, wake up guys, let's go, you know, or maybe everyone feels this on their own.
Speaker 1
Well, I do think that, uh, I mean, they're both inspiring in their own ways, but there were, I think there were some news articles around, right. Sergey going in and actually being involved. Yeah. Like six days a week and sitting there. Yeah. Right. And that's really inspiring, right. That when the founder of one of the biggest companies in the world is coming in and spending time directly with, with the team, uh, and, and Demis is just a very strategic leader. He's a, he's, you know, he's very strategic. And I think, uh, sincere leader in his desire to build an artificial general intelligence, um, and, uh, make it beneficial. And so I think he's much more of actually a tempered like leader when, when, when people speak about AGI timelines, Demis tends to be more conservative on his. Uh, so I think that he's, uh, yeah, he's a, he, he, right. He's been doing this for now, 2010, let's be 15 years. Uh, and, uh, he's a very inspiring leader.
Speaker 2
My sense, this is not asking you to put words in his mouth. Maybe you could check my sense of reality. I mean, my sense was always, you know, DeepMind was out to create this very sophisticated... Based off the AlphaGo stuff, it was like we keep doing games... We do more and more sophisticated games. Our AI goes deeper and deeper. And at some point we create this very elegant machine that understands the real world and the game that is reality. And it's this beautiful form, this elegant form of AI. where we ended up with LLMs was something that can feel much cruder, which is you hoover up just trillions of words and you just throw immense amounts of GPUs at them and some form of intelligence bubbles up out of it that we don't fully understand. And just the more you do this, you know, there's a brute force mechanism to it that I think, um, felt a bit anathema to my sense of, of what deep mind was always pursuing. Do you, does that ring true at all? Or is that like too simple of a reduction?
Speaker 1
No, that definitely, that definitely rings true. I mean, I think that, uh, It's hard. I mean, the first thing to say is that it's hard to, you have your kind of abstract notion of how you believe intelligence should develop, and then you're surprised. So some of these things are just hard to predict. I think it was very hard for anyone to predict that language models were going to be so powerful. They were one of many things that people studied. People studied language models in NLP and computer vision and reinforcement learning, and they were just one of many things. And some people believed that they'd have these emergent capabilities, but not that many.
So I think that first, it's kind of hard to set a prescriptive vision of how you believe artificial general intelligence will develop and years in advance and for that to actually be the case. But I think that there's another point that you're making, which is, I mean, one way to put it is, There's this essay, which I'm sure you've read in a lot of, I think it's kind of the essay that's defined AI, which is the bitter lesson. And the bitter lesson basically says that the methods that we should be pursuing in artificial intelligence, the ones that will basically scale, are going to be ones that maximally leverage compute over human heuristics.
And the two ways of leveraging compute are learning and search. But fundamentally, it's a point against injecting human heuristics into a system. And people often use this bitter lesson argument to say that language models are so-called bitter lesson-pilled, that you just throw a ton of compute. But they're actually not maximally bitter lesson-pilled. And I think that's the point that some people are making, Rich Sutton included, that you inject a lot of human heuristics by doing imitation learning on the internet. And that the most bitter lesson-filled thing to do would be to figure out a method where an agent effectively learns from scratch and has no human knowledge.
It's just on its own, right, learns how to do things. And probably the best example of this was AlphaZero, right, which ended up being much more powerful than AlphaGo, but needed a lot more compute. So I still think that there's a lot of opportunity for blue sky research. It's very hard to find areas where things that are truly bitter lesson-pilled overlap with the practicalities of how much compute you have. So I think AlphaZero required so much more compute than AlphaGo to achieve roughly the same results, and then it became even better. But to get to the same point that AlphaGo had, AlphaZero required an inordinate amount of compute.
Speaker 2
Um, all right. I'm going to ask you a couple of questions, which are not, they're not terribly insightful. I think we're all battling with, with some form of these, but I'm just super curious to see where your head is at. You know, I mean, we've had this, I've been working on this open AI book for like three years and, and, you know, in the different cycles of that, um, at one point, you know, like chat GPT comes out and then it's like, oh, by the time we get to GPT five, um, the super intelligence will be here. It felt like the whole world kind of felt like that for a moment. And then, um, I think I'm like at this stage now where, um, a lot of this, I lived through the.
com boom. We were talking about this a little bit before we started recording, but some of this feels familiar to me where it's like, you know, um, this thing is going to change the world, but now it feels like it kind of oozes out over you over time, as opposed to just a moment of shock, total shock, and awe in the world has kind of changed overnight. It's feeling to me like there's tons of progress still to be made with existing techniques, applying more compute, but that we haven't had something quite quite on the order of like the transformer that pushes the field forward in a long time. I don't know.
How are you feeling? I mean, this goes back to some of the stuff we were just talking about is like, are we still, do we just keep hammering away at this and we see a clear path to whatever people want to define as super intelligence? Or are we, are we now more clear that we are elegant breakthroughs away from, from achieving that? One of the predictions that I had kind of in mind when we started the company was
Speaker 1
that I believe we were two, three years at the time away from a super intelligence. And I still believe that to be true. It's just that when we think about I think the way I might have mentioned it at the time was a jagged superintelligence. When we are seeing the progress with reinforcement learning starting to scale and starting to win IMO gold medals and these various coding competitions, And I think we're at the brink of these systems being able to contribute scientific discoveries. Maybe not huge breakthroughs yet, but there is some net new knowledge discovery, I think, that is probably happening now.
We just don't know it and soon on the horizon. So I think within narrow domains, we are within reach of a superintelligence. That's maybe not too surprising. We've had superintelligence in the game of Go and chess and so forth. But when we think about superintelligence within certain problems in physics or mathematics, you've significantly expanded. It's much less narrow than Go. These are categories that are general enough to be meaningful. Now, I don't believe we'll see a full-on super-intelligent mathematician. We'll see super-intelligence within slivers of mathematics, because each field, as we think of it, is actually a collection of many subfields.
And some language model, the current training paradigm, scales into them. Others, it doesn't scale into them yet. So I think, I stand by that we're going to be seeing a jagged superintelligence at this point very soon. I think within the next year, we'll be seeing jagged superintelligence systems. Okay.
Speaker 2
Okay. So when people are, because everyone's obviously still, they're debating in this moment, are we, you know, about to hit, is the bubble about to burst or is the bubble not even big enough for really what's going on? So, I mean, you're a little more, you're more on the optimistic camp of this. We're still... Things are going quite dramatically.
Speaker 1
I think so. I think we kind of... From the inception of the company, which is, let's say, independent of the company, it's really just AI timelines. Early 2024, the field was in a place where it's, oh, we scale these up to be good at chat. We have no idea how to make good agents out of them. It kind of seemed like this is kind of all they're going to be good at. Most people at the time actually believed that reinforcement learning doesn't work. Because it's complex, there's reward hacking. And so the belief was just keep scaling pre-training. But then basically the next generation of large pre-training runs weren't going as well as planned.
And so there's, I think, this thought that we're at a plateau. And then the reasoning models came about. And that was a binary event that happened a year ago. And from the reasoning models coming out and kind of being good at grade school math and maybe some high school math competitions, we now have these systems that are winning IMO gold medals within 12 months. And we've gone from systems that, right, maybe one way to think, to also think about it is the emergence and the disappearance of the term vibe coding. Vibe coding might refer to these systems that are sitting in your IDE and you can kind of, you know, are kind of like coding partners, but you're deeply in the loop as a human.
That's why you're kind of telling them what to do and they're kind of filling out some piece of code for you. I, I remember that kind of term kind of peaking at some point and I don't really hear it as much now. It's a quick run because these systems have been replaced by agents that now do fully autonomous chunks of work. And so now it's not really vibe coding. It's more like prescriptive coding, right? You're, you're giving them descriptions of what you want to do, and then you're kind of following them and giving them a to-do list. And that's all happened in a year. And I think that the progress is actually so fast that, uh, that we don't quite appreciate and also concerning how fast it is.
I think that it's kind of a frog boiling in water sort of situation where it's happening. Intelligence is improving at an incredible rate that is both really exciting but also alarming. And there might be, I'm not an expert in economics or anything like this, so there might be some local adjustments or something like this, but we are in a medium and long-term trend of incredible capabilities coming out of these systems.
Speaker 2
Okay. Okay. Random question. Very random. I mean, I feel like there's two giant wild cards that don't get talked about quite as much because they're more secretive, I guess, which is Ilya and John Carmack. You're at the top of the AI research circles are... people actively talking about what they may be. I feel like they're going to, one of them is just going to spring up one day and be like, surprise, motherfucker. I've built this thing. Do you guys, are people like actively trying to kind of figure out what they're up to? I don't know. I'm always fascinated that they kind of, had their big thing said you know we're off trying to do something and then have managed to stay stay underground uh i mean it's all uh i know i know you know just as much as you do on this aspect uh i mean certainly i think ssi has been quite secretive uh i think that i mean john carmack's startup they the last the last
Speaker 1
thing i saw them right was uh basically training a reinforcement learning, uh, agent that was actually embodied and using a real like life joystick to play Atari. So as opposed to, so deep Q networks, which were the first system that kind of showed deep reinforcement learning working at scale, uh, show that you could train the system to play Atari video games, but it was still kind of using, um, you know, it, it was, it wasn't using like an actual, uh, like joystick or something like this.
Speaker 2
Yeah. I remember, I went, I remember going to Rich Sutton's lab and seeing them play all these video games. So yeah, just, just the computerized version of it. Yeah.
Speaker 1
Right. And it's, I mean, I think it's really interesting, but also quite wild, uh, because it's kind of like saying, you know, what would have, like AlphaGo is also done in a purely computerized way. And so here it's kind of thinking about not just like the thing that thinks, but also the robot, also the robot that moves the pieces. Yeah. Right. So, um, I mean, that's the last thing I saw come out of there. And I think it's, I, I mean, I think it's really good to have, um, people pursuing ideas outside of this paradigm because we are, it is actually not a maximally bitter, less entailed paradigm. They're probably better paradigms. Uh, and I think it's, great that there are some people pursuing the more blue sky research, probably it'd be better if there was more, um, if there are more opportunities for that, because I kind of think that language models sort of sucked the air out of the room for other things.
Speaker 2
Yeah. I mean, you get kind of too focused on one. I mean, I guess that was John's sort of bet. Um, the in like robotics, I mean, same thing. I, I always get excited and then I get let down. Um, All this money has been poured in to creating models now for robotics. Do you, do you have a intuitive sense on, on if you think we finally cracks the code and they, and they really, you know, become much more sophisticated than we had expected.
Speaker 1
Well, I was a robotics AI researcher in Peter Abil's lab. And I remember the reason I, there was a paper where after that paper, I was like, you know, maybe I should just focus on the intelligence problem alone because robotics is kind of hardware and intelligence, right? It's kind of, you have these two problems that you're trying to solve. But my anecdote there was that I was advising a couple of students who, this was during COVID, so they took the robots back home to their apartments. And they collected data overnight. And then during the next day and for a week or two, they were trying to understand why they collected data and trained the robot.
And it works at some times, but it doesn't work another time. So what's going on? It turned out that they collected the data at night, but were evaluating the robot during the day. There was a data mismatch. By the way, what they decided to do with that problem is to basically become nocturnal and sleep during the day. I advise them otherwise. That experience made me think about, well, It'd be much better, like there's so many problems to solve and just the intelligence side that is there a more, is there a way where you can kind of take all the other hard things out and just focus on intelligence?
So that got me thinking about digital intelligence, but seeing the progress from then to now in robotics, it has also been tremendous. I mean, probably not as tremendous as what happened with large language models, just because that was, I mean, I think really took the world by storm, but I'm very excited about what's happening in robotics. I kind of think that locomotion, just the ability to walk around in a generalized way, is solved, which was not at all the case then. So there's probably a pretty significant overhang of capabilities there. I think integrating them into real-world settings is tough, so that's a challenge.
I would say the last frontier is manipulation, but the amount of progress being made in robotics has actually been pretty incredible as well. Deep learning, the field is not large language models, it's deep learning. Deep learning lifts all tides, and I've seen that everywhere.
Speaker 2
Some of the stuff I see is awesome. I've been covering all these robot fights, and so I've been watching tons of videos. I know we used to always have the Boston Dynamics videos of the dogs doing all kinds of things, and then people would kind of question how... Much was scripted and all that, but, you know, I see these humanoids flipping, getting pushed over, jumping up and all that, but then I get excited and then I get really depressed because, you know, figure it comes out and it's like the robot's still folding a shirt and we're
Speaker 1
like...
Speaker 2
You know, I go into these other labs and it's full of these arms, you know, opening and closing a microwave door over and over again. I was like, man, I thought we were doing that like 12 years ago. Like this is still the frontier of what's going on. And so I keep getting excited and then I see that and I'm like, Oh, I don't know. Maybe we're not, we haven't got there, but then kind of like you're talking about it with, with China. I'm not like a huge China fear monger. I mean, I, I, um, like you, I'm an immigrant. I appreciate the United States and all the opportunity. I wish China and U S cause there's like kind of, um, similar things down at times.
I feel like we've got like a lot more in common than, than not. Um, but. when I see, like you're talking, I took this trip to Shenzhen and I went to DJI and it was while I was there, it was DJI had destroyed all the US robotics drone companies. And then, you know, I was kind of like, man, how does this, how does it like keep advancing? Like what, they're just so dominant. And then I realized, oh, they have like, five competitors down the street from them who are like the second dji put something out it's like they're chinese competitors like steal the design make it cheaper and then dji responds to that and it's like their ceo is just relentless you know it's just like a way of life and so i see that now with the humanoid companies there's like 12 or 16 chinese companies that i think are going to sharpen each other more than like the U S competition will.
And then when I think about what you're talking about with these, these open models, and then it's very long winded sort of thought, but. the thing I like about the humanoids really is that instantiation of AI in something. And it feels very powerful to me. And I don't know when I, now I'm just adding all this up in my head. I mean, you could see a scenario where China does reach some kind of escape velocity compared to everywhere else, because it's able to meld the software side and the hardware side and, and, and all this, um,
Speaker 1
Yeah.
Speaker 2
Companies pushing each other, um, in a way that I'm just not sure the U S is like fully wired right now in the same, same way. I don't even know that's a question.
Speaker 1
No, it's... Well, it's... There is a question within there. And, I mean, one thing that is... Like, all this stuff is interconnected. And the humanoid... The humanoid companies... I mean, a lot of that is done with currently pretty small neural networks. Or, you know, sometimes it's not even... deep learning necessarily even though that's become more and more the case uh that deep learning is kind of taking over um the kind of locomotion and on robotics but their brains are going to be powered by open models they're going to be open like the things that these language models and foundation models like when i think about multimodal right they can see and they can think right they endow them with reasoning abilities And so these are the kinds of companies that are going to be building on top of open models.
And certainly, if the greatest open models are coming from China, they'll have basically the full stack kind of vertical advantage. And I'm not really... I'm not really fear-mongering kind of around China either. I think that actually what's happened with the open models that come out of there was a net positive for the world because otherwise I think what would have happened in the States is a very likely concentration of AI development and just closed labs and no incentive to really do anything else about it. But we have to understand that we are in a world that has two poles that can emanate the most powerful technology of our time.
It's America and China. I don't think that there's any other region in the world that has the talent, capital, infrastructure to really build these things. And it has to be balanced. You have to have great models coming from both places. It's amazing.
Speaker 2
If Russia could ever get their... act together on many fronts. They could have been a... I mean, there's so many brilliant Russian mathematicians and physicists and computer scientists. I'm sure they could have also played here.
Speaker 1
Well, they were a powerhouse in theoretical mathematics and in physics. And that's because in the Soviet Union, all you needed was pencil and paper. Yeah, and just an incredible education system.
Speaker 2
Well, I want to be respectful of your time. Thank you so much for joining us. I know I don't think... If I remember right, you guys haven't quite, it's like next year where you're coming with really debuting and showing your technology for the first time. Is that right? And what should people expect from Reflection in the coming months?
Speaker 1
So, right, the capital enables us to set up large-scale training runs to build these models, which takes some time. We are an open intelligence and open science company, and so people should expect us to be releasing artifacts and findings and basically research that we think is interesting, that we think that it'd be useful if other people know about it as well, kind of the internals of how Frontier Lab gets built. We'll be releasing those along the way and leading up to the model.
Speaker 2
Okay. And you guys, I think you've been based in New York. Are you moving? Where will the company be centered? So the company actually has three locations in San Francisco, New York, and London.
Speaker 1
Okay. And the reason is that that's how when we were at DeepMind, a lot of kind of AI talent was actually distributed across these three areas. And so that's kind of how we set the company up. Our largest presence is actually going to be in NSF because you can just kind of follow the sort of distribution of talent that Yeah, no, it's just when I saw New York a budge, I was like, man, this is going to be tough. Yeah. I'm here. I live in SF. We have a great team here and, you know, great team in like, in both the other locations as well. So we, and we actually kind of, you know, fly in people to spend time together between the various locations. Yeah.
Speaker 2
Super nerdy. Last question, only because I'm a, I am a historic open source dork. I mean, I think DeepSeek released their weights under the MIT license. Is that what, what are, do you guys know what you'll do? Cheryl, there's like 10 people that care about this or maybe more?
Speaker 1
Yeah. Well, I think that the spirit of it is that you want to have a kind of, you know, for the majority of your models, right? You want to have a fully permissive open license that people can do research and use for commercial use freely. Now, whether it's MIT or Apache 2 or something else, right, there's some regulation that's coming in around various aspects of model training. And so that might, maybe some new versions of like the MIT or Apache 2 style license will be brought to fruition. But the intention is very much, right, you're releasing open models for research and commercial purposes that they're fully free. Now, there are going to be a set of models that might be trained on data that is industry-specific. There's going to be a set of models that are probably dual-licensed where it's free for research, but we need to set up a license to kind of use them. But by and large, most of the models will be kind of fully permissive. We want people to just not think about it, take it and use it. That's our intention. Okay, okay.
Speaker 2
All right. Well, thank you so much for joining us. Really appreciate it. It was the first time we met. It was really cool. I look forward to following what you guys do. I think, yeah, this stuff is like I'm an Android user. I get made fun of all the time. But, I mean, I do actually do it because it's open source. Yeah, there are dozens of us. I mean, you're right. There's like a billion, you know, but we get so much grief among people. among the Silicon Valley crowds. But yeah, it's always been near, dear to my heart. Got a Linux desktop. So anyway, I'm into what you guys are doing.
Speaker 1
Yeah, well, thank you for having me, Ashley.
Speaker 2
This was fun. All right, man. Thanks. core memory podcast is hosted by me ashley vance it is produced by david nicholson and me our theme song is by james mercer and john sortland and the show is edited by the john sortland thanks as always to brex Ventures, for making this possible. Please visit our Substack YouTube and podcast channels to get more of what Core Memory makes. Thanks, y'all.