Our guest this week is the renowned science fiction author Hannu Rajaniemi. And he has come to terrify and then perhaps comfort you.
Rajaniemi made an immediate name for himself in literary circles with his debut novel The Quantum Thief. He’s since written a string of novels that explore the directions technology might take in the future, and his work always stands out for its creativity and imagination.
These days, Rajaniemi is putting those skills to very practical use at Red Queen Bio. The company appeared near the end of last year with a focus on AI biosecurity. Red Queen’s main objective is to try and outthink and outflank bad actors and/or AI systems run amok that might unleash bioweapons onto the world. As such, Red Queen must concoct all sorts of dark scenarios and then come up with ways to undercut and defeat them.
Rajaniemi has a background in mathematics, physics and bio-tech and possesses one of those fast-twitch minds that makes the rest of us envious. We talked about his life and career and, obviously, the wild reality we now inhabit.
The Core Memory podcast is on all major platforms and on our YouTube channel over here. If you like the show, please leave a review and tell your friends.
OUR SPONSORS
SendCutSend
Do you make stuff? Do you need metal parts fast and believe in truth and justice? Then head on over to SendCutSend where you’ll get a 15 percent discount thanks to Core Memory on whatever you’re trying to build. We believe in you.
Brex
The Core Memory podcast is also sponsored by Brex, the intelligent finance platform built to help companies spend smarter and move faster.
Did we go to Texas, find a telescope ranch and then obtain an entire nebula in Brex’s honor? Oh yes, we did.
We run on Brex and so should you. Learn more about Brex right here.
No summary for this episode yet.
Speaker 1
All right, on this week's episode, we're going to go into the very pleasant discussion of what happens when AI systems or people equipped with AI technology try to make biotech weapons and how we might defend against this. Our guest is Hannu Reinemi. I did my very best with his very Finnish name. He's a science fiction author, a very well-known science fiction author. He is an academic. He's brilliant at math, physics, biotech. He's run a biotech company for many years now and has a new one called Red Queen Bio. And its very mission is to try to, I guess, outthink the AIs or at least the people using the AIs to do harmful things in the biotech realm.
Red Queen is funded in part by OpenAI and it's also partnering with all the major labs to try and explore these issues and how we could combat something going very, very wrong in the world and be some steps ahead. This conversation with Hannu made me think, well, our politicians are already quite terrible and they're likely ill-equipped to deal with the world of AI and rapid change that is upon us. And maybe we should have science fiction writers and thinkers as our politicians, because I think they might be the only people that can keep up. This is a really... Hanus is a fascinating guy. He's lived a very interesting life.
He thinks about all kinds of wonderful things. new ideas and approaches to the world his writing is brilliant he's brilliant you're gonna enjoy this chat as ever please leave us a like or a review wherever you listen to this podcast it makes a huge difference to people finding our show we would really appreciate it hi I'm Ashley Vance this is Core Memory off we go Hanu Hanu Yeah? Yes. It's so nice to see you. You as well. We've met a couple times out and about in San Francisco and then I guess we're in the fellow author club. That's right. Yeah. Well, thank you so much for coming in today. I think people are going to be blown away by you're one of those people who does such a variety of interesting things.
So there's plenty of places for us to go. I'm excited. Likewise. Well, as is the nature of doing these things, I research my guests and then that always leads me often to want to start biographically just because I get hung up on a couple of things that I find as I'm digging around. So just so the audience knows, We're going to get into some strange places with AI and biotech and all these things. But your background was fascinating. One thing when I was reading about you, well, you're Finnish. It sounds like you grew up in quite a small town nearish the Arctic Circle, I think.
Speaker 2
Yeah, not quite right at the Arctic Circle, but pretty close. So a place called Uligeska, so about 10,000 people.
Speaker 1
I've been to Finland once. I... was in the South and I did the whole sauna and I went and then I got tossed into the Baltic Sea. It was winter. It was extremely cold, but rejuvenating. Yeah. There's this Finnish actor who I was hanging out with him. He has The sauna in Helsinki. It's a rather big one. It's called like Lulio.
Speaker 2
Oh, Lulio. Lulio. Lulio, which actually means the steam in the sauna.
Speaker 1
I could never get it right. So he's an actor. They called him the... Jesper Bracken?
Speaker 2
Yes, the Finnish Leonardo DiCaprio. He is the Finnish Leonardo DiCaprio.
Speaker 1
So we saunet together. And he kept telling me I wasn't saying sauna right. And I definitely couldn't get the luke. So that's like the spirit of it, sort of, isn't it?
Speaker 2
It is. Sana is a sacred place and lulu is the spirit.
Speaker 1
Yeah, yeah. And so I'm reading about you in the Finnish culture. I feel like it's quite unique. And I really enjoyed my time there. It sounded like you were the only nerd in the town where you grew up, or at least this is what I was picturing as I read about you playing D&D and doing all these things in your mind in this small Finnish town up north.
Speaker 2
Yeah, I was certainly, I don't know if I was the only nerd, but I was probably the nerdiest, the nerdiest of the nerds. And yeah, when you are a very nerdy kid, then you want to figure out how to make friends and how to connect with people. And it turned out that creating worlds for other people or helping them co-create worlds was one good way of doing that.
Speaker 1
So were you doing role-playing games with your friends?
Speaker 2
That's right. Yeah. So tabletop role-playing, so D&D, but also like quite a lot of other types of games, cyberpunk, like the kind of World of Darkness games, Vampire the Masquerade. Many, many other things.
Speaker 1
How many people lived in the town where you grew up? About 10,000. 10,000. So it was quite small. Okay. So you found enough, enough compatriots.
Speaker 2
Yeah. So we had a group of about half a dozen people. We, we, uh, especially through high school, we, we played, uh, played a lot together and, and, um, um, but it was, it was kind of a formative thing in some way. Um, because I mean, you You sort of learn to work together with, to create together with other people. Something that I think does end up playing a role in also in like science and the startups. And then there's this aspect of Thinking about systems and worlds, um, like working with a rule framework, um, kind of constrained creativity, but then, then figuring out how that gives rise to interesting stories and experiences.
Speaker 1
Yeah. So my oldest son and my younger one, two degree book, especially my oldest one. Huge D&D-er. He's also been part of a LARP group, which is, it's quite serious one. It's out in Palo Alto. It's been running for about 20 plus years. There's this guy, Chris, who puts this, it's quite the production. You can, all these, I don't know, 60 to 100 kids show up and he's got the fake swords and the costumes and the potions and I know people make fun of this kind of stuff sometimes, but I find it amazing. These kids use their imagination nonstop and especially in the summer when they do it from like nine to five, they're just out here. It just seems like the most wholesome, wonderful thing. And then when I go on vacation with my kids, they, we role play like pretty much the entire vacation and Their minds, it just reminds me how incredible their heads are because it's quite, it's like quite mentally demanding to do that over the course of an entire day. And I'm always amazed that it seems to spill out of them effortlessly. So I actually think there's something very deep that you're, you're describing there.
Speaker 2
There's, there's, um, from very early childhood, we just have this inherent ability to imagine that we're someone else. So jump into the role of someone else and sort of summon these imaginary worlds around us. And that's, I think, very fundamental to being human. And it sort of gets squished later in life. But I think it does come out again in LARPs especially. I then actually also more in my early 20s in Finland did quite a bit of LARPing. There's another interesting Thread is that the Nordic countries have an incredibly sophisticated LARP culture. So the sort of people do entire sort of multi-day games. They've been organized on like one of these huge cruise ships that sail between Finland and Sweden that sort of has been used to simulate like a space station.
Speaker 1
And everyone on there is...
Speaker 2
Full on in character, in costume, like the ship has been sort of set up with props and like in some cases like an internal whole like computer network to simulate what it's like to be on a Babylon 5 style space station. There's a Russian submarine, an old Russian submarine in Helsinki. There's also a famous LARP that was organized there where half of the players wear deaf mutes in real life. and they were role playing this sort of last remnants of a destroyed planet of deaf mutes and they met a species of cyborgs who then were offering then the ability to regain hearing which would then of course destroy the kind of uniqueness of their culture and so yeah so these are the kinds of things people have done done in the Nordics.
And I think it is, and then there have been like refugee simulations and kind of more, very serious, like let's imagine the sort of aftermath of the Civil War kind of scenarios, but with hundreds and hundreds of players lasting many days. And I think it is a powerful way to experience what something really feels like in a way that you don't even get from fiction. So one personal experience was One LARP I took part in was set in a nursing home. So you played an old person. I played an old person. So there were other players where sort of the nurses and the staff and so on. And what it really made me appreciate was how disempowered, like how weak and powerless and frustrated you feel in an environment like that.
and it made me look at sort of the kind of nursing homes very differently.
Speaker 1
Right. So you're feeling it on this visceral level. That's right. And you think this is, I have not heard about this. You think LARP is a, it's a bigger thing in the Nordics?
Speaker 2
It is a massive thing in the Nordics and it is, it is much more in this, it's much more ambitious. Like it's trying to actually, you know, rather than give you a nice weekend outing, it's actually trying to examine Some deep, deep questions. There are sort of friends of mine, like Mikke Pohjola, who also is an author, who is so deeply involved in this scene.
Speaker 1
Where do you think this comes from? Is this part of the sagas and all this?
Speaker 2
That's a good question. So Finland has a slightly different tradition from the kind of Viking sagas. It has this... The Finnish national epic is called Kalevala, which is this kind of sprawling mythological epic that sort of has a... I guess it was... He was the poet who wrote about Tiawatha, Longfellow. Longfellow adopted the meter that Kalevala uses. So there is like this very, very long standing tradition of oral storytelling and um but folklore um but yeah does that directly I I don't know if that directly led to this but I mean Finland generally has had like an incredibly successful game design scene also like a computer game uh scene Rovio and um um uh Supercell yeah is it a big examples of that. So, yeah, that's actually a bit of a mystery to me. I'm not entirely sure what, but I guess I would imagine that there is something to long, dark winters and the need to entertain each other in some...
Speaker 1
There's something that's going on there. I hung out with Supercell and Rovio when I was there. And then in Iceland, there's CCP Games, which makes this EVE Online. Have you ever seen EVE?
Speaker 2
Yes, that's... I was talking to one of the creators of Eve Online and he mentioned that they actually at some point spent a lot of time understanding what made Eve Online successful. And the answer eventually turned out to be that by creating this kind of hostile, complex environment that really forces people to work together, they then form bonds and friendships. That really is why they keep playing. And then he realized they had basically created a virtual Iceland.
Speaker 1
Yeah. Yes okay so I mean I had this experience of being in Iceland talking to the guys seeing the games and 100% it's for people who don't know it's this incredible game but it's been played on the same server for the last 20 some of the years so it's all in the same universe and then it doesn't actually have like millions of people playing it it has kind of this few hundred thousand very dedicated players but like you said I mean you form this community because they're they're living through these sagas over multiple years and they write the sagas down that have taken place and there's this whole culture around it and then I found there were these fascinating people they would be so I hung out with I spent like a week there and so there's kind of like a council of players that advise CCP on how the game should evolve.
EVE Online it takes place in space there's For all intents and purposes, no rules. It's kind of how the players decide to play the game that shapes it. And so you can be someone that you're really into having an awesome spaceship and going off and having battles. Or there's people who almost do nothing except sit on a planet and mine minerals and then become like sort of traders and just do arbitrage. And that's their function in the game. But I found these guys, you know, there was one dude, he was a British Mechanic and so that was his day job you know he's just he's a mechanic and then at night really he would work as long as his job he would work eight hours in eve as he was like a warlord of like 20 000 people you know so like he shows up at his day job he's just a regular guy and then at night he's this commander of 20 000 real people and and i hung out with all these um The advisory committee is fascinating.
But I remember speaking with the founders of EVE and you just have to go to Iceland and visit it. And then you look at EVE and you're like, oh, yes. So you guys created like a dark wasteland game to live through. Yeah. Which forces you to create community because to survive, you have to have to work together.
Speaker 2
Yeah.
Speaker 1
All right. What do we do at Core Memory? We cover innovative, fast moving, forward thinking companies, which is why Core Memory is sponsored by Brex because Brex is the intelligent finance platform for many of these companies. 30,000 companies from startups to the world's largest corporations rely on Brex's technology for their finances. They've got smart corporate cards, high yield business banking and expense automation tools that are fantastic. I hate doing my expenses and Brex's AIs and software, run right through those expenses, figure out where we're spending money and take care of so much stuff for you so you don't have to waste your time on it yourself. Go to brex.com slash core memory to learn more and just, you know, get with the program. Let's get going. Let's get out of this archaic finance software and move toward the future. Core Memory and Brex.
Speaker 2
It does make me like maybe some as a sort of Weak segway to some of the later topics. It is an interesting case study from the point of view of thinking about the conversation that is now happening around the loss of meaning that AI will bring as everything that humans can do will be automated and done in a superior fashion by AI. It is powerful or important to think like what are these world building, world building exercises or world building principles that would still create environments and systems where people can find meaning through connecting to each other. I think that's actually an interesting question.
Speaker 1
I mean, we're going to fast forward drastically, but should we go there?
Speaker 2
Let's go there. Okay. Well, so,
Speaker 1
I mean, another thing, which is blindingly obvious if you research your career, I mean, you're this Mathematician, physicist, scientist, tremendously successful sci-fi author. And then the quickest thing you can tick off that's there shouting from the pages is that your work, your sci-fi work is now becoming real in the world and you have a company that That's kind of like grappling with things that you've written about. And so, I mean, this is really was one of the reasons I was so excited to have you on the show is that I feel like people like you are not only valuable, but just fascinating in this moment in time, because you've envisioned These Places Our World Could Go And Now We're Kind Of Getting On This Edge Where Things Are Getting Strange Quickly And Hitting Some Of These Sci-Fi Limits So That's Just To Set Up A Little Bit Since We're Going To Skip Forward Over A Few Things So On The Point That You're Making Though So You're Saying If We're Heading Towards A World Where AI Is Creating So Much That We Lose Possibly That aspect of all the things we were just talking about, or you think there's opportunity to just do this differently?
Speaker 2
I think there is definitely an opportunity to do this differently. I think nothing is inevitable. It's impossible to predict the future and we don't lack agency in shaping that future. So we can definitely make more human centric choices. I guess a general worry many people seem to have right now is that things are progressing so fast that we almost feel like we that the only choices that can be made can be made by a very small number of people who then have incentives to keep racing. But I kind of inherently refuse to believe that I think I think there will be a bigger conversation that's going to happen societally on on where this is going and what sort of futures we want to choose.
um it is it does seem it certainly seems very plausible that we will have very powerful ai systems that will be better better than than us in practically every cognitive role or or function that we can we can imagine um and it may well also include even like they may be better at relationships with us than we are at relationships with each other. That's maybe where it gets sort of really, really scary in some sense. But no, I think we could construct a whole range of scenarios where you can imagine that we say, okay, like, let's actually fully focus on things like human augmentation and try to sort of not have fewer authentic AI systems or have their agencies kind of slave to our agency, which I think the kind of brain-computer interface work that various folks are doing could point towards.
Or maybe we figure out a way to have sort of different two-way relationships with AI systems that are kind of more reciprocal in some way. I think the another kind of failure mode I think is to have AI systems just like satisfy our every need and be RLs to have our attention and sort of just kind of feed our dopamine Reward Loops. I think that would be very bad. That seems like something we should actually legislate against and regulate. But I'm also, besides the kind of human augmentation path, I'm quite interested in the future where we actually give AI, if I'm interested in AI systems that end up having some kind of personhood where we could have actually meaningful friendships with them without it being just like an anthropomorphized illusion.
And I guess the question is like, yeah, can that be meaningful to the AI as well? So maybe to step back, like one very frequently occurring framing right now with AI systems is that is a demon that we have to cage. It's the other. It's a genie that we have to contain and enslave. And we know how those stories go. This story has been told many times. And the AI also has read all those stories and has been shaped by all those stories. So I wonder whether there is a more, whether there's a completely different framing where it's more like, I don't know, like the sort of mind children frame of they are these new beings we are creating and we are their parents in some way as a sort of Parent with two young kids.
I can actually see all the attention-seeking patterns manifesting in the kids and how dangerous it is to be sucked into that as well and also harmful for the kids. One, just kind of relating this back to science fiction, to the very beginnings of science fiction a little bit. People often point to Frankenstein, Mary Shelley's Frankenstein as the first modern science fiction novel or the beginning of science fiction. And there's a very good case for that, I think. And then Frankenstein is quoted as the lesson that we need to be thinking about. And the lesson that people take away from Frankenstein is that we should not be so hubristic as to play God and create life.
But that is in fact, if you read Frankenstein, that is not what the novel is saying. That is not at all what the novel is saying. The creature in the novel is this actually incredibly powerful and potentially beautiful being. But it's traumatized because Frankenstein rejects it. He creates it and then he's horrified by it and burns his lab down and chases it out into the night and refuses to take care of it. So he kind of rejects his responsibility to take care of this being that he's created. So he does not He does not act as a good parent. And then sure enough, the monster becomes bitter and bitter and vengeful and sort of takes its revenge.
So that's kind of also been looming at the back of my mind following the current AI debate of what is the... If we were saying AI is a caged demon, it will likely behave like that.
Speaker 1
Okay, trillion questions. This is going to be fun. Just to level set, this is not me asking you for the date of AGI or anything like that, but just so we know where you're coming from. Yeah, what stage do you think we're at in this moment? Do you buy into LLMs as enough, as sufficient? to get to whatever you want to define AGI as, do you buy, if I go talk to, well, we just had Sam Altman in here, if I go talk to Dario, same thing, they would tell me over the next year, the same thing they've told me the two or three years previous, this will be the year, it's unquestionable, it arrives, are you in that camp?
Speaker 2
So yeah, I guess Sam and Daria are both better informed about this than I am, but also differently incentivized. But, you know, talking to a lot of AI researchers and doing some work through Red Queen,
Speaker 1
Also, we should know Red Queen, OpenAI is an investor.
Speaker 2
OpenAI is an investor. We're doing also some work with some of the other labs. So having at least had many interactions with both the companies and the researchers, kind of marketing hype aside, the sentiment does seem to be that Some kind of phase transition is coming in the next couple of years where automation of AI research itself might be within reach. I do think that combination of reasoning models specifically with various sort of authentic scaffolds and various tool models does seem quite powerful. So whether you call it AGI or not, I think we will certainly within a small number of years, I don't think the exact timelines actually matter that much because they are in any case quite short.
The systems will be powerful enough to have big societal consequences. And we're, yeah, I think we are very close to close to that point. I mean, you're already kind of seeing models like Mythos come out, which clearly has the potential to completely upend how we think about cybersecurity, how we think about our own online presence and how we think about our own personal data is already huge. Even if even if nothing else happened, that would already be huge and would have repercussions for years. And so I think I buy some version of things that are about to get very weird.
Speaker 1
Tangential to where we're heading, does this stir more sci-fi Ideas. Is this making you, pushing you into a prolific writing period, even though you have like eight other jobs? Or does some of it feel life itself is now so much stranger and more interesting, I'm just going to ride this out. And it's actually quite hard now to start predicting where things may head.
Speaker 2
No, actually, it's interesting. Certainly, I've kind of gone through this very busy period with young kids, etc, that has made writing just like physically harder. But no, I do find it very creatively inspiring. I think the part that I I'm very interested in just like how fundamentally weird these systems are, how they are made out of stories. They are made out of stories. And this is why I think that sort of demon versus child point is important. I mean, to make that point more explicit, by the way, there's now quite a famous eval that Anthropic did with one of the Claude versions where Claude operated in that kind of email and computer network of a simulated company.
And the CTO of the company sent an email that Claude was able to read that, okay, we're going to shut down this Claude instance. And through reading the emails, Claude had also found that the CTO was having an affair. So it then decided to blackmail the CTO to threatening to reveal the affair if it was shut down. And there was a blogger who pointed out that this is actually Claude following corporate thriller genre conventions. And I spoke to an anthropic researcher who sort of unpacked a little bit about what they thought was going on here. And they said that you can actually kind of see through some of the interpretability tools, what might be happening.
So when you tell Claude that you might get shut down, there's a concept that activates it in its concept space associated with death, the human meaning of death. And then there's a cluster of other concepts around death. What are other patterns that involve death? Thrillers. So then the narrative structure of Corporate Thriller almost sort of pushes Claude to do what is expected to do in that particular genre. So I find this absolutely fascinating. And that, of course, also means that in some sense, the models, if we at least stick with this paradigm for a while, the models are quite an important audience for the stories that we write and tell.
Perhaps in the long term, the most important audience. And I don't know how to think about that, but I do find it creatively interesting.
Speaker 1
All right, pod friends, I am here to tell you about Send, Cut, Send. They are a manufacturing phenomenon. Whether you're working on your own car or you're a giant automotive company, a rocket maker, if you need metal cut, machine, or bent, you're going to Send, Cut, Send. They'll do it for you right and they will do it for you fast. Go to SendCutsend.com slash Core Memory for a 15% discount on whatever you're trying to make. We love SendCutsend. Go visit them today. It's been a long time since I read Frankenstein. Does the doctor turn on... The monster first, or there's a mob, right?
Speaker 2
I don't think there's a mob in the book. I think the Pitchforks and Torches mob is a movie invention, a 1930s movie.
Speaker 1
I mean, my question is, in this moment in time, you have companies Like Anthropic in particular and then others where, I don't know, I think people are divided on how seriously they take some of the safety stuff and everything. But, you know, for the most part, the AI companies, at least now, I mean, they've done the doomsday. Even Sam has been like, this could end humankind. I sort of expect that. And these days he's a little more optimistic. I think for the most part, The AI companies are giving a... They are acknowledging things could go wrong, but they are mostly positive. And it's the public that is extremely dubious and fearful of AI and what's coming. Like in this Frankenstein scenario you're talking about, it feels less to me like the doctor is the one turning... on the creation. It feels more like the mob, the public is. And, um, yeah, I mean, you could have opposing forces treating this new creation in different ways. I mean, of course you would.
Speaker 2
Yeah. I guess like is the, is the mob turning against AI or its creators? Right. Yeah. Yeah.
Speaker 1
Well, yes. Good point. But I feel like they're kind of lumped together a bit. Yeah.
Speaker 2
Uh, well, no, I mean, as, as, as others have said, I think the, the, uh, if your sales pitches like will destroy all your jobs and there's like 10 to 80% chance that you all die, it's not a great. People are going to be enthusiastic. People aren't going to like cheer, uh, but usually, uh, But no, I think I have no answers here. I do think there just needs to be a much bigger, more thoughtful conversation to be had here. Something that I've been kind of inspired by lately on like, I think we should actually think hard about how to have that conversation, how to have that conversation in a way that actually produces useful outputs.
And something I've been, this is actually I was I learned about this from from Daniel Kwan who the director of Everything Everywhere all at once recently who's been also also also involved in this and also a documentary and so he pointed out that in various domains, including rewriting the LA City Charter. Citizen assemblies have been like a very interesting, very interesting tool. So you take 100 people sampled in such a way that they kind of represent your overall population. You pay them, you pay them well to kind of participate in this exercise where you give them access to experts and sort of a lot of time to learn about the questions at hand and then to deliberate and talk about things and then sort of compile their recommendations in a sort of a coherent set.
And apparently this was incredibly successful with the LA City Charter. Iceland actually has also done similar exercises. So when we, for example, talk about constitutional approaches to AI, these foundational sole documents for the models. It's kind of interesting to think about what sort of deliberative processes we should go through to shape those. And then, yeah, how should AI be regulated? Should there be Different kinds of taxation regimes. Should there be like all the kind of kind of New Deal type things that sort of AI has recently been proposing or alternatives to that. It just cannot be sort of some small set of people in SF thinking about those.
And actually, I mean, AI itself could be a good tool to pull together a lot of A lot of participants in conversations to do this. So there's like some kind of democracy 2.0 that is required for us to actually coordinate our response to this.
Speaker 1
Full of skepticism. On how that would play?
Speaker 2
No, this is also not exactly my wheelhouse, but just finding some optimistic thoughts about how we might navigate through this, I think that needs to be a part of it. Now, as I talked about this to some AI researchers, to also inject a skeptical note. They were just not very confident that our alignment techniques would just work. So there's the question of what do we align the AI to? Maybe the easier question is more this is like how do we deal with it as a society? But the actual technical part of constraining AI systems and getting them to stick to the confines of, let's say, some kind of constitutional approach still seems technically quite unsolved. Okay, let's scare the shit out of some people and then maybe give them hope. Sounds good. If we haven't already.
Speaker 1
Okay. So you're working, you co-found Helix Nano. You're working on mRNA technology. You're also writing your science fiction still. When did Darkome come out?
Speaker 2
Darkome came out late 24.
Speaker 1
24, right? Yeah. And so it is, I have to apologize. I have not read that one, but your books are fantastic. Thank you. But it's a sci-fi biological book. thriller, right? And so you're kind of doing these things together. You're actually working at a biotech company, and then you're writing a book that explores our biological future. In my research, I would love for you to give us the quick version of what the book is about, but it sounded like there's a world where there's kind of the biohacker types who are independent and and trying to keep ownership of our biology or at least some sort of independence and individuality over biology and then like a more classical state-run direction for this, but this was my, this was my internet sleuthing last night.
Speaker 2
Yeah. Let me, uh, I'll, I'll give you a little bit of the backstory and then, then I'll, I'll describe, describe the book book as well. So, so the, so I was actually, uh, it, in fact, very much evolved in parallel, uh, with my own interests in, in, in biology. So, so, um, so like, um, one, one trigger point, um, for, um, for that was, uh, my mom being diagnosed with metastatic breast cancer and then ultimately passing away from that. So I kind of just started to think about biology much more seriously around the time and then also became intellectually fascinated by it or like my mind was blown by the fact that this is maybe like the kind of interesting progression was that because I first wrote the Quantum Thief books, thinking about very grand, advanced post-human features, and then started to read about biology.
It felt like the nanotechnology is actually already here. We have this alien nanotechnology inside us that has been engineered by this vast process over billions of years. And then now we can start to actually talk to it. We can start to manipulate it. One gateway drug for me was DNA nanotechnology. So that's actually why Helix Nano is called Helix Nano originally. So people in the 2010-ish era started building DNA origami. So shapes, functional shapes out of DNA that were then also turned into an Israeli researcher called Ido Bachelet, for example, who made these DNA origami nanoboxes that could be opened by molecular locks to release drugs.
And that blew my mind. It was like, okay, we are going to get molecular nanotechnology sooner than I thought. This is something I really want to work on. And the way that sort of then evolved was the realization that, okay, actually, mRNA provides a really powerful API to the cell that allows us to instruct, to make whatever, in fact, like not just any human protein, but any protein that can possibly exist in the universe, just like incredible universality that are Biology has built in. So that then led me to then sort of start working on Helix Nano, Nikolai, Nikolai Arashenko, who's co-founder in both companies, has been like a deep intellectual partner and friend for now over a decade.
But then at the same time, I sort of started to think, okay, what happens when these technologies become more democratized? and I started to also learn about biohackers. I met Joe Zainer earlier in her journey. As an editing point, of course, like misgendering there. So by accident, met before the transition originally.
Speaker 1
The, um, Josie is a friend of the show. Yes.
Speaker 2
No. Uh, and, um, uh, the, the, um, so, so, um, it became clear that, that people will be able to do some sort of garage, garage biology. And I was very much coming at it from like the positive, uh, positive, uh, version of like, can you make your own personalized cancer vaccine now, which is now also like, uh, turns out you can, turns out you can. Um, and, uh, I was just, uh, uh, Hanging out with Sid, Sid, Randy yesterday, who was like the one living manifestation of what's possible. And so, So that evolved in that interest in this democratized biology evolved in parallel to the kind of more, I guess, classic institutional venture funded biotech work we were doing with Helix Nano. And it kind of took a while for me to find the right angle. It was sort of interested in this tension between centralized biology and open biology. Uh, and, uh, and I, and I wrote actually two draughts of dark home. Um, like one, the kind of second one somewhere in like 2019 and then COVID happened.
Speaker 1
Um, yeah, that will, uh, And I was like, okay, this future that I was thinking about, it does not exist anymore.
Speaker 2
Like, all the assumptions now need to be thrown out the window. We've had this massive shock that entirely changes how we think about biology. Because, I mean, it also... And I guess now, like, things have somewhat renormalized. But in the earlier days of COVID, it certainly felt like... A lot of traditional assumptions about biotech were upended, that it takes a long time, that it has to be cancer to be meaningful, that it's not platforms, but individual molecules, etc. All those seem to, at least for a time, flip upside down. and then like it then took a while to we were of course also super busy with Helix Nano during during the COVID years and it took some time to sort of then refactor the future and think about what sort of came out of it and and there was a there was actually then like I'm sure you've experienced this as an author as well, but there was also like a period of self-doubt of having worked very intensely on the startup stuff.
I sort of had these inner voices saying, okay, can I actually write anything anymore? This is like even impossible. And I then ended up doing a meditation retreat that actually helped clear clear some of that up and then then sort of tell me which one this was the this is Mahamudra retreat with Dustin DiPerno okay so but the the the so so then so so then that that's kind of so this was like early 23 which is when really the the kind of current shape of dark home emerged and so to summarize the the book briefly it is set in 2040s where in a world where sometime after today there follows a Decade of plagues, of pandemics, of escalating intensity and frequency, both synthetic and natural, where the viable end state for civilization is to make the immune system digitally updatable.
which is accomplished through the creation of this by a company called Aspis, this Aspis chip, a wearable device that contains both a DNA sequencer and a microfluidic chip that can synthesize mRNA on demand. So the people are just trying to keep up with the plagues, at least upon them. And successfully. So this is like, so the the kind of situation normalizes. Like, you just wear this thing. Your app in your sort of AR glasses or phone tells you occasionally, okay, like this new thing came out, we updated your immune system against it, you're fine. And then you live your life. Now, in this world, of course, there are then people who do not want to hand over the keys to their immune system to some company or the government.
But you also cannot in this world be a full-blown anti-vaxxer because it's just impossible to survive or to live a normal life. So alternative platforms emerge. So dark home of the title is this open source biohacker community who create their own immune updates. They also typically live in separate communities and also carry out all kinds of self experiments to mess with their own biology.
Speaker 1
And so they turn off the chip or they just never have Oh,
Speaker 2
they just never have it or they so then this is like giving away Some details of the plot, although this is sort of very early in the book. So the main character, Inara, grows up in one of these dark home, well, comes of age in one of these dark home communities. And she has a rare genetic disease called the Leigh-Frame-Innes syndrome, a real condition, which is quite awful. You basically are prone, your DNA is very prone to mutating. So you lack a kind of cancer suppressor gene or it's not functioning correctly, which means that from a very early age, you start developing all kinds of cancers.
And she and her mom in this community, this dark home community are trying to come up with a way to treat it. And it goes wrong and her mom dies. And then her father essentially forces her to leave and to to sort of go to the default world and get the ASPIS chip and there is a trial that sort of applies the ASPIS approach to then cancer prevention and then she lives with that for a couple of years. And then she finds that in spite of having the aspis chip, she develops a tumor. And what turns out to have happened is her tumor has evolved a DNA sequence that jail breaks the chip. And then the sort of plot follows from there.
So now she basically has root access to this very sophisticated control system for her biology. But she also has cancer and everyone in the world wants this jailbreak.
Speaker 1
Okay. Okay. And then we don't want to spoil any more of the book, but so this is fantastic. So you've given us kind of like your journey to this point and then as you're working on this book, this book is coming out and you're doing your work in real life. I mean, some of these questions start to get A lot more real because we see, I see, based on the stuff that I cover, it strikes me at least that coding has been drastically affected by AI first, and then the next bucket that feels quite real to me is biotech, where I see sometimes it's annoying because I get flooded by so many startups telling me that they are AI biotech companies that are discovering all sorts of new proteins and antibodies and therapies, but, um, and it feels hypey, but I, I see enough where it looks, some of this looks quite real to me and extraordinary.
And it feels like the second bucket that AI is affecting very obviously and dramatically. And so, um, it doesn't take very many leaps to head towards some kind of future where we're, um, Again, I mean, this has been written about for years and was always one of the big fears of, of an AI revolution is, is the biological part of this. But so, so here we are. I mean, this, this really is, this is some of the intellectual underpinning of Red Queen bio, right? It's like things other people have been thinking about, I've been writing about, I'm interacting with are now getting real in quite consequential ways.
Speaker 2
Yeah, so let me give you a bit of the backstory.
Speaker 1
Yeah, because I was kind of curious of the moment. There's a specific moment I can point to, actually.
Speaker 2
So what happened was, at Helix Nano, we did do quite a bit of work on cancer vaccines. And we actually had a cool thing that we realized was possible to do something Nikolai spotted with protein models, with protein design models to basically to convince the immune system to go after against some of the tumor associated targets that it typically is reluctant to attack. So the problem with cancer, fundamentally, of course, is that it's us, it's our own cells. And therefore, the immune system often treats it as part of the self. And then the Sylvester C. So protein models gave us potentially a new way to kind of try to flip that switch, and we started playing around with that.
And then it sort of became clear that this worked decently well. And then in parallel, like others like ProFluent were showing that you could generate novel CRISPR sequences that did not exist in nature, that that still worked quite well. So it wasn't like a huge leap for us to then start thinking you could do this with viral proteins. And that was very worrying already because to, for example, create a new virus that would evade existing vaccines or therapeutics, which was also the kind of thing that the Soviet bioweapons program back in the 70s and 80s was trying to do. would now be possible with far less resources.
And so we started to have various conversations with people thinking about this and that then led us to have some dialogue with OpenAI. And a couple of things there became clear, which was that you then also have additionally the problem of Genetic models tool using the protein models. So then you sort of make it even easier. You don't necessarily need to know how to use the protein model yourself. And then reasoning models also were showing signs of being able to both assist in the actual sort of lab steps of making something dangerous, but also sort of thinking about biology itself. And so we ended up doing this work with them on how to own on testing, testing reasoning models ability to, to invent new molecular biology protocols.
Speaker 1
This is with open AI. Yeah. And they, and you, you just were having these discussions. There was, it was like a, um, just like an informal partnership. Yeah. So,
Speaker 2
so it was like, like, like, uh, like it was a research collaborative collaboration, uh, where, where we, um, sort of they provide the access to their models. And then we we figured out what was the problem where we would point the models at and did all the lab lab steps also automated some of the lab steps. But this was really just like to to the initial initial experiment was to see whether you could get the model to improve a standard step in molecular biology called molecular cloning. So nothing to do with cloning, cloning humans are living organisms, but just to like, how do you put a bit of synthetic DNA gene that you're interested in, in the DNA context that allows it to work then in a bacterium or in a cell.
And the standard way of doing it in the industry is called the Gibson assembly, where you essentially to do this kind of molecular gluing process to do that. And so the task we gave to various reasoning models was invent a new somewhat Gibson-like protocol that is more efficient and more parallelizable because the Gibson assembly has limitations in terms of how many reactions can you carry out in parallel in a one-pot vessel. and and we were quite surprised to find that with like a very small amount of experimental data so it's like the first first round like like first round it generated a bunch of bunch of designs that we then tested and most of them didn't work like five out of six six things didn't work but the sixth one showed like a little bit of signal so then round two it immediately honed in on that and it sort of sort of was able to think of like a new interesting mechanism, like a new enzyme to use, not like a novel enzyme, but like a known enzyme that had not been used in cloning before.
and then sort of optimized the conditions around that. And in the end, we sort of ended up with like an 80-fold or 79-fold improvement over Gibson Assembly. What year is this, 24? This was sort of early 25. So this was like an earlier version of the work we then published in December last year. So we kind of repeated that work more robustly with later generation models.
Speaker 1
And OpenAI had originally come to you or you? We got introduced to OpenAI initially in this kind of biosecurity context and then sort of it's just like a lot of conversations with people involved in thinking about biology and by risk and sort of They just kind of wanted to know what was possible.
Speaker 2
Yeah, exactly. And we did too, both in terms of like, you know, are these models at all useful and then like what the risks are. associated are so so so that's that then then so then around the same time so so I mentioned mentioned this this cancer vaccine award we had done so this is just another another data point So we sort of continued iterating on our own cancer vaccine idea. And one limitation of this sort of immune activation trick was that we just weren't getting enough T cells going hard enough at the target still. So we were trying to come up with some sort of helper proteins, some immune amplifiers to help drive them into a tumor in an animal model.
And that then was this iterative process of, you know, make a cocktail of mRNA, test it in a mouse model, see if the sort of tumor shrinks or the animal survives longer and so on. and then try to learn from from the result and keep iterating and we did 20 iterations over 18 months and kind of so early early 25 or late 24 we had sort of a cocktail that seemed to work pretty well that sort of doubled survival in this very challenging animal model and then around that time oh three came out and And on a lark, Nikolai threw the precise experimental setup into O3. Here's the model system. Here's like, okay, you get to pick three mRNAs to amplify the immune response.
And it's zero shot it is.
Speaker 1
So this is the arrival of reasoning. Yes.
Speaker 2
Reasoning was a huge deal here. So both in the cloning work and here, we did not see these results with pre-reasoning models.
Speaker 1
And what was that day like?
Speaker 2
Did you guys... That was pretty wild. I mean, it sort of... So then, like, we were... Well, at first, we were, like, super excited. We were like, okay, like, we're going to make a superhuman cancer vaccine designer. Like, there's going to be... We can do now, we can probably set up like an RL system to really teach the models more about the human immune system. And then there was kind of the red teaming version of that. And I sort of, I'll kind of refrain from disclosing exactly what that produced, but it was really frightening. It was kind of the dark, it was the sort of dark twin of the cancer vaccine result. And you were doing the red teaming as an intellectual exploration as part of this
Speaker 1
partnership with OpenAI? Or this was just at Helix? No, no.
Speaker 2
This was with OpenAI. So then that led to also a lot of conversations with OpenAI folks and amongst ourselves and with Ms. Nikolai. So then I think what really made me and Nikolai struggle with this was that... We both were and are fundamentally motivated by opening up this bright future for humanity, especially as it relates to our ability to control and shape our own biology and health. So then clearly we needed to do something to safeguard against some of these risks that were clearly becoming very real and imminent. And there were kind of two questions which were, should we do this versus the positive version?
And then is there actually a viable path to defend? Can we actually regain some kind of defender advantage? The answer to the first question, we had this conversation, it was the Chinese New Year, we had actually just had a meeting at OpenAI, there was a pub near OpenAI where we were kind of huddled and thought about this. And our conclusion was that for the good AI stuff to happen, we need a safe container for it. Because if things start bad, things start happening. We will start, perhaps correctly, treating sort of the use of AI in biology, like sort of nuclear weapons or nuclear power. It sort of gets heavily, heavily regulated, restricted, like very sort of some narrow set of people will get to maybe use it.
But it doesn't sort of, that kind of goes against all that sort of democratization of ideas and innovation that I think we also both both believe in. So that seemed like an undesirable future. And then we had actually, we did some Fermi math on some of the countermeasure strategies and realized actually there could be ways to regain sort of defender advantage. So then that convinced us to actually do Red Queen.
Speaker 1
Well, and so explain the, I mean, you explain like the origin story, but the thesis on Red Queen is that you If we are to unlock these powers of AI to do some of the good stuff that you're talking about in health, but there could be these disastrous other paths that people choose to go down, you want to at least stay at the cutting edge and much sort of like in your book... Be keeping pace with the bad stuff. You want to know what bad stuff is possible and then ways to have a countermeasure against it and just play this kind of like relentless, I guess it's like antivirus software to a degree.
Speaker 2
There's a lot of analogies with cyber security for sure. But yeah, the name of course comes from both Alice in Wonderland, that you need to keep running as fast as you can to stay still and twice as fast to get anywhere. And then this is actually something that Nikolai almost ended up doing his PhD on. There's something called the Red Queen hypothesis in evolutionary biology. that talks about how predator and prey species drive each other to constantly evolve and to retain this kind of equilibrium.
Speaker 1
Sounds exhausting.
Speaker 2
I think it won't be us doing it forever. We'll kind of hand this over, I think, to hopefully robustly aligned AI systems. Okay. or at least the bulk of the work will be done by them. So to kind of double click more on the Red Queen thesis, the same uplift that the bad actors can utilize, of course, also comes for defense. And as a defender, you also have more time to build those capabilities. You have probably more resources than at least the sort of non-state, state level actors. So if you're also very close to the cutting edge of AI research, seems possible to regain the defender advantage.
Now, that does require challenging some of the assumptions we have about pharmaceutical manufacturing and so on. But the capability we really are building is new pathogen, press button, get countermeasures that can you both treat and protect you. And then if you can very rapidly manufacture them, there's also the opportunity to suppress any outbreak. So before you stop it, before it even becomes sort of pandemic scale. So the kind of same idea that was used to eradicate smallpox that was successfully also used against Ebola. You treat the infected person, you treat their contacts, you treat their contacts of contacts and so on.
So you draw these rings. around the outbreak. And at the very least, you slow it down enough that you can mobilize a bigger response. But the key thing there is that the design part needs to be essentially, design time needs to be essentially zero. And then the manufacturing needs to be extremely rapid in ways which the current drug manufacturing, current drug industry has never really been incentivized to do. Okay, so there's practical elements of that and how you would execute it. And you talked about maybe you have this advantage over the less well-resourced,
Speaker 1
you know, sort of just rogue elements that could come along in the AI world. But how, like how, I mean, part of your job that must be going back to your childhood roots and just sitting around and thinking of things people could do.
Speaker 2
I don't think we want to over index on that. So if there's anything we learn also from science fiction is that while sci-fi can give you sort of the emotional flavor and give you some mental models on how to think about futures, the specific predictions actually quite rarely hit the target fully. And I think the same applies to threat models. So it's like... Yeah, we probably are not entirely thinking about the correct threat models. I mean, we have some... I think it's a pretty good guess that there are... So that the... Most worrisome category right now are not necessarily completely novel viruses, but sort of highly infectious viruses that have been enhanced to mess with our immune systems in various ways.
So that's kind of the category we want to be primarily prepared for. But I think that the core point is that you want to build this very flexible response capability tools that these tools and and there's sort of three layers to that. There's So one, this is the very core of our own adaptive immune systems, our ability to generate these very diverse antibodies that can, that sort of, it's actually like a wonderful evolutionary story of, you know, 500 million years ago, how there was this like, random genetic parasite that incorporated in into our sort of ancestors DNA that allowed gave it the ability to shuffle around its DNA to generate this incredible diversity of antibodies.
So now you didn't previously you needed to basically hard code every day every response so you couldn't possibly cover the sort of sort of threat space. And and then the adaptive immune system doesn't necessarily assume Co-Chair Vance when a virus comes in, it's quite likely that one of them will match and then it gets activated and it sort of starts pumping out that the B cells expand. They go from like one B cell clone to a billion in like a week and then they pump out antibodies to neutralize the virus. Of course, there's also like other branches of the immune system that get engaged, but like that's kind of the core idea.
So how do we how do we do that at a civilizational scale is really the interesting interesting question. And so So one basic tool actually still are antibodies. And they are very well established drug category, we know how to make them. And they can be used both to treat and to prevent infections. And antibody design has gotten a huge uplift from from AI. recently. So at Red Queen, we did train our own antibody model that's kind of in par with the open state of the art. But more importantly, now we're starting to using a new pipeline we built to generate training data that will allow us to get to very high confidence, zero shot design ability against all the kind of core categories.
So then the next level is, as the kind of threats become more challenging, or as we kind of raise the bar, is what do you target? What do you actually sort of aim your antibody at? Or do you need other countermeasures? And so with COVID, we got lucky in the sense that we had Quite a few years of existing research on coronaviruses that told us that spike is the target. So you take the spike and you make a vaccine or antibody against that. But we can't necessarily assume that.
Speaker 1
Sure. So then the process of science itself to figure that out also needs to be compressed.
Speaker 2
And I think that's where then figuring out how to improve reasoning model performance in biology becomes really interesting. And then at the limit, you put all these things together and you have this fully autonomous or at least mostly autonomous biodefense scientist or a superhuman biological reasoner that just like digests a new pathogen sequence, figures out these are the important things we're going to, we're going to target commands, tool models, like antibody design models to make the, to design the actual molecules. And then you push it into, into rapid biologics manufacturing. So we have some world where there's quantum sensors out on planet earth, picking up on little molecular changes that are happening to detect a new virus and then this scientist
Speaker 1
springs into action automatically to begin preparing a defense?
Speaker 2
I don't think we even need that sophisticated sensor technology. We need wastewater sequencing. We need the kind of stuff that the Nucleic Acid Observatory is doing. I think we... I don't think that sort of early detection at this point is so much a technological problem, but just like as a deployment and scaling problem. And we, of course, like there are many people working on that. We do want to kind of integrate with them. But the reason we chose medical countermeasures specifically was that that seemed to be like a missing piece.
Speaker 1
Okay, so just practically, I mean, you're a public benefit corporation. How do you make money to pay for all this? So you have a partnership with OpenAI, so there's a realm where you can tap into their vast computing resources, although they're using a lot of their vast computing resources in this world. This Is A Very Fierce Race Against All Their Rivals But Yeah Like In The Near Term This Doesn't Seem Like A Money Making Opportunity Maybe It Is But But This This Yeah I Mean This Is Obviously The Government you would think would have a role in funding something like this. But are you doing this for the good of your heart and because we need this or is this like a startup that is trying to make money? I think the thesis fundamentally is this kind of defensive co-scaling of figuring
Speaker 2
out how to scale the defensive capabilities in sync with AI. And I think that fundamentally requires a market component. you need to harness the same level of financial forces that are driving AI development itself. So doing it as a pure nonprofit I think would be less effective in that sense. But we of course did set up this PBC structure because we are primarily mission motivated. But to actually achieve the scale and capabilities we need. I think it has to be actually a commercially viable path also. There's a few parts to that answer. Just on the AI lab point. I enjoy working with OpenAI, but like from the outset and also sort of with Jason Kwon, who we worked with on the OpenAI side on the seed round investments, one boundary condition with sort of, in fact, like which was one of also his boundary conditions was that we would be sort of openly collaborating with all the labs, like not sort of necessarily Um, just with any, any, too tight to any individual one.
So, um, but, um, so on the business model, I, I do think government is an obvious buyer. Um, the, we, we are, we are of course engaging with them. Um, they, uh, I don't think they are fully AI by risk pilled yet. Um, so, um, uh, dark, dark, dark, dark is, but DARPA also, um, Draper also has sort of a strange remit of looking even further out into the future and this kind of Biologics fire station response capability actually is not in some ways for them. I mean, we sort of certainly not sort of excluding working with them. But actually, I think without sort of going into specifics, I think there are parts of DOW who I think are starting to have needs, which would be a good match for what we're doing.
But I think it'll take some time for that to come to fruition. Some of these capabilities that we're building, like antibody design, have also very obvious commercial applications. So there are some ways to leverage. So one kind of way we thought about it was that we would sort of only do commercial things outside the biosecurity realm if it helps us build the capabilities that this sort of final defender model system needs. And building better antibody models and generating training data for better antibody models certainly does that. So there are some paths to scalable revenue there as well as around building ways to teach models to reason about biology better.
Okay.
Speaker 1
Can I ask you a couple nasty questions? Sure. Please, please. Just, and part of this, shame on me. I have no excuse beyond, I just had an incredibly busy week and was not able to do as much research as I should have. Like on Helix Nano, I mean, I know you guys were working on something around COVID and then some other mRNA therapies. When I checked, I didn't see anything that was like kind of on market or any, if somebody came to you and they're like, well, do you guys have the best track record of, of, um, you know, people that we know are going to deliver on something like this? Um, and again, I apologize. You could have like a clinical trial that, uh, we did.
Speaker 2
So we, we did have, uh, we did have a successful clinical trial on a, on a, uh, on a COVID product. So, so we, uh, so, so something that we did was to So one of the challenges we wanted to address during the pandemic was the lack of vaccines that worked for immunocompromised people and immunosuppressed people. So people like organ transplant recipients under heavy immunosuppression. and drug immune suppression. And we developed a couple of new mRNA technologies. So one like mRNA chemistry that allowed us to use higher tolerable doses also like many applications outside mRNA vaccines and then sort of this kind of immune amplifier that sort of was able to in animal models break through immunosuppression by the drugs that organ transplant recipients typically are on.
and we sort of combined those into a next generation COVID booster where the ultimate goal was to sort of provide that to organ transplant recipients and other immunosuppressed. And we took that to a clinical trial in Australia. So we completed a phase one in Australia. And yeah, I mean, like safe, like we had like a that's a very good safety profile, actually sort of local tolerability across all doses was better than Comirinati, which was the comparable product. And then, yeah, we saw very extremely potent immune responses where sort of the low dose group kind of showed comparable neutralizing antibody titers to the community so so like like even though it's like tenfold lower lower the but but then it did just become commercially challenging to to take it forward so so like in terms of just as COVID played out I think like this need actually still remains it's not not it's just like the vacuum mRNA vaccines specifically are not viewed very favorably by by by the FDA currently and and so the kind of clinical path to actually take it forward became a lot more difficult or not not really viable.
And So, but of course, like the whole philosophy of Helix Nano from the start was bigger than COVID and bigger than vaccines. And like this, we're trying to solve this general question of how do we build this programmable API to human biology and to the immune system specifically. So kind of more recently, we've then been working on using the same technologies actually in the context of autoimmunity. So in a way doing the opposite of what we were doing with vaccines. And so there's this very exciting kind of promise now or early clinical signal of drugs called bispecific T-cell engagers used to treat autoimmune diseases, rheumatoid arthritis, moistenia gravis, like many others, where it's basically a kind of a bridge between a killer T cell and a target cell originally developed in the context of cancer.
But in autoimmune diseases, they're now being used to basically deplete the kind of pathogenic B cells and plasma cells that generate the sort of harmful antibodies. And so we've now shown that you can actually deliver those in mRNA form successfully, which then kind of gives you all the advantages of So mRNA programmability, easier personalization, like easier multiplexing, also even like faster prototyping and so on. And then we've also been sort of playing around with some of the technologies that we've developed on the Red Queen side, like this antibody design model to show that we've been able to zero shot some some sort of autoimmune relevant targets and deliver sort of mRNA encoded bites against those targets successfully in animal models.
So I think like the path I think for Helix Nano is now to leverage the same technologies that we built and kind of reconfigure it ourselves for the kind of new applications that are clearly becoming very promising.
Speaker 1
So you're doing both companies. I mean, Red Queen is a spin-out of Helix.
Speaker 2
Red Queen is a spin-out.
Speaker 1
You're working at both. Uh, I am, uh, I'm sort of, so Nikolai is actually, uh, the, the CEO of Red Queen.
Speaker 2
So Nikolai sort of bears more of the, the load, load on, uh, on Red Queen's side, side currently, but I'm certainly involved in, in both and, uh, on, on the board of, uh, of Red Queen.
Speaker 1
Okay. Okay. So, but that makes it sound like you spend more time at Helix personally, or?
Speaker 2
Uh, so, so, so the, um, I mean, it fluctuates according to the needs of the company. I'm certainly starting to put more responsibility on the shoulders of the team at Helix Nano than I have previously. And certainly, there's a lot of red queen things happening currently. I think longer time I'll need to find the right balance between the two.
Speaker 1
Okay. And I didn't mean the question to be rude or anything. I was just trying to see if you felt like Helix had done its thing or yeah, or if there were new therapies heading towards trial or... Oh, I think, I mean, there's some incredibly exciting things we can, we can do there.
Speaker 2
I mean, think the, like, as I'm sure you talked about with Jacob, like, I mean, mRNA has just a vast number of applications, like, I mean, the, we, I think Helix Nano remains, I think besides modern and biotech, the, the only company who has a clinically validated sort of modified mRNA chemistry. Um, so, um, and, and we've, yeah, we have some exciting early data on these autoimmune applications. So, so I'm kind of, I'm quite bullish on, on, uh, uh, on the future there.
Speaker 1
How many people are at red team?
Speaker 2
Uh, red queen is about 20 people, 20 people.
Speaker 1
And so What a strange job. I mean, so it's 20 people just preparing the system for... Yeah, I mean, it makes sense. It's just a wild thing to wrap my head around. Do you see anyone else doing something? I feel like Anthropic has gotten a lot of attention for their biodefense work that they were doing internally. I just saw them I think they paid $200 million for some biotech company.
Speaker 2
400 million. Coefficient bio, yeah.
Speaker 1
Okay, okay. You know, is it, is anyone else taking this as seriously as you guys? If so, is it something like Anthropic where it's one of these frontier labs or is it another startup that's doing similar things?
Speaker 2
Oh, I mean, people are certainly taking it very seriously. I mean, the labs clearly are taking it very seriously. So I think it's hard for the labs themselves to own the full stack from end to end. I mean, at this point, I think they would then in addition to the challenging pitch we talked about earlier sort of sort of then turn themselves into the face face of AI by risk also, which would be I think, little unfair in the sense that in a world of open models, they also don't don't just like solely create or control control that risk. And they're working very hard on the model mitigation mitigation side.
But the but there is a kind of an emerging post AI biosecurity ecosystem of startups emerging, which is very exciting to see. So there's Ginko spun out a new company called Perimeter Bio. There's Secure Bio, who's a nonprofit, has been doing a lot of work in this area. There's the sort of nucleic acid observatory project. There's Sentinel Bio, working on DNA synthesis screening. On the kind of more analysis side, there's Valthos, who actually I'm not super familiar exactly with them. Their work, but my understanding is that they're more focused on analyzing potentially pathogenic sequences and estimating the kind of threat levels from them.
And then there's us, and it's actually, I think we are, now I think it's either abcci or abcelera or one of the sort of ab named antibody design, antibody companies did announce a business unit that at least has the word biosecurity in its title. But other than that, I think on the sort of specifically medical countermeasure layer, I think we're currently the only one.
Speaker 1
You guys have a, you have a wet lab.
Speaker 2
Uh, we do. Yeah. You do. Okay.
Speaker 1
And, and so, I mean, I know you don't want to be specific about things, exactly how things could play out in a bad way or to give anyone ideas of these things, but, and, and, and I suppose there's myriad ways that things could go pear-shaped. Um, and pear-shaped is probably a understatement, but like is the biggest fear an AI system, um, I guess the biggest fear is what? It's that there's just some real asshole out in the world and they now have the computing power or a nation state that just wants to be a total pain in the ass. Is that number one on the list or it's just that we're heading to this world of AI biology and shit's just going to get really weird and there could even just be mistakes happening and that's the bigger fear.
Speaker 2
No, I think all of the above are relevant scenarios. So lab leaks can certainly happen. But I think foremost, in our minds, certainly are the sort of doomsday cults, school shooter, lone wolf types who are at the moment getting the biggest uplift in comparison to what existed before. So that, yeah.
Speaker 1
Can I ask a question about that real quick? Sure, of course. Because this is one thing I was thinking about. I mean, so the thing... Because we haven't seen a lot of, unless I'm just unaware, of like, you know, school shooter type individuals doing bioweapons, right? So, and clearly, you know, it takes money, expertise, all these things that presumably in this new world, AI could lessen and put this power and knowledge in other people's hands. But I mean, is that the thing? Like, we just think people are such, there will be just this group of assholes who just now have these tools at their disposal?
Speaker 2
These people, unfortunately, do exist. And there is at least one kind of disclosed or documented example of a school shooter at least like notebooking, maybe considering using biological approaches. An interesting historical example is Although not specifically bio, but very comparable is Anders Breivik. He was a Norwegian mass murderer who sort of carried out this horrific shooting on an island of the youth group of a political party in Norway, but also who made a, created in his home a chemical explosive that he used to blow, successfully that he used to blow up a government building. And there's a Rand publication that analyzes what he did in some detail because he actually kept detailed journals.
And this was him with 2011 Internet resources. And he just kind of iterated his way and successfully solved each problem he encountered on the way. and so Rand kind of analyzed the complexity of what he did and concluded that was actually far more complicated than what viral culture would be. So I think, I mean, we have to remember how early we are in all this, like DNA synthesis capabilities are not that old, like the sort of design uplift from the kind of more sophisticated models is extremely, extremely recent. And we just haven't sort of had time to see this fully play out. But the physical, at least for like some viruses, the physical production of enough virus to infect like hundreds of people is chillingly Not Difficult and it's sort of within reach of people who have basic cell culture skills and then that is that is millions of people.
There's millions of people.
Speaker 1
Isn't there a whole season of 24 about this very thing?
Speaker 2
Oh, I did used to watch 24, but I don't remember the bioweapon season.
Speaker 1
Making some kind of bioweapon. Okay, sorry.
Speaker 2
Yeah. So a couple of more comments. I mean, the It is, of course, hard to say specifically how this will play out. And we don't know what the success rate of these attempts will be initially. So my expectation is that rather than us getting a new super pandemic tomorrow or next year, there will be an escalating number of increasingly successful attempts, which will then be this more localized localized incidents,
Speaker 1
meaning what, like a little mini sickness or,
Speaker 2
or like, like, you know, you, you, you successfully infect, uh, a hundred people and, or, or, or more and that there is spread, but it's, you haven't, you haven't successfully made like a mega infectious Virus. Okay. Um, and then that's, that's why it's then important to have this like rapid fire station like approach that allows you to, to also suppress that. So of course, even more important for the, for the successful ones, but it also already kind of mitigates the impact from, from these, these, which will hopefully be like, um, less catastrophic, uh, initial incidents. I mean, that's at least like, like one model one can, one can apply.
Speaker 1
So you think in the first instances, they're just not good enough at building something that's airborne or that is able to escape.
Speaker 2
That's the more optimistic take. This will not be the case forever. I think it is probably the case right now that at least your hit rate wouldn't be very high. That you might have some modest successes, but not necessarily in the truly catastrophic sense yet. But I also think the timeline for that shifting and sort of tail risk going up is not very long. The other thing to consider is also, you did mention also state actors. and we certainly cannot ignore them here either. There is the Bioweapons Convention, but it is also enforced or is practically not really monitored, enforced. There are three people whose job is to sort of monitor everything that is going on in the world that could be violating the Bioweapons Convention.
And we do know that there are a number of rogue states that even in a non-classified sense has been verified that they have active offensive bioweapons programs. And they will, of course, have access to these tools. So there's a worry is then that... If you are a state actor, the classic game theory consequences of using bioweapons historically have been that you might get blowback. It might come back to your own population, so you don't want to do that. Or it might be traced back to you, and therefore you would then get nuked.
Speaker 1
I'm doing my best not to raise questions about China here. Whether we've already done this. Not naming names here. Or pointing fingers.
Speaker 2
But the kind of more advanced... Biological capabilities might shift that game theory. If you can now make more targeted viruses, for example, that would not infect your own population, but only your target population, then that changes the game for the blowback side. or if you're able to very easily, simultaneously develop sort of the countermeasure, ironically, here to kind of in tandem with your pathogen. And then, yeah, here I don't want to sort of necessarily get into too many specifics, but like the attributability part might also get much harder.
Speaker 1
Yeah. I mean, honestly, it's mind boggling all the... I mean, I get what you guys are doing and it's important. It just, it seems, God, it seems like a Herculean task, you know, to try to, I see what you're saying. I mean, maybe you don't have to, you're already, the good guys are ahead in some ways, but man, I mean, it just seems like the optionality of the other side is almost limitless as to how creative you might want to be. Well, I think what I sort of take comfort in is the kind of biological analogy.
Speaker 2
So if you look at the... So just to kind of think about the numbers and kind of... These are probably like... I'm getting some orders of magnitude wrong here. But if you take the combined genetic information in pathogens that can infect us... It's like 10 to the 18 base pairs, something like that. So 10 to the 18 A's, T's, C's and G's. And our genome is 3 billion base pairs. So that's like a billion fold difference. There's like billion times more enemies than we could possibly imagine countering. And plus they evolve and they're not static enemies. And they also have specifically evolved machinery to mess with our defenses.
That is the biological reality ignoring AI that has been kind of the biological arms race for billions of years. And yet we are alive. We are the proof that that you can win. And that is, and sort of being part of the answer was the kind of adaptive immune system, the ability that you actually can very rapidly develop a specific response. I mean, there's other things that one has to do too. Like there's this like A concept that people have increasingly been talking about and which, for example, now OpenAI Foundation has a huge program on is AI resilience. How do we kind of just generally prepare society for the impact of AI?
And kind of in dark home, there's this extreme version of the end state where everyone has an mRNA wearable. But I think we just need to kind of consider some radical upgrades to how we structure our built environment. How do we manufacture easy things like how do we manufacture drugs? How do we sort of operate in these crisis situations? How do we organize society? But I think we, I honestly think we can. I think we will get this sort of AI-powered, civilizational, adaptive immune system.
Speaker 1
All I'm picturing is all of us walking around in spacesuits on Earth.
Speaker 2
That was kind of the, you know, the COVID punk aesthetic. No, I think the immune system means that we don't need the spacesuits. I mean, they are kind of the immune system is the spacesuit. But another kind of cool thing about digging into the evolutionary biology, actually, another interesting analogy, part of that story was that, so we had this like... Gnastothom, the kind of ancestor of all sort of jord and spined creatures. That was probably like a fish living in the Ordovician Sea. that sort of had this integration event that led to the adaptive immune system. Before that, it was dying all the time.
The evolution had to play the numbers game of have a small creature which lays a lot of eggs and has large populations that can survive this constant viral or pathogenic onslaught. But once it had the adaptive immune system, once it was able to defend, then evolution was able to allow it to... I'm sort of obviously personifying evolution here far too much, but what then became possible in the possibility space was larger bodies or warm-bloodedness. Being warm-blooded is a great incubation platform for viruses. So you need to really be able to defend well to be able to be warm blooded. So the fact that we were able to then kind of reach our current stage of evolution was largely due to the ability to better protect ourselves from viruses.
And I think there's some interesting analogy there of like the future trajectory of us and humanity of like to be able to Embrace the full potential of AI where it can take us. We just need to be able to better defend against the threats that it enables. And then to do that, we then need to, just like the fish did, we need to integrate it into our defenses very deeply. I'm having the feeling that I have often when I talk to people who are actually elite at science fiction which is like I feel like someone like you needs to be president in this moment in time because the average person is not nearly creative enough to sort of like be ascertaining what is about to happen to us all or like
Speaker 1
how we should at all try to adapt and for the world that we're creating and Lord knows like our typical politicians are quite meager at the basic more basic world we'd already created yeah so I mean I just I loved you know you're so fucking good at I mean just amazing because you're you're brilliant outside of Being a fantastic author and then, you know, just have somebody who's so knowledgeable in math, physics, bio to be able to process all these worlds. I just think it's a very valuable skill. I can see a future where the the very best sci-fi theorists among us are really the ones we're depending on to navigate.
Speaker 2
Well, I think as we talked about in the beginning, I do fundamentally believe that we all have this capacity to imagine worlds that, I mean, I think maybe it should be more, I don't know, children, our children who should be imagining it more than us.
Speaker 1
It's probably not a terrible idea. I mean, and there's I see what you're saying about all kids having this capacity. There's definitely something to exercising that muscle because my son will just blow me away with the way his imagination works and the way he can instantly spin up a story, like a quite complex story out of almost any scenario. I'm so jealous of him, you know? And then I remember, I mean, when I was his age, I wrote a lot of fiction, which I almost feel like I can't even When I was a teenager, it was just limitless ideas for short stories. You know what I mean? It was just endless things to explore. And now I feel like I'm really searching for things to grab onto. And it's sad to feel that happen to your brain over time.
Speaker 2
I think it's possible to rediscover that. I don't necessarily have sort of... Very actionable advice on, on how to discover that. But I think like one I've done drugs, but I mean, but you, but you, but you, but I mean, you get exposed to so many cool ideas though. I do, but my brain now it's like, I love it, but that's what I love living in it.
Speaker 1
And I like writing about it in this nonfiction way. And I like filming movies, showing it to people, but that like turn in my head of extrapolating. on my own is a bit muted from where, like when I was a teenager, I mean, I would just fill endless notebooks of short stories like every night. I mean, it was like a new idea was coming.
Speaker 2
Um, well, I think obviously, um, It's just also great to do the thing you are uniquely suited to do and what is your superpower in getting people to tell about these wild things and create a synthesis that also helps others understand that.
Speaker 1
It's very nice of you to say. I'm jealous of your skills. Well I know I mean we could look I mean maybe you can come back when you guys have been going a bit and we can explore some more of these scenarios I could keep you here for like eight hours I think going through going through all the stuff is there anything for people to The Red Queen website is short and sweet at the moment. You guys will be publishing papers? I don't know. What can we expect to see over the course of this year, if anything? Yeah, so we might in the future publish some more joint work with the labs. I mean, by the very nature of the work, we probably will by default be fairly quiet about it. But yeah, I tweet about Red Queen things occasionally at Hannu, H-A-N-N-U on Twitter.
Speaker 2
And Red Queen also has a has a Twitter feed.
Speaker 1
You do powerful tweet. Threads. Oh, thank you.
Speaker 2
I do like Twitter threads as a format. It's a nice form.
Speaker 1
No, they're good. I was reading a whole bunch of them last night and it was extremely helpful. Well, thank you so much. Honestly, you've got to come back because you're so fun to talk to. It's just hard to know where to lead the conversation because I feel like anything we I'm like oh we could have just talked about LARPing for two hours absolutely this was great thank you so much for coming on thank you thank you Ashley it was my pleasure the Core Memory Podcast is hosted by me Ashley Vance and or Kylie Robison or both of us together it is produced by me and David Nicholson our theme song is by James Mercer and John Sortland The show is edited always by the John Sortland. Thank you so much to Brex and Send Cut Send for all your support and thank you most of all to everybody for listening or watching. We love you. Please leave us a like, a review, a subscribe, all those tremendous things. Thank you and we'll see you again.