Erik Torenburg and Haseeb Quereshi join us for today's debate.
Should we accelerate or decelerate our tech progress? How about when it comes to something as powerful as AI? This is not just a debate in tech circles - this is a political debate that poised to define the next decade.
We’ve had leaders from both sides of the debate on the podcast - episodes with Elizer Yudkowski and Beff Jezos. You’ve heard what they think.
Today’s episode is a discussion and at times a debate on these opinions to help you think through where you stand on this issue - Haseeb Quereshi tends toward the EA side which favors more caution and regulatory intervention around AI while Erik Torenburg tends toward the e/acc side of the issue which favors faster progress and lighter touch.
------ 📣SPOTIFY PREMIUM RSS FEED | USE CODE: SPOTIFY24 https://bankless.cc/spotify-premium ------ 🔐 SAFE | USE SAFE, GET REWARDED. CHECK OUT SAFE PASS https://bankless.cc/SafePass_NL ------ BANKLESS SPONSOR TOOLS:
🐙KRAKEN | MOST-TRUSTED CRYPTO EXCHANGE https://k.xyz/bankless-pod-q2
🔗CELO | CEL2 COMING SOON https://bankless.cc/Celo
🔐 SAFE | USE SAFE, GET REWARDED https://bankless.cc/SafePass_NL
⚖️ ARBITRUM | SCALING ETHEREUM https://bankless.cc/Arbitrum
🛞MANTLE | MODULAR LAYER 2 NETWORK https://bankless.cc/Mantle
🗣️TOKU | CRYPTO EMPLOYMENT SOLUTION https://bankless.cc/toku
🏙️ CONSENSUS | SAVE 20% WITH CODE BANKLESS https://bankless.cc/4aykesD ------ TIMESTAMPS 00:00:00 Start 00:03:51 Intro To Haseeb and Erik 00:05:58 Definind EA 00:11:30 Reflecting on EA 00:19:23 Erik's Case For E/Acc 00:23:05 Defining E/Acc 00:27:18 The Problem with E/Acc & Humanism 00:34:20 How Big is This Debate Really? 00:46:31 AI Safety & Regulatory Capture 00:56:39 EA's Political Affiliation 00:59:43 Extinction Risk 01:11:04 Politicizing the Debate 01:19:56 The Pro Tech Case 01:24:08 Productive Tension 01:28:33 AI Ethics vs Safety 01:32:53 Pick a Side
------ RESOURCES Haseeb Qureshi https://twitter.com/hosseeb
Erik Torenberg https://twitter.com/eriktorenberg
------ Not financial or tax advice. See our investment disclosures here: https://www.bankless.com/disclosures
No summary for this episode yet.
If you look at the companies that are actually accelerating, they're mostly EAs, right? Which like kind of fucks up the narrative, which is like, oh, the EAs are ruining everything. They're slowing everyone down. And like, it's the accelerationists who want to go fast. The accelerationists are mostly VCs. They're mostly not building anything. They're just like on the sidelines cheerleading for this imaginary team that they think is in the driver's seat when in reality, it's fucking EA people who are even thinking that this was possible in the first place, right? It was all the VCs who were not investing in any of this stuff because they thought it was so impractical and it was worth it.
It's the EAs who believed that AI risk was a real thing because AI was going to become really powerful really quickly who created all this shit. Welcome to Bankless, where today we're exploring the frontier of the tech acceleration versus deceleration debate. This is Ryan Sean Adams. I'm here with David Hoffman, and we're here to help you become more bankless. The question on today's episode, I think a question that is everywhere right now. Should we accelerate or decelerate our tech progress? And how about when it comes to something as powerful as AI? This isn't just a debate in tech circles, at least not any longer.
This is now a political debate. I think it's poised to define the next decade. We've had leaders from both sides of the debate on the podcast. You might remember our episode with Eliezer Yudkowsky, who argues very much from an AI safety perspective, and Beth Jesus, which is almost the complete opposite of that. So you've already heard what they think. Today's episode is more of a synthesis type episode. This is a debate on these two opposing opinions to help you think through where you might stand on the issue. We have Hasib Qureshi, who tends towards the EA side of the conversation, which favors more caution, more regulatory intervention around AI.
And we have Eric Tornenberg. He tends more towards the EAC side of the issue, which is a bit more tech forward, faster progress, and a lighter touch from art regulators. We talk about the history of the debate, the cultures in Silicon Valley. We talk about Sam Altman. We talk about the regulators, the big bad US government, SBF, and what they think is the most sensible position on the acceleration versus deceleration debate. Before we get into some of the takeaways, our friends and sponsors over at SAFE wants to let you know that SAFE, this is the multisig. Bankless uses this. I've used this personally.
I have my own personal multisig. A lot of people use the SAFE multisig. And now SAFE is launching an activity rewards program so as you use your multi-sig you can get rewarded with points so weekly users or just for pushing volume through the safe or having a high number of transactions or you store a lot of assets with safe everything that's an activity around safe gets you now safe points and they also want you to stay on the lookout for further activities that will offer additional points as they unlock if you want to learn more about safe points and what you can do with them click the link in the show notes to getting started with safe points today one of One of the reasons, Ryan, why I was really motivated to get this episode out here is because I think right now this conversation is relevant to both crypto and AI is about like accelerationism.
And are we pushing the gas? Do we want to push the gas further? It's now just relevant to these two industries. I think there's more industries that is going to be relevant for beyond just what the scope of what this conversation is. I think this is like a sign of things to come. There are other industries that are also going to present some very hard conversations to humanity and therefore government. And our tech sector is going to be coming out of the tech sector. When we talk about accelerationism, the world is going to look so much more different in 20 years than any other 20-year increment that we've ever had before.
And that's only going to increase. So we have biotech and gene editing on the horizon. We have longevity. People like Brian Johnson literally trying to become immortal. And I think AI and crypto are like banded together as kind of these accelerationist movements. But the thing is, I think these are the first of many industries to show up on the accelerationist side. And this conversation about this like caution versus gas, do we press on the gas pedal or do we hit the brakes? That is going to be a more, it's going to define society more and more and more, I think, as we move forward into the future.
So that's kind of the frame of thought that I hope listeners go into in this conversation. I completely agree. This is the political debate of the decade, but it's also probably the political debate of the entire next century. So a lot of podcast episode fodder for us in the future. All right, guys, we're getting right to the conversation. But before we do, we want to thank the sponsors that made this episode possible, including our number one recommended exchange, the place you can accelerate your crypto buys. That is Kraken. Go create an account. If you want a crypto trading experience backed by world-class security and award-winning support teams, then head over to Kraken, one of the longest-standing and most secure crypto platforms in the world.
Kraken is on a journey to build a more accessible, inclusive, and fair financial system, making it simple and secure for everyone, everywhere, to trade crypto. Kraken's intuitive trading tools are designed to grow with you, empowering you to make your first or your hundredth trade in just a few clicks. And there's an award-winning client support team available 24-7 to help you along the way, along with a whole range of educational guides, articles, and videos. With products and features like Kraken Pro and Kraken NFT Marketplace and a seamless app to bring it all together, it's really the perfect place to get your complete crypto experience.
So check out the simple, secure, and powerful way for everyone to trade crypto, whether you're a complete beginner or a seasoned pro. Go to kraken.com slash banklist to see what crypto can be. Not investment advice. Crypto trading involves risk of loss. Have you heard about SAFE? They're not just pioneers in crypto custody, they're also leading the transition to the world of smart accounts. With SAFe, managing your crypto has never been smarter or safer. They've recently passed $100 billion in total value secured and are now deployed everywhere with over 15 supported networks. But that's not all.
SAFe is revolutionizing the game with their full compatibility with ERC-4337, making embedding wallets super easy to integrate into your daily crypto activities. And for the crypto enthusiasts out there, SAFe has something special. the SafePass Activity Rewards Program. It's a fantastic way to engage and earn rewards, launching just after Safedow voted in favor of safe token transferability. So what are you waiting for? Head over to safe.global, sign up for the SafePass Activity Rewards Program, and don't forget to check out SafeCon during Berlin Blockchain Week, where the future of smart accounts is unfolding in real life.
Click the link in the show notes to secure your spot today and be a part of the transition that's setting a new standard in the world of custody. Taking self-custody of your crypto is one of the most important things you can do on your bankless journey. It's also one of the hardest things to get right, with huge consequences if you don't. If you want help going bankless, talk to Kasa. Kasa helps you take custody of your crypto assets so you don't have to wonder whether you're doing it right. Kasa is a one-stop shop for doing self-custody the right way. With Kasa Vaults, you can hold Ether, Bitcoin, stablecoins, all with one simple app and multiple keys for the ultimate peace of mind, with a support team to help you every step of the way.
But it doesn't stop at self-custody, because even though crypto is forever, you are not. We all plan on making life-changing wealth in crypto, but with Kasa's inheritance product, life-changing wealth can elevate to generational wealth. For your kids and your loved ones who don't know anything about crypto. With Kasa, you won't lose your private keys, and you won't accidentally take them to the grave either. Click the link in the description to get started securing your generational wealth. Bankless Nation, I'm excited to introduce you to Eric Torenberg, an investor, technologist, and fellow podcaster.
He's got a podcast network called Turpentine Media, lots of excellent podcasts in that network at the intersection of technology, culture, philosophy, social commentary. Eric, welcome to the podcast, my man. Thanks for having me. Longtime Bankless fan. Just stoked to be on. You know, actually, before we introduce your fellow guests here, I actually remember a very early podcast episode that you had Ryan on as a guest, actually. Ryan and Cyrus Unessi, I believe, which is when some of the formative years around like ETH as money as a topic. Amazing. Yeah. Joining Eric here on the podcast today, Bankless listeners probably know Haseeb Qureshi, another investor, technologist, podcaster, who we've had on the Bankless many, many times before.
GP over at Dragonfly and is also in the effective altruist camp well before anyone in crypto even knew what that meant. Haseeb, welcome back to Bankless. Thanks for having me, guys. Always fun to be here. So just to lay some foundation for this episode, I think what this episode is going to be is kind of is going to evolve on its own. But really, we are watching two camps out evolve in the tech space. And it's also migrated into government as well. But there's also some nuances. This is the accelerationism versus decelerationism camp. There are some other tribes inside of these tribes. There are some adjacent tribes.
But overall, there's identities forming in the world of tech and governance and where we are going as a society in the future. And it's causing arguments, is causing debates. The accelerationists want to just hit on the gas pedal and innovate, innovate, innovate as fast as possible. And the decelerationists are like, ooh, scary. Let's regulate. Let's regulate these things. Now, I don't think we've totally seen perfect identification or identities form around these tribes. I think this is all new for Silicon Valley as a whole, which is why we want to bring you guys here on the podcast today to kind of like us out and like figure out this landscape of these growing alignments across tech across halocon valley across politics i think we can do that here on the show today let's do it perfect so i kind of just like laid down a whole bunch of stuff uh different identities different values um maybe hisib you can kind of get us started here because uh you were you were are an effective altruist well before anyone in crypto knew or cared what that meant and that was one of the like earliest call it tribes both in silicon valley in the venture space and and also just broadly um maybe you can kind of identify about like the formations of that whole camp and how it's uh innovated or just been a part of the whole like silicon valley tech sector sure so i think effective altruism for most people it came into the popular imagination with spf which now it's kind of a irrevocable taint on the movement and on the kind of the ideas behind ea but ea came originally in around like 2011 2012 mostly around oxford and cambridge from a small number of philosophers who were very interested in this idea of trying to apply a more rigorous form of ethics and morality to philanthropy it originally started with philanthropy and it broadened into a number of other ideas um so it starts with folks like peter singer um and uh you know a small a small number of um uh what what's what's who's the guy um who was affiliated with sbf um will mccaskill that's right will mccaskill toby ord uh a few guys who all basically came up around that time who started writing about a lot of these ideas in public and the origination of the ea movement is very close to the rationalist movement which was also founded by eliezer yukowski who also has a lot of ties to ai doomerism um and so the ea though is a little bit different from rationalism Rationalism is the cohort that really came out of Silicon Valley, whereas actually EAA mostly came outside of the tech sector, mostly came from universities.
So now EAA, the core ideas behind effective altruism very simply are that most people, when they think about doing charity or doing good for the world, they kind of turn their brains off. They're basically guided by their emotions. They kind of donate based on mood affiliations or what makes people look good or what sounds good. think as rigorously as they do when they are for example doing science or technology or politics or i don't know maybe not politics but when they're building businesses for example right so when you're building a business you a b test you look for statistical significance you're like very careful in making sure does this thing actually improve my product does this thing actually get the thing that i want and if not you are very very careful to measure the difference and allocate resources accordingly but when most people do charity they're just kind of like well you know here for the teaching violin in the inner cities that sounds good sure let's like go you know start a museum uh that'll that'll be good for kids learning how to read or whatever these kinds of things that like they sound really good but are they actually good and how good are they and so uh ea kind of came up as this very scientific engineering heavy approach to thinking about how to do ethical um ethical actions in the most rigorous way and there's a whole framework around it i don't think we need to go into the details but one of the things that came out of ea which which is now very, very relevant in the world of Silicon Valley, is for a long time, EAs have argued about what is the most important cause area that can move the most impact in the world over a short amount of time with a small amount of resources.
And, you know, many people talk about global poverty, animal welfare, but one of the most popular cause areas for a very long time, almost 10 years now, has been AI risk. The idea being that as people develop more and more powerful AIs, AIs might be so powerful that they could end up disrupting society or even causing, you know, mass human extinction. And this was before ChatGPT, this was before any of the modern, you know, kind of acceleration in AI advancement that we've seen over the last 10 years. And so people have been working on this, you know, a lot of small groups like Miri and Chai and these, you know, very weird kind of, you know, people in the back room doing stuff that It was very disconnected from Silicon Valley.
Only now, with the rise of large language models and the sense that everybody has of like, oh, shit, this is actually happening and this is real, has the discourse around AI risk started to really intersect with society, with tech, with economics, with politics. All these things suddenly matter now. That's kind of been happening in a back room for about 10 years. That part of EA, so I was aligned with these ideas basically like 10 years ago before any of this stuff was really on a global stage. of thinking, hey, you read these arguments. There's a very famous book by Nick Bostrom called Superintelligence, where he sketches out a lot of the in-principle arguments of how rapid AI advancement might cause some degree of existential risk.
And you read the arguments, you're like, yeah, this kind of makes sense. It's not a slam dunk. It's like obviously correct. It's not that clearly this will happen, but there's at least a risk that it will happen. And nobody seems to be thinking about that risk besides these small cohort of weirdos in the East Bay or in Oxford. And so people thought at that time, oh yeah, you should donate some money to these people because this seems like a very underexplored risk that right now society is ignoring. Now today, it's quite different. Society is not ignoring that risk. Now it's like a, it's something that the White House is thinking about, which is kind of crazy, right?
Very recently, Paul Cristiano, who was the head of, he was a very, very early EA. He was the head of safety at OpenAI. He left OpenAI. Now he is at NIST. NIST recently hired him as like the head of AI safety at NIST. So now at this point, you know, it's very firmly entrenched in at least the US government is this concern that, hey, AI safety is a real thing. And that's not just, it's not just sort of AI bias or AI replacing jobs. It's also catastrophic risks that might arise from the rapid advancement in AI. Yeah, I think probably listeners are generally familiar with GiveWell, which is this charitable organization that does a lot of research for understanding if you give this one charity $1, how effective will that $1 actually go into like improving people's lives?
and then like this is where famously like they came down to like malaria nets if you actually want to like put your one dollar and save the most number of human lives you would just buy malaria nets for like kids in africa to prevent them from getting malaria but this would also like this is a very effective and rigorous process of understanding how to out capital allocate in the world of charitable giving but i think as we are working on defining the landscape of all these different like tribes and identities about like the future arises here i think has seen what you're also alluding to is that, well, there's like this like risk off low risk research and pragmatic capital allocation strategy in the world of charity.
But then there's also like, okay, well, what about some like venture bet future high impact things as well? So not just about like, hey, current kids could be impacted by this, but like, we could also have future generations. And like, not just like next future generation, but literally every single future generation. So that's, this is how like the world of effective altruism got interested in like, AI risk because like that's literally the whole thing. It's like all of human society. And so effective altruism is kind of taking the like, not just like a pragmatic approach to charitable giving today, but like also taking like venture bets in charity or venture bets in like effective altruism.
How do you, how do you, how would you feel about just that out on right there? Reflect on that for a second. No, I think that's exactly right. Most people, when they think about EA or they hear these recommendations among EA, they're immediately turned off. There's a few reasons why people immediately get turned off. One is that like, well, you know, who are you to say what's the most effective and what's not, you know, it seems like you guys are kind of these big central planning type people. And, you know, naturally people have an aversion to that. And, you know, one thing to understand about EA is that EA is making recommendations at the margin, right?
EA is sort of not assuming that most people will follow EA because they don't. And that would be stupid to assume that everyone will do what you tell them to do. So you always want to be thinking, what should more people be doing at the margin? And you'll probably influence 1%, maybe 2% of people at the most. If you're influencing everybody, like let's say you are the government, then okay, the way you allocate capital and the way you make recommendations should be very different. But if you are saying, okay, I can basically influence about 1% to 2% of people, what should 1% to 2% of more people do given where dollars are already being allocated?
And the answer usually is, well, okay, there's some obvious things like we should have schools, we should have sanitation, we should have... And so somebody might say, well, are you arguing that we should not have schools or not have sanitation? Instead, we should all donate to malaria. bed nets? The answer is no, obviously not. Given where the majority of dollars are being deployed today, where should the next dollar go? That's the real question that EA is tasked with trying to answer. So given that backdrop, now you might ask the question of like, well, you know, if you donate to an anti-malaria bed net, okay, I guess that makes sense.
You save somebody's life from dying of malaria. That's a very cheap way to save somebody's life. But, you know, donating to AI risk, maybe AI is not a risk, right? Maybe there's only a 10% chance that AI is a risk, in which case you'd be wasting that money. And again, you know, the way that EA frames this is that, you know, you're thinking more about a portfolio of good as opposed to thinking, well, definitely this good will do this much and this good will do that much. Most people, when they're thinking about, okay, I want to do one thing, you know, I want to eat lunch. And if you're going to eat lunch, are you going to take a risk on like, you know, maybe this random restaurant is like an amazing restaurant and I should try it out.
Or you're just like, look, I know that if I go to, you know, I don't know, Denny's at least have a decent meal, right? I don't know, depending on how you feel about dinies. And most people are naturally very risk averse when it comes to their own lives or the things that they do with their time. But the idea is that when you have a large portfolio of giving, of all the giving in the world, you actually want there to be some people who are doing high risk giving because, you know, sort of high risk, high reward. If nobody's doing high risk giving and nobody's doing stuff that looks kind of weird or that may not pay off or that may not even matter, but in the times when it does matter, it really, really matters a lot.
So the analogy that a lot of EA people give is that, you know, imagine that this is something like nuclear research. If you were in the 1930s or the 1920s and you were thinking about nuclear research, at the time it was kind of this relatively boring kind of scientific thing that nobody really, nobody really understood why this mattered until they saw the atom bomb and they saw the destructive power of nuclear energy. And there was a time that this was considered to be very speculative, that this was even possible at this kind of scale to have this much destructive damage from this technology.
and on the off chance that it turned out to be right, that the order of magnitude estimates of this stuff was correct, then you would really want there to be a lot of research into the safety of how to prevent nuclear proliferation, how to prevent mass nuclear scale wars. But people may be under-invested in that. And as a result, people in the 50s, 60s, 70s kind of lived under this specter that maybe there would be maybe one or two more decades of human existence and then the world would just wipe itself out. And for all we know, maybe we weren't that far from that happening. Maybe we were kind of various times on the brink of massive amounts of human damage and catastrophic risk from this proliferation of nukes.
And so the question is, is AI like this? Is AI a similar technology? And the answer might be, well, probably not. Maybe AI only has like a 20 percent chance of that, 10 percent chance of that. But even if it's 20% or 10% chance, what an EA would likely say is that, well, that is high enough that you probably want some people, maybe 1% to 2% of people spending their time on this. Because 1% to 2% of people spending their time on something that might be 10% as bad as nukes, that's a pretty good trade. That's a pretty good investment if you're thinking about the overall portfolio of how people are spending their time and spending their resources.
So if you think about EA as here is what I decree as an EA, as this East Bay rationalist guy that everybody in the world should be doing, then I think you'll come away with the sense that EA or EAs are a bunch of selfish pricks and they think they should run the world. But if you come away with the sense that, OK, EAs are advocating about at the margin how to alter the portfolio of all the different things that human beings are working on to ameliorate risk and increase the likelihood of human flourishing, then you might say, OK, that sounds like a reasonable investment strategy. Maybe I don't agree with it completely, but it's a lot more reasonable if you think about it that way.
So Haseeb, I want to bring Eric into this conversation, just kind of reflect on what you said and add. But I have just one question that kind of plagues me. So we started this conversation talking about accelerationism versus tolerationism. The way we started this conversation was talking about EA and the rationale behind how EA came to support and fund a lot of the AI safety initiatives. And it's really, when I think of AI, it's really like utilitarianism or consequentialism as a philosophy kind of applied to giving. That part to me sort of makes sense. But it doesn't necessarily follow that AI must lead to investments and funding of AI safety.
Because if you are in the EA community and you believe in this sort of giving, you could just as well make the case that in order to benefit the most amount of, like the greatest number of future humans, say trillions of humans, We want to actually invest in AI technology because we believe AI technology will build a utopia and cure diseases, cure illnesses, solve the problem of death and old age and all of these things. And so you could easily make the case in the EA community under that philosophy that, no, we shouldn't be funding necessarily anything that would slow down AI. We should actually be funding startups.
We should be funding open AI. We should be funding all the tech that goes into AI. But it seems like the community just forked mainly in one direction such that EA has become somewhat associated with AI safety. I think, by the way, recently, maybe some of the founders of EA, Will McCaskill and others, have kind of walked back from that and be like, hey, you know, that's not – EA is not necessarily AI safety. They're not one and the same. There's kind of some differences. Anyway, I just throw that idea out there. And, Eric, what are your reflections on this conversation so far? Well, first, I just want to add that not all long-termism is in the venture bet category, right?
It's also things like pandemic prevention or reducing nuclear proliferation, things that already exist, already happened. And they were talking about pandemic prevention before COVID, right? So they're really onto some things. The leap that long-termism can be broadly explained by this idea that EA is about a kind of arbitrage, right? uh dave you described how if one dollar can make a better difference uh bigger difference to people in africa than it can to people in san francisco well maybe we should put our dollar to to people in africa and and ea says okay um because a person in africa's life is worth as much as a person in san francisco's life what about a person that doesn't exist yet what about a future person that person's life is also worth uh as much as a current person's life and guess what there's going to be trillions of future people, way more than exist today.
And thus, we should really care about the future. And there's a lot of people who got on board with that. There's a lot of people who didn't get on board with that. And this was a schism in the EA community. Some people are like, hey, I'm all about effective charity, but this long-termism stuff, that's a bit too out there for me. And there's some people who go all the way. And now, even among the people who go all the way, there's another schism that Ryan just outlined. Some people say, hey, it really depends on what you think about the future of AI. Some people say that the idea that you just said, Ryan, which is if you're concerned about helping the most future people, you want to accelerate AI.
And these are people who are effective accelerationists. This is why there is an additional schism. It's people who are not on board with the AI safety agenda. And one thing that's worth noting, you know, EA and EAC are having the strongest conflict. But what did Henry Kissinger say? Something like the tyranny of small differences, like AI safety people and EAC people agree on 99% of things in many cases. They both believe that the people who are worried about misinformation or DEI or AI saying racist things, they're not focused. They're not at the adult table of the important conversation. Those people are misguided.
They're not disagreeing with that. And in many ways, AI safety people and EA people are tech accelerationists. They agree that nuclear regulation has been really bad. They want to accelerate things like self-driving cars or longevity or other things that EA people get on board with. The one place in which they disagree is this field of AI. They say AI, this time it's different. We're not just introducing a new technology. We're almost introducing like a new form of evolution or a new species that one day is going to be cognitively way smarter than us. And thus is a threat, not just to fake news.
It's not like social media, not just to jobs, but to actual humanity, to actually the chance of us being extinct. and thus we should treat it differently. And that is the core of the argument between effective accelerationists and effective altruists as it relates to AI safety. Okay, okay. So we're dealing with like, this is like an argument between like Catholics and Protestants basically. So like all in the same religion, but like you guys are arguing over these specifics here. I'm going to dispute that. I'm going to dispute that a little bit. I think, I think I'd say a lot of EACs. So first of all, I think it's probably worth, worth actually defining what EAC is, what it means as a movement because i think it's also been in a sense co-opted by what people want it to mean which is like accelerationism right this idea that oh all technology is good and all technology should be faster we should be super libertarian we should you know kind of let all the guardrails off and just let it vroom vroom vroom right that's not actually what yak says right if you read the yak manifesto from from beth jayzos who's the guy who invented it is like this google engineer worst quantified it's actually pretty fucking crazy like what he actually literally says.
Like, I don't know, Eric, I, I, I'm not, it's been a while since I've actually looked at that manifesto, but there's stuff in there about how like, yes, if, if AI ends up, you know, totally conquering humanity, like that's good. We actually want to feed entropy. We actually worship entropy. Entropy is the thing, you know, the, the, the core value from which all good flows. It's like actually very weirdly cult-like and kind of anti-humanist. I think most people don't, haven't actually read it or they, they just kind of take it as a vibe and they're like well the vibe that i want it to be is like you know basically mark andreessen i think that that is what i imagine eac is but if you actually read the eac manifesto it's like some it's a bunch of other weird shit that's adjacent to like the mark andreessen philosophy but it's not quite the same thing so i think it's sort of been typecast into this is like silicon valley uh you know pro-tech libertarian energy but that's not that's not literally what eac says i don't know eric if you if you would agree or disagree with that i i i do agree with it and i should say that that is my um my tribe in some sense is is people like mike solana people like balaji people like mark andreessen um and so that is where that is where i come from and so i've been very sympathetic to this eac movement right which um to to some degree says hey um over the last decade, there have been a lot of anti-tech movements and sentiments and people trying to use arguments to thus regulate tech in ways that have been very bad from whether it's energy or social media or a wide variety of things.
How about crypto? Is that bad to the West? Yes, exactly. And we're not going to let that happen here. And we're finally going to stand up for ourselves because you saw Zuckerberg and others apologize, and that didn't really get them anywhere. It only conceded their sort of lack of moral sort of credibility and that they were wrong and blah, blah, blah. And that's all these bad things. And so this EAC is coinciding with a desire for tech to stand up for itself, to say, hey, we are actually good. We are actually going to push back and we are going to defend ourselves. Now, I think it brings up a really interesting point because yeah, Mike Solana, Balaji and Marc Andreessen are not saying that, you know, we're going to be pro-human or sorry, post-human in some sense.
They're saying that technology is going to make human life way better for decades to come. And I think what Beth was doing, and you know, in some ways, EAC is critiqued as being about vibes. And the benefit of being about vibes is you can't really be pinned down. You can't really be critiqued on your philosophy. And I think that's partially because of what Hasib just identified, which is if you take it to its logical conclusion, it's not something that a lot of people want to get on board with. If you take sort of advancing technology to its logical conclusion, like what is the role for humans once we have super intelligence?
What is like when we're like cyborgs and stuff and then different speciation as a result? Like, so it is very weird, but also I think in some ways it's intellectually honest of like, that's where things are going. And I couldn't pin down Solana or Bology or Mark on like, what do they think about that? But, but I think there is some truth to that. But I also think there's some, like, I do think it's hard to be a pro tech on a long enough timescale and not think that we're going to like be like, think that humans are the last sort of uh you know form of intelligence that is going to going to rule the world so i i think it's intellectually honest i also think it is very weird so has he well what's this what's what's the problem with like yak plus some humanism right it's like a more you know like moderated to be clear there's yeah there's there's nothing there's nothing wrong with the yak plus some humanism i think it's much preferable to like raw yak as it it was actually articulated in its genesis i think it's evolved that way the thing that's weird yeah well i don't know I don't know that it's evolved so much it's been co-opted.
I think it's more like it's been co-opted, right? It's been co-opted. The reality is that any time you get a culture war, you basically get the superimposition of what was once like a pretty esoteric argument about like, well, will AIs take over the world? Is it risky? Is it not risky? Is it good to have more? Is it good to slow down? This is like a pretty conceptual theoretical argument that's been going on in very obscure circles for a very long time. And then basically in the span of about a year and a half, it has now become a culture war. And once it becomes a culture war, then all of a sudden people get typecast, right?
So like, okay, if you're an EA, you're like the decelerationist. That means that you hate technology. And if you're an EAC, you love technology and you love Silicon Valley and you love Marc Andreessen and you love Peter Thiel. And it's like, well, you know, not necessarily. Like in reality, there's a panoply of views. There's people who arrive at different parts of the spectrum from many different places. And there's people who say, well, look, I think the probability of AI is going badly is 5%. but the likelihood that actually it's better if it's open source is like 25%. Or some people say like, well, look, I think it's like 10%, but I actually think that decelerationism is a bad idea and it ends up just politically backfiring, and so we kind of have to live with the acceleration.
In reality, there are EAs and there are EACs, quote-unquote, who have views anywhere along the spectrum, but once you become a culture war, all that shit goes away. And it's just like, oh, you're EAC, oh, you're Decel, or you're EA, or whatever the fuck. And people ultimately want a one-dimensional or sort of one-bit answer to how you feel about what is probably one of the most important questions right now facing technologists or, you know, technology regulation in America. So, you know, if you ask EAs, what do you think we should do, you know, regulatorily about AIs, you'll get a lot of different answers.
You won't get, well, we should shut it all down and, you know, fucking control all the GPUs, right? Eliezer says that. But Eliezer is like the, all the way on the spectrum, he's like, you know, the platonic ideal of a decelerationist, right, in that sense. But most people on EA are very, you know, there's like a multidimensional spectrum that people sit on different places in that spectrum. So for, you know, for myself, I was donating to AI risk, like in 2014, 2015, way before, you know, large language model. I mean, not way before large language model, but before any of this stuff was in the popular imagination.
And it was not very obvious at that time, what were the specific policy prescriptions that were going to be made or how was this going to interact with Silicon Valley? At that time, the people who were working on AI risk were also Silicon Valley nerds. It was the same team, right? It was the same people talking about this stuff. It's only very recently that now there's this sense that, well, you know, build, baby, build, which is like the Silicon Valley mantra, is now hitting this wall. And, like, I think it's a little bit of a boogeyman as well because the reality is that the EA types, you know, they don't really have that much power.
Like, they're not actually stopping anyone from doing anything at the moment. Like the real people who are stopping AIs are like the EU or like China, right, who are not EAs, right? That's not what's motivating them. It's like data privacy laws or just deference to the CCP, right? Even the executive order that Biden passed said that, OK, if you're above a certain training run size, you have to report that to the government. That's it. It doesn't say you have to stop. It doesn't say you can't do it. It doesn't say you have to follow these rules or whatever. It just says you have to let us know that it's happening, which to me, like, OK, that's a pretty far cry from, you know, deceleration, blah, blah, blah.
It's really just like an information gathering exercise, which I don't know, like probably they wouldn't have that much trouble gathering that information anyway, given the amount of GPUs would have to be cornered by anybody running a training run of that size. So I think there is a lot of reactivity right now, and that's what's causing people to believe, oh, you're way on this side and I'm way on this side and you kind of can't take any nuance of you in the middle. That's what happens in a culture war. first let me just say that eliza has also tweeted things like um abortion we should be able to abort babies that are up to 18 months or you should be able to leave your partner if you find some your wife or husband if you find someone 25 better uh like he he is you mentioned the platonic ideal he takes utilitarianism to the extreme and so like in the same way that best manifesto takes that idea to the extreme there are people in ea sbf of course one of them who take uh you know some of the ideas within EA to the extremes so far that they're no longer, you know, sort of palatable.
I would take the other side a little bit. I do think EA has a lot of power because I think that a lot of people who make up OpenAI, who make up Anthropic, who make up some of these biggest labs were influenced by EA or themselves are. They were. Yes, exactly. And so the ideas, they sort of came up in the EA soup. And right now there's not abrasive regulations, as you mentioned, you know, people are still allowed, but we're at a time where these regulations are about to be defined, the regulatory era of AI over the next year, et cetera. And the people who have, you know, like they're inviting people into the conversation who have EA influence, EA ideas.
And so I do think the area safety community will have an impact into the regulatory. But OK, but you raise a good point, which is kind of ironic, right? Which is that if you look at OpenAI, if you look at Anthropic, if you look at the companies that are actually accelerating, they're mostly EAs, right? Which like kind of fucks up the narrative, which is like, oh, the EAs are ruining everything. They're slowing everyone down. And like it's the accelerationists who want to go fast. The accelerationists are mostly VCs. They're mostly not building anything. They're just like on the sidelines cheerleading for this imaginary team that they think is in the driver's seat when in reality it's fucking EA people who are even thinking that this was possible in the first place.
Right? It was all the VCs who were not investing in any of this stuff because they thought it was so impractical and it was worth it. It's the EAs who believed that AI risk was a real thing because AI was going to become really powerful really quickly who created all this shit. So that's why I think like, again, this culture war typecasting that has happened is just ahistorical. It just doesn't make sense given who's actually the players involved. Most of the people who are regulating AI, like, yes, we just talked about Paul Cristiano, who is now somewhat influential, presumably at NIST, which is, again, a relatively minor kind of scientific organization.
He's not a congressperson, right? That's who actually writes the laws is congresspeople. If you listen to congresspeople, what do they care about? They care about jobs. They care about bias. They care about, oh, you're squelching conservative voices. That's what is very likely to end up on the regulatory regime. or the legislative regime. You know, I'd love if Paul Cristiano got, you know, something in edgewise into that conversation, and maybe he will, but so far, it doesn't seem like that's predominantly what we're hearing from the people who actually make the laws. There's one thing that we're familiar with in the crypto space.
It's tribes and certain, like, cultural leaders in respective tribes becoming the hardliners for that tribe, right? They really, they teach the tribe who, you know, vibe associate with the cultural leader how to be a hardliner. and then like the people that listen to like the high priest of this particular alignment camp absorb some not all of the message right like oh yeah most of this stuff feels good to me right we see this in literally every single crypto tribe that has ever been birthed and and we all have like one at least one respective hardliner and that's what like kind of more or less creates the tribe and then also you smash the particle of social media into that and like everything gets just gets juiced.
Especially this last cycle, as like Bitcoin ETFs have gotten approved and like BlackRock is starting to tokenize securities on Ethereum. I've very quickly realized that like the realm of crypto Twitter is actually a significant minority of like what actually matters in the space. And like if you're in crypto Twitter, you think crypto Twitter is massive. You think it's a really big deal because you are in it. And maybe it actually is. But like I remember hearing this like line from Sam Harris when he was critiquing Elon Musk's takeover of Twitter is like Sam Harris was saying like Elon Musk is like disconnected from reality because he's on Twitter all of the time he thinks the universe is Twitter and this is this is where the these tribes fight right this is where the hardliners you know chant their chant and they'll post out their tweets like get the their tribe on board and then everyone else thinks that this is the universe and so I guess like zooming out Eric like you you talk to all the technologists of Silicon Valley like can you like help us understand the scope of this like is this like a broad encompassing blanket that is over all of silicon valley and like government and like everyone is focused on this conversation or is this like kind of like a side quest from like the vcs and the builders and like it's actually not really defining the the game the landscape that much like how how far are we on these like continuum here's continuums i think the answer is is both similarly you know people say Twitter is not the real world.
Most people in the world are not on Twitter. That said, the people who are influential in the world, who influence other people's views, whether it's journalists or politicians or people on TV or anyone who's got a mouthpiece to the rest of the world are on Twitter. Not only are they on Twitter, they get their ideas from Twitter. They battle it out in the marketplace of ideas or the culture war. And so I disagree with Sam Harris. I do think Twitter is the source where a lot of ideas come from and a lot of the sort of ideas get litigated on Twitter. And similarly, most of Silicon Valley is just doing their jobs, not on Twitter, not focused on this.
But where do things get litigated? Often on Twitter, right? Like, you know, Aziz was just saying how EA has not had a big impact yet. We alluded to this off camera, But there's a world where Sam Altman did get fired, and there was an EA coup, and maybe there was overblown, but there seemed to be some EA concerns from the board, and maybe OpenAI would have taken a much more sort of decelerationist stance, right? There was this movement to pause AI about a year ago that it didn't seem like people followed, but maybe they would have. Go for it. Yeah, I want to push back against this because like this again was the framing of the open AI coup basically in like the couple days when it was all fog of war and nobody knew what was actually going on.
There's now been a ton of reporting on what actually happened in the open AI coup. And it looks like just a regular old, you know, like Sam Altman was like kind of telling people different things and he was like raising money for stuff on the side and not telling the board and blah, blah, blah. there's just like actually there was not oh there's q star it's a secret algorithm that's gonna ai risk and you know people saw that like oh my god you know sam allman wants to unleash it on the world and he's not being safe enough that was not what happened like we know now that's not what happened right what happened was just ordinary board loses trust with ceo ceo and board fight board is like very amateurish ousta ceo hire somebody you know it was all just like terrible board management but wow really because like to this day i have always thought that it was an AI safety issue.
No, there's been so much reporting right now. This is new to me right now. The New York Times has done a ton of exposés about this now. There was almost nothing to do with AI safety and the reason why OpenAI... Because at the end of the day, the whole non-profit structure of OpenAI was not the reason why they fired Sam. The reason why they fired Sam was that the board members lost trust with Sam. Sam reportedly was telling different people on the board different things. The board was like getting back together and they were very uncomfortable with the way that Sam was managing things and he was kind of controlling people.
And he had, people talked a lot about the fact that Sam is a very manipulative guy and he's very, very effective at what he does. Part of what makes him a very good leader is that he's very, he has this reality distortion field and he makes people feel how he wants them to feel when he's around them. That's the real story. If you try to tell the story about, well, opening eye was an EA coup, then you have a lot more explaining to do about like okay what was the ea thing that happened that precipitated all this perception is reality right and it was exactly no it's true it's true it was framed in that way by like the the chorus you know just the people on twitter the talking heads who wanted this to be the story it's the same thing with like ea versus eac right people want this to be the story but the story is almost always more complicated and the reality of opening eye was that it was more complicated than that Yes.
But if it had been completed, this coup that ever was, it would be framed as an EA coup, right? Yes, yes. Which, so let me refer in a different way. You're saying, hey, the people who actually write the laws, they don't care about AI safety. They're not AI safety people. They care about jobs and they care about misinformation. And I agree with that. And this gets to the sort of Baptist bootleggers sort of dichotomy that Mark and Jason often brings up, which is this idea that there are people who are purists. They actually believe in things like AI safety and they really care about the issues.
And there are bootleggers who are sort of either grifters or opportunists who notice something that is in their self-interest to take the same position as the Baptists. the Baptists, and they use the language of the Baptists to justify their own advancement of their own self-interest. And similarly, in tech, when right now there's a schism within tech, like there was a survey that went out to 10,000 researchers or thousands of researchers, and I think 10,000 MLIR researchers who work at these big labs expressed some concern over or sympathy with AI safety. And so if we as an industry don't present a united front in our belief of these technologies, it gives ammo to people who want to regulate them, right?
And in the same way that within crypto, if you have half the community talking about why crypto is bad and regulators see that, they might say, oh, even crypto people think it's bad or Web3 people think it's bad, Thus, we need to regulate it. So there's a concern in the same way that with social media. Social media people apologize all the time and express their concerns. And it gave more ammo for regulation. They have the concern that the same thing will happen here. The counter to that, which I think is a good counter, is no, it's not about giving them ammo. It's about self-regulating. If we as an industry can self-regulate ourselves, maybe that will prevent other people from coming in because we can prevent some of the damages.
is and and you know crypto talking about this a lot too of like you know um getting rid of scams early so that doesn't give the whole industry uh a bad name well in reality that is what's happening right it's it's who's doing the ai safety research who's actually trying to be responsible with this stuff the answer is open ai and anthropic and like the guys who are actually leading the front are self-regulating because their regulars have no clue what the fuck is going on they have no idea how to even be productively how to productively give input into how to guide this technology forward. So the reality is that, you know, the concern about regulation, I mean, it's one that I don't know anybody who doesn't share the concern over bad regulation.
Bad regulation is bad, right? Clearly. But it's also obviously true, even among the effective accelerationists, that AI is really powerful. And AI is going to massively change the playing field around who controls what. And right now, you know, they're kind of toys, like, okay, yeah, you can spam people or you can, you know, spearfish much more efficiently using these tools or they can tell you how to build a bomb, which like, okay, if you can't figure out how to Google how to build a bomb, like, you know, good luck using a large language model to get there. But like, there's a lot more that's coming and it's pretty obvious to everybody.
There's a lot more that's coming. And so I think, you know, whether you agree about, whether you think the right way to do this is self-regulation or government regulation depends on your confidence in the right laws or right frameworks to arise. And Silicon Valley obviously has, you know, a lot of scar tissue in believing that, you know, governments fuck it up. Governments are terrible. You know, everybody hates us. And so they're going to create these draconian laws that are going to be about this, you know, power struggle with government and with special interests or whatever. And that's going to be the regulatory regime that we enter into.
But nobody goes around saying like, you know, you know, all this stuff that OpenAI is doing around safety or this research that Anthropic is doing, it's stupid, it's worthless, it's slowing us down. Let's throw it away. Right. If effective acceleration has said that, then I would say, okay, it sounds like you guys are very consistent in believing that AI is an alloyed good. But they don't say that. They don't say like, well, why are these people slowing themselves down? Instead, they say, well, you know, government bad, these people good, which like, okay, I understand where that's coming from.
And I don't think EAs are pro-government, right? Which I think is, again, another way that this dichotomy kind of breaks down. EAs in general think that governments are terrible allocators of goods, right? I mean, you can just see it historically. Governments are incredibly inefficient. And so I don't think EAs look at that and say, well, great, government is the natural person to provide this regulatory regime because they're all brilliant and we love what everything the governments do. Most EAs are pretty libertarian on almost every single front. They generally believe that governments are incredibly wasteful.
But when it comes to AI, the concern is that, well, is self-regulation enough when you have a tool that is incredibly powerful, right? So if you have self-regulation around nuclear weapons, how well is that going to do in an environment where nuclear weapons are extremely powerful and extremely damaging? Well, in practice, we've kind of learned through experience the only way to really control nuclear weapons is with the monopoly on violence. It's basically saying, yo, Iran, if you develop nuclear weapons, we're going to come at you. So, you know, North Korea, if you develop nuclear weapons, we're going to come at you because we don't want these proliferate.
We don't want this to just be a tool in everybody's hands. We actually think that's a worse equilibrium to have everybody be really powerful. But this is kind of what EAC implies, is that the best equilibrium for AI is that everyone has one and AIs keep other AIs in check. And it's sort of like we all have nukes. Maybe that's true, but there's at least a real possibility that that's not true, that it's more like nukes and It's not like, you know, I don't know, you know, the books, right? Which is a thing. Okay, more education is good for everyone. So anyway, sorry, Eric, I know you want to jump in.
You are correct in saying that we are accelerating and EAC people are happy with the status quo. They're just worried that things will change. Because as you mentioned, the irony, people who are sympathetic with AI safety are the ones driving the acceleration. People work at these labs. But there are people who are even further on the side of AI safety who are noticing that contradiction, saying, hey, you claim to be about AI safety, but you're actually accelerating. People like Eliza, people like Laurent, very smart, brilliant people who are saying, hey, we actually need to slow down. Like, you need to be more, we need to pause AI.
We need to put an off switch. We need to have some sort of more extreme intervention. And I think the EAC people are responding to that concern. Not that the status quo is a problem, but that a very significant change could be a problem. So that's what they're worried about. providing a more stable foundation for Mantle's applications. The Mantle treasury is one of the biggest DAO owned treasuries, which is seeding an ecosystem of projects from all around the Web3 space for Mantle. Mantle already has sub communities from around Web3 onboarded, like Game7 for Web3 gaming, and Bybit for TVL and liquidity and on-ramps.
So if you want to build on the Mantle network, Mantle is offering a grants program that provides milestone based funding to promising projects that help expand, secure and decentralize Mantle. If you want to get started working with the first DAO-led Layer 2 ecosystem, check out Mantle at Mantle.xyz and follow them on Twitter at ZeroxMantle. Celo is the mobile-first, EVM-compatible, carbon-negative blockchain built for the real world. Driving real-world use cases like mobile payments and mobile DeFi, and with Opera MiniPay as one of the fastest-growing Web3 wallets, Celo is seeing a meteoric rise with over 300 million transactions and 1.
5 million monthly active addresses. And now, Celo is looking to come home to Ethereum As a Layer 2, Optimism, Polygon, Matterlabs, and Arbitrum have all thrown their hats in the ring for the Celo Layer 2 to build upon their stacks. Why the competition? The Celo Layer 2 will bring huge advantages like a decentralized sequencer, off-chain data availability secured by Ethereum validators, and one-block finality. What does that all mean for you? With Celo Layer 2, gas fees will stay low and you can even pay for gas natively using ERC-20 tokens, sending crypto to phone numbers across wallets using Social Connect.
But Celo is a community-governed protocol. This means that Celo needs you to weigh in and make your voice heard. Join the conversation in the Celo forums. Follow Celo on Twitter and visit Celo.org to shape the future of Ethereum. to make sure that you have the best advice and Toku can help to optimize your taxes so you pay the least possible amount of taxes while still maintaining legal compliance. With Toku's guidance, you can concentrate on building your company while Toku handles the logistics. Token launches don't have to be complicated. Talk to Toku today to get a free initial token valuation.
Welcome to Consensus 2024. Consensus is one of the biggest hubs for all things crypto, blockchain, and web3. This May, Consensus is celebrating 10 years of decentralizing the future. Going to Consensus means being in good company with over 15,000 attendees from over a hundred countries. You have the opportunity to learn directly from the architects and advocates representing Bitcoin, Ethereum, Solana, along with the teams from popular layer twos like Mantle, Arbitrum, Optimism, Base, and others. But consensus is more than just discussions and presentations. Badge holders get access to witness 10 professional karate combat fights and one unprofessional one between myself and Nick Carter.
For the visionaries, Pitchfest is your spotlight, presenting a stage for the most promising early stage Web3 companies. And for the devs, the hackathon offers a unique chance to build your next project or take your existing project to the next level immerse yourself in hundreds of side events and hacker houses scattered around austin register for consensus 2024 today and save 20 with code bankless yeah yeah i think i think that draw draws something that we see on both the extremes and something that elizur yukowski and like um beth jesus might also agree it's like there's another more cynical interpretation of the stuff that the ea people like the same altman's are doing and the reason they're spending time in DC.
And that interpretation is regulatory capture. So they actually want to hit the accelerator on AI in general, but they're also reasonable people. And they're happy to work with the government in order to come up with sensible regulation and partner with them because we're the educated ones, we're building the models. And so, yeah, let's team up with the regulators and the governments around the world in order to kind of create the right rules for this new and emerging industry. And oh, by the way, this would be, I think, the Marc Andreessen critique. By the way, we are the recipients of value.
We have cemented ourselves. We've created a moat for ourselves and our own businesses. And so there's a criticism that comes from Eliezer in doing this. He's saying, well, this is hypocritical. If you're really worried about AI safety, you would like cease immediately. You would stop like doing this until you do a Manhattan project and go figure it out. And then there's a criticism from the Beth Jaysos side of things with Sam Altman. Beth would probably be someone who says like, this is clearly regulatory capture. They're doing it in broad daylight, right? The only solution for this is decentralized AI and everyone needs like a model and an AI genie in their own home running on their own uh like hardware right so this is a critique that's coming from both sides and i'm wondering hasib like what about that more cynical interpretation of of what's going on like in in fact wouldn't that be like um actually the game theory of what companies want to do they want to go build monopolies and so i mean that that's a sensible uh business strategy uh sam albin's sure individual he's he's great at this right yeah okay so first of all i'd say i find this a is a little ironic because again, during the whole AI ousting or open AI ousting drama, Sam Allman was typecast as like the Promethean, you know, like the, the EAC guy who was trying to make AI go faster.
And now all of a sudden, Oh no, no, actually, nevermind. He's not the savior. He's actually the, the, he's the boogeyman. He's actually going out there and trying to, you know, he's the JP Morgan trying to corner the steel trade or whatever. I don't know. To me, this is not a critique. This is an innuendo, right? What is Sam Allman? Okay. Let's, let's, let's step away from AI. Let's talk about crypto because I think, you know, people in this podcast understand crypto easier let's pretend that instead of sam allman it's brian brian armstrong okay he goes to dc and he says hey i'm going to engage with dc and try to come up with you know sensible legislation would you be like oh my god he's trying to cap his regulatory capture what is he doing why is he consorting with the enemy so not not uh brian armstrong but spf that's exactly what he was doing yes yes okay so put spf aside let's say brian armstrong brian armstrong does go to dc he does do all those things do you say the same thing is happening now it's just brian armstrong instead of spf no but i would be cautious generally i'm why not why not why not just just because i mean for me is this a be cautious what do you mean by be cautious what do you mean be cautious i think i think it's both it's he's both fighting for regulatory arbitrage in the way maybe implicitly but he's also fighting for the industry as a whole uh yes regulatory capture yes but he's me i think he's motivated by all the right reasons and then the effect of that is regulatory capture.
Sure. Okay. So it sounds like what you're saying is, hold up a sec. Let's see what he actually does. Yes. And then judge him based on the consequences of the legislation that's actually proposed. Yes. Yes. Okay. That sounds very reasonable, right? That sounds very reasonable. Okay. What is the legislation that Sam Allman has proposed? I actually haven't seen anything. Nobody fucking knows. We don't know. The answer is we don't know. So it's all innuendo, right? This is people just making up a fucking story because it sounds good. The reality is if you're Sam Altman and you're not going to D.C.
and you're ignoring people in the White House, you're a fucking idiot. You're an idiot whether you're fighting for the industry or whether you're fighting for regulatory capture. Like either way, if you just ignore them, you're a fucking moron. So until we see what is the actual legislation that he's advocating, we don't know. And if you were Sam Altman and you literally just ignored D.C., you would be definitely doing the worst thing possible, right? I would much rather Sam Altman be there than whoever else is going to be there instead, you know, some guy from, I don't know, fucking Google or something.
I would much rather say well than be there. I think this is a fair point. I want to hear what Eric says on this, but it is a fair point. Actually, it was kind of like a critique that I had of like Brian Armstrong and Coinbase of like not engaging in D.C. earlier and sort of letting a vacuum be present so that people like SBF could actually engage. The moment I actually, like Bankless in general, so David and I kind of like started, our spidey senses started tingling with SBF was when the draft of some proposed legislation that he was responsible for actually came out. And it felt very much like a rug pull, ladder pull up on all DeFi front end interfaces and like brought him to task and said, hey, SBF, this is not like crypto values.
Like, what are you doing? you're um you're essentially forcing it or creating some legislation that would force kind of compliance on this space and and promote your centralized exchange and so a critique of like brian during that time was like i wish he had been there because if if if if you're saying sam altman could be good we don't know it's kind of like you know schrodinger's uh sam altman we'll see what the legislation that that pops out on the other side um i guess the the the case for that would be if he doesn't do it, then some more nefarious version of a Sam Alton would be in DC engaging those regulators and engaging regulatory capture.
So I suppose we don't know until the legislation is out. What do you think about this, Eric? I agree with Haseeb's framing that Sam has to get involved. Yeah, let's wait and see what the regulation looks like. I would like to see AI safety people more strongly disown the AI ethics people because they often get conflated, right? And because they have a sort of a coincidence of wants motivated by, you know, disparate desires. Who are the AI ethics people? I don't think we've defined that well enough, Eric. AI ethics people are people who are worried about misinformation, who are worried about sort of inequality about certain people or certain voices being represented by the AI.
Is this like AI woke people? Yes, that's exactly it. And these are the concerns that along with jobs and other things that Congress people or regulators are more sympathetic to because they don't quite understand the AI safety arguments just yet, or it's a bit too abstract. And by not disowning those sort of reasons, they sort of implicitly accept them or give them more power. And I would like to see that. And this is why we see things like Google Gemini being super woke or even ChatGPT earlier. And these things matter. And so that's something that I would like to see. One thing I want to return to a little bit earlier is Steve was framing the culture war.
And when we have a culture war, things get kind of dumbed down. And people typically associate culture war with bad, right? And when they think of a lack of culture war, they think of, oh, a great marketplace of ideas where people are being very sophisticated and presenting good arguments. And this, to EA's credit, is often what EA is in many ways. It's very intelligent conversation, trying to get the truth in some ways. Now, I would also posit that the lack of a culture war is not just this great marketplace of ideas. It's also something like North Korea. It's something where there's a lack of moral or intellectual diversity.
It's just like you just have to have this. This is a defense that some people give. Is this a pro-culture war argument? Yes, yes. We should have more culture wars. It's a pro-polarization argument. I think in, and even in EA, I saw this blog post, we can link to it, where someone was saying that EA needs more polarization. And it actually affects their giving. Like EA gave, or, you know, Gible gave like $200 million to criminal reform or something. And this guy was arguing that actually made the problem worse. And why didn't people come in and measure this? because they felt it was too controversial to go against it.
And this is a critique that some people give of EA, which is as much as they want to claim to be rational, first principles, you would think that that would lead to a diversity of perspectives. And in some cases, it does on issues like long-termism and specific implementation details. But it's worth noting that EA is Democrat, that there are very few Trump-supporting EAs. Now, why is that? Is it possible? that everyone in EA from their first principles is just like Trump bad, Biden better, that seems very unlikely. It seems that EA is also prone to tribal thinking in ways that other communities are.
And that's not a knock on EA, but it's the reason why culture war in this case might be good. I'll also posit that EAC is a way for Silicon Valley to implicitly be right wing, implicitly be conservative and you notice that eac is not only uh talking about issues like you know advancing ai or technology but also wading into other culture it's it's much more masculine it's much more alpha it's much you know it's concerned with birth rates right um and so um i think it's good for there to be in silicon valley more polarization and more diversity as it relates to um as it relates to intellectual issues, it relates to politics, because for so long, we've had a lack of that.
And that's prevented really important conversations on things like, you know, criminal justice, for example, or things where there are different, where there are taboos, and EA and rationality is supposed to get rid of taboos, or, and in some ways, it hasn't done that. So I'm curious how you would react to the characterization of EA as Democrat affiliated, or left-wing and not having enough sort of intellectual or moral diversity. I think you raise good points. And I should probably reiterate that, you know, I've been affiliated with the EA philosophy for, you know, almost 10 years now. I wrote a post fairly recently kind of critiquing EA's, I think I titled the post, the unreasonable ineffectiveness of effective altruists.
And I think what I've found over time, you know, coming into the crypto space, I kind of thought that there would be, you know, when I first got into EA, EA was like, you know, these kids who were really, really smart and, you know, made a lot of money and they seem to be extremely smart and fastidious and hardworking. And I thought, wow, these people are going to be super successful. I'm a nobody. I hope I can be successful too someday. And then, you know, I found my way into crypto and started building stuff. And I knew some EAs who'd gotten into crypto. One of those EAs was this kid named Sam, who I first met at EA Global, which is like this big EA conference in San Francisco in 2015.
He was still working at Jane Street at that time. And I met him in a hallway and we chatted for like five minutes just about blah, blah, blah, EA, whatever. And, you know, whatever. I didn't think much of it. He's just, you know, got, you know, a piece of guy curly hair, shorts. Little did I know. Little did I know. I'd come across him again much later when we were both doing very different things in the crypto industry. Neither of us were in crypto at that time. And so I kind of assumed that there would be a lot of people who were really successful in crypto who were EAs. and what I would later discover many years after being a VC was that that was super not true.
There was basically only one other person who was a real EA or like a kind of central EA who was very successful in crypto and that was Sam and I didn't know Sam super well. We chatted maybe three four times over the years that we'd interacted with each other but obviously you know we all know the story of what happened with Sam and he you know single-handedly kind of redefined EA for most people as being this kind of really corrupted kind of corrosive um you know group thinky kind of go along with the flow um very left-leaning uh tribe right essentially that that's that's what most people think of ea as well well now i'd just like to add a little bit more onto that just like sociopathic comes to mind because it was like utilitarianism to its nth degree like not considering about like any local humans emotions or anything like that right right and so in these famous stories about you know would you bet the entire universe on a 51 49 uh coin flip and he's like yes i do it infinitely many times um and so just almost like you know this autistic chasing of oh go ahead eric it's worth noting he said that in a podcast and it wasn't like there was this you know everyone coming down on him criticizing him he was still a god uh and so it's yeah it's crazy the difference between how spf was treated before we found out he was doing a fraud even though he was saying some of these things he wouldn't say fraud but he was saying extreme utilitarian ideas in broad daylight.
And so it's just worth noting. Yeah, exactly. And so it is, it is, it's something that we actually talked about, we alluded to briefly earlier about extinction risk, right? And like, you know, what is the, what is the importance of avoiding extinction risk? And the reason why SPF's example is wrong. So a classical thing in EA is this idea of risk neutrality, which is this idea that, okay, you know, most people are risk averse. they don't want to take risks and so it's like okay if i can definitely save a life by you know going to uh i don't know a food drive and donating some food and i will definitely save a life by doing that but it's very very expensive um or i can like maybe probabilistically save a life by you know investing into water filtration systems and maybe somewhere down the road that's going to result in saving a life most people are like well i want to know for sure that i saved a life and ea kind of advocates this risk neutrality which is the idea that look in expectation because you know there's millions of people doing millions and millions of things trying to save lives, all you really care about is on average, how many lives you save.
And in the portfolio of all the things people are doing to save lives, you should just increase the expected value and not worry so much about whether your coin flip turns out heads or tails. Right. And so, you know, SPF kind of took this idea to an extreme and said, okay, well, we should gamble the whole fucking world on, you know, plus EV one life. Great. Okay. Flip the coin as many times you want. That's free money. Now this is wrong. Okay. This is actually just wrong. This is wrong. according to this mathematical rule called the Kelly Criterion, which basically defines the optimal level of risk-taking you should make in order to maximize the growth rate of your bank roll.
I used to be a professional poker player before I ever got into tech or crypto or anything. And Kelly Criterion is a concept that everybody in poker knows, is that if you want to make the most money, you follow the Kelly Criterion. You don't bet your entire bank roll on, oh, okay, I've got like, you know, 60% to win this hand if we go all in. So great, I'm going to bet my entire a bankroll on it because that's the maximal expected value. That's wrong. That is wrong to do that. It is wrong to do that because when you go to zero, if there's a real existential risk, even if the risk is low, you can never come back from zero.
As long as you still have some bankroll, you can make it all back. But if you go to zero, you cannot make it all back anymore. Your growth rate is now zero forever. And so Kelly Criterion tells you you should maximize growth rate as opposed to maximize expected value. And you maximize growth rate by following the Kelly Criterion. So Sam was wrong. in his elocution of that. But people kind of get stuck on this idea that, oh, well, that's what EAs believe. EAs believe that you should bet the universe on every tiny little edge and every small piece of expected value. So again, it's like this, it seems like the EA worldview just completely diverges from what normal people think of as common sense morality.
And I think it's, SBF's worldview did. But most EA's worldviews, if you explain them clearly enough, it's like, actually, no, that actually does sound pretty reasonable. Yeah, okay, if you're playing with a technology that might make you go to zero, okay, well, you know, the one rule of gambling is that you never fuck with going to zero, right? You never fuck with going broke. You always leave some money on the side that if you end up losing the hand, even if you're all in aces versus kings, you still – there's a chance you lose when you go all in aces against kings, right? So, okay, that 10% of the time that you wipe out, you want to make sure you've got some money to start grinding it back.
And in some sense, that is the core idea behind, hey, if you're P-Doom, that's the probability that you think that AI is in some way an existential risk to humanity. If your P-Doom is like, you know, 5%, that means to most people, like, oh, okay, well, then why worry? Like, obviously, this won't happen. And so, you know, what's the chance that a 1 in 20 thing is going to happen? Why are you guys freaking out about this? But if somebody says, you know, I don't know what my P doom is, but it's probably something on the order of like five ten percent Which means the modal outcome nobody ever has to worry about any of this None of this is gonna matter most the time you're gonna walk to the world and AIs are just gonna be you know Sex robots and you know, it's gonna help you with your taxes and whatever But you know, none of them is gonna none of them really gonna try to kill humanity Right that most people who are talking about EA believe that they believe that the modal outcome is that nothing bad will happen Or nothing bad on a catastrophic scale will happen.
I should I should clarify And, but they say, even if that's true, that 5% of the time, you don't risk that. You don't risk that. So even if you think, yes, there are going to be trillions of humans in the future, and the EAC worldview is that, well, all those trillions of humans, I agree there will be trillions of humans in the future, and we should care about their well-being just as much as we care about present humans. And so therefore, you know, if we wait even a moment longer to let AIs arrive into the world, we are doing a massive amount of harm to all those humans. The shape of the argument is kind of similar, right?
But the Kelly criterion, if you take it seriously, what it implies is that, hey, waiting another couple of years to get to the same place we're eventually going to get to but with much more – with basically minimizing the chance that your bankroll goes to zero is worth it if you're just thinking about Kelly criterion. And also with the role of human incentives, I think the gap between the Kelly criterion and what value like maximizing EV ended up being like SPFs like Bahamian penthouse and all of his political donations and everything else. One thing I want to speculate with you guys is why is EA this convenient punching bag?
And it's a punching bag on contradictory statements, right? Like the AI ethics people for years have been calling EA like transhumanists are saying, hey, you're way too tech oriented. And of course, the people call them doomers like, you know, EA is has a branding problem. It's been having a branding problem. And it's it's it's it was a punching bag after SBF. It was a punching bag for open AI. It's basically something that everybody else can rally around of why they dislike it. right and and it continues to have this trouble and i would pause it it's because ea has beta energy ea is a has nerdy beta energy and it doesn't stand up for itself it doesn't say you know uh like after the spf thing it goes it apologizes it goes into hiding after opening i think also like why did they say no this was totally fake you're making this up actually like EA has done some amazing things, right?
EA has had incredible accomplishments and yet they're not shouting them off of the rooftops in the way that Mike Solana is shouting off, you know, Alpha aggressively saying why tech is good. And this is where I posit when I, you know, somewhat joking about culture we're good, but I think EA and EAC need each other. Like I want an ecosystem where EAC and EA are duking it out because I think we need both. I think we need a movement that is explicitly, unadulterated, pro-tech, alpha energy, willing to fight back against people who are trying to unfairly critique it or get our CEOs fired or put in dumb regulations.
But I also want another movement that keeps that movement in check and says, hey, AI safety is actually this really important thing. We should really look into it. We should self-regulate and have that fight internally as opposed to externally. And we've seen when EA gets too powerful, it becomes this massive punching bag. At the same time, EAC, when it gets too powerful, it becomes really cringe, right? Like EAC is at its best when it's duking it out with EA. When it's trying to be this overarching thing, it can't really... EAC is like an underdog movement. They're both like underdog movements that should be in productive tension with each other for us to figure out.
And maybe the status quo is actually like pretty good. Like we have labs who are accelerating, and yet they're also working on alignment research. They're also trying to keep each other in check. And if we could just keep this productive tension, or what I'm calling productive tension, maybe we can get to a better solution here, as opposed to the worst of these extremes. You talked about the manifesto and how extreme that is. And we talked about some of the extreme players in the ai safety and how bad that is so that's uh something i would posit why ea gets beaten up so much and why it needs uh eac support to help defend the parts of it that that they agree with which is 98 percent in in in in my belief um and then also why the why the tension is helpful i agree with you that ea is a punching bag it's it's weird to me in a way so you know i was in ea before ea got really on the global stage right most people didn't know what an ea was when when I was first in EA.
And then really kind of in large part due to SBF, EA suddenly became very high status, right? During SBF's reign, EA, like it was almost crazy the amount of positive coverage that EA was getting, despite the fact that EA is like objectively really weird and very unapproachable for most people, right? So it kind of got lumped into this just like general asceticism and like sagely, saintly energy that SBF was trying to portray himself as being. and the like in a way two things I'd say one is that that made me very uncomfortable this idea that like wow EA is like so good and everything about you is good and everything that is EA is good and now EA is actually really cringe right it's like not cool you go to Silicon Valley party and you tell someone you're an EA and they're like oh okay well interesting and that it's definitely not something that people continue to self affiliate with which is part of the reason why I also like it more now?
Because I feel like, okay, if you're EA now, then you actually, it requires some balls, right? You're basically taking a hit publicly to say that you're an EA. Right, exactly. It's an EA bear market. I think like that is kind of the valley of darkness that EA needs in order to really define its identity and not just be like this kind of milquetoast, like, oh, I'm smart and cool and good. And isn't that wonderful that I'm all those things at the same time? And so that's one thing I'll say. I think that it has been good for EA in a certain sense to kind of get stress tested by becoming very politically unpopular.
The second thing I'll say is, OK, why is EA such a punching bag in a way that, for example, tech was not post Theranos or post, I don't know, crypto. Crypto obviously was a punching bag post SBF blowing up, but EA as well. And I think a big part of the reason for that is that EA is just not designed to be politically capable. It's almost premised on this idea that politics is bad. And politics is the mind killer. And if you believe this and everything that you preach is about nuance and careful thinking and avoiding sloganism and not being lazy and being suspicious of power structures, and then you're like, great, now let's go fight in the biggest power game of all, which is politics, you're just going to lose because you're going to suck at it.
So I think that's largely the answer is that the one person who was good at politics in EA was SPF. And everybody else in EA just like fucking sucks at politics. And that's why they were the saintly, quiet, nerdy people who were just in the background doing stuff and donating to bed nets and all this – doing the AI research, AI safety research at a time when nobody else cared. And now it's like, oh my god, you guys are actually in the way of progress and you guys are all terrible people. And they're like, no, no, we're really not. Let's do a two-hour debate to discuss why. And they just don't have the ability to get out there and fight with slogans, which is the EAC people, very politically capable.
Right. I mean, Marc Andreessen and Mike Salon and all those guys, they live and breathe politics. Right. Whereas the EA people, you know, they're a bunch of like philosophy professors. Right. Like that's that was the leader of their movement. These are these are verbose, you know, kind of extremely particular people and they suck at politics. They might not be interested in politics, but politics is interesting. That's just the point. Maybe we could bring to that that part of the conversation, because like these nerd battles that we thought we were having insular to like kind of nerd culture in Silicon Valley are now like.
political battles. And there seem to be some party lines kind of drawing and using these platforms for maybe a different use case than when they were originally created. And there seems to be this dichotomy forming behind kind of a political party for de-accelerationism, like check on Silicon Valley power and technological progress without constraints. Maybe there's some anti-capitalism or anti-billionaire type stuff tied up in that. And then there's this pro-tech accelerationism, remove the constraints, let's let America be the grandmaster of AI, let's win this battle. And at a very curious time with respect to at least American politics, because we're sort of in between orders.
We had the New Deal order for a very long time, FDR until the 1970s, And now we're in this neoliberal order and have been for the last 40 years. And I feel like we very much are on the exit ramp out of that neoliberal order. And it's like the U.S. is trying to find out what's the next political order that we're going to establish ourselves with. And I think the neoliberal order that kind of rubber stamped the internet in the 1990s and helped Silicon Valley prosper, they were very tech forward. They love technology, right? It's going to bring jobs, like the economy. It's not a certain thing that the next order, political order that dominates America, will be as tech forward as the order has been at this point in time.
You could start to see some battle lines being drawn. You know, I think people like Balaji and Marc Andreessen might say there's like the blue tribe that is tending towards tech de-accelerationism, like lots of restraint, lots of regulatory apparatus, like slow down on this whole tech thing in general. And then there's maybe Team Red. They haven't quite chosen an alliance yet, but maybe they are going on the tech forward side of things and tech accelerationism side of things. And it seems like, I don't know, you have to pick a tribe at this point in time. From our conversation up to this point, Haseeb and Eric, I feel like both of you guys believe in a P-Doom for AI greater than zero, right?
So you're not maximalists on either side, the EAC side, you know, or the or the EA side of this debate, you're probably somewhere in the middle. But it's hard to really pick a side politically, right? When it seems like if you choose the de-accelerationism side, then you're consigned to like shitty regulation and they're going to like shut things down and cement some of the leaders. Or if you go on kind of the other side, well, then maybe you don't have the constraints that you actually need for the space and you're not properly regulating kind of like the the danger of this anyway how do you think about the politics of this whole conversation that has exploded beyond like nerd culture and is now like biden has executive orders about this stuff all right and it's just starting like ai is the thing uh that the nation that the world is is talking about at this point.
So Haseeb, what's your take on this? So what I resist the most strongly is the politicization of this question, right? Because this is one of the most important questions of our time, which also means that it's really fucking important to get it right. And the one way you will guarantee that you don't get it right is by making it into politics, right like if you think about masks like you know how we dealt with the pandemic was probably one of the most important questions this decade and we fucking failed because we turned it into politics instead of turning it into a just raw scientific question of what is the answer of how this fucking disease is spreading and disrupting society and like you know killing millions of people around the world um and so if you let that happen to ai i think you've already lost the game right if you if you concede this idea that well there's this tribe over here and this tribe over there and you pick one side and then, you know, the end, like, no, that's fucking retarded.
Okay. That's just absolutely wrong. That's not the way you should be thinking about this. The way you should be thinking about this is that these are really hard questions and the answers require nuance. They require careful study. They require lots of time and energy. And the only way you will guarantee that you get it wrong is by saying that there are only two sides, right? In reality, it's a multidimensional question. Like, and the idea that, okay, well, you know, there's the D cells and there's the X cells and like, you know, the blue tribe likes this, the red tribe likes that and blah, blah, blah.
It's like, no, no, no, no, that's not true. Okay. One thing that we know about politics from people who actually go and study this stuff, as opposed to reading media, which will give you a very distorted view of what people actually think is that most people are not diehard leftists or diehard rightists. Most people are somewhere in between. They have a mishmash of ideas. They don't fit neatly into either of these categories. And they don't like either of the leading candidates right now, right? That is what we know. We know that by actually doing polling. If you go look at people, they don't fit neatly into these two categories and they don't on AI risk either.
Right. So people say, well, you know, I think PDOM is this, but I actually think we should do that. Or I think, hey, you know, GPU constraints are not smart, but I think we should be putting more effort into, you know, using the government to fund safety research. Right. Because maybe it's undersupplied by the private market. There are a lot of median positions you can take that are not shut it all down or like build, baby, build. Right. There's tons of room in the middle. And if you lose that room, then you're definitely going to fuck up. I think you'll fuck up to some degree, but I would argue that it could actually be worse.
And so I think it would be not the worst situation if one side was build baby boom and the other side was shut it all down. Because my worry is that both sides are going to say shut it all down. Like we have Tucker Carlson going on Joe Rogan, literally saying shut it all down. He sounds like a dumber version of Eliza. Not to put down Tucker necessarily. And Tucker is one of the most popular people on the right. Like if he ran for president, there wasn't Trump, maybe he'd be a candidate. So I could see shut it all down being a bipartisan thing. Like, you know, we're at a time of extreme populists, as Steve mentioned.
You know, people don't like Biden. People don't like Trump, you know, and and and we're also at a side of an era of horseshoe theory on anti-tech. Right. Like when you think about someone like Bernie Sanders, you think about someone like Trump. These are populists from both sides who actually have a lot in common or more than we might think. So my hope is that the AI safety people, I don't want to call them decelerationists because they don't call themselves decelerationists. And we should use the terms that people use for each other, for themselves. My hope is that the AI safety people and the EAC people can publicly state, hey, we have 95% agreement.
We're both, we're all pro-tech. Tech as an industry is pro-tech. We disagree on this little issue. Of course, it's of mega importance, of utmost importance of AI safety, because that would signal to the rest of the world that there's alignment. Whereas my concern is that both sides will be, both red and blue in a populist side will be anti-tech and will be sort of missing the forest from the trees when we need to actually defend tech. I share that concern. And actually, that might be kind of like the default state of the pendulum swing, because I would say the neoliberal order of the last 40 years has been very much like pro-globalization, pro-many things, but definitely pro-tech.
And I'm seeing whatever the new political order that's replacing it to not be so favorable to tech as they previously were. And a microcosm for this is crypto for me. It's basically like it's not a sure thing that Team Red or Team Blue will be team crypto. It's just totally not a sure thing. We have no idea where they're actually going to fall on this. And it actually, to Eric's point, does make me, as somebody who is an advocate for crypto technology, decentralization, private keys in the hands of individual, all of these things, start to skew a bit more extreme than I otherwise would be in trying to make the case for like why crypto is is good right it's like um i have to do that in order to push the agenda and to contrast myself against these movements from both like sides of of politics that would just like shut it all down they don't see the use case for um proof of work mining and bitcoin so just shut down all the mining facilities they don't understand why people need to run a validator in their own home or why um defy interfaces you know don't require aml kyc and all of these things right so let's see what do you say to that like eric's making the case that maybe we we should all band together not necessarily on the far extreme eac type of um case but we should definitely make a pro-tech case um like or else or else we'll fall prey to the the other political parties that just don't want any of this technology just don't care about it it so the the ea tribe is often affiliated with being doomers about the technology but i feel like of the eax side is in a way a doomer on the politics right where they basically believe that you know if we don't have this extremely rigorous defense of technology that it's all just going to get you know it's all going to go kablooey and we're going to get you know we're going to turn into like this uh socialist uh state that we're all going to be uh enslaved by elizabeth Warren and nobody's going to have any freedom.
And like the reality, you just look right now, okay, you say, oh, the EX are in control, or sorry, the EAs are in control, the safetyists are running the asylum. If you look right now around the world, where are the AI restrictions actually happening, right? The answer is in the EU. That's where the most constraining stuff is happening. And then in China, right? People are saying on the EX side, they're like, oh, no, if we don't, you know, EA is so anti-tech, you know, if we let the Democrats, we have a democratic president right now. The Democrats, if they control things, they're going to shut down all the technology and they're going to make it so I can't use the internet, I can't use social media, I can't use whatever.
Go look at China where they have, you know, people are worried, oh, China's going to race ahead of us. They're going to unlock the technology. They're the real accelerationists. Go read the AI regulations in China, right? In China, you cannot release an AI application without it being explicitly approved by the CCP. There are only 40 applications that have ever been approved by the CCP, right? You are liable in China if your large language model says something that's not true, you are liable in China. That's the law that they passed in China. Okay. That's fucking insane. That's absolute. That is what you're up against in America.
The reality is that yes, there's a cacophony of voices. Many people saying many different things. The EACs are saying one thing. The EAs are saying one thing. The AI, you know, anti-bias people are saying some other things. And the reality, what did we actually have in the US? The answer is nothing. There is no laws. There's no regulation. There's nothing right now, right? There's an executive order that says, you have to let us know if you run a training run at least this size, that's it. That's the only regulation that we actually have. And regulation is a strong word for that, right? The reality is that there's no regulatory regime at the moment in the US.
And the reason why that is, is because that cacophony of voices continues pulling things in different directions, right? I mean, we say, man, it really sucks that Gensler is doing this. And, you know, the FinCEN is doing this and blah, blah, blah. Okay. What are the laws of crypto in the US? The answer is that there are none. There are no laws in the US. There's no regulatory regime, there's nothing. There's just a bunch of people fighting. And, you know, if you look at the founding fathers, the way that they described government is that they wanted that to be the case. They wanted there to be continual fighting between the different branches of government to prevent any centralized control in, for example, the president.
They didn't want the president to be able to say, well, guess what? I'm president. So here are the laws now. Well, the laws can get shut down by judges. They can get replaced by legislators. And the reality is that that cacophony of voices keeps things in check. So anybody who's claiming, oh my God, there are EAs in the government now, therefore it's all going to go to hell. And, you know, we're now all going to be, you know, talking on our Google controlled smartphones and nobody's going to have open source AI anymore. It's all going to get banned. They're fucking wrong. It's never happened.
It's never been true because of our system of government. So that's why that like, there's a political doomerism that I also object to, which I feel like is part of what motivates the, the, um, the energy in demonizing the the ea type so i think what what they have to say is a very good point that deserves to be heard but do i want ea is running the government no i want the government to be the way it is which is you know a a um a contest of different forces right there are people who are economically minded who have a good point that's not being pro-culture war it's being pro democracy yes i'm just teasing but you're pro this productive tension and it plays out yes yes i'm Very pro-productive tension, 100%.
I actually really like this productive tension framing. Kind of like as we get to the close of this conversation here, I kind of want to zoom out because I actually see the same acceleration. I know decelerationist isn't actually a tribe here, but it's like kind of a talking point. There's accelerationist versus decelerationist debate. But it's also not just like Silicon Valley. It's not just AI. It's not just crypto. Whereas these things are generally all on the accelerationist front. Like we're also seeing experiments going on in other technology verticals as well. Like Brian Armstrong or excuse me, not Brian Armstrong.
Brian Johnson is trying to experiment himself into like becoming a new class of humans. This is the guy who's taking any risk or not any risk, but any sort of like experiment to try and like add, you know, five more minutes to his life every single day. Right. Like people like Aubrey de Grey are literally trying to create like immortality. Even in the crypto space, there's like Vida Dow out there who's like trying to combine crypto and immortality to make it happen faster. and like this is we haven't even like opened up the conversation about like gene editing which is like not far away like there's other technologies out there that's really going to like if you think ai and crypto is going to make the future weird well like there's like three more technologies out there who's also going to make uh the future weird and the thing is like this has always been the case of like technology technology just accelerates it's always accelerated as soon as we develop tools we can use those tools to develop other tools and all of a sudden like we are an accelerationist in an accelerating state and this is just the only difference between like now and any other time in history is that it seems to be where we are now versus where we are at the end of the lifetimes might be like multiple orders of magnitude different and that has never been true before in history like we've only ever had like 20 percent 30 percent gains at most like usually over the span of human history we have like two percent gains and like for thousands of years we actually literally had zero percent gains and we're now we're all on this like parabola of innovation and so if we're talking about this tension between governments, like stakeholders in the government.
It does make sense that when you have crypto and AI and like biotech and all of these other different like sectors of technology, which are all like making monumental gains, that all of government is like, okay, everyone break. Because who else is saying that? Who else is saying like, yo, calm down. Like that's maybe like kind of like my commentary on like why I think the government will trend towards breaks, not gas, but like maybe Eric, maybe you can like check my reasoning on this. No, I, um, I, I, I, I agree. That's part of, uh, the, the broader productive tension. And I, um, I want to bring in, you guys had this amazing episode with Vitalik where he, he, uh, identified and expanded upon his Diak philosophy.
Um, and I think that's worth noting too. And, and I think that piece had a great, um, synthesis of the, of the, of the problem and sort of the common alignment between EA and EAC and trying to develop this sort of thesis and synthesis approach. But I think, unfortunately, I think it's a bit too neat. I think it's tough to just focus on technology that are defensive. Things that tend to be defensive can be offensive and vice versa. Fire can be used for good, it can be used for evil. And if we're going to continue to develop these models, I don't see ways in which it can only be used for defensive ways.
So that's my commentary on that. And then to connect to your point, I think we are going to continue to need the AI safety people to develop and further develop our alignment capabilities. And we're going to need people who are pushing the brakes. It's my goal in this conversation to rehab or improve EA's reputation, AI safety's reputation, but to also keep it in its box. As Haseeb said, we don't want them running the government. They're not close to it yet. But, you know, the regulatory regime, you know, is going to be up for grabs over the next few years. And that's why these fights are really important.
Even if they only influence a small amount of people right now, they have potential to influence a large amount of people. And so I think we do need the right combination of brakes versus gas. I would rather see it come from within the industry, from people who know what they're talking about, than outside of it prematurely. And so, yes, we are going to see governments come in with some brakes. Ideally, they can be informed by some of our people and some of the productive tension that we're having first. The one thing I would add to that is that we've talked a lot about, oh, my God, what if the EAs are running things and what if they have total control?
Won't they shut it all down? The reality is a much more politically powerful cohort is not the AI safety people, but the AI bias people, right? These people are much more influential. Are these the same people that Eric was calling AI ethics earlier in the conversation? Yes, AI ethics, exactly. So these are people like, okay, you know, what if the models are biased? What if the models are more liberal? What if they're more Republican? What if they, you know, say things that they shouldn't be saying or, they give people instructions on how to cause harm or whatever. Now, the interesting thing about AI ethics versus AI safety is that the core problems that you need to solve are actually kind of the same, which is how do you control these models?
And the answer is we don't really know. We don't have good techniques to control these models. Now, how do you control a model? Well, that's called AI alignment, which is the core problem behind AI safety, which is, okay, right now, the thing that the model is doing that you don't want is making biased representations of, you know, people in certain, you know, stereotypical careers or something. But, you know, eventually it might be the thing you don't want is that, you know, gathering a bunch of resources or hacking people in order to, you know, make a bunch of money in order to fulfill some task that somebody who's running an AI agent wants it to do.
These problems are one in the same, in a sense, right? I mean, they're, one of them is easier to solve than the other, but the core of the problem is that we don't know how to control these models. They are very difficult to control. They're very unintuitive. They're kind of like these space aliens that we've conjured up, right? People, People often say that large language models were discovered, not invented in the sense that, you know, we just sort of threw more and more compute. And then it's kind of like, you know, when something moves faster and faster, it turns from a liquid into a gas.
In the same way, when you throw more and more compute at something, at a certain point, it becomes a large language model. And you're just like, whoa, what the fuck? What is it? This thing can now like talk to me and do my math homework. Like, that's really weird. And that phase transition is still very poorly understood. And I think there's going to be a lot of political fights about it. But if both the EACs and the EAs don't get their shit together, the AI ethics people are going to win because they have much – one, they're much more persuasive. They're much more easy to understand for most people.
Like the whole Gemini drama had nothing to do with EAC or EA. It was all bias, right? It was all like, oh, you know, this thing fits neatly into the actual culture war, which is the left-right culture war, which is, oh, these things are super woke and they won't depict any white people. And that is much more powerfully animating in – among Congress. We're talking about what are 70-year-olds who are actually the people making the laws and voting on this stuff. What resonates with them? I'll tell you. It's the AI ethics stuff. None of this stuff even rates yet. So everything that Mark Andreessen doing and that Eliezer is doing is important because by default, both tribes are losing.
And maybe this is a great place to end this idea. There's this saying, I'm against my brothers, but me and my brother are against my cousin. And right now EAC is against EA, but EA and EAC need to team up against AI ethics or AI bias because we can all agree that those people are wrong. Well, hold on, hold on. Last thing I wanna say, I want to make some room for the AI biased people because like obviously it's true that Gemini was like a horrible model. And obviously it's true that the AI models can do pedestrian bad things too. And you want to control that because way before AIs are going to become super intelligent or become so powerful they take over the world, they're going to do pedestrian harms.
And you kind of want both, right? You want to also solve the pedestrian harms, and that's a real problem. You also want to solve the existential harms. That's a potential real problem too. It's a much bigger problem. And you also want to solve AI overregulation. That's also a big problem, right? All three of these are problems that a good regulatory regime should find a way to solve. And so, I mean, that is my very lame and narrow attempt at synthesis of these three positions. But I don't think you have to say, well, you know, these two are illegitimate and this one is legitimate. The answer is obviously all three of them have legitimate concerns.
And you want to find a way to address all three. That's too much nuance for me. I preferred my… Fair enough. Let's close this conversation out. And I want to ask you just one final ending question, which is just maybe summarize the conversation for each of you. So when faced with the question, which you surely will, Bankless listener and then Haseeb and Eric, are you team Excel or team Decel? Are you team EAC or are you team EA? Pick a side. What's the most sensible posture to that kind of framing of the question to pick a side? Haseeb. so i mean i won't surprise anyone to say that i'm on team ea um but a frame that is saying i'm on team ea because i think uh at the margin the world needs more of that i think it's got enough people who are say you know pro tech uh no regulation i want more ai products and i think there's also enough people who are saying hey there's too much bias in these things and they're they're bad for society i think there's not enough people saying hey these things are really risky and we should invest more into safety?
I also want to surprise people. I'm team accelerationist. I'm team pro-tech, but I think that we should absorb some parts of EA. I think EA is beaten down. They have wounds and we should pay for their hospital bills and bring them into our tribe and team up against the AI bias or AI ethics. Some who have some legitimate points, I will concede that, but also some points that I also very much disagree with. And I think my call out to accelerationists is to take AI safety seriously. I think they worry that if you concede that PDoom is even a concept or that there are AI safety concerns, that you sort of throw out the baby with the bathwater and you go as extreme as some of the most extreme EA people.
But I think we should find a way to have more common ground with AI safety people, acknowledge that there's 95% agreement with most of them and work on alignment and then fight the right enemies, which as Hasib mentioned, it's the AI ethics people, AI advice people, regardless of what you think of them, they have a lot more power on a regulatory stage. And that's where the battle is really taking shape. So I'm an accelerationist with some humanism, and I think we should extend an olive branch to our most rational and reasonable AI safety people. There you go. Nothing unites us like a common enemy.
And so maybe that common enemy is the EI bias people. The people are just trying to censor all these models. Hasib, Eric, thank you for this fantastic conversation. I think this will leave bankless listeners with a lot to think about on this subject. It's been a pleasure. Thank you for having me. Got to leave you guys with this. Of course, I usually say crypto is risky, but we talked mostly about AI. I think AI is risky as well. This is definitely the frontier. It's not for everyone, but we're glad you're with us on the bankless journey. Thanks a lot.