Welcome to Bankless, where we explore the frontier of internet money and internet finance. In this 8-episode series, we are exploring some new frontiers. New frontiers in new technologies, all of which are poised to completely revolutionize the world and change everything about the operating system that society is currently running.
This video features two conversations with big-brain builders Daniel Shorr of ZKML and Justin Drake of the Ethereum Foundation. Although cryptography quickly falls down a technical rabbit hole, it looks like we're entering a new golden age of cryptography.
Keep an eye out as we roll out the rest of these boundary-pushing episodes!
----- BANKLESS SPONSOR TOOLS:
🐙KRAKEN | MOST-TRUSTED CRYPTO EXCHANGE https://k.xyz/bankless-pod-q2
🦊METAMASK LEARN | HELPFUL WEB3 RESOURCE https://bankless.cc/MetaMask
⚖️ ARBITRUM | SCALING ETHEREUM https://bankless.cc/Arbitrum
🦄UNISWAP | ON-CHAIN MARKETPLACE https://bankless.cc/uniswap
🛞MANTLE | MODULAR LAYER 2 NETWORK https://bankless.cc/Mantle
----- Timestamps:
4:00 DANIEL SHORR 6:00 Cryptography and AI 9:15 A Computing Explosion 13:10 On-Chain AI Models 15:45 Modulus Labs 19:15 Compute Integrity 24:00 A Verifiable World 26:15 Accountability for Machine Models
31:00 JUSTIN DRAKE 33:30 Nova Cryptography 39:00 Decentralizing zk-Rollups 43:30 The Future of Rollups 47:35 Improving Validity 50:45 This is a Big Deal 54:20 Justin’s Zuzalu Experience
---- Resources:
Daniel Shorr https://twitter.com/realDanielShorr?s=20
Modulus Labs https://www.moduluslabs.xyz/
Justin Drake https://twitter.com/drakefjustin?s=20
---- Not financial or tax advice. This channel is strictly educational and is not investment advice or a solicitation to buy or sell any assets or to make any financial decisions. This video is not tax advice. Talk to your accountant. Do your own research.
Disclosure. From time-to-time I may add links in this newsletter to products I use. I may receive commission if you make a purchase through one of these links. Additionally, the Bankless writers hold crypto assets. See our investment disclosures here: https://www.bankless.com/disclosures
No summary for this episode yet.
Welcome to Bankless, where we explore the frontier of internet money and internet finance. And today, on this episode of Arzuzalo series, we were exploring some new frontiers, new frontiers, and new technologies, all of which are poised to completely revolutionize the world and change everything about the operating system that society is currently running. On this episode of Arzuzalo series, we're exploring the frontier of cryptography, which is maybe not as new of a frontier as some of the other ones that we've explored yet nonetheless. The cryptography-enabled future is poised to change the landscape as all the other technologies that we've talked about.
I will say that the ZK Week at Zuzalo was one of the weeks that I intended the fewest talks and works of ops on, because I mean, come on, what am I going to do there? Which is why I pulled in a very familiar friendly face, Justin Drake, to summarize the entire ZK Week at Zuzalo in a 45 minute episode. Comes out, there's this cool new frontier of crypto called Nova, Nova ZK Nova, which has to do with folding numbers recursively. To make cryptography harder, I don't know how to explain it, but that's what Justin is for. But first before we get to the familiar territory of Justin Drake, we're going to talk to Daniel Short, who's working at a startup in the ZK ML landscape, which has gotten a ton of hype and attention lately.
And if you listen to the interview with Daniel, you'll understand why. The thesis is that there's going to be a Cambrian explosion of AI models out there and simply verifying the model itself on chain using Ethereum and a ZK proof can give consumers and users of these models assurances of the authenticity and the outputs of that model. The fact that the input actually went through the correct model and the output is actually verified by the model that you want. Why this is important and what this unlocks, Daniel will explain in the show. In conclusion, this one is a doozy but Daniel and Justin do a great job of dumbing it down for us in this episode.
So let's go ahead and get right into it. But first, at the moment to talk about some of these fantastic sponsors that make the show possible. Kraken Pro has easily become the best crypto trading platform in the industry. The place I use to check the charts and the crypto prices, even when I'm not looking to place a trade. On Kraken Pro, you'll have access to advanced charting tools, real-time market data, and lightning fast trade execution. All inside, there's spiffy new modular interface. Kraken's new customizable modular layout lets you tailor your trading experience to suit your needs. Pick and choose your favorite modules and place them anywhere you want in your screen.
With Kraken Pro, you have that power, whether you are a seasoned pro or just starting out, join thousands of traders who trust Kraken Pro for their crypto trading needs. Visit pro.kraken.com to get started today. You know Uniswap, it's the world's largest decentralized exchange with over $1.4 trillion in trading volume. You know this because we talk about it endlessly on Bayquus. Uniswap, but Uniswap is becoming so much more. Uniswap Labs just released the Uniswap Mobile Wallet for iOS. The newest, easiest way to trade tokens on the go. With Uniswap Wallet, you can easily create or import a new wallet by crypto on any available exchange with your debit card, with extremely low fiat on-ramp fees, and you can seamlessly swap on mainnet, polygon, arbitrum, and optimism.
On the Uniswap Mobile Wallet, you can store and display your beautiful NFTs, and you can also explore Web 3 with the in-app search features, market leaderboards, and price charts, or use Wallet Connect to connect to any Web 3 application. So you can now go directly to DeFi with the Uniswap Mobile Wallet, safe, simple custody from the most trusted team, and DeFi. Download the Uniswap Wallet today on iOS, there's a link in the show notes. Mantle, formerly known as BitDow, is the first Dow-led Web 3 ecosystem, all built on top of Mantle's first core product, the Mantle Network, a brand new high-performance Ethereum layer 2, built using the OP stack, but uses eigenlayers' data availability solution instead of the expensive Ethereum layer 1.
Not only does this reduce Mantle Network's gas fees by 80%, but it also reduces gas fee volatility, providing a more stable foundation for Mantle's applications. The Mantle Treasury is one of the biggest Dow-owned treasuries, which is seeding an ecosystem of projects from all around the Web 3 space for Mantle. Mantle already has subcommunities from around Web 3 onboarded, like Game 7 for Web 3 gaming, and buy Bit for TVL and liquidity in on-rounds. So if you want to build on the Mantle Network, Mantle is offering a grants program that provides milestone-based funding to promising projects that help expand, secure, and decentralize Mantle.
If you want to get started working with the first Dow-led Layer 2 ecosystem, check out Mantle at Mantle.xyz, and follow them on Twitter at 0xMantle. Bangladesh Nation, it is ZKWeek here at Zuzalu, and I am talking to Daniel from Modulus Labs. Daniel, welcome to the show. Thank you for having me. Okay, so there is a growing hype and attention around this world of ZKML, and so we are getting some hype-y adjectives, not adjectives, hype-y letters, consonants. Yes, exactly. Yeah, letters. Can you explain the world of ZKML to the best of your ability as short as possible, and then we'll get to why these things are currently getting married in this point in time?
Yeah, I think, I mean, let's just start with the letters. ZK as the first two, zero knowledge is often known as an accountability or integrity technology, so it basically tells you that some compute was done correctly. So that's exciting, and actually has this odd property where verifying that compute is a lot less expensive than doing the compute naively. So it's often been used to compress information, and then in the place of blockchain, bring that information on chain while retaining the security standard. The metaphor we like to use a lot is that it's hard to complete a Sudoku puzzle, but once a Sudoku puzzle is completed, it is easy to verify that it was done correctly.
Exactly. And that's just like ZK in its essence. Yes, yes, precisely. That's kind of the most powerful property of ZK in the blockchain context. Kind of what's next then, at least for us, was, okay, excuse me, if this technology can be used to scale blockchains, what is the most kind of intense or almost irresponsible kind of compute we can throw at this kind of technology? And in terms of the size of the compute, it doesn't get much larger than machine learning models. And what's more responsible is that it's just in like the magnitude of the compute. Yes, exactly. So you're stress testing the whole paradigm of ZK.
That's right. And that's how you got to ML. That's right. Why is, okay, what is ML and why is it so intensive? Yes. So machine learning or just artificial intelligence in general is a process of using an algorithm to approximate human-like decision making. So I think like high semantic output space, right? So I want to look at an image in the site if it's a cat or a dog, or I want to kind of predict what might happen prices in the future by looking at a lot of data from before. Traditionally, this has been seen as kind of a task for human beings. But ML is this kind of wild regime where algorithms can take the place of human decision-making.
And specifically these algorithms, there's a software and a hardware component, right? And the hardware is kind of the clock speed, how fast this thing can think. And you can throw a lot of hardware at this thing, you can, and that will get the result faster. And the point is that blockchains Ethereum is not something that you go to to do a lot of compute quickly because that is what gas is, that is what gas fees are. That's right. So like where does this intersection occur at? So like if you said that you want to have this irresponsible use of a ZK proof and what that means is just like throwing a lot of compute at this thing, that's fun.
Why is this a real utility? Well, why is this actually useful? So kind of the magic is, I guess, the security of the blockchain, right? And the ability to bring compute of any size, but especially in this case, really large compute up to that same security so that you can ingest AI decision-making into your smart contracts or into your DApps and on-chain services. That we think is a really powerful paradigm and something that's now uniquely enabled by the fact that ZK has improved so much, and especially at least in the case of modulus, with a focus towards machine learning compute. Okay, so apps can use AI, just unpack that a little bit more.
For sure. It's a very general statement. Yeah. Can you make it a little bit more just to find an illustrative? Of course. Let's take some kind of DeFi service which has liquidity pools. Perhaps they want to rebalance these pools using a really advanced algorithm, maybe something even akin to an AI algorithm. Currently, all that compute needs to happen off-chain because it's just too expensive to run on-chain. But with ZK AI or ZKML, you can imagine that option compute getting that ZK seal of approval. It's like, okay, this compute has been pre-committed, bless you. Of course. And using zero knowledge, we can prove that that compute was done correctly, thereby upgrading it up to the security center of the chain, and it's as though that entire process, in this case of rebalancing the pool, ran naively just on-chain.
Why do you need to verify? Why do you need to verify it? Why can't you just run it without actually having to verify it? Yeah, and I guess I'll start by saying a lot of services currently do just run compute off-chain. But I think a big part of why we're in the blockchain ecosystem at all, and certainly a big part of what attracts modulus, is the kind of security standards that's established by this decentralized network of nodes and having the social consensus, and all the wonderful things we get in Ethereum and some other chains as well. And so we want to make sure that the services that write on these chains that buy into the security ethos of the chain gets to participate in that fully even as they take on bigger statements of work when it comes to compute.
So if I'm a DAP, or I'm an on-chain service, and I want to use AI, maybe I don't have to give up on the security that my customer and maybe even myself, I expect out of my own service. Okay, so I think the reason why this whole area of focus is getting so much attention, ML, machine learning, chat GBT has just like elevated that into the stratosphere. Yes. ZK on the crypto side of things, the theme of ZK week was how fast and compressed and capable some of these ZK circuits are becoming. Yes. And so on one side of things, we have the growing Cambrian explosion of AI, getting large in capability.
And then on the other side, we have ZK decreasing, which was what ZK does, decreasing complexity and simplifying compute. Yes. So like at a high level, at a broad stroke, you can see how these things kind of would work together. I'm guessing without knowing too much about this kind of naively that the idea of putting is an AI on chain implies that there's going to be tons of AI models like generalizable and any kind of model that you can think of that an AI would be able to produce for, I don't know, defile liquidity comes to mind, but like literally anything. Sure. And then the idea is that with ZK ML, you get to verify the actual model, the external model that I'm assuming many, many people are going to work on, like individual models.
And we want to make sure that that is the actual model that we are running on chain. Exactly. And that's the ZK component. Yeah, you got it. I mean, this is, I mean, sure, it's defile and certain market mechanisms potentially or maybe moving users' funds, of course, or crypto across different chains to optimize yield farming or even NFTs, right? Let's say I want a machine algorithm to output pixel art or any type of generative art. But I want to know that that piece of art actually came from the algorithm that might be really valuable, right? So ZK ML is a way of extending that kind of cryptographic promise of authenticity to all kinds of AI outputs specifically.
So I guess the possibilities are substantial, so long as we can get the tech right and obviously all the acceleration on the ZK side really helps with that. So I'm just going to like list off a bunch of models that I can think of, we got like ChatGDPT is the big one, GBD4, mid-journey, what are some other ones that are out there? Like we got, we got a barred, there's all of these older models like Bert, right, recommender models, generative models that output pixel art, GANs, generative adversarial networks, as well as maybe more subtle models like anything from, you know, a game that uses an agent, by an AI agent to simulate NPCs, to something more kind of outlandish, like an LLM that maybe predicts investment decisions or things like that.
So perhaps one model is, in the gaming world, is something that is generatively producing a landscape. Sure, yeah. That is a model. Yes. And maybe this applies in the world for people that are familiar with Dark Force. Sure, totally. We need to make sure that we're playing a game that has a specific model to define the landscape of the game that we are playing. Exactly. This is an example of a model. Yeah, that's great. And the counterparty risk here is bigger than just swapping out the models. It's swapping out the output entirely. So let's say you have an AI responsible for the landscape, or the weather, or the in-game economy, or it's like a, almost like a God role in your game, right?
If, you know, I as the operator of the game, or the developer, is biased to, let's say, penalize David's camp, or David's planet, right, we're going to nuke your planet from orbit via the decree of the Galactic government. And there might be enormous financial stakes through these in-game economies. That's like a devastating result. And so in the same way, it's a rug pull. It's a rug pull. Yes. And so in the same way that blockchains kind of extend this veil of security, where this promise of security, rather, to everything that's on-chain, we want to make sure that keeps being the case, even as we want to bring AI kind of feature sets on-chain.
Right. Okay. And so like, just going further, like we got the AI generative landscape. And you also have like the models of AI NPCs. Sure. And like, I could just think of any, this kind of fun to think of, like, what AI models could become. But I think that's kind of the point is that it's so generalizable, right? And so, AI's, we're about to get into AI week loss of AI talks happening right now. There's a talk of generalizable AI, like artificial general intelligence, but then there's also the topic of like, narrow AI. Yes. These are both models. Right? It is a narrow AI about chess. And then we have more generalizable AI's that we think are coming or word are coming.
Also a model. And so the landscape of models, which is a, it's one of those words that you don't really understand until you see how generalize it is, the growing world of AI's generalized models for stuff. And then the ZK element allows it to take the soul of that model, of a particular model, and place it on chain to become an on chain resource. That's right. For the rest of the blockchain, to ecosystem to use. Exactly. And it has all those properties that we love so much about things being on chain, including it's composable, it's obviously a high security. It's in some sense really a testable and referenceable.
All these things that, you know, makes the chain kind of a wonderful environment, you kind of imbued that AI compute, which previously was just in a black box somewhere. And so like this, I'm assuming, yeah, the composable part gets really, really cool because then you can create some sort of system that creates a world of models. And I don't know where, where is the utility coming from first? Like so if there's, it's exciting to see all this possibility. Sure. What's the lowest hanging fruit? Where is going to get built first? Yeah, great question. You know, there's already kind of prototypes, including ones that we've built and others as well, kind of exploring, it's still very nascent, a category, right?
Everything from, you mentioned this briefly, like chess engines, right? So we brought a four million parameter chess engine on chain and now players can stake and bet against a chess engine, knowing full well that they're always playing against the same AI model. And in no way can modulus or anyone else swap out the results of this particular chess engine by calling up our friend Magnus and say, hey, Magnus, what move would you play? Yes. But you know, that's just where we're starting. We're also starting a ZK Gan project, so generative art and of course, we're kind of marching towards that LLM goal.
But there's a lot of kind of space in between that, of course, right? Again, I mentioned like, recommenders earlier, there's a lot of use cases for just any amount of personalization when it comes to the chain, but still at the kind of security standards we want, right? If you have a social media feed, but you want to know that the same algorithm that drives the equitable results you see on Daniel's feed is the same one that David sees, then ZKML can play a really, really key role there. So, okay, at modulus labs, what's the current, what are you guys focusing on right now? What's the current bottleneck or constraint or problem that you guys are currently solving?
Yeah. Where are you in the roadmap, I guess? Yeah, yeah. Great question. So, you kind of alluded earlier in the ZK week, right? We're seeing kind of the ZK overhead come down substantially, and that is amazing and obviously very helpful precisely because at the top, we mentioned that AI is like a lot of compute. It's almost irresponsible. I think the exciting here is that our jobs almost easier because AI as a classic compute is really structured, really repetitive, and those things, those like properties of that compute, allows us to make the ZK stack much more efficient, right? In some sense, it's almost like you've down-selected to a more specialized class of problems that gives your ZK prover a lot of space to be more efficient and kind of take advantage of that structure.
And so, modulus kind of what we work on for the most part is making the proving stack significantly more efficient so that we can bring much larger, much more expressive models on chain at still that same security standard. Okay, so this is what your guys' technology is. You guys aren't bothering with the AI world. You're not here to build AI models. That's for the AI industry. That's right. You're just to build the bridge to be able to verify models on chain. Exactly. So, you guys are operating in the ZK world. Precisely. Precisely. You got it, yeah. Okay. Sounds ambitious. We do our best. Yeah.
How big is modulus slabs? Modular slabs is currently a very proud four people. And when did you guys get started? About seven months ago. Okay. Yeah. Where did the original inspiration come from? Was there like an aha moment or how did the team come together and what was the motivation? Yeah, I mean, this is going to sound a little ridiculous, but of course, there was all this kind of excitement around stable diffusion and generative models. And around the same time, we kind of fell in love with ZK and we kind of started asking ourselves a question of, hey, kind of what would we want to build here, right?
And the background of the team is all like AI researchers from Stanford. And so it was almost kind of an obvious thing. We kind of asked ourselves, oh, how silly would it be if we like put a very non-performing AI model on chain to, I don't know, let's say, predict eith prices. So that's what we did. We built the world's first on chain AI project as a joke. We hacked it over or hacked it together over a week and it started predicting prices of eith and making trades on L1 with a unisop contract. It's a joke, right? We did this purely as a proof of concept. But the point was not to make money on eith.
I don't think the goal was to make money that that wasn't the goal. No, no, no, it was an idea. And this model would not be able to do that, to clarify, but kind of, and I guess just to really nail that point home, we didn't put a call function in the smart cop. So once money went in, we put in like 500 bucks, right? No one could touch it, us included. But kind of something miraculous happened, which is lots of randles on the internet and ons included started donating money to the trading bot. And if you look at the kind of historic performance, there's like a friend in, it kind of goes up into the right.
It's not actually doing, that's just like, buoyed up by the donations it was getting. And of course, eventually it lost all everyone's money as we've been telling her very kind of transparently. Their algorithm failed to produce more ether. It did. Yes. But it did succeed at being an algorithm on chain. Exactly. And it was the point precisely. And kind of there was nothing that modulus team could do to, again, tamper with anything that it, it's kind of like an, imagine like an autonomous robot just executing forever. So kind of from that point, we were like, oh man, what if we brought an actually performant model on chain?
Imagine how cool that would be. Right. Yeah. Okay. There are two worlds that I see spawning here. There is the insular world of crypto who's like, oh, we could build models to do things inside of the crypto world. Yes. And then there's external uses that need to verify models and their execution off chain. Yes. Yes. Can you talk about how these two worlds might develop independently? Yeah. Exceptional kind of insight. You're totally right. And that's kind of how we see it as well. In some sense, the crypto world is a little more convenient because there's already kind of a cultural expectation of a compute integrity as a really core value, right?
We want to see that as much of the compute that's related to our D apps and on chain services are on chain as much as possible, right? This is kind of the excitement that's driving all the ZK roll up kind of activity. But of course, the question is what happens when you step beyond the on chain world? Does the rest of the world care about verifiability? That this algorithm was the one that made that decision, right? And you can imagine in a future where the judicial system uses a large language models to make decisions about sentences, God forbid, or a medical system that uses a very sophisticated model that determines certain medication treatments.
These kind of intersections are really sensitive where liability is a big concern. I think verifiability is going to be a big deal. And what's cool is we get to get that flywheel started, the cultural appetite for it in crypto, and really kind of hopefully build up a really strong kind of, almost a strong example of what it's like to be able to attest and make our algorithms accountable. And then we can communicate that with the rest of the world. But modulus right now, we're very much focused in crypto with kind of an eye to the future. Sure, sure, sure. Yeah. But knowing what the eventual tam would be, especially as the tam is likely going to grow as AI grows, right?
So the mental model I have is like that little like SSL certificate, like the little shield in your, it's kind of like that. It is. Prove this model that you're using. It's proved. Exactly. That's right. Rugpole resistant. Exactly. Or a rugpole immune. I would imagine that like as all of the AI people that are over there talking about AI doom, they're talking about like one of the past towards AI doom. First before doom, we get to AI fun times. Yes, that's right. And in the AI fun times, an explosion of models, an explosion of usefulness, an explosion of human productivity and flourishing and wealth generation, precursing the inevitable blow up.
But before we get there, it's a world that we like live, the humans live on models. Yes. And our life is guided by models and determined by models. And so with that Cambrian explosion of models, I would assume that the surface area for rugpoles also grows. Yeah. It's actually kind of terrifying how big the attack vector can be for generating catastrophic results in your AI models, right? There's a kind of classic example of a vision model which sees a stop sign and you go in or a picture of a stop sign, say, and you go in, you put three pieces of tape or manipulate some pixels in a totally, in a way that's totally indecisurable to the human eye.
And it thinks the stop sign is a, you know, a go sign or God forbid is a toaster, you know, anything, right? These AI models do have very substantial kind of adversarial environment or attack vectors. And it's a little scary for sure. Yeah. And we're helping secure our future. It sounds pretty important. And also it's like making it, it's just like trustless, there's many different aspects of AI. And this is like one way to make AI applications safer. Yes. It's not the AI safety conversation, but it is part of it. Yeah. I mean, the way I like to think about it is, you know, you have all kinds of different models and your model might be more explainable, more robust to attack, more equitable, right?
It doesn't bias for specific political allegiance where anything else, right? And these are amazing attributes and very hard problems that people are actively working on. But without verifiability, right, without the ability to pin down that model at any given instance of use, you can swap out that fair model, that robust model for a different one or for no model at all. I can just be feeding it any answers I want as the operator. And so in the same way that the security center of blockchain is that it's all there, right? Like you can just go into the ledger and see exactly the transactions. We make sure that the algorithms have that same kind of quality.
Right. And so the one, the insular way of using this technology is that we get smart contracts that are AI's that get to do things on chain and that's going to be pretty cool and tight and I don't even know where to think about how to start thinking about that. But the outside world is at that point, just using the blockchain as like a time stamping tool, correct? Yes. Yeah. Yeah. Using environment where public verifiability is just like so obvious there, right? And so it could be this amazing kind of settlement arena for the world's compute. Right. Yeah. And in a world in which we are probably are going to be using AI models and we're probably not going to think about the rugpole surface surface area, right?
Yeah. So like humans, when we use these things, we're going to assume that they're the things that we want them to be. And so we're not going to be looking for the rugpole. And this actually, this technology actually allows us to be cozy as we use these models. Yeah. In some sense, and it's a little insidious, these models are very sticky. They're incredible, right? They're very personable, magical kind of features that we can add into every part of our compute diet as a society. And of course, while that's happening, we're very quickly expanding the surface area of potential attacks. And the goal is to make sure that before we have that catastrophic outcome, right, before somebody gets really injured where a lot of money is lost because of the widespread use of large AI models, that we have that accountability piece in place, along with all the other AI safety technologies.
Yeah. Daniel, I would imagine that this conversation, just about ZK, ML, what we're talking about here, can go on and on and on and on and on. Definitely can. What parts of the, are there any big parts of the conversation that I haven't opened up yet? Good question. I mean, every part seems like it's filled with potential, right? But something that we spend a lot of time on, for example, is, and this is going to sound like the opposite of the kind of aspirational exciting thing that's happening, is a literal cost of doing this process, of running these compute, or these, this very expensive classic compute in a zero-knowledge setting, and making sure that although we're excited to kind of have our heads in the sky, we're kind of marching towards real implementation, real use cases, real customers, right?
So it starts with working with folks like WorldCoin on identity verification, or self-custy or biometric information, all the way to games and defibrato calls, and of course NFTs as well, to kind of push the envelope on accountability for machine intelligence, right? So we have this kind of bigger thesis, but at least for modulus, and I think the category in general, this nascent category, we want to make sure we march to the beat of kind of real impact, right, making sure that it's actually making a difference in the ultimate lives of these service providers. The phrase accountability for machine models, I think, is going to be something that really resonates with a lot of people, even at just like the cursory level, right?
AI is going to and has triggered just like a lot of people's just like the hairs on the back of their neck, sure. And so just as a branding, hey, we're helping AI be safe, it's like a really good branding to lean into. Well, kind of what's exciting, of course, is beyond just the branding being kind of very appealing for sure, is that this is, you know, AI researchers are not going to love kind of the way I phrase this, but I almost see these technologies with personalities, right? AI is this like very expressive, creative, like infinite potential, very powerful, but cryptography is very humble, it's very discreet.
It says, this is the statement that I can show with pure mathematics and, you know, this is kind of the kind of claim that I'm able to make and no more. And so being able to marry these two things which have quite a bit of tension by their nature is something that's like deeply exciting for certainly me and I think the whole modulus team, right? Yeah. Yeah, you're used that word expressive, which is like one of my favorite words, and we have all of this explosion of AI models that have all of this power and personality that you're saying. And I think like maybe adding in that ZK circuit component also adds in just like a stamp of authenticity.
Yes, precisely. Yeah, it's like, I mean, you mentioned the little little little check mark where it's like a Twitter verified check mark, maybe back in the day when that was more substantial socially, but having something like that for your models, right, for your AM models or for your any mechanism that is, you know, sophisticated compute precisely. Daniel, I've learned quite a lot where should listeners go if they want to continue going down this knowledge rabbit hole? Yeah, I mean, not to show our own stuff too much, but modulus labs. We're on Twitter. We try to put out decent content, and of course, I watched your guys this first video on this for all YouTube and man, that broke my brain.
Oh my goodness. Yeah, yeah. There's, you know, all parts of the stack to enter, we're very technical, to kind of more philosophical, but we want to make sure that kind of we meet people where they are because it's really cool. And we want as many people kind of to be in, in the know about this stuff and kind of be part of this movement for your words now, accountable machine intelligence. Yeah, that's love it. Daniel, thank you so much. Thank you, David. Really appreciate it. Yes. Metamask has something new. Introducing Metamask Portfolio. Metamask Portfolio is the best way to view your crypto portfolio from a holistic level.
See everything across all the chains all at once. In your portfolio, Metamask will report the aggregate value of all the assets in your Metamask wallets. And even the other wallets you import too. But Metamask Portfolio isn't just a passive portfolio viewer, it is a place to do all of the money verbs that make DeFi so powerful. You can buy, swap, bridge, and stake your crypto assets. So not only is Metamask the easiest place to see your wallets in aggregate, but it's also a powerful battle station for all of your DeFi moves. So go check out your Metamask Portfolio because it's waiting for you to open it up.
Check it out at portfolio dot Metamask dot IO. Arbitram 1 is pioneering the world of secure Ethereum scalability and is continuing to accelerate the Web 3 landscape. Hundreds of projects have already deployed on Arbitram 1 producing flourishing DeFi and NFT ecosystems. With a recent addition of Arbitram Nova, gaming and social apps like Reddit are also now calling Arbitram home. Both Arbitram 1 and Nova leverage the security and decentralization of Ethereum and provide a builder experience that's intuitive, familiar, and fully EVM compatible. On Arbitram, both builders and users will experience faster transaction speeds with significantly lower gas fees.
With Arbitram's recent migration to Arbitram Nitro, it's also now 10 times faster than before. Visit Arbitram.io where you can join the community, dive into the developer docs, bridge your assets, and start building your first app. With Arbitram, experience Web 3 development, the way it was meant to be. Secure, fast, cheap, and friction free. Hiring people worldwide, paying them in crypto, providing them access to benefits. It's all so complex. But it doesn't have to be. Compllying with labor laws, payroll rules, tax obligations, and crypto regulations in every country that you employ someone is difficult, time consuming, manual, and costly, and is drawing more and more attention from regulators and governments.
But there is good news. Toku is here. Toku is the first of employment and compensation platform for the crypto industry that makes this easy. Toku helps you hire employees or contractors and pay them in Fiat or crypto legally, importantly, and with all the taxes handled, and over 100 different jurisdictions. So whether you're an early-stage company with just a team of two, or you're an enterprise with 200, Toku has a solution that meets your needs. Toku is already working with the leading companies in this space, protocol labs, Hedera, GetCoin, and many more. So transform your employment and token payroll operations with Toku.
You can reach out to Toku at toku.com slash bankless or click the link in the show notes. Bankless Nation. Here at Azuzalo, and I'm talking with our good friend, Justin Drake. What's up, Justin? How's it going? Yeah. Well, good. Thanks for having me again, David. So this is ZK Week. Yes. As you are knowledge week, this is, I've hopped into two talks trying to understand what's going on. I stepped in to the talk, and it started to break my brain, and I did not. Nothing went in. And so as someone who is both a cryptographer, who's on the frontier of cryptography, yet also understands how to explain these things to a more general public.
I'm hoping you can kind of help me understand what the hell is going on this week. Right. So I actually took a bit of a break from crypto, a one year break more or less going into MEV. But you know, I've been getting back into things in the last few weeks, oh, by crypto, you mean cryptography. By bankruptcy, yeah, I mean cryptography, yes. And it turns out there's been a ton of progress around this thing called Nova. Now Nova is kind of this idea, which started in two years ago in 2021, by a paper written by, by, by three enough, sati. And basically he came up with this approval optimization for snarks.
So one of the big bottlenecks in snarks is the ability to prove very, very big statements with, you know, small amount of computational resources and also with low latency. And just, just a snark is just like a compression technology, it's, it's, it's a ZK. It's, it's exactly, it's a ZK proof. And the thing that we're very, very good at is getting the ZK proofs be extremely small and extremely easy and fast to verify. So that's on the verifier side of things. And a lot of the work now is on the proof side of things, we want to generate these proofs in the first place. And you know, we can do proof for simple statements, you know, like in the context of ZCAST, I'm making a valid payment, but we want to be doing things like, you know, ZK rollups.
And here we have massive statements, we want to prove that a whole Ethereum block is valid. And a lot of the complication from an engineering perspective stems from the proof side of things. Okay. So just to make sure I'm with you, we have the technology to take a bunch of data and compress it into a really small packet of data. Yes. And the technology to do that fast and cheap and quickly, right? Right. Well, maybe now we do, or at least we're getting there. That's what we're talking about. That's what's being talked about here. Exactly. Exactly. That's the cool frontier that we're on. Yes. So there's a whole class of snarks that are based on so-called curves or lipstick curves.
And the Nova techniques are on the order of 10x faster than the previous proof techniques. Nova is the cool new thing that people are discussing. It's the cool new thing. Yes. The generic term is called folding. And the reason is what you do is that you're going to take structured computations. So instead of taking this huge unstructured statement, you're going to take very, very structured statement and try and fold the various steps into each other. And this folding process is much, much cheaper than snarking. Now what do I mean by structure? Imagine that you have a CPU and every cycle of the CPU, you know, CPUs run, for example, about three gigahertz, three billion instructions per second.
Every cycle is this structured thing that can be folded into it into the next step. And then ultimately- If it's structured, do you mean like cereal, like linear, like a step-by-step, by step-by-step? Yes. So what I mean is that you want to prove a very big statement that can be broken down into steps, all of which have the same format or template. So they still all have the same length and they're all proving something- Okay, here's an example, BLS signatures. So we all know that BLS signatures is one of the big optimizations that allows Ethereum to have half a million validators. The next is the thing that brought the validator requirement from 1,500 ether per validator down to 32, because it was a very compressed piece of a previous technology.
Exactly. What does BLS aggregation allow? It basically allows you to take, let's say, 10,000 BLS signatures and fold them onto each other such that if you verify the folded thing, you've proven that all the other 10,000 unfolded signatures are also valid. And just to put numbers on this, it takes about one millisecond to verify a signature. So if you want to verify all 10,000, it will take 10 seconds. But if you want to verify the folded one, that takes on the order of one millisecond. Okay, so some of the deep down details I don't get. But the patterns I think I'm understanding, whereas if you tell me it takes one millisecond to verify a BLS signature, and then if you want to do 10,000 of them, well, it's a linear.
It's linear up to 10,000. It's linear, yes. And with this new folding mechanism, there's that meme of this, like, you can't fold anything in the universe 12 times because it's too exponential, right? And so I'm understanding that, I understand exponential curves. And so it sounds like we have a way to do something previously, linearly, that we now have something a new way to do it, and it's exponential. And so it just gets that economies of, it gets the scale of an exponential curve. Is that a way to understand it? So we basically have these two tools at this position. You can think of like the high duty power machine that is very expensive to use.
And we have the hammer. People of them can get the job done, but one of them is much, much cheaper to use. And the hammer turns out to be about 10 times cheaper to use. So it is a constant optimization. We do know how to make snarks that are linear time. In the sense that the time it takes to do the proving grows linearly with the size of the statement. But now we've actually reached a point in the maturity of snarks, where it's a game of constants, and at least for elliptic curve based snarks, Nova allows us to get this 10x boost relative to the status quo. So what does that mean for crypto currency?
What does that mean? Why do we care about this? How does it really benefit? We enjoy things that are cheaper and faster just implicitly, but how does it impact our lives? Right. So I guess one big thing is it's going to make it easier to deploy roll ups on mass. OK. ZK roll ups specifically. So this is a democratizing technology for deploying ZK roll ups. Yes, but it's also the key to getting decentralized proving. Now what do I mean by decentralized proving? I mean two things. I mean, first of all, the lowering the barrier to entry in terms of computational resources. So right now, if you want to be a prover for a ZK roll up, you need to hire some sort of rack in a data center, lots of compute.
And it is not really friendly to doing so at home. So imagine a small box at your home and you can be a scroll prover or whatever that is, ZK saying prover. The other interesting thing about NOVA is that it allows for decentralized proving, which is kind of the next step after distributed proving, which is the next step of a parallel proving. So let me try and explain. So snarks are very parallel friendly in a sense that if you have multiple CPUs on your machine, or if you have multiple threads within each CPU, you can make use of these threads to do work in parallel. But they all sit within one machine.
That's parallel proving. Then the next step is distributed proving where you have machines that are geographically distributed all around the world and are separated by the networking layer. And here what you need is basically these small proofs that can be communicated fast so that you can distribute the work. And this is like distributing the sequencer, distributing the validator of a layer to similar conversation. Yes. Well, here is about distributing the prover, and the key thing about distribution versus decentralization is that there's only one prover that's distributed, whereas in the decentralized model, it's an untrusted kind of coordination of provers that ultimately help build this mega proof.
Right. And the idea of a decentralized ZK rollup is that ultimately we want anyone to be able to generate a proof. Yes. Right now, that's still too costly, too expensive, because just that's the state of things we're in. Right. So Novak kind of helps in two ways. One is that it's a constant optimization by 10x. But the other thing is that it makes it much, much simpler to have this best-in-class decentralized proving where a thousand nodes, let's say, that don't trust each other can all combine work to ultimately form a final proof. That's a, I think, a new part of ZK rollup for me is multiple different computers, nodes coming together to produce a proof.
How does that fit into a ZK rollup? Where does that fit? Right. So the ZK rollups have the same kind of infrastructure as the layer ones. You have the proposals, the attestors, and you have the block builders, which are sometimes of course sequences, but there's a new roll, which is the prover. And right now, this... And that new roll, the prover, comes because it's a ZK rollup, because it's a snark. It's so the snark of that is a ZK rollup needs to be proved. That's the thing. Yes. So traditionally, the rollup prover was subsumed within the block builder, and the reason is that the block builder needs to do something, which is basically compute the state root.
Now, in addition to computing, the state root does this other thing that needs to be done, which is to compute the snark. And that is just so much more expensive than computing the state root that it makes sense to unbundle these two rolls. Right. Okay. And so with a ZK rollup, what does it mean for many different nodes in a ZK rollup to produce like... Everyone's doing a small snippet of work that gets aggregated, but they're not doing the same work independently, correct? Yeah, that's correct. So just to zoom out in terms of why we care to decentralize the prover, it's all about liveness. So right now, all the ZK rollups have a centralized prover, in AWS or whatever it is.
If AWS goes down for one hour, the ZK rollup goes down for an hour. So we care about the strong kind of World War III grade liveness, so we need to decentralize the prover. And as you said, what we're going to do is we're going to take this whole big block, this rollup block, partition it into small steps, for example, transactions, but maybe even more granular, you know, the upcode by upcode level, and then have each decentralized prover perform their mini-proof, and then aggregate these mini-proofs into a final proof. So in a ZK rollup, the blocks are really big, and we need multiple nodes to process parts of this block in order to submit, create a proof that gets submitted down to the Ethereum layer one.
The more nodes we have, the faster that that block can be processed, and also the liveness of the actual rollup increases. Correct? Yes. I mean, even without big blocks, even if you're only doing, let's say, 3 million gas every 12 seconds. So 15 million gas every 12 seconds, which is what the layer one does today. It's still extremely expensive, because the DVM is not a snark friendly. So we want to combat this unfriendliness of DVM, but once we've reached that, you're right, we want to increase the gas limit, or another thing that we want to do is have multiple instances of your virtual machine.
And the reason is that any given instance of DVM is going to be bottlenecked by sequentiality. So if you take DVM, for example, it's what's called a single threaded virtual machine, and so it can only do so much. So let's say it can do 1,000 transactions a second, or 10,000 transactions a second. And once we've reached that peak, we've maxed out on the throughput of one single instance of DVM. It will make sense for these rollups to have multiple instances of themselves. Okay. And so when you put all these pieces together, what does the future of ZK rollups look like before and after this new Nova technology?
Right. So I guess Nova is one of the pieces that I'm going to get us from the present, which is a fully centralized proover on AWS to this kind of utopic future, which will happen in a few years, where not only do we have decentralized proving, meaning we have potentially hundreds of thousands of nodes collaborating to form the proof, but we have very high gas limits per instance of the virtual machine, and we have multiple copies of the rollups to consume all the data availability that we have on chain. And when I say that Nova is only one of the pieces, there's other pieces at play. So another very important one is hardware acceleration.
So if you use GPUs, it turns out you can get a lot of hardware acceleration, but the step after GPUs is actually to build an ASIC where you get another 10X improved performance. And all these proover optimizations compound on each other, and we're going to need all of them to get to where we want to be. Right. And when I think when people hear the term ASIC, they think Bitcoin mining, but this is not what we're doing, you only one node needs one ASIC to do the job. You don't need a wall or farm of ASICs, correct? Yeah, that's correct. So we have what's called an honest minority assumption. We just need one proover to be online and participating and to produce the proof to have live-ness.
And so one of the things that we want in these proover networks is some amount of redundancy. It could be 100 to 100 redundancy, it could be a thousand to one. So 100 to one means that even if 99% of all the proovers in the world just suddenly go offline, the ZCable app still keeps on progressing forward. Okay. So we are currently in, we have some ZK EVMs, Polygon, ZK Sink, our live-on-mainnet scrolls coming soon. The costliness of these proovers are extremely high, and there's only one because of how high they are. And that's the current state of things. With further optimizations of each one of their own tech stack, you get some improvements.
With this new NOVA cryptography mechanism, you also get some improvements with moving from GPUs to ASICs, we also get some improvements. Can you put some numbers on these things? So we're going from some amount of block space in the ZK EVM world, and then you aggregate all of these innovations together, and we get a different number of how much total block space there is. Is there any sort of how much magnitude more block space do we get as a result of all these things? Right. Right. One metric that we could be looking at is the cost per transaction of doing the proving. And nowadays we only order one cent, so it's actually not that high, and with all the optimizations we'll get it down to noise.
Now to actually answer your question around the total throughput of the system, the really cool thing is that it scales horizontally. So the more people come in, the more fees are being paid, the proven network can actually grow organically. It's like a natural scaling mechanism. It's a natural, exactly. It's a natural scale a mechanism. And I think the main cost that we're paying right now is kind of this somewhat subtle thing is the lack of decentralization, whereby we're trusting decentralized proofers for liveliness. And one of the things that ultimately we want to do at Layer 1 within Ethereum is snarkify the EVM itself, the Layer 1 EVM, and build a so-called enshrined roll-up.
And in order to get to that holy grail, we need to do all the hard engineering work. So all the stuff that the roll-ups are doing, the non enshrined roll-ups will ultimately be useful for the Layer 1 as well. Okay. So with the cryptography conversations that are happening here at Zuzalo, this whole nova thing, we've applied this to the ZK roll-ups into block space into just reducing costs and growing efficiency and all that kind of stuff. Are there other verticals that this new nova technology can apply to? Yes. So generally speaking, nova is an improvement to the ZKP world, the snark world. And in my opinion, snarks are just going to completely change the world.
For blockchain specifically, we've talked about scalability, but it also has a massive impact for privacy. But even zooming out outside of the blockchain world, we're trusting entities to do computation for us all the time. We make a Google search, we get some sort of answer. We have no idea on the validity of this answer. And so one of the possible futures is actually that the blockchain space builds so-called co-processors to the main processes. So every time you have, for example, a CPU in your phone or a CPU in the cloud, that can be accompanied by a piece of hardware, a co-processor, that does all the proving work in real time to prove that the processes work is valid and ultimately generates a snark proof.
In this world, what does an invalid processor look like? What's the utility here? Right. One kind of very technical thing, which doesn't really happen in practice, is, okay, what if there's a bug in the CPU that has happened, you know, sometimes that is extremely rare? But the big fret model is basically that, you know, it's just this trusted operator problem, trusted third party. You know, maybe your banker is giving you your correct balance on your bank account, but maybe it's not, maybe it just removed a few zeros or whatever it is. And so when you go and open your mobile banking app, you actually have a mathematical proof that this is indeed your balance as opposed to having to trust your banker.
So the idea, I think what you're trying to say is with this new Nova technology, we can apply it to crypto, but then also there's ways to apply it in the rest of the world just because it's more, it's cheaper to run this thing, it's cheaper to operate. And so we can start applying more trustless principles in areas outside of crypto. And, you know, I think the end game will be that these, these code processors will be roughly a hundred times the size and consuming roughly a hundred times the power of the processor. So, you know, it is, there is still a cost there, but right now we're talking more about, you know, 10,000 X overhead or 100,000 X overhead.
And so that really limits the number of applications that stocks are being useful to the most high value ones. And every time we remove and order of magnitude, we're opening up the design space. And I think just like progressively the internet has been eating the world every time you increase bandwidth by 10X, stocks are going to eat the world every time you reduce the proof of cost by 10X. So how big of a deal this whole Nova thing? Yeah. How big of, in a cryptography world, how like excited, what, what, what, what, what, what's the level of excitement from the cryptographers? Like, it's because for the normal people, like me who don't understand this thing, it's like, okay, I take this at face value, Justin's excited.
But like, is it how the whole cryptography community, like how excited are they? Like, can we rate this on a scale of 1 to 10? So the applied cryptographers here in Zuzalu, I think are very excited. I'm going to say, you know, eight out of 10. When they came here, I think it was more like a five or six out of 10. And all the presentations that have been done, all the sharing of ideas, people were like, oh, wow, you know, we can actually combine these clever ideas and actually some new ideas came through at the various workshops. So in the history of cryptography, like, where does this stand on like breakthroughs?
Would you call this a breakthrough? It's definitely a breakthrough for the applied cryptographers, especially people who want to build real world applications. Of course, you know, if you really zoom out over the multi-decade, there's like improvements to the asymptotic. So you might have like a quadratic proverb versus a linear proverb. That's like a huge improvement. But now, you know, as I said, we've reached the optimal point from an asymptotic and it's all about improving the constants. And in my, as I see it, Nova is optimal from a both an asymptotic and a constant standpoint for snarks that are using curves, elliptic curves.
Okay. So this is the end of the road for the the proof system or very, very close at least, like the theoretical max of what we could get. Yeah, pretty much so. And so with the many different ways to scale blockchain, cryptography is one of them. You're saying that Nova is the theoretical max of the cryptography side of that equation for scaling a blockchain. Yes, specifically for this this proving of statements and ultimately generating a small proof that can be verified by a blockchain. So now is just like a matter of building the infrastructure around Nova to support it, make it better, refine it, but Nova is the deal.
Yes, I mean, I think there's going to actually be a bifurcation of two types of snarks. There's going to be the so-called curve-based snarks like Nova and there's going to be the hash-based snarks, you know, like stocks and and fry-based things. And the the jury is still out because the the underlying cryptographic assumptions are pretty different and that has implications from a performance standpoint. But I think what will happen is that we will see both explored in parallel and both are extremely promising. One of the good things about the hash-based stuff is that it's post-quantum. So from an endgame perspective that's kind of the most natural way to lean right now, but it turns out that you can generalize Nova to use so-called lattice-based commitments a little bit technical, but basically it's the equivalent of curves, but they're post-quantum.
Okay, so there's there's future proof. It's the way to read that. There's a potential roadmap to future proofing Nova, but right now the details haven't been fleshed out. Okay, that always kind of seems to be where conversations with cryptography leave is like there's potential row we haven't figured it out yet. Right, right, right. Yeah, at least for the curves, you know, we've reached something optimal from a from a constant standpoint. Yeah. So just in here as Uzalo, there's just been the idea of Uzalo, one of the big ones is cross-pollination, like get all the brains together, get them to talk.
How's it just going for you? Talk about your experience here at Uzalo. Right. I mean, I've had a few kind of mind-blowing moments, just meeting people that I was not expecting to meet. I mean, one within crypto, you know, there's like, for example, Lev, who's very much interested in FHE, and he's very much interested in MoonMaf, like witness encryption. And there's various other people like him, but outside of the cryptography world, it turns out I've learned of two different projects to build stablecoins that are backed by central banks of governments, of nation states. And these seem to be like serious projects, one of which is Montenegro.
And you know, I got to meet the most likely candidate to being the prime minister of Montenegro, and you know, people as part of his team, and they've been working on this crypto law for a very long time, and it seems to be a very serious and interesting project. Yeah. I'm interviewing Mickey in a couple days here. Oh, excellent. So this will be a featured content on this user track. Amazing. Yeah. Who else do you think I should interview while I'm here if you have any, if you had it to pick? Right. So for the second FHEAT stablecoin backed by central bank, I've been told to not leak the alpha, but I can tell you privately, I guess, and then you can ask them if they want to be interviews.
Yeah, that seems to be the central bank stablecoin. There's only so many central banks to go around. Right. Justin, thank you so much for guiding us through the world of ZK cryptography. And also, I hope you enjoy your time here as you Zalip. Yeah. Thanks, David. Cheers.