Main Topic: The podcast episode discusses the concept of prediction markets and the platform Manifold Markets, which allows users to create and participate in prediction markets on various topics.
Key Points:
Participants:
Takeaways:
Future Developments:
Challenges:
Stephen Grugett is a cofounder of Manifold Markets, where anyone can create a prediction market. We discuss how prediction markets can change how countries and companies make important decisions.
Manifold Markets: https://manifold.markets/
Watch on YouTube. Listen on Apple Podcasts, Spotify, or any other podcast platform.
Episode website here.
Follow me on Twitter for updates on future episodes.
Timestamps:
(0:00:00) - Introduction
(0:02:29) - Predicting the future
(0:05:16) - Getting Accurate Information
(0:06:20) - Potentials
(0:09:29) - Not using internal prediction markets
(0:11:04) - Doing the painful thing
(0:13:31) - Decision Making Process
(0:14:52) - Grugett’s opinion about insider trading
(0:16:23) - The Role of prediction market
(0:18:17) - Dealing with the Speculators
(0:20:33) - Criticism of Prediction Markets
(0:22:24) - The world when people cared about prediction markets
(0:26:10) - Grugett’s Profile Background/Experience
(0:28:49) - User Result Market
(0:30:17) - The most important mechanism
(0:32:59) - The 1000 manifold dollars
(0:40:30) - Efficient financial markets
(0:46:28) - Manifold Markets Job/Career Openings
(0:48:02) - Objectives of Manifold Markets
Dwarkesh Patel
Now, here's a question I've had for a while. Why don't companies who have direct incentive to get the best possible information on themselves, on the factors affecting their business, why aren't they using internal prediction markets if this is the best way to aggregate information?
Stephen Grugett
All right, this is going to be fun. Today, I have the pleasure of speaking with my friend, Stephen Grugett. He's the founder of Manifold Markets, which has received a grant from Scott Alexander. Scott has written thousands of words about these guys, and they've raised a $2 million seed round. And it's an incredibly exciting project. So Stephen, why don't you tell us a little bit about Manifold Markets?
Great. Thanks so much for having me on this podcast, Dwarkesh. It's great to be on here after seeing other people like Tyler Cowen and David Deutsch. I guess first thing, I'm one of three co-founders of Manifold Markets. What we're doing is building a platform for user-created prediction markets. The idea is that anyone can come onto our site and create a question about anything that they care about. Then they can have their friends and other people on our site come bet on that. The betting process, through the magic of our market mechanism, will help get the best and most calibrated probabilities that you can find.
Dwarkesh Patel
Let's talk about the mechanism here. Correct me if I'm wrong, but the idea is you use real money to buy manifold dollars. What is your reason for expecting that people will care a lot about how many manifold dollars they have? What is your hypothesis about human nature and reputation that makes you think this is something people are going to invest a lot of effort and time into calibrating?
Stephen Grugett
Yes. To take a step back for people listening, Manifold uses a play money currency. If you sign up right now, we'll give you a thousand Manifold dollars, which is our in-platform currency for you to use and bet as you see fit. The reason why we think play money can work is that people are driven more by status and competitiveness than greed. We kind of see ourselves as a social game where people can come on to hone their skills at predicting and then demonstrate to others that they really do know more about what they're talking about. They can prove it with an objective track record from their betting history.
Dwarkesh Patel
That's a very interesting point, which makes me wonder, do you expect that in the future, Wall Street firms will be enticed to get the top people on the leaderboards on Manifold Markets to come work for them? One of the objections that Tyler Cowen has to prediction markets is, he's kind of tongue in cheek about this, but I remember at one point he was saying, if you guys are so good at predicting stuff, you would expect all these hedge funds to be trying to constantly hire you guys. The fact that they're not makes me think this is kind of just a hobby. So I'm curious about your reaction. Do you expect people to be coveting these top predictors for their prowess at predicting the future?
Stephen Grugett
I'm obviously very biased, but I think something like that is possible. We have a leaderboard right now. Our top predictors are actually quite good. The person who's currently occupying the top slot won big on one of our markets on whether Russia would invade Ukraine in February. In the forecasting community in general, there actually is, as you would expect, a fair amount of overlap between the people who are using these services and financial professionals who actually do manage money or trade as their profession. So I don't entirely agree with the premise of the question or Tyler Cowen's earlier point. Although obviously, as a play money platform, we do attract a fair number of hobbyists who, despite not having a financial background, still are quite good. I do believe that there's a lot of untapped potential in these top predictors and that sites like ours actually are able to identify them.
Dwarkesh Patel
In your experience, what has made people who are the top predictor so good at the art? Is it just their domain knowledge? I know there's different theories about how people can get good at predicting. Based on your experience, what kind of traits do you identify here?
Stephen Grugett
Probably a big one is just experience. A lot of our top predictors have actually come from other sites and have spent a good deal of time thinking about forecasting and prediction in general. Probably the first hurdle that most people have to overcome in order to start improving as a predictor is getting used to clarifying and crystallizing your views about the world. If you're thinking about some political event, you can very easily incorrectly misremember that you got some event right or not. But if you're not actively putting out numerical predictions and recording those to keep yourself honest, it's very difficult to improve. So that's a good first step. A lot of our users already cleared that before joining our site.
Dwarkesh Patel
We talked about whether finance firms would want to hire these predictors, but it would be incredibly exciting if you lived in a world where news firms would want to hire the people who are very good at predicting. Scott Alexander actually has a very interesting post where he speculates, what if you had investigative reporters who could short something? Let's say they discovered that some government has really messed up. They could short the market on the government's GDP in a year and then release the information and then benefit from their investigative journalism. I don't know if you have a reaction to those kinds of ideas.
Stephen Grugett
I think that's great. I think that's a very obvious case of pro-social benefit of markets, using the market mechanism to provide a public good that society otherwise wouldn't be able to produce. Getting accurate information about corporate malpractices or whatever is very valuable to society. Anything that we can do to encourage that is good.
Dwarkesh Patel
This is a question a lot of people will be interested in and maybe you can't comment, but is there any potential that eventually through crypto or offshoring or some other option, somebody's ability to predict will somehow be able to get reflected back on them in some sort of monetary gain outside of the play money?
Stephen Grugett
On our site? First of all, we are planning to do things like host tournaments with real cash prizes. That's something that we are able to offer despite being a play money product. We originally started as a crypto idea before pivoting back to Web2. That's funny. We're one of the first firms to pivot from Web3 back to Web2 for usability reasons. Creating a real money crypto offering is something that's on our back burner and something that we're actively thinking about. It would probably be in the form of a separate product, though, rather than as an addition to our current offering.
Dwarkesh Patel
I'm curious what the usability concern was there. Is it like connecting the MetaMask wallet to your account? Your current process is so easy. You can basically make a bet within 30 minutes or 30 seconds of visiting the site. I'm curious what the concern was there with crypto.
Stephen Grugett
I think there are several things. The first is just onboarding. Only a tiny chunk of the global population actually has created a MetaMask wallet or a Solana wallet or any of these things. The process of doing that and transferring tokens to the wallet is actually pretty cumbersome and not yet very easy. So that's a huge hurdle just to start with. Then you have to add in all of the other frictions associated with being a crypto platform. It takes a while for transactions to be confirmed. If you're doing everything in a purely decentralized way, you will have to sign each transaction with your wallet, stuff like that. Each of those things is just an additional hurdle that will prevent users from being able to bet and enjoy their experience on the platform.
Dwarkesh Patel
Not to mention transaction costs, which would reduce liquidity.
Stephen Grugett
That's a big one too.
Dwarkesh Patel
Speaking of reputation, one of the things that seems interesting to me. My prediction over the long term is that the reputation of the market maker or market creator rather will matter a lot because on your website, they're the ones who get to resolve questions or resolve markets. What is the equilibrium there? Is it just that there's going to be a few trusted market creators who people trust to adjudicate what happened? Or will anybody be able to create a big trusted market?
Stephen Grugett
I think it'll be kind of a bimodal distribution where you'll see a few huge market creators that are high trust and have huge volumes across a lot of their markets. Then there'll be a very long tail of smaller individuals with less of a track record. Their markets will be participated on by people closer to them on the social graph, their friends or friends of friends and stuff like that.
Dwarkesh Patel
Now, here's a question I've had for a while. Why don't companies who have a direct incentive to get the best possible information on themselves, on the factors affecting their business, why aren't they using internal prediction markets if this is the best way to aggregate information?
Stephen Grugett
This is a great question. First of all, a lot of companies have tried using prediction markets internally, including Google, GM, the CIA, and a bunch of other firms as well. But for the most part, you find that they will use it, people will talk about it for a bit, they will even praise the benefits of prediction markets, but ultimately they'll abandon them. I think the main reason for that, and a very Hansonian point, is that people literally don't want to know the answers to a lot of questions. In a corporate context, that mostly manifests itself in the manager choosing a course or vision for their company and then not wanting to get negative feedback about that. Even if the feedback is mostly positive, it still can seed doubt on the part of employees. The introduction of a prediction market by itself might just lower the odds that that mission will be successful, even though one wouldn't think that just the addition of more information would actually change the outcome. I would say that that's the biggest point. It steps on management's toes, and they don't like that.
Dwarkesh Patel
Interesting. It's almost the opposite of his point about consultants. His point about consultants is that they basically put a pretty face from Harvard. They allow you to say, "This highly credentialed person who talks well supports what I'm doing. So that's why we should go ahead and do it." One question I've always had about this Hansonian view is, even if it's true, you would expect some firms to do the painful thing or some managers to do the painful thing. You're a startup founder. You know that many of the most successful startup founders will go ahead and do something that is quite difficult that they don't want to do. We would expect over the long run for the market to be dominated by players who have done the thing that helps their company, right? Out of all the thousands of companies that are out there. So why do you think in a decade or two, all the best companies in the world will have internal prediction markets? Or is the force from managers against it so strong that that's not going to happen?
Stephen Grugett
I would say there are two parts. The first is a rational concern on the part of managers to not use prediction markets because it undercuts their mission. It's not merely an irrational quirk of human nature, although perhaps it is in general, but it's not an irrational quirk of the manager's part in choosing not to use them for certain contexts. The second part is, I think the areas where prediction markets more clearly add value without distracting from the mission or hurting management are where they're used for their informational aspects or to do market research. Questions where you need to survey what consumer behavior will be, how our competitors will behave, that sort of thing.
I think that's a much clearer example of where prediction markets can provide value in a corporate setting, which doesn't fall prey to most of these downsides. Then the question becomes, why hasn't that happened yet? I would say a part of that is actually just usability concerns. It's actually very hard to create a product that's extremely simple and easy for all of your employees to use, that doesn't require too much thought, but can still yield reasonable results. I would say part of our goal with Manifold really is to bring the bar down lower such that more and more people can participate in prediction markets and it'd be a pleasant, fun, and easy to use experience.
Dwarkesh Patel
That it definitely is. I was about to suggest, maybe it would help Zuckerberg to know, maybe it's like subsidize the market to find out how many VR devices there will be in the world by 2030 to help make his metaverse plans. But maybe he doesn't want to know that, or at least he doesn't want that publicly known. One question I have is, in what situations is it best to have a single person compound all the available knowledge? And in what cases is it best to kind of decentralize the decision-making process by having a market?
Stephen Grugett
I would say that in general, if you're making a decision in the real world, it's often very difficult to operationalize what the success criterion is down into one thing that the market can then measure and be used to act upon definitively. I would say that's the biggest case for personal discretion or human involvement in decision making. In general, I think prediction markets work best when people are creating markets on a variety of metrics and then using human intuition to figure out what the best course of action is to proceed using that information.
Dwarkesh Patel
I'm curious, what is your opinion about insider trading in Congress, for example? I know this is a big debate. Do you think it serves a useful price discovery function or too much of a hazard of adverse election? Kind of a tangential point. I'm just curious about your opinion.
Stephen Grugett
I would say in general, my view of insider trading is basically Matt Levine's view, that it should be viewed as taking from shareholders rather than a fairness or equity type of discussion. I do think in general, insider trading obviously does benefit price efficiency, but there are other things that we care about. We also don't want our corporate shareholders to be profiting from certain types of information. In the case of congressional betting or insider trading by elected representatives, I think that's for the most part not cool. We would prefer for them to be compensated directly through salary or other things which are more open and transparent to the public, rather than this kind of roundabout way of corruption. You can make a deal with some company and then trade on that, and the money never directly passes into your hands, but you're privy to this insider information. The net effect is equivalent to this practice which we would not normally condone.
Dwarkesh Patel
Now, one place where I'm skeptical of prediction markets is when we're talking about questions that resolve over a long period of time and which there's no good base rate for. The market hasn't really been trained on that kind of question. One example would be what are the odds of catastrophic AI by 2030, which I'm sure is a question on your website. I'm not sure how much credence I put into the prediction on this question. One, because I'm not sure why I would expect that much good information to be aggregated here in the first place. What is the information they're going off of? And second, I guess more important is, why would somebody bet yes? Because the best case scenario if they bet yes is they die anyways, right? They have nothing to gain if catastrophic AI happens. In these kinds of scenarios, what do you think is the role of prediction markets? Do you have these kinds of concerns? What are your thoughts?
Stephen Grugett
I think both of those concerns are very valid. I think part of this is just a fundamental human constraint: if things are very far in the future, we care about them less. That's true in prediction markets, but it's also true in every other domain and every other forecasting technique as well. The interest rate is a fact about human nature, or discounting of the future is a fundamental facet of human nature. You can twiddle with the mechanism here on the margins, but I don't think it'll fundamentally change that. For your second point, though, that is very well taken too. You can't bet on an apocalypse. You're not going to be there to collect your winnings. The money is worth less in that universe. So you should rationally bet against it.
Dwarkesh Patel
Actually, Bryan Caplan and Eliezer Yudkowsky do have a bet on an AI apocalypse. The bet is about whether there will be catastrophic AI, I think by 2030 is the exact bet. Bryan pays Eliezer now. If by 2030 there hasn't been catastrophic AI, then Eliezer pays Bryan the sum that Bryan paid plus more based on the ratio of their bet, which I thought was an interesting idea. Just going off this topic a little more, one of the things that Scott Alexander brought up in one of his blog posts is when you have these kinds of bets that resolve over the long term, it doesn't have to be as far-fetched as AGI. It could just be something like who's going to be president in 2024. He pointed out that at least at the time that he wrote it, Dwayne Johnson had like a 9% chance of being elected president, which seems high, except why would somebody get their manifold dollars held up in a question that won't resolve for four years, or two years now? The ability of speculators to correct prices is diminished because they don't want their money to be held up in questions that won't resolve for a long time. How are you guys dealing with that kind of problem?
Stephen Grugett
In general, the best way to tackle these long-term more speculative questions is to try to break them down and address the proxy variables that are most relevant to predicting their success in the future. Instead of asking, "Will the AI apocalypse happen in 2050?" you can ask, "Will OpenAI's GPT-4 exceed this number on this benchmark?" Similarly for The Rock, instead of asking, "Will The Rock be the president in 12 years?" you could ask, "What are his polling numbers today? What are his favorability ratings? Will he indicate interest in running as a politician?" Those are much more short-term questions which you can use to get a sense of the longer-term, more speculative questions that interest you.
Dwarkesh Patel
Tyler Cowen has this other criticism of prediction markets: these prediction markets are tied to financial markets that you actually could bet on. If you think somebody has a higher or lower odds of being president, maybe that has an effect on GDP or something, and that has an effect on stock prices. He says, if you're so good at betting in prediction markets, why don't you just bet in the financial instruments that are linked to whatever question you're interested in? Bryan Caplan's response to this is there's so many different things that can affect any given financial instrument that it's not easy to explain. I feel like that defense of prediction markets is a criticism of your response that you just gave, where you're saying short-term prediction markets can substitute for your interest in long-term prediction markets.
Stephen Grugett
I would say yes and no. Asset prices of major financial commodities and equities and other instruments are affected by way more factors than another prediction market on a more isolated question on some proxy variable that you care about. The nice feature of prediction markets is that you really can isolate the particular risk that you care about. Even if it's just discussing one proxy variable that's related to the overall picture, you can still get a much better understanding of the thing that you care about by picking multiple well-targeted proxy variables and creating markets on those, rather than oil prices, which tell you many things, too many things.
Dwarkesh Patel
Lay out your vision for me of 10, 20 years. Prediction markets are not only much more liquid, more people participate in them, and it's kind of everybody knows what a prediction market is. People understand what it means when you say this prediction market, Biden, I guess it wouldn't be Biden then, but whoever the president is passing this bill. Well, one of the many things that would need to happen other than a constitutional change would be major advances to longevity research. What would the world look like if people actually cared about prediction markets and if it was common knowledge what the market thought about any given situation that was happening?
Stephen Grugett
First of all, I would say that would probably be a much better world. Across a wide variety of domains, I think it's better in nearly all cases when people are grounded in terms of facts and well-calibrated predictions instead of pure speculation or ideologically biased thinking. More concretely, I can imagine a world where the average news article, blog post, CNN station, if that's still around in 10 or 20 years, has an embedded prediction market on whichever topic they're discussing. It'll allow people to immediately get a sense of what the most grounded opinion is. It'll ground the opinions that people are hearing in fact and make it easier to have more productive conversations and ultimately allow them to better understand the world. I hope that's the case.
Dwarkesh Patel
There's a pessimistic take that people are not consuming politics to understand what's happening and that they will almost resent you for presenting them with this kind of information.
Stephen Grugett
That's true. I'm not implying that a large part or even a majority of the consumption of political news is based on a desire for accurate information. I think that would be a very naive view of how humans operate. But at least a small part of that is. At least some portion of people's desire to consume news is legitimately to understand the world. Insofar as people are attempting to do that, prediction markets can help.
Dwarkesh Patel
I really hope so. I think that actually could be true, which is very exciting. One question I have is these trades that people do on your market, 4% of what is traded or the traders' winnings go to the market creator and 1% are just burned. Correct me if that's wrong. But that seems like a negative sum bet, which means that are you concerned that that would reduce liquidity because people have to get over a higher threshold of confidence before they're willing to bet on any given market?
Stephen Grugett
Yes, fees do impede the efficiency of the market in some sense. There are people who on the margins would trade if there were no fees who don't when there are fees. That certainly is true. But part of the reason why we have fees is to encourage things that we like. We have a creator fee. The creator earns a commission on trades that incentivizes them to create and resolve more markets. We currently have a liquidity fee as well, which feeds into the liquidity pool, which you can think of as subsidizing the entire market.
Dwarkesh Patel
I'm curious, what is your background? One of your co-founders is your brother. Do you guys have some sort of financial background or mathematical background? I was looking at your technical documentation. I'm not claiming to have understood most of it, but I saw the formulas that were there. I visually skimmed it. How are you guys able to get into this field?
Stephen Grugett
I studied computer science in school. Then I went to work for SIG, or Susquehanna, an options trading firm for a little bit. Then I left to go work for my friends' RoboAdvisor startup, where I wrote their portfolio optimizing software. I have some financial experience as well. All three of us are technical and also have a previous background doing other entrepreneurial things as well. We're all kind of full stack entrepreneurs, I guess you could say.
Dwarkesh Patel
Can you talk a little bit about your previous entrepreneurial experience? I think listeners might be interested.
Stephen Grugett
Sure. Right before this, my brother and co-founder James and I were working on our app called Throne. It's a subscription group chat app for online creators. People like you, or Instagram creators, or DJs, or anyone who's built up an audience online. The idea was that they can set up a private group chat with their audience where they're paying a subscription fee to join. The premise of our app is that we provide a much better chatting experience for larger groups. It's designed to accommodate the creator's entire audience and make that a seamless experience.
Dwarkesh Patel
I have a friend who has a popular fantasy football channel. He has a very profitable Patreon where basically the point of the Patreon is it'll give you the link to the invite to the Discord, which seems convoluted. This product is just basically combining those two services. That seemed very useful. So what happened with that?
Stephen Grugett
It's still going slightly. Basically, we couldn't get the growth that we were hoping for. The ultimate cause is it's kind of too late. The creator market is already saturated with all different sorts of tools. Most creators are already monetizing one way or another and aren't keen on moving to a new platform.
Dwarkesh Patel
When it comes to Manifold Markets, the idea for having prediction markets, even the idea of having prediction markets with play money, I believe has been around for a long time, right? What took so long for somebody to make a user experience that was so comfortable as yours? Or is there something else that prevented somebody from making a Manifold Market much earlier?
Stephen Grugett
I would say the other key piece of the puzzle that other people were missing is the idea of user-resolved markets. On the surface, that sounds a little bit crazy, that you just allow anyone to come and create a market on any question where they are also the judge of that question and can resolve it in any way that they want. That obviously opens the door to fraud and abuse and people taking advantage of the system. The fact that there is a possibility of fraud has basically prevented other people from even exploring this option. Instead, they're opting for oracles or centralized authorities deciding the outcome of all markets. But that severely limits the scalability and reach of a prediction market platform if users can't go on and create their own thing. It's really realizing that user-resolved markets actually can work that led us down this path. There is a small amount of fraud, but it's actually quite small and manageable. If you allow users to choose which markets to participate in, they for the most part are making pretty good decisions about where to allocate their time and money.
Dwarkesh Patel
There's this great essay called "Unix is Worse is Better." I don't know if you've gotten a chance to look at that. The basic point the author makes is, if you ask why has Unix been so successful...
You know, you can say some of the features and some of the design decisions are arbitrary. They're somewhat suboptimal in certain situations. But then it seems that maybe it was those bugs that actually allow Unix to be the kind of thing that can actually run on real computers. Maybe it's not optimal from the perspective of somebody who wants something super elegant and beautiful.
Gwern has a really good blog post about this, "Bitcoin is Worse is Better," where he makes the same point about Bitcoin. Some of the actual constants involving block size or whatever, they're pretty arbitrary. But the fact that somebody just put out the arbitrary numbers meant that innovations that could have been around years before in terms of cryptographic tools actually got instantiated in a product like Bitcoin.
It kind of seems like you're taking a similar attitude towards prediction markets. Even if it's somewhat arbitrary to let users resolve markets, that's better than having some sort of Oracle structure which is super convoluted and hard to use. It may sound good in theory, but is kind of impractical as something that people want to use.
Stephen Grugett
Yeah, that's exactly correct. I think the most important thing for creating a usable platform is making sure that the key mechanism is something simple and easy to understand, more so than handling every possible edge case perfectly. As long as the core experience is extremely simple and easy to use and user-friendly, that matters much more than the 1% of cases.
Dwarkesh Patel
I'm curious if this is something you learned at your previous startup. Did you guys make this mistake and now you've learned to avoid it? How did you come to that realization?
Stephen Grugett
I don't know that I can think of a good example that's directly relevant. Although we did focus on simplicity of both the business model and our user interface for our previous chat app. The idea of having a subscription model is kind of the minimum viable business for a creator to support themselves in a real way over time. That might be one manifestation of this principle in action.
Dwarkesh Patel
Okay, so one concern somebody could have about Manifold Markets is that you said you were giving out 1,000 manifold dollars. Somebody could just create 1,000 different accounts, make different trades on all of them, or make a sequence of different trades. In one of them, they just make a series of the best trades that anybody has ever made on the platform. Now they're on the top of the leaderboard.
Stephen Grugett
It's certainly true that if you're giving away free money, that's not an economically sound mechanism. We currently do some things to prevent abuse and bot behavior. I'm not going to tell you what those things are. If we end up open sourcing our code, the cat will be out of the bag and you can see for yourself what abuse practices we have in place.
I would say that we're not necessarily committed to maintaining our free sign up bonus indefinitely. That's definitely partially a growth thing for starting off. In the beginning, most of our users have been very well behaved and haven't abused the system. If Manifold becomes a key nexus for people trying to weigh in on the future, we may have to be more strict with our policies.
Dwarkesh Patel
It kind of reminds me of the PayPal story where they were giving $10 or $20 bonuses for people signing up. It meant they got exponential growth, but they were losing money faster. In this case, you're not losing real money, but maybe you're diluting the reputational value that the best people on the leaderboard have, at least for now.
Stephen Grugett
Yeah. I would say the concept of a global leaderboard becomes less important over time as our site gets larger. A lot of the markets that people bet on are personal markets or markets between friends. What you as an individual care about in terms of ranking who the top traders are is not all of the markets on our platform, but the subset that are of interest to you.
We used to have a feature called communities where you could create a community centered around a collection of different markets, and we would show the leaderboard just for those markets. That's a way of assessing the skill of predictors within some particular domain that you care about rather than globally. We'll probably bring that back in some capacity in the future.
Dwarkesh Patel
Can you give an example of that? Something like fantasy football?
Stephen Grugett
Yeah. One thing you might care about is who is the best geopolitical and war predictor regarding Russia and Ukraine. One way to assess that would be to hand pick a few markets about the invasion and the subsequent course of events during the war, and then see how much profit people have made within those markets. That will give you a reasonable estimate of who the top predictors are there, versus a global thing.
For a while, one of our top markets was about whether this stray cat would allow a random human to pet it. Totally random stuff like that. If you're trying to assess who the best geopolitical thinkers or economic thinkers are, you may not care about the stray cat. But a lot of people really do care about the stray cat in other contexts. It's a fine balance.
Dwarkesh Patel
Another interesting part of your platform is that people can buy more play money. The concern is that even within these subdomains where people are being compared, the actual proficiency of a person could be distorted by the fact that somebody else could just buy more manifold dollars and as a result have a higher profit. I guess you can measure it by percentage gain on total amount of money. But I'm curious about your thoughts.
Stephen Grugett
In general, I'm pretty pro-efficient markets. If you think about what's happening when a whale comes in and buys up a huge amount of money and bets it on the wrong side, what they're essentially doing is providing a huge subsidy and bonus to the people who are actually correct. Markets are the most efficient way of solving the whale problem.
If you have too much money and you are not very smart and are very confident in your views, the markets have a very fast and easy solution for you. You will no longer have so much capital to throw about. There's a direct analogy in real markets where a pension fund or some other big fund needs to rebalance its books. It'll dump a bunch of stock, and liquidity providers can make money off the big trades that these big funds need to make.
Dwarkesh Patel
So you wouldn't be interested in schemes like quadratic decaying value of the manifold dollars that you can buy in one account, where the marginal manifold dollar costs more than the one before it? You think this would inhibit price discovery?
Stephen Grugett
Yeah. Although I have toyed with some other interesting monetary schemes in the past. One idea I had is introducing demurrage, or basically negative interest rates on cash balances. You could imagine a world where your purchasing power erodes over time. If you made a bunch of really good predictions this year, it's not necessarily the case that you should be rewarded by having all of that cash forever. Maybe some portion of those uninvested cash balances erodes by 20% a year or something.
I think it's a really cool idea in principle, but in practice, users absolutely hate losing money for any reason at all. So it's kind of a non-starter. But it's interesting to think about.
Dwarkesh Patel
Sorry, I'm not sure I understood. Could you clarify what you meant?
Stephen Grugett
Sure. The idea is that at certain times you'll have uninvested cash sitting in your account. The idea is to charge you for that. Charge a sales tax at the rate of 20% a year, but maybe once per day at midnight you lose a small fraction of your uninvested cash.
Dwarkesh Patel
One thing that makes financial markets really efficient is you have these big firms putting up large amounts of capital to recruit the top talent in the world because it's worth it for them. They're running supercomputer simulations, and it's expensive to do all this stuff. But it's worth it if you're getting 0.001% of a trillion-dollar market. In the case where you have play money, what is the incentive for somebody to put in the kind of effort it takes to have efficient financial markets?
Stephen Grugett
In general, people are willing to put a lot of time and effort into virtual economies irrespective of financial gains. If you look at things like World of Warcraft or earlier Second Life, which has virtual real estate, people are willing to invest the equivalent of hundreds of thousands or millions of dollars in these game worlds. People's ability to drill in and focus and work on things that are of interest to them is a very powerful force, even if it's not directly tied to a financial payout.
Dwarkesh Patel
What is the point by which Manifold's own internal decision making will be informed by prediction markets involving the firm's predictions about the firm?
Stephen Grugett
Oh, it is already. We actively create markets on all sorts of things which are of interest to us. Most recently, we created a market on whether we would be able to complete our fundraising round by the end of April. That was a cool market. The market believed in us for the most part. I don't think we fell lower than 85%.
We do try to dogfood our markets as much as possible. We have a new market now on whether we'll be able to onboard three employees before the end of June. That's a number that we try to keep our eyes on. Probably the first big case where the market actually substantively informed our decision was an early market on whether we should try to monetize by selling the play money.
Initially, we weren't sure whether that would be a good thing to do, whether users would hate it or it would seem scammy. We created a prediction market on this subject phrased in conditional terms: if we introduced the feature, would we keep it for some period of time? The market seemed to think that we would. That actually was a factor which played into our decision.
Dwarkesh Patel
I'm asking these questions in probably the wrong order. This is probably one of the initial questions I should ask you. Talk me through the timeline of developing Manifold Markets. How long ago was it launched? In the beginning, it was supposed to be based on crypto. When did you guys change your mind? What is the timeline?
Stephen Grugett
This company began long, long ago, way back in December of 2021.
Dwarkesh Patel
In a galaxy far away?
Stephen Grugett
Yeah. It's a very new company. We decided to ditch crypto after maybe a week's worth of speculation and research. Part of it is that we thought we could build a play money prototype very quickly and just test that to see what the experience is like. If we wanted to, we could continue further into crypto. Partially it's based on reading about the regulatory nightmare that is prediction markets and crypto, and partially the usability concerns with crypto.
In December, we came up with the original idea. We applied and received the ACX grant from Scott Alexander. We timed it such that right when the grant announcement came out, we had a working prototype of our prediction market system ready to go. We were able to onboard a bunch of users from the ACX community immediately, which formed the base of our platform. Since then, we've been growing and responding to user concerns and improving our site to be ever more usable.
Dwarkesh Patel
I know you guys use something called a dynamic parimutuel betting system. I looked into the paper. I think I understood maybe a quarter of it. Was it an experience of learning as you went, or is it something you guys were already familiar with?
Stephen Grugett
Definitely the former. I had heard of Uniswap and some other mechanisms. I had heard of Hanson's log market scoring rule and some other things, but I didn't actually delve into the details until quite recently. Originally, we came up with the idea for dynamic parimutuel by ourselves, thinking about it from first principles. Then I went back through the literature and read a bunch of papers and realized that it was called dynamic parimutuel and found a more elegant implementation based on a quadratic cost function that I hadn't considered previously.
Dwarkesh Patel
You'll have to talk me through it over dinner next time. You mentioned that you are hiring. Maybe there are some people in my audience who might be interested. What kinds of roles are you interested in hiring for?
Stephen Grugett
Right now we're looking to onboard a few people to our team. We're looking for full stack developers who preferably have a lot of front end and potentially React experience. We're looking for a community manager to help us manage our Discord, help write blog posts, help with our Substack, help reach out to people on social media, and organize online events. Someone with no previous background in doing this at a startup would be great, but we're open to people from other backgrounds as well.
We're also looking for a head of growth, someone who has experience scaling up an early to mid-stage startup. Someone who has helped take a company from one to ten million dollars in annual recurring revenue, or around 50,000 monthly active users, something in that neighborhood. If you are interested in prediction markets and Manifold in particular, I encourage you to reach out to us. You can email [email protected] or me personally at [email protected].
Dwarkesh Patel
Excellent. Are there any other topics involved with prediction markets or Manifold that we have not discussed yet that you would like to touch on?
Stephen Grugett
One of the things we've seen from launching this site is that users have come up with all sorts of exotic ways to use prediction markets that we hadn't previously considered. Prediction markets obviously can be used on basic yes or no questions about the future. But some exotic things you can do include getting users to help research topics for you. You can create a market on phrases and people can propose certain answers and other users can bet on them.
People have hacked our platform to do things like create lotteries and play games. We did Manifold Plays Wordle, where we created a series of prediction markets on which word we should guess next. There are all sorts of other non-prediction type things you can do with this market mechanism which are really cool.
Dwarkesh Patel
That is an interesting idea. I could imagine a researcher saying, "Will my conclusion on a paper of this question be X or Y?" To move the market, somebody would not only have to bet, but also put in the comment section the data that makes them think it's X or Y, which can be the basis of the paper. You're basically getting research assistance.
Stephen Grugett
Yeah. Relatedly, one of the new types of markets we've introduced is the concept of a free response market. In addition to a yes or no market where you're just betting on whether something will happen, we have this idea of a free response market where you ask a broad open-ended question and people can submit an answer. When they're submitting an answer, they're also placing a bet on that answer. Other users can bid up different answers that the market creator will then choose. That really opens up the space of possibilities towards allowing a much wider array of questions.
Dwarkesh Patel
Steven, thanks so much for coming on the podcast. So that's manifold.markets, right? Any other places or links that people should be aware of?
Stephen Grugett
I think that's the big one. Manifold.markets. You can join right now and we'll give you a thousand manifold dollars to bet on any market you like or create your own.
Dwarkesh Patel
Excellent. Thanks so much, Steven.
Stephen Grugett
All right. Thank you.