Podcast Episode Summary
The podcast episode features an interview with Grant Sanderson, the creator of the popular YouTube channel 3Blue1Brown. The main topic of discussion is the intersection of mathematics, education, and technology.
Key Points:
Takeaways:
Participants:
Style:
The podcast episode features a conversational style, with the interviewer asking Grant questions and engaging in discussions on various topics related to mathematics, education, and technology. The conversation is informal and relaxed, with a focus on exploring ideas and concepts rather than presenting a formal lecture or presentation.
I had a lot of fun chatting with Grant Sanderson (who runs the excellent 3Blue1Brown YouTube channel) about:
- Whether advanced math requires AGI
- What careers should mathematically talented students pursue
- Why Grant plans on doing a stint as a high school teacher
- Tips for self teaching
- Does Godel’s incompleteness theorem actually matter
- Why are good explanations so hard to find?
- And much more
Watch on YouTube. Listen on Spotify, Apple Podcasts, or any other podcast platform. Full transcript here.
Timestamps
(0:00:00) - Does winning math competitions require AGI?
(0:08:24) - Where to allocate mathematical talent?
(0:17:34) - Grant’s miracle year
(0:26:44) - Prehistoric humans and math
(0:33:33) - Why is a lot of math so new?
(0:44:44) - Future of education
(0:56:28) - Math helped me realize I wasn’t that smart
(0:59:25) - Does Godel’s incompleteness theorem matter?
(1:05:12) - How Grant makes videos
(1:10:13) - Grant’s math exposition competition
(1:20:44) - Self teaching
Dwarkesh Patel
Grant, the videos were really inspiring. You're the reason I'm going into grad school. And there's this little bell in the back of my mind that's like, do I want that? To get more people going into math PhDs?
Grant Sanderson
Math academia, finance, and computer science almost certainly have an over-allocation of talent. Actually, I'm quite determined at some point to be a high school math teacher for some number of years.
Dwarkesh Patel
Math lends itself to synthetic data, how AlphaGo is trained. You could have it produce a lot of proofs and just train on a whole bunch of those.
Grant Sanderson
The thing that takes at most 30 minutes of the teacher's time, maybe even 30 seconds, has these completely monumental rippling effects for the life of the student they were talking to that then sets them on this whole different trajectory.
Dwarkesh Patel
Okay, today I have the pleasure of interviewing Grant Sanderson of the YouTube channel 3Blue1Brown. You all know who Grant is. I'm really excited about this one. By the time that an AI model can get gold in the International Math Olympiad, is that just AGI, given the amount of creative problem solving and chain of thought required to do that?
Grant Sanderson
I, to be honest, have no idea what people mean when they use the word AGI. I think if you ask 10 different people what they mean by it, you're going to get 10 slightly different answers. It seems like what people want to get at is a discrete change that I don't think actually exists. Where you've got, okay, AI is up to a certain point. They're not AGI. They might be really smart, but it's not AGI. And then after some point, that's the benchmark when now they're generally intelligent. The reason that world model doesn't really fit is it feels a lot more continuous. GPT-4 feels general in the sense that you have one training algorithm that applies to a very, very large set of different kinds of tasks that someone might want to be able to do.
That's an invention that people in the 60s might not have expected to be true for the nature of how artificial intelligence can be programmed. So it's generally intelligent, but maybe what people mean by, oh, it's not AGI is you've got certain benchmarks where it's better than most people at some things, but it's not better than most people at others. At this point, it's better than most people at math. It's better than most people at solving AMC problems, and IMO problems is just not better than the best. So maybe at the point when it's getting gold in the IMO, that's a sign that it's as good as the best.
And we've ticked off another domain. But I don't know, is what you mean by AGI that you've enumerated all the possible domains that something could be good at, and now it's better than humans at all of them? Or enough that it could take over substantial fractions of human jobs or something. Right now it's impressive, but it's not going to be even 1% of GDP. But in my mind, if it's getting gold in IMO...
Dwarkesh Patel
I mean, having seen some of those problems from your channel, I'm thinking, wow, that's really coming after podcasters and video animators.
Grant Sanderson
I don't know. That feels orthogonal because getting a gold in the IMO feels a lot more like being really, really good at Go or chess. Those feel analogous.
Dwarkesh Patel
Well, it's super creative. I think anyone who, I don't know chess as well as the people who are into it, but everything that I hear from them, the sort of moves that are made and choices have all of the air of creativity. I think as soon as they started generating artwork then everyone else could appreciate there's something that deserves to be called creative here. And the creative side of the math, I don't know how it would look when people get them to be getting golds at the IMO, but I imagine it's something that looks a little bit like how AlphaGo is trained where you have it play with itself a whole bunch.
Math lends itself to synthetic data in ways that a lot of other domains don't. You could have it produce a lot of proofs in a proof checking language, like Lean, for example, and just train on a whole bunch of those. Is this a valid proof? Is this not a valid proof? And then counterbalance that with English written versions of something. So I imagine what it looks like once you get something that is solving these IMO level things. One of two things: either it writes a very good proof that you feel like is unmotivated. Anyone who reads math papers has this feeling that there are two types: the ones where you morally understand why the result should be true, and then the ones where you're like, I can follow the steps, why would you have come up with that?
I don't know, but I guess that shows that the result is true, and you're left wanting something a little bit more. So you could imagine if it produces that on the gold to get a gold in the IMO, is that the same kind of ability as what is required to replace jobs? Not really. The impediments between where it is now and replacing jobs feels like a whole different set of things: having a context window that is longer than some small things such that you can make connections over long periods of time and build relationships and understand where someone's coming from. And the actual problem solving part of it.
I mean, it's a sign that it would be a more helpful tool, but in the same way that Mathematica can help you solve math problems much more effectively.
Grant Sanderson
Tell me why I should be less amazed by it. Or maybe put in a different context. The reason I would be very impressed is that with chess or something, obviously this is not all the chess programs are doing, but there's a level of tree search you can do to narrow down the possibilities. More importantly, in the math example, with some of the examples you've on your channel, the ability to solve the problem is so dependent on coming up with the right abstraction to think about it, coming up with ways of thinking about the problem that are not evident in the problem itself or in any other test. That seems different from just a chess game where you don't have to think about what is the largest structure of this chess game in the same way as you do with the IMO problem.
Dwarkesh Patel
I think you should ask people who know a lot about Go and chess. I'd be curious to hear their opinions on it because I imagine what they would say is if you're going to be as good at Go as AlphaGo is, you're also not doing tree search, at least exclusively. It's not dependent on something as growth than that because you get this combinatorial explosion, which is why people thought that game would be so much harder for so much longer. There sort of has to be something like a higher level structure in their understanding. Don't get me wrong, I would be super impressed and anticipate being very impressed when you get AIs that can solve these IMO problems because you're absolutely right. There's a level of creativity involved. The only claim I'm making is that being able to do that feels distinct from the impediments between where we are now and the AIs take over all of our jobs or something. It seems like it's going to be another one of those boxes that's this historic moment analogous to chess and go more so than it's going to be analogous to the industrial revolution.
Grant Sanderson
I'm surprised you wouldn't be more compelled.
Dwarkesh Patel
I am compelled. Or just you don't think that skill of this problem is isomorphic to this completely different way of thinking about what's happening in the situation. And here's me going through the 50 steps to put all that together into this one proof. I'm surprised you don't think that's upstream of a lot of valuable tasks.
Grant Sanderson
I think it's a similar level of how impressed I was with the stable diffusion type stuff where you ask it, give me a landscape of beautiful mountains, but made out of quartz and gemstones or something. And it gives you this thing which has all of the essence of a landscape but it's not literally a landscape. So you realize there's something beyond the literal that's understood here. That's very impressive. In the same way, to solve one of these math problems that requires creativity, you can't just go from the definitions. You're 100% right, you need this element of lateral thinking, which is why we find so much joy in finding the solutions ourselves or even just seeing other people get those solutions.
It's exactly the kind of joy that you get out of good artistic analogies and comparisons and mixing and matching. I'm very impressed by all of that. It's just, I think it's in the same category. And maybe I don't have the same opinions as a lot of other people with this hard line between pre-AGI and post-AGI. I just don't know what they mean by the word AGI. And I don't think that you're going to have something that's this measurable discrete step, much less that a math tournament is going to be an example of what that discrete step would look like.
Dwarkesh Patel
Interesting. Interesting. Okay. Applied mathematicians. Where do we put them in society where they can have the biggest benefit? A lot of them go into computer science and IT. I'm sure there's been lots of benefits there, but where are there parts of society where you just have a whole bunch of mathematicians go in and they can make things a lot better? I don't know, transportation or logistics or manufacturing. But where else do you think they might be useful?
Grant Sanderson
That's such a good question. In some ways, I'm the worst person to ask about that. But this isn't going to answer your question, instead it's going to fan the flames of why I feel it's an important question. I have actually been thinking recently about if it's worth making an out of typical video that's specifically addressed it, like inspiring people to ask that, especially students who are graduating. I think this thing happens where when you fall in love with math or some sort of technical field, by default in school, you study that. When you're studying that effectively, you're going through an apprenticeship to be an expert in that or a researcher in that.
The structure of studying physics in a university or math in a university, even though they know that not all majors are going to go into the field, the people that you're gaining mentorship from are academics and are researchers in the field. So it's hard not to effectively be apprenticing in that. I also have noticed that when I go and give talks at universities or things like this and students come up after and they're saying hi, there's a lot of them like, Grant, the videos were really inspiring. You're the reason that I studied math or that you're the reason I'm going into grad school. And there's this little bell in the back of my mind.
That's like, cool, cool. I'm amazed. I don't know if I believe I was wholly responsible for it, but cool to have that impact. Do I want that? Is this a good thing to get more people going into math PhDs? On the one hand, I unequivocally want more people to self-identify as liking math. That's very good. But that those who are doing that necessarily get shuffled into the traditional outlets like math academia. I think you highlight it very right. It's like math academia, finance, and computer science, data science something in there. In general, they are very common things to go to, and as a result they almost certainly have an over allocation of talent.
All three of those are valuable. I'm not saying those are not valuable things to go into, but if you were playing God and shifting around where do you want people to go... I'm not answering your question. I'm just asking it in other words, because I don't really know. I think you should probably talk to the people who made that shift, of which there aren't a huge number, but Eric Lander is maybe one good example. Jim Simons would maybe be another. People who were doing a very purely academic thing and then decided to shift to something very different. I have sort of had this thought that it's very beneficial to insert some forcing function that gets the pure mathematicians to spend some of their time in a non-pure math setting.
NSF grants coming with a requirement that 10% of your time goes towards a collaboration with another department or something like that. The thought being these are really good problem solvers in a specific category of problems, and to just distribute that talent elsewhere might be helpful. When I run this by mathematicians, sometimes there's a mixed response where they're like, I don't know if we'd be all that useful. There's a sense that the aesthetic of what constitutes a good math problem is by its nature rooted in the purity of it, such that it's maybe a little elitist to assume that just because people are really, really good at solving that kind of problem, that somehow their abilities are more generalizable than other people's abilities.
Why ask about the applied mathematicians rather than saying, shouldn't the applied biologists go and work in logistics and things like that, because they also have a set of problem solving abilities that's maybe generalizable. The back of my mind, I think, no, but the mathematicians are special. There really is something general about math. So I don't have the answers. I will say I'm actually very curious to hear from people for what they think the right answers are or from people who made that switch. Let's say they were a math major or something adjacent, like computer science, physics, and then they decided that they wanted to pour themselves into something, not because that was the academic itch that they were scratching by being good at school and getting to appreciate that, but because they stepped back and said what impact do I want to make on the world.
I'm hungry for more of those stories because I think it could be very compelling to convey those specifically to my audience who is probably on track to go into just the traditional math type fields. Maybe there's room to have a little bit of influence to disperse them more effectively. But I don't know. I don't know what more effectively looks like because at the end of the day, I'm a math YouTuber. I'm not someone who has a career in logistics or manufacturing or all of these things in such a way that I can have an in-tune feel for where is there a need for this specific kind of abstract problem solving.
Dwarkesh Patel
It might be useful to speculate on how an undergrad or somebody who's a young math whiz might even begin to contemplate, here's where I can have an edge. I'm remembering actually it just occurred to me a former podcast guest Lars Doucette. He was a game designer actually, and he started learning about Georgism which is this idea that you should tax land and only land. So he got really interested in not only writing about those ideas but also with well, if you're going to tax land you had to figure out what the value of land is. How do you figure out the value of land? There's all these algorithms of how you do this optimally based on neighboring land and how to average across land. There's a lot of intricacies there. So he now has a startup where he just contracts with cities to implement these algorithms to help them assess the value of their land, which makes property taxes much more feasible. That's another example, right? Where the motivation was more philosophical, but his specialty as a technical person helped him make a contribution there.
Grant Sanderson
I think that's perfect. Probably the true answer is that you're not going to give a universal thing for any individual. It's going to be based on where their life circumstances connect them into something either because they had an interest in Georgism for whatever reason. But if someone, I don't know, their dad runs a paper mill and they're connected to the family business in that way and realize they can plug themselves in a little bit more efficiently, you're going to have this wide diversity of the ways that people are applying themselves that does not take the form of general advice given from some podcast somewhere, but instead takes the form of simply inviting people to think critically about the question rather than following the momentum of what being good at school implies about your future.
Dwarkesh Patel
We were talking about this before the interview started, but we have a much better grasp on reality based on our mathematical tools. I'm not talking about anything advanced, literally just being able to count and in the decimal system that even the Romans didn't have. How likely do you think it is that something that significant would be enjoyed by our descendants in hundreds or thousands of years? Or do you think that that kind of basic numeracy level stuff, those kinds of thinking tools are basically all gone?
Grant Sanderson
Just so I understand the question. You're talking about how having a system for numbers changes the way that we think that then lends itself to a better understanding of the world. Like we can do commerce, things like that. Or we can think in terms of orders of magnitude. It would have been hard to think. We have the word orders of magnitude in a way that is hard to write down, much less think about if you're doing Roman numerals. Is there something analogous to that for our descendants? I mean, fluency with a programming interface really can help understanding certain problems. I think when people mess around in a notebook with something and when it feels like a really good tool set, there's a way that that has the same sensation as adopting a nice notation in that you write something with a small number of symbols, but then you discover a lot about the implication of that.
In the case of notation, it's because the rules of algebra are very constrained. So when you write something, you can go through an almost game-like process to see how it reduces and expands and then see something that might be non-trivial. In the case of programming, of course, the machine is doing the crunching and you might get a plot that reveals some extra data. I think we're maybe at a phase where there's room for that to become a much more fluid process, such that rather than having these small little bits of friction, like you've got to set up the environment and you've got to be in the notebook, you've got to find the right libraries, that there's something that feels as fluid as when you are good at algebra and you're just at a whiteboard kind of noodling it out.
I think there's something to be said for the fact that there's still so much more value in if you and I were to go into some math topic right now. You ask me something that's a terrible question for a podcast but I'm like, oh let's actually dig into it. The right medium to do that is still paper. I would break out some paper and we would scribble it out. So whenever it becomes the case that the right medium to do that lends itself to simulation and to programming and all that, that feels like it would get to the point where it shifts the way that you even think about stuff.
Dwarkesh Patel
Yeah, that's really interesting. What's up with miracle years? This is something that happens throughout science and especially with mathematicians where they have a single year in which they wake up many, if not most of the important discoveries that they have in their career. Newton, Einstein, Gauss, they all had these years. Do you have some explanation of what's going on? What's your take?
Grant Sanderson
I think there's a bunch of possible explanations. It can't just be youth because youth lasts 10 years, not one year. So it must have something to do with every 35 year old right now. It's like, how dare you? [Laughs] Made 20 years. So yeah, it can't just be that. I don't know. There's a bunch of possible things you could say. One is you're in a situation in life where you have nothing else going for you, or you just really free for that one year and then you become successful after that year is over based on what she did.
Dwarkesh Patel
Yeah. But what is your take?
Grant Sanderson
I don't know. So I agree. That's probably multiple factors, not one. One thing could be that the miracle year is the exhalation. And there's been many, many years of inhalation where often, let's say the classic one is Einstein's where his miracle year were also some of the first papers kind of springing onto the scene. I would guess that a lot of the ideas were not bumping around his head only in that year, but it's many, many years of thinking about it and kind of coalescing. So you might be in a position where you can build up all of this potential energy. And then for whatever reason, there's one time in life that lends itself to actually releasing all of that.
If I try to reflect on my own history with what I'm doing now, I think I didn't appreciate early on how much potential energy I was working from simply from being a student and in college, where there's just a bunch of ways of thinking about things or empathy with new learners or just cool concepts. The basic concept behind a video, in fact, it was many, many years of all of my time having learned math before I started putting out stuff online that I was able to eat into. And then maybe it was a little later where, okay, the well never runs dry. There's always a long list of things that I want to cover.
But in some sense, I recognize that the well was at risk of running dry in a way that I never thought that it could. Without being a little deliberate about devoting some of my day, not just to output and producing, but to stepping back and learning new things and touching something I never would have, that doesn't happen by default. I don't know if this is also the case for the people who have genuine miracle years where they were letting out all of this stuff. And then it takes a decade to build up that same level of potential energy. The other thing, you have everything to gain and nothing to lose when you are young.
So even if it's not merely youth, there's a willingness to be creative. And there's also none of the obligations that come from having found success before. There's certain academics who made an extremely deliberate effort not to let what do they call it, is it like the curse of success or there's some term for it. I think maybe James Watson had this standard reply to invitations for talks and interviews and things like that. It was basically no to everyone because I just want to be a scientist. It was much more articulate than that and he has all these nine points, but that was the gist of it.
Short of doing that, I think it's very easy for someone to have a lot of other things that eat into their mind share and time and all of that, that even if it's just 20 hours a week, that really interrupts a creative flow.
Dwarkesh Patel
Were you a student when you started the channel? Technically?
Grant Sanderson
Yeah. The very first video was made when I was a senior at Stanford. Basically I had been toying around with a personal programming project in my last year of college that was the beginnings of what is now the animation tool I work with. I didn't intend for it to be a thing that I would use as a math YouTuber. I didn't even really know what a YouTuber was. It was really just a personal project. It was March of that year that I published the first ever video. So it was kind of right at that transition point.
Dwarkesh Patel
Do you think you could have done it if you had become, I don't know what you were planning on doing after college. I remember you saying somewhere, maybe a data scientist, but data scientist and math PhD were the two 50/50 contenders basically. Is there a world in which you started doing that, but then later on made Manim? Or do you think that that was only possible in a world where you had some time to kill in your senior year?
Grant Sanderson
If the goal was to make math YouTube videos, it would have been a wild thing to do to do it by making Manim as the method for it, because it's so strikingly inefficient to do it that way. At the very least it probably would have built on top of an existing framework. If I had, there's so many things that I would tell my past self if I could go back in time, even if the goal was to make that, it's like certain design decisions that caused pain that could have been fixed earlier on. But if the goal was to make videos, there's just so many good tools for making videos. I probably would have started with those.
Or if I wanted to script things maybe I would have first learned After Effects really effectively and then learn the scripting languages around After Effects. That might even been better for all I know. I really don't know. But I just kind of walked into it because the initial project was to make something that could illustrate certain ideas in math, especially when it came to visualizing functions as transformations, mapping inputs to outputs, as opposed to graphing. The video output was just a way of knowing that I had completed that personal project in some sense. And then it turned out to be fun because I also really enjoy teaching and really enjoy tutoring and stuff.
I don't know. Then again, there's a lot of other people who make their own tools for math GIFs and little illustrations and things, which on the one hand feels very inefficient. If people come across a math GIF on Wikipedia, there's a very high probability it comes from this one individual who is just strangely prolific at producing these creative comments visuals, and he has his own home-baked thing for how he does it. And then there's someone who I came across on Twitter, Matt Henderson, who has these completely beautiful math GIFs and such. Again, it's a very home-baked thing that is built on top of shaders, but he kind of has his own stuff there.
Maybe there's something to be said for the level of ownership that you feel once it is your own thing that just unlocks a sense of creativity and feeling like, hey, I can just describe whatever I want, because if I can't already do it, I'll just change the tool to make it able to do that. For all I know, that level of creative freedom is necessary to take on a wide variety of topics. But your guess is as good as mine for those counterfactuals.
Dwarkesh Patel
Yeah. This is personally interesting to me because I also started the podcast in college and I just was off track of anything I was planning on doing otherwise. And this is many, many orders of magnitude away from 3Blue1Brown. I don't want the audience to cringe in unison, but I just think it's interesting how often something that later on ends up being successful is something that was started almost on a whim as a hobby when you're in college or something like that.
Grant Sanderson
I will say there's a benefit to starting it in a way that is low stakes. You're not banking on it growing. I had no anticipation of, much less an expectation of 3Blue1Brown growing. I think the reason I kind of kept doing it was in the fork of life. If I did the math PhD and all that, I thought it might be a good idea to have a little bit of a footprint on the internet for math exposition. I was thinking of it as a very niche thing that maybe some math students and some people who are into math would like it, but I could sort of show the stuff as a portfolio, not as an audience size that was meaningful.
I think I was surprised by what an appetite there was for the kind of things that I was making. In some ways, maybe that's helpful because I see a lot of people who jump in with the goal of being a YouTuber. I think it's the most common desired job among the youth is to be like a TikToker or a YouTuber, think of that what you will. But when you jump in with that as a goal, you kind of aim for too large an audience and end up making the content which is best for no one. One, you're probably not that good at making videos yet. So you're competing, if it's a generally applicable idea, you're competing with all of the other communicators out there.
Whereas if you do something that's almost unreasonably niche and also you're not expecting it to blow up, one, you're not going to be disappointed. It's outstanding when a thousand people view it as opposed to being disappointing. And two, you might be making something that is the best possible version of that content for the audience who watches it because no one else is making that for them because it's too narrow a target. That's sort of the beauty of the internet is that there is an incentive to do that. I don't know if this is the case with your podcast when you're starting off, where not thinking about, oh, how can I make this as big as possible, actually made it more in-depth for those who were listening to it.
Dwarkesh Patel
Is it surprising to you that prehistoric humans don't seem to have had just basic arithmetic and numeracy?
To me, I guess to us with the modern understanding, that kind of stuff seems so universally useful and so fundamental that it's shocking that it just doesn't come about naturally in the course of interacting with the world. Is that surprising, just the concept of numbers?
Grant Sanderson
You're right. It's so in our bones that it's hard to empathize with not having numeracy. A lot of it's linked to commerce and money. Maybe the question is the same as saying, is it surprising that early humanity didn't have commerce? When you're below Dunbar's number in your communities, a tit-for-tat structure just makes a lot more sense and actually works well. It would be obnoxious to actually account for everything.
The other loosely related idea: have you come across those studies where anthropologists interview tribes of people removed from normal society? They don't have the level of numeracy that you or I do, but there's some notion of counting. If you have one coconut or nine coconuts, you have a sense of that. But if you ask what number is halfway between one and nine, those groups will answer three, whereas you or I would probably answer five because we think on this very linear scale.
It's interesting that the natural way to think about things is logarithmically. The social dynamics as you go from solitude to a group of 10 people to a group of 100 people have roughly equal steps in complexity, more so than going from one to 51 to 102. I wonder if by adding numeracy, we've also lost some intuition in other areas. Now if you ask middle school teachers what's a difficult topic to teach, they say logarithms. But that should be deep in our bones. Somehow it got unlearned. Maybe it's harder to relearn in the formal sense, but there's a sense of quantitative thinking that humans naturally do have that is hard to appreciate when it's not expressed in the same language.
Dwarkesh Patel
Yeah, I have seen the thing from Joseph Henrich where the still existing tribes can do numeracy and arithmetic in very concrete terms, like with seeds, but the abstract concept of a number is not available to them. Do you think the abstract concept of a number is useful to your life?
Grant Sanderson
Oh yeah.
Dwarkesh Patel
Like in what ways?
Grant Sanderson
It's almost like asking how the concept of the alphabet is useful. It comes up so often.
Dwarkesh Patel
Is that the concept of an abstract number though? It's like two people, two lights, one-to-one correspondence. Did you leverage the abstraction of two as an object which is simultaneously a rational and a real and an integer? No, you're just, there's a light for you, a light for me.
Grant Sanderson
Yeah. I'm pretty sure the abstract idea of a number is important for all of us, but I don't think it's immediately obvious. It shapes the way we think. I'm not sure if it actually changes the way we live if you assume you don't work in STEM where you're literally using it all the time.
Dwarkesh Patel
I'm trying to go through my day and think through where am I using them. There's the obvious commerce examples, going to a restaurant and figuring out what to tip. But that seems a very particular example. Do I really use numbers that infrequently? I don't know. Many people listening are probably screaming out of their heads with much more apt examples. But it's hard to say.
When a mathematician is working on a problem, what is the biggest mental constraint? Is it working memory? Is it processing speed? Plants are limited by nitrogen usually. What is the equivalent of nitrogen for a mathematician?
Grant Sanderson
That's a fun question. I'm not a research mathematician, I shouldn't pretend like I am. The right people to ask would be research mathematicians. I wonder if you'd get consistent answers. As with so many things, there's not one.
Maybe the number of available analogies to be able to draw connections. The more exposure you've had to disparate fields, you could see that a problem-solving approach used here might be useful there. Sometimes that's literally codified in the forms of connections between different fields, like functors between categories. But sometimes it's a lot more intuitive. The idea that someone's doing a combinatorics question and they think, "Oh, maybe generating functions are a useful tool to bring to bear." Then in a completely different context of studying prime numbers, they think, "Maybe I could take a generating function type approach."
One of the tendencies you've seen in math papers over the last 200 years is the typical number of authors is much bigger now than before. People have this misconception that math is a field with lone geniuses coming up with great insights alone next to a blackboard. The reality is it's a highly collaborative field. I remember one of the first times I was hearing from a mathematician when I was a young kid at a math circles event. Someone asked him what surprised you about your job? The first thing he said was how much travel was involved. If you're studying a very specific niche field, the way you make progress is by collaborating with other people in that field or adjacent fields. There's only so many of them, they probably aren't at your university, so you travel to work with them.
These days a lot of that happens on Zoom, but conferences are still super important. Events that bring people all under one roof, like MSRI, try to do that systematically. You could say that's a social thing, get more ideas, but I think it's hitting on this idea that what you want is exposure to as many available analogies. So the short answer to your question is the nitrogen for a mathematician is the analogy.
Dwarkesh Patel
This actually is an interesting question I wasn't planning on asking, but it just occurred to me. Is it surprising how new a lot of mathematics is, even mathematics taught at the high school level? With physics or biology, that's also new, but you can tell a story where we didn't have the tools to look at the cell or inspect an electron until very recently. But we've had mathematicians for two or three thousand years doing pretty sophisticated things. I don't know why linear algebra is so new given that fact.
Grant Sanderson
I wouldn't have thought of math as being new in that way. If anything, especially at the high school level, there's always the sensation that it's frustrating that all the things are way more than a hundred years old. The names attached to the theorems you're doing, none of them are remotely modern. Whereas in biology, the understanding of how proteins are formed is relatively much more modern, you might be just a couple of generations away.
To some extent, there's a raw manpower component. How many people did pure math for most of history? For most of history, no one was a pure mathematician. They were a mathematician plus something else, or a physicist, a natural philosopher. Insofar as you're doing natural philosophy, one component is developing math, but it's not the full extent of what you do. Even the ones we think of as very pure mathematicians, like Gauss, a lot of his output was centered on very practical problems.
Since then, you start to get an era of something more like pure mathematicians. The raw number available, the man-hours being put into developing new theorems, probably got this huge spike. The population grows, and the percentage of the population with the economic freedom to do something as indulgent as academia grows. Maybe it's pretty reasonable that most of it is much more recent.
Dwarkesh Patel
Some of these things seem actually pretty modern, like information theory is less than 100 years old. That's true. And it's pretty fundamental. Theoretically, you could have written that paper a long time ago.
Grant Sanderson
That's a really good example. Maybe this is a sign that the math developed is more in the service of the world you live in and the adjacent problems it's used to solve than we typically think. Information theory is such a good example because it's so pure. You could have asked the question, you could have defined the notion of a bit. But evidently, there wasn't a strong enough need to think that way. When you're doing error correction or thinking about actual information channels over a wire at Bell Labs, that's what prompts it.
Another really good example would be chaos theory. You could easily ask, why is chaos theory so recent? You could have written the Lorenz equations since differential equations existed. Why didn't anyone do that and understand sensitivity to initial conditions? In that case, it's the opposite. It's not that you need the existence of computers as a problem to solve. Instead, you need them to even discover the phenomenon in the first place. A lot of original concepts in chaos theory came from running simulations that required a massive amount of computation that simply wouldn't be done by hand. Someone could ask the question, but they wouldn't have observed the unexpected phenomenon.
Even questions as relevant to a pre-computer world as a post-computer world, like the nature of weather modeling or the three-body problem, somehow without the right tools for thought, it just didn't come into the mind. Maybe there are other things like that where pieces of technology that fundamentally shape everyone's life will then invariably shift the mathematician's focus.
Dwarkesh Patel
This actually reminds me of the first day of Scott Aaronson's quantum information class. He said that what I'm about to describe to you could have been discovered by a mathematician before quantum physics existed, if only they'd asked the question: we're going to do probabilities, but we're only allowed to use unitaries. You could have just discovered quantum mechanics or quantum information from there.
Grant Sanderson
The thing about math, especially pure axiomatized math, the experience as an undergrad is that you go through a textbook that starts with the axioms of the field, then deduces lemmas and theorems. With that framing, you get the impression you could just make up any pile of axioms and deduce what follows. The space of possible math is unfathomably huge. You need some process that calls down what are the useful things to pursue. One thing all too often missing in those pure math textbooks is the motivating problem. Why was this set of axioms found to be useful and not something else?
The framework for quantum information theory marries together linear algebra and probability. That's great, but there are all sorts of other things you could try to cram together and get some sort of math out. The question becomes, is it worth your time to do that?
Knot theory emerged because Lord Kelvin had a theory that all the elements on the periodic table had structures related to knots. If you have a closed loop in 3D space and you want to continuously deform it without it ever crossing itself, you ask if you could get back to an open loop. If you can't, what are the set of all other loops that could be deformed into that? You end up categorizing all the different knots. This started with a completely incorrect theory for what's going on at the atomic level. He found with smoke rings that if you're very dexterous, you can get them to form knots in 3D, and they're very stable. It was irrelevant for understanding the periodic table, but it was an interesting mathematical question and people ran with it.
In that case, it was an arbitrary reason someone thought to ask the question. Frankly, fewer people run with it than would if it turned out to be a more useful question. You want to ask what prompts people to ask what turns out to be a mathematical question, given that the space of possible mathematical questions is so unfathomably huge that it's impossible to explore through a random walk.
Dwarkesh Patel
Wait, are you saying that Lord Kelvin's apple hitting Newton story was that he was smoking a lot of pipe and he needed to categorize his puffs?
Grant Sanderson
I can't remember if it was smoke rings out of his mouth, but that's a natural place to look. We should look into that.
Dwarkesh Patel
You've changed how you and other creators have changed how pedagogy happens via animated videos. What would it take to do something similar for video games, text, all these other mediums? Why hasn't there been a similar broad scale adoption and transformation of how teaching happens there?
Grant Sanderson
I'm not sure I understand the question. You're saying there's been a rise of explanatory videos, why is there not a similar rise in pedagogical video games? Games are very hard to make. It takes a lot of resources for a given game. Whenever people seem to try to do it with pedagogy as a motive, making a game whose goal is to teach something, I don't play enough games to really speak to it the way well-versed game designers can. It seems to be the case that they are not fun in the way people would want them to be fun, and the ones that are most effective are not directly educational.
The one game I actually played because enough of my friends told me I should, and it seems relevant to math explanation, was The Witness. As someone who doesn't play games and then did play it, it's fantastic. It's absolutely well done in every possible way. Critical to that is the nature of how problems are solved. The reason people were recommending it to me is because the feeling of playing The Witness is a lot like the feeling of doing math. It's nonverbal. You come across little puzzles where the simple mechanics of one puzzle inform you about the fundamental mechanics that become relevant to much harder ones. If you do it with the right sequence, you have the feeling of epiphany in ways that are very self-satisfying. You come away feeling like you should be able to do something like this for math. Maybe you can. It's just so hard to make a game at all that there's not the rate of production you would need to explore and get enough games out there that one of them hits.
With YouTube, there are a lot of math videos. It's OK that most of them suck. You just need enough that when someone searches for a term, they get one that is good and scratches that itch. Or they might get recommended something that brings a question to their mind they wouldn't have thought about. With video games, you're also spending a lot more time as a user on each one, a many-hour average experience rather than a five-minute average experience.
You asked about text. I don't know if I accept the premise that there's not the same advances and innovation in the world of textual explanations. Mathigon is a really good example. It's like the textbook of the future, an interactive website. The explanations are really good. Insofar as it doesn't have more impact or reach, it's maybe just because people don't know about it or don't have an easy means of accessing something that recommends the really good innovations in textual explanations. YouTube has a recommending engine that tries its hardest to get more of these things in front of people. In the world of actual written textbooks, there are so many that I like so much that I think it would be a disservice to say that medium is not making advances in terms of empathy to the learner.
Dwarkesh Patel
Should the top 0.1% of educators be exclusively on the internet? Because it seems like a waste if you were just a college professor or a high school professor teaching 50 kids a year, given the greater scale available. Should more of them be trying to see if they can reach more people?
Grant Sanderson
I think it's not a bad thing for more educators who are good at what they're doing to put their stuff online, for sure. Highly encourage that, even if it's as simple as getting someone to put a camera in the back of the classroom. I don't think it would be a good idea to get those people out of the classroom. If anything, one of the best things I could do for my career would be to put myself into more classrooms. I'm quite determined at some point to be a high school math teacher for some number of years. I don't know when, there's such opportunity cost. It's something I would plan on notably later, as long as there aren't other life logistics that occupy a lot of mindshare. Everything I know about high school teaching is that it just kicks your ass for the first two years.
One of the most valuable things you can have if you're trying to explain stuff online is a sense of empathy for what the possible viewers are like. The more distance you put between yourself and them in terms of life circumstances, the more of an uphill battle it is to make the content good for them. I'm not a college student, so I don't have the same empathy with what a college student is like. Certainly not a high school student, so I've lost that empathy. Keeping people in regular touch with what people in the classroom actively need is necessary for them to remain as good and as sharp as they are.
So yes, get more of those top 0.1% to put their stuff online. But I would absolutely disagree with the idea of taking them out of their existing circumstances. Maybe for a year or two so they don't lose that sharpness, but then put them right back in. One, it makes them better at the online exposition. Two, the reach is lower, but you're with them for much more time and you actually have the chance of influencing their trajectory through a social connection in a way you just don't over YouTube.
I think you're using the word education in a way I would maybe sub out for the word explanation. You want explanations to be online. But education derives from the same root as the word educe, meaning to bring out. I really like that etymology because it reminds you that the job of an educator is not to take their knowledge and shove it into the heads of someone else. The job is to bring it out. That's very hard to do in a video. Even if you can kind of get at it by asking intriguing questions, for the most part the video is there to answer something once someone has a question. The teacher's job should be to provide the environment such that you're bringing out from your students as much as you can through inspiration, projects, mentorship, and encouragement along the way. That requires eye contact and being there in person, being a true figure in their life rather than just an abstract voice behind a screen.
Dwarkesh Patel
Then should we think of educators more as motivational speakers? As in, the actual job of getting the content in your head is for the textbooks or for YouTube, but now the job of why we have college classes or high school classes is we have somebody who approximates Tony Robbins to get you to do the thing.
Grant Sanderson
That would be a subset of it. But there's more than just motivational speech that goes into it. There's facilitation of projects, coming up with what the projects are, recognizing what a student is interested in so you can try to tailor a question to their specific interests. Or you can act as the curator. There are a lot of online explanations for what a Poisson distribution is. Which one is the right one that I could serve? Based on knowing you as a particular student, what might resonate? You might be in a better position to do that. All of that goes beyond being a Tony Robbins saying, "Oh, be the best person you can be."
One thing I might say is that any time I chat with mathematicians and try to get a sense for how they got into it, so often it starts by saying, "There was this one teacher and that teacher did something very small. They pulled them aside and just said, 'Hey, you're really good at this. Have you considered studying more?'" Or they give them an interesting problem. The thing that takes at most 30 minutes of the teacher's time, maybe even 30 seconds, has these completely monumental rippling effects for the life of the student that sets them on a whole different trajectory.
Two examples come to mind. One is this woman who said she had this moment where she got pulled aside by the teacher and he just said, "Hey, I think you're really good at math. You should consider being a math major." That had been completely outside of her purview at that time, and it changed the way she thought about it. Later she learned that he did that for a large number of people. That's a level of impact you can have in person as a figure in their lives in a way you can't over a screen.
Another one was very funny. I was asking this guy why he went into the specific field that he did. It seemed arbitrary in my mind, but I guess all pure math seems to be. He said that for his first year of grad school, he was sitting in this seminar. At the end, the professor, an old professor he had never met before, comes up to him and says, "You, I have a problem for you. A good research problem that I think might be a good place for you to start in the next couple months." He gets this research problem, spends some months thinking about it, and comes back. It later came to light that the professor mistook him for someone else he was supposed to be mentoring. It was the stereotypical image of a doddering old math professor not very in tune with the people in his life. Nevertheless, that moment of accidentally giving someone a problem completely shifted the research path for him. If nothing else, it shows you the sensitivity to initial conditions that takes place when you are a student, and how the educator is right on that nexus of sensitivity who can completely swing the fences one way or another for what you do.
For every one of those stories, there's going to be an unfortunate counterbalancing story about people who are demotivated from math. I think this was seventh grade. There was this math class I was in. I was one of the people who was good at math and enjoyed it and would often help the people in the class understand it. I had enough ego built up to have a strong shell around things. For context, I also really liked music, and there was this concert where I had a certain solo earlier in the day or earlier that week.
There was a substitute teacher on one day. She didn't have any of the context. She gave some lesson and then had us spend the second half of the class going over the homework. All the other students were very confused. They would come to me and I would try to offer to help them. The substitute was going around the class in circles, marking off a little star for how far down the homework people were, just to get a sense of their progress. When she got to me, I had done none of them because I was spending my whole time trying to help all the others. After having written a little star next to the same problem three different times, she said to me, "You know, sometimes music people just aren't math people." And she kept walking.
Now, I was in the best possible circumstance to not let that hit hard. I had the moral high ground of, "Hey, I've just been helping all these people. I understand it. I've been doing your job for you." That was my little egotistical seventh grade brain. I knew that I knew the stuff. Even still, with all of that as armor, I remember it was just this shock to my system. She says this thing and it just made me strangely teary eyed. I can only imagine if you're in a position where you're not confident in math, and the thing you know deep in your heart is that you are kind of struggling with it. A little throwaway comment like that could completely derail your whole relationship with the subject.
It's another example to illustrate the sensitivity to initial conditions. I was in a robust position. It wasn't as sensitive. I was going to love math no matter what. But you envision someone a little bit more on that teetering edge, and the comment one way or another, either saying "You're good at this, you should consider majoring in it" or saying "Sometimes music people aren't math people," which isn't even true.
Like that was the other thing about it that niggled at my brain when she said it.
Dwarkesh Patel
All of that is just so important for people's development. When people talk about online education as being valuable or revolutionary, there's a part of me that sort of rolls my eyes because it just doesn't get at the truth that online explanations have nothing to do with all of that important stuff that's actually happening. At best, it should be in the service of helping that side of things where the rubber meets the road. I had Tyler Cowen on the podcast, and he obviously has Marginal Revolution University, these YouTube videos where he explains economics. He had a similar answer to give. I think I asked, basically, why aren't you just replacing, or should we think of you as a substitute for all these economics teachers? In his mind as well, he was more a complement to the functions that happen in the class.
And to your point about the initial conditions, I'm sure you remember the details of the story, but I just vaguely remember hearing this. Wasn't there a case where a mathematician who later ended up becoming famous arrives to a lecture late? Do you want to tell the story? I don't remember it beat for beat, but I think it was a statistics class and he was a grad student. He comes in late, and there's two problems on the board that the professor had written. He assumed that those two problems were homework, so he goes home and he works on them. After a couple weeks, he goes to the professor's office and turns in his homework.
He's like, "I'm sorry I'm so late, this one just took me a lot longer than some of the others." The professor says, "Oh, okay," and just shuffles it away. Then a couple days later, when the professor had the time to go through and see them, he realized that the student had fully answered these questions. What the student didn't know is that they were not homework problems written on the chalkboard. They were two unsolved problems in the field that the professor put up as examples of what the field was striving for. I don't remember what problems they were, so that would be more fun color to add to the story.
But then, at least as the anecdote told to me however many years ago goes, the professor then finds the student's housing and knocks on the door. "Do you realize that these were actually unsolved problems?" And then he gets to basically make those his thesis.
Grant Sanderson
That idea of just being given something for completely random reasons and it shifts the course of what you do. Or it's a thing where if you know a crossword is solvable, you just keep going at it until you solve it. Or the four-minute mile.
Dwarkesh Patel
Exactly. That's a great example. Another valuable experience, at least one I had, was taking Aronson's classes in college and realizing I am at least two standard deviations below him. That was actually a really valuable experience for me. Not because it increased my confidence — I didn't have a moment where I was like, "Oh wow, I'm good at this" — but it was useful to know. Podcasting is an easier thing to do. So it's good to know that there are actual technical things out there where you can get really deep into something and people are just going to be way above you. Having that sort of awareness.
Grant Sanderson
Do you think it's fair to have a mental model that has a static G factor type quality here, such that you're two standard deviations below and that is forever the state of things? Or do you think the right mental model is something that allows for flexibility on where contributions actually come from or where intuitions come from? Through many years of experience in certain kinds of problem solving, maybe what seemed like a flash of insight was actually the residue of just years of thinking about certain kinds of puzzles that he had that you maybe didn't.
Dwarkesh Patel
Okay, can I tell you a story from that class actually?
Grant Sanderson
Yeah, go for it.
Dwarkesh Patel
So he's giving some proof about how one complete — actually, it wasn't that. He was giving a proof of a method. I forgot the name of the method, but it's a very important method in complexity theory that helped to prove the bounds of the complexity of different problems. He explains it and he says, "You know, in 1999, I proved this myself, but I realized that six months before, somebody had already published a paper with this method. And I realized I'm catching up to the frontier now. When I was a kid, I was doing Euler. That's 2,000 years in regress. Now, six months behind." Then later on in the day, I'm like, "Wait, 1999? How old was Scott Aronson in 1999?" I think it was 18 or 19, and he was basically proving frontier results in complexity theory.
Grant Sanderson
So at that point, you're like, "Alright, Aronson's a special animal here."
Dwarkesh Patel
You are right, he's probably a special animal. But it's just broadly good to know, just to have that sort of upper constraint on your Dunning-Kruger, that this exists in the world.
Grant Sanderson
Maybe the thing that I would want to say is that whatever the scale is on which he's two standard deviations above you, that might not be the one scale that matters. Contributions to these fields don't always look like genius insights. Sometimes there's fruit to be born from becoming kind of an expert in two different things and then finding connections between them. The people who make contributions are not necessarily the Scott Aronsons of the world.
Dwarkesh Patel
Still, there is probably a truth that there are — von Neumann's another example of one of these.
Grant Sanderson
Right, yeah, yeah.
Dwarkesh Patel
How much does Gödel's incompleteness theorem practically matter? Is it something that comes up a lot, or is it just an interesting thing to know about the balance that isn't day-to-day applicable?
Grant Sanderson
You've asked me another question where I'm not the best one to ask, and I should throw that as a caveat to begin from. From what I understand, it really doesn't come up. The analogy to make, the paradoxical fact that it's conveying, the idea that you can't have an axiom system that is both — that will basically prove all of the things that are true and which is also self-consistent — the contradiction that you construct out of that has the same feeling as the sentence, "This statement is a lie." You think about the statement: if it's false, then it must be true. If it's true, it must be false. It's that same flavor. You might ask, does the existence of that paradox mean that it's hard to speak English unequivocally?
Dwarkesh Patel
That's interesting.
Grant Sanderson
It's so rare that you would come up with something that happens to have a bit of self-reference in it. There was one of the first times that there was something that came up that didn't feel quite as pathological in that way. If the curious listener wants to go into it, that search term would be Paris-Harrington theorems. It's a little pathological, but it wasn't a question that came up that seemed like it was deliberately constructed to be one of these self-referential things. It shows itself to be outside the bounds of whatever axiom system you were starting with. It was shown to be unresolvable in a certain sense, but it was asking a question where you wouldn't expect that to be true.
So maybe at the edges of theory, there are some times when the paradoxes that are possible from Gödel's incompleteness theorem do eke their way in. The impression I get is no mathematician is thinking about it. They're not actively worrying about it. It's not like, "Oh god, can I be sure that the stuff that I'm going to show is true?" For all the practical problems — the Riemann Hypothesis or Twin Primes — almost everyone's like, "No, there's going to be an answer." Maybe they turn out to be unresolvable in one of these ways, but there's just a strong sense that that theorem came from a pathology in a way that natural questions that people actually care about don't.
Dwarkesh Patel
That's really interesting. Something from the outside and in popularizations seems to be a very fundamental thing. People have definitely heard about this.
Grant Sanderson
A good analogy here is in computer science, the halting problem. You take a computer science course, one of the first things you'll learn is the proof of the halting problem. It's another one of those things where you don't really need to be able to prove that every single — or you have that sort of program available before.
Dwarkesh Patel
No comments. No more comment.
Why are good explanations so hard to find, despite how useful they are? Obviously, there are many other cases of good explanations besides you, but generally it just seems like there aren't as many as there should be. Is it just a story of economics where it's nobody's incentive to spend a lot of time making good explanations? Is it just a really hard skill that isn't correlated with being able to come up with the discovery itself? Why are good explanations scarce?
Grant Sanderson
I think there's maybe two explanations. The first, less important one, is that there's a difference between knowing something and then remembering what it's like not to know it. The characteristic of a good explanation is that you're walking someone on a path from the feeling of not understanding up to the feeling of understanding. Earlier, you were asking about societies that lack numeracy. That's such a hard brain state to put yourself in. What's it like to not even know numbers? How would you start to explain what numbers are? Maybe you should go from a bunch of concrete examples, but the way that you think about numbers and adding things — you have to really unpack a lot before you even start there. At higher levels of abstraction, that becomes even harder because it shapes the way that you think so much. Remembering what it's like not to understand it — you're teaching some kid algebra and the premise of a variable. They're like, "What is X?" And you're like, "Well, it's not necessarily anything, but it's what we're solving for." They say, "Yeah, but what is it?" Trying to answer what is X is a weirdly hard thing because it is the premise that you're even starting from.
The more important one probably is that the best explanation depends heavily on the individual who's learning. The perfect explanation for you often might be very different from the perfect explanation for someone else. There are a lot of very good domain-specific explanations. Pull up any textbook, and chapter 12 of it is probably explaining the content quite well, assuming that you've read chapters 1 through 11. But if you're coming in from a cold start, it's a little bit hard. The real gold nugget is, how do you construct explanations which are as generally useful as possible, as generally appealing as possible?
Because you can't assume shared context, it becomes this challenge. There are tips and tricks along the way, but because the people that are often making explanations have a specific enough audience — it's this classroom of 30 people, or it's this discipline of majors who are in their third year — all the explanations from the people who are professional explainers in some sense are so targeted. Maybe it's the economic thing you're talking about. Until recently in history, there hasn't been the need or the incentive to come up with something that would be motivating and approachable and clear to an extremely wide variety of different backgrounds.
Dwarkesh Patel
Is the process of making your videos mostly you? Given the scale you're reaching, it seems that if it was possible, just a small increase in productivity would be worth an entire production studio. It's interesting to me, or surprising, that the transaction cost of having a production setup are high enough that it's better to literally do the mundane details yourself.
Grant Sanderson
Yeah. I mean, this could honestly just be a personal flaw. I'm not good at pulling people in, and I've struggled to do this effectively in the past. But a part of it is that the seemingly mundane details are sometimes just how I even think about constructing it in the first place. The first thing that a lot of YouTubers will do if they can hire is hire an editor. This is because they film a lot of things. A lot of the editing process is removing the stuff that was filmed that shouldn't be in the video and just leaving the stuff that should be. That's time consuming and it's kind of mundane. It's probably not that relevant to what the creator should be thinking about. When you're not filming stuff, the editing process for me — I start by laying out all of the animations and stuff that I'll want in a timeline. Then once I record the voiceover, the actual editing is like a day. I guess I could hire someone and gain a day back of my life, but the communication back and forth for saying what specifically I want — all of the little cuts that I'm making along the way are my way of even thinking about what I want the final piece to be. It would be hard to put it into words.
It's similar for why I maybe find it quite hard to use a copilot or some of these LLM tools in coding. For the animation code, it can be super great if you're learning some new library and it knows about that library that you don't. But for my library that I know inside and out, if I'm just using it, it feels like this should be the most automatable thing ever. It's just text. I should be the first YouTuber who can actually do this better because the substance behind each animation is text. It's not an editing workflow in quite the same way. But it doesn't work. I think it's because maybe you need a multimodal thing that actually understands the look of the output.
The output isn't something that is consumable in text. It's something about how it looks. But at a deeper level, I can't even put into words what I want to put on the screen except to do so in code. That's just the way that I'm thinking about it. If I were to try to put into English the thing that I want as a comment that then gets expanded, that task is actually harder than writing it in the code. If it's clunky to write in code, that's a sign that I should change the interface of the library such that it's less clunky to be expressive in the way that I want. In that same way, a lot of the creative process that feels mundane — those are just the cogs of thought slowly turning.
If they weren't turning for that part, they would have to be turning during the interface of communication with a collaborator.
Dwarkesh Patel
On the point of working with Copilot, where we kind of visualize the changes you wanted to make, the paper from Microsoft Research, the Sparks of AGI paper, had a really interesting example. It was generating LaTeX and they generated some output and they say, "Change this so that the visual that comes up in the rendering is different in this way." It was actually able to do that, which was their evidence that it can understand the higher-level visual abstraction. But I guess I can't do that for Manim.
Grant Sanderson
There's a couple reasons it might not be as fair a comparison. One would be the two versions of Manim. There was a split where there's a community version that is by the community for the community, and then mine. The interfaces are largely similar. The rendering engines are quite different. Because of slight differences in that, it might have a tendency — it learned from one or it saw examples from one and it's intermixing them. So stuff just doesn't quite run when there's discrepancy. I maybe shot myself in the foot where all of my code for videos — I don't really comment it that much because it's a one-and-done deal.
There's also the code for the core library; I could comment and document a lot better. But the way that I'm making it feels much more like the editing flow. If you were to look at the operation history of someone in After Effects written down, it's a little bit more like that. There's not a perfect description in English of the thing that I want to do, and then the execution of that is just the execution of that. It's not meant to be editable in hindsight as much because I'm just in the flow of making the scene for the one video. Maybe I could have given it a better chance to learn what it's supposed to be happening by having a really well-documented set of "this is the input, this is the output, this is the comment describing it in English."
But even then, that wouldn't hit the problem that I would have to articulate what the thing I want is in the first place. The programming language is just the right mode of articulation in the first place.
Dwarkesh Patel
This is something I wanted to ask about ever since I learned about it. I watched many of the Summer of Math Exposition prize videos, and it was shocking to me how good they were. I mean, these look like entire production studios were dedicated to making them, many of them. It was shocking to me that you could motivate and elicit this quality of contribution given the relatively modest prize pool — five winners, $1,000 each. What is your explanation for running prizes like this? Why were you able to get such high quality contributions? Is the prize pool even relevant? Is it just about your reputation and reach?
Grant Sanderson
I do wonder how relevant the prize pool is. We've been thinking about this because we did it first in 2021, then we plan to continue doing it annually. I probably, if I was a mover and a shaker, could raise much more if I wanted to get a big prize pool. I don't think it would change the quality of the content because the impression I get is that people aren't fundamentally motivated by winning some cash prize. Certainly they're not investing with an expected value calculation. If they are, that's a terrible plan. If anything, that might be a problem. Let's say it was a hundred thousand dollar prize for each of the winners. Then it would be a real problem where someone who — and people do delusionally think that they're very likely going to be the winner — they might actually pour a lot of their own resources into it with the expectation of gaining it. That's just a messy situation. I don't want to be in with, "Why wasn't mine chosen as a winner?" Because the whole event is not supposed to be about winners.
Actually, for listeners who don't know, I should describe what you're talking about: the Summer of Math Exposition. The history is a little bit funny because it started with an intern application. In 2021, I wanted to have just a couple interns to do a certain thing on my website. I put out a call for people to apply. I got 2,500 applicants. Somewhere in the application, I mentioned that during the summer, in addition to the main task I wanted them to do, I'd give freedom if they just wanted to do something relevant to math exposition online that was their own thing. I'd be happy to provide some mentorship or just give them the freedom to do that one day a week and give me a little pitch on what your idea would be.
As I went through all of the applications, which is a lot, I felt so bad because so often the person would have a little pitch on what they would want to make. In my mind, I think, "Cool, you should make that. You don't need me to do that. Just spend your summer making that. Why not?" People were clearly inspired by the thought of adding something. Being a YouTuber is the most common job aspiration among the youth these days. As a consolation of sorts to those 99 that I had to reject for the internship, I said, "What we will do — we're just going to host this thing. We'll call it the Summer of Math Exposition.
We'll give you a deadline. I'll promise to feature some people in a video. Maybe I'll choose five of them to do that. If the thing that you were going to do with me as your 20% project as an intern is something you're excited about, make it a 100% project or 20% or whatever freedom you have, just do it anyway. I can give you this little carrot in the form of featuring it in a video and give you a deadline, which let's be honest, is what actually makes the difference between people doing something and procrastinating on it sometimes."
Later, I think it was Brilliant that year said they would be happy to put some cash prizes in. So I said, "Sure, why not?" I don't think the cash prize is super important, but it's nice. It shows that someone actually cared and put some real thought into doing something that wasn't just a made-up gold star. They put some material behind saying that you were selected as a winner of this thing. But all in all, it was never supposed to be about choosing winners. It was just get more people to make stuff. If anything, I'd actually love it when I see stuff from existing educators and teachers, where it's maybe not the youth who want to be YouTubers pouring their hearts and souls into it, but it's the educator who built up a lot of intuition over the course of their career for what constitutes a clear explanation. They're just sharing it more broadly.
To your question on what caused there to be such high production quality in some of the entries, part of the answer might just be that tooling is so good now that individuals can actually make pretty incredible things.
Dwarkesh Patel
I misphrased if I said production quality. I just meant the whole composition as a whole.
Grant Sanderson
Well, there's a selection filter too. In that first year, there were 1,200 submissions. I featured in the winning video five of them. Of course they're necessarily unrepresentative of the norm by the very nature of who I was choosing to feature. But the fact that those were even in the pool — something that high quality was even in the pool — I think it hits a little bit to your miracle year point. I think what might be happening is you have people with a ton of potential energy for something that they'd kind of been thinking about making for a long time. The hope was to give people a little push.
Here's a deadline. Here's a little prize. Here's a promise that maybe if you make it, it won't just go into the void, but there's a chance that it gets exposed to more people. I think that has absolutely played out, and not for the reason that someone might expect where I choose winners and I feature those winners and people watch them. A huge amount of viewership happens before I even begin the process of looking at them. This was an accident too. In this first year, we got 1,200 submissions. I said, "Expect judges who are reviewing it to spend at most 10 minutes on each piece. So it could be longer, but don't rely on someone watching it for more."
But realistically, when I'm reviewing something, I want to watch the whole piece. I absolutely do not have time to watch that many. It takes me about two weeks of just full-time work to watch a hundred of these pieces and give the kind of feedback that I want. To manage that problem of more than we could manually review, we put together this peer review system that would basically have an algorithm feed people pairs of videos. They would just say which one is better, and then it would feed them another one. In the first two years, we just used a tool that was common for hackathons that did this.
What that did is one, it gave us a partially ordered list of content by quality loosely. We didn't need it to be perfect. We just needed there to be a very high chance that the five most deserving videos were visible somewhere in that top 100. The algorithm doesn't have to be perfect. But what happened, I think, is that by having this period when a ton of people are watching the same batch of videos — a thing I've learned about the YouTube algorithm is in theory, you would want to just use machine learning for everything. You have some massive neural network where on the input of it, it's got 5 billion videos or however many exist, and the output, it decides what seven are best to recommend to you.
That is completely computationally infeasible.
I also think this is all public knowledge, but what you have to do instead is use some sort of proxies as a first pass to nominate a video to even be fed into the machine learning driven algorithm. So you're only feeding in like a thousand or so, something in the order of thousands, like nominees.
The real difference that it can make between a really good video getting to the people who would like it and not getting there, it's not the flaws in the algorithm. The algorithm is probably quite good. It's the mismatch between the proxies being used to nominate stuff to see whether it's even in the running.
So one of the things used for nomination is understanding the co-watch graph. If you've watched video A and you've also watched video B, and then I watch video A, you watching both of those gives a little link between them. Or maybe you and a ton of other people watching both of them gives a little link, such that once I watch video A, B is potentially nominated in that phase because it's recognized that there's a lot of co-watching. That's something that I'm sure still is quite challenging at scale, but it's more plausible to do at scale than running some massive neural network.
I think what might have happened is that by having a bunch of co-watching happening on this same pool of videos, all you need is for some of them to have decent reach and get recommended right, because then that kicks off, it's like igniting a pile of kindling. Then if others are good, if they're going to give people good experiences, they get not only nominated but then recommended, which then kicks back in the feedback loop there. That turns out to be, I think, as close to a guarantee as you can get of saying: if you make something that's good, a good piece that will satisfy someone, they come away feeling like they learned something that they otherwise didn't know and it was well presented, if you can get it into this peer review process, it will reach people. It's not just going to be shouting into the void.
In this case, last year I think there were over a hundred videos where after the first two weeks they had more than 10,000 views. I know in the grand scheme people think huge numbers of views and millions out there, but for a fresh channel talking about a niche mathematical topic to be able to put it out and get 10,000 people to watch it, I think is amazing. The idea that that could happen for over a hundred people, I think is amazing. That had nothing to do with the prize pool.
In that, the motive might have been a hope of actually getting some reach and having some sense of a guarantee of there being some reach. Ironically, the reason to do the whole peer review system in the first place is in the service of selecting winners. Without something in the service of selecting winners, if you just said, "Hey, we're having a watch fest where everyone watches each other's things," somehow it wouldn't quite have the same pull that gets people into it. So I think it still makes sense to have winners and to have some material behind those winners. It doesn't have to be much though. And if anything, I think it might ruin it to make it too much.
I'll also say it's $15,000 actually, because we will give $500 to 20 different honorable mentions, at least this year. So still pretty modest in the scheme of how much money you can invest to try to get more math lessons in the world. I watched many of the honorable mentions as well, because they were just topics that were interesting to me. It's like the thing that the president of the University of Chicago said at one point: he said we could discard the people we admitted and select the next thousand for our class, and there'd be no difference. It was that level of peak.
Dwarkesh Patel
Yeah. And I really admire, by the way, not only the education that you've provided directly with your videos, which have reached millions of people, but the fact that you are also setting up this way of getting more people to contribute and maybe get to topics that you wouldn't have time to get to yourself. So I really admire that you're doing that.
If you're self-teaching yourself a field that involves mathematics, let's say it's physics or some other thing like that. There are problems where you have to understand how do I put this in terms of a derivative, an integral. And from there, it's: can I solve this integral? What would you recommend to somebody who is teaching themselves, let's say, quantum mechanics? They figured out how to get the right mathematical equation. Is it important for their understanding to be able to go from there to getting it to the end result, or can they just say, "Well, I can just abstract that out. I understand the broader way to set up the problem in terms of the physics itself"?
Grant Sanderson
I think where a lot of self-learners shoot themselves in the foot is by skipping calculations, by thinking that that's incidental to the core understanding. But actually, I think you do build a lot of intuition just by putting in the reps of certain calculations. Some of them maybe turn out not to be all that important, and in that case, okay, so be it. But sometimes that's what shapes your sense of where the substance of a result really came from.
It might be something you realize: "Oh, it's because of the square root that you get this decay." And if you didn't really go through the exercise, you would instead come away thinking such and such decays, but with other circumstances it doesn't decay, and not really understanding what was the core part of this high level result that is the thing you actually want to come out remembering. Putting in the work with the calculations is where you solidify all of those underlying intuitions. Without the forcing function of homework, people just don't do it.
That's one thing that I learned as a big difference post-college versus during college. Post-college, it's very easy in learning stuff to just accidentally skip that. And then it doesn't sink in as well. So I think when you're reading something, having a notebook next to you, just pen and paper, pencil and paper, whatever it is, should be considered part of the actual reading process. If you are relying too much on reading and kind of looking up and thinking in your head, maybe that's going to get something, but it's not going to be as highly leveraged as it could be.
Dwarkesh Patel
What would be the impact of more self-teaching in terms of what kinds of personalities benefit most? There's obviously a difference in the kind of person who benefits most in a situation where it's a college course and everybody has to do the homework, but maybe some people are better tuned for the kind of work that's placed there, versus all this stuff is available for you on YouTube and textbooks for exercises and so on, but you have to have the conscientiousness to actually go ahead and pursue it. How do you see the distribution of who will benefit from the more modern way in which you can get whatever you want, but you have to push yourself to get it?
Grant Sanderson
There's a really good book that's actually kind of relevant to some of your early questions called *Failure to Disrupt* that goes over the history of educational technology. It tries to answer the question: you have these repeated cycles of people saying such and such technology, which almost always is getting more explanations to more people, promises that it'll disrupt the existing university system or disrupt the existing school system, and it just kind of never does.
One of the things that it highlights is how stratifying these technologies will be. They actually are very, very good for those who are already motivated or kind of already on the top in some way. And they end up struggling the most for those who are performing more poorly. Maybe it's because of confounding causation where the same thing that causes someone to not do poorly in the traditional system also means that they're not going to engage as well with the plethora of tools available.
I don't know if this answers your question, but I would reemphasize that what's probably most important to getting people to actually learn something is not the explanation or the quality of explanations available. Since the printing press, that has not been literally true because maybe access to libraries and such isn't as universal as you would want, but people had access to the explanation once they were motivated. Instead, it's going to be the social factors. Are the five best friends that you have also interested in this stuff? Do they tend to push you up or do they tend to pull you down when it comes to learning more things? Or do you have a reason to? Is there a job that you want to get or a domain that you want to enter where you just have to understand something? Is there a personal project that you're doing?
The existence of compelling personal projects and encouraging friend groups probably does way, way more than the average quality of explanation online ever could. Once you get someone motivated, they're going to learn it. It maybe makes it a more fluid process if there's good explanations versus bad ones, and it keeps you from having some people drop out of that process, which is important. But if you're not motivating them into it in the first place, it doesn't matter if you have the most world-class explanations on every possible topic out there. It's screaming into a void effectively.
I don't know the best way to get more people to know things. I have had a thought, this is the kind of thing that could never be done in practice, but instead it's something you would write some kind of novel about. If you want the perfect school, something where you can insert some students and then you want them to get the best education that you can, what you need to do is, let's say it's a high school. You insert a lot of really attractive high schooler plants as actors that you get the students to develop crushes on the various plants. Then anything that you want to learn, the plant has to express a certain interest in it.
They're like, "Oh, they're really interested in Charles Dickens or something." They express this interest, and then they suggest that they would become more interested in whoever your target student is if they also read the Dickens with them. They're also interested in learning the physics. If you get that in a way, you socially engineer this setting, the effectiveness that that would have to get students to actually learn stuff is probably so many miles above anything else that we could do. Nothing like that in practice could ever actually literally work, but at least viewing that as this endpoint of "okay, this mode of interaction would be hyper effective at education," is there anything that kind of gets at that?
The kind of things that get at that would be being cognizant of your child's peer group or something, which is something that parents I think very naturally do. Or it doesn't have to be a romantic crush, but it could be that there's respect for the teacher. It's someone that they genuinely respect and look up to, such that when they say there's an edification to come from reading Dickens, that actually lands in a way. Taking that as a paragon and then letting everything else approximate that has, I would emphasize, nothing to do with the quality of online explanations that are out there. That at best just makes it such that you can lubricate the process once someone's sufficiently interested.
Dwarkesh Patel
You found a new replica use case.
Grant Sanderson
I mean, I'm not saying we should do it, but think of how effective that would be.
Dwarkesh Patel
Okay, final question. This is something I should have followed up on earlier. Your plans to become a high school teacher for some amount of years, what are your plans on doing that and what do you hope to get out of that?
Grant Sanderson
I would say no concrete plans. I wouldn't want to do it in a period where I also have young children, and therefore it would make sense to... maybe a lot of people will say this kind of thing, but there are friends of mine who think when their child is in high school, that's when they would want to be a high school teacher.
I think two things I would want to get out of it. One of them, as I was emphasizing, I think you just lose touch with what it's like not to know stuff or what it's like to be a student. Maintaining that kind of connection so that I don't become duller and duller over time feels important. The other, I would like to live in a world where more people who are savvy with STEM spend some of their time teaching. I just think that's one of the highest leverage ways that you can think of to actually get more people to engage with math. I would like to encourage people to do that and call that call to action.
Some notion of spending, maybe not your whole career, but a little bit of time in teaching. There's not as fluid a system for doing that as, say, going through a tour of service in certain countries where everyone spends two years in the military. Shy of having a system like that for education, there are all these ad hoc things where charter schools might have an emergency credential system to get a science teacher in. Teach for America is something out there. There are enough ways that someone could spend a little bit of time, that's probably not fully saturated at this point, that the world would be better if more people did that. And it would be hypocritical for me to suggest that and then not to actually put my feet where my words are.
Dwarkesh Patel
Yeah. Well, I think that's a great note to leave it on, Grant. Thanks so much for coming on the podcast. And genuinely, I mean, you're one of the people I really, really admire. What you've done for the landscape of math education is really remarkable. So this was a pleasure to talk to you.
Grant Sanderson
Thanks for saying that. I had a lot of fun.
Dwarkesh Patel
Hey everybody, I hope you enjoyed that episode. As always, the most helpful thing you can do is to share the podcast. Send it to people you think might enjoy it, put it on Twitter, your group chats, etc. It just splits the world. Appreciate you listening. I'll see you next time. Cheers.