Main Topic: The concept of a "second brain" and how AI can help create a more efficient and effective knowledge management system.
Key Points:
Participants:
Takeaways:
Future of Knowledge Management:
The future of knowledge management will involve a shift from active energy to passive, automatic work being done on behalf of the user. This will be achieved through AI-powered knowledge management systems that can learn and adapt to an individual's needs, providing proactive suggestions and insights. The goal is to create a true second brain that can augment thought, memory, and abilities, making it easier to work through information and apply it to challenges.
How many people spend more time organizing their “second brains”, instead of leveraging the information within them?
With consumer AI now capable of processing simple language prompts and interfacing with unstructured data, is the landscape of information management on the brink of a transformative evolution?
Founders of Mem, Kevin Moody and Dennis Xu, plus writer Nat Eliason, explore what’s gotten in the way of a true second brain, and how AI may finally unlock what “knowledge management” tools have promised for so long.
Topics Covered:
00:00 - A true second brain
02:45 - Knowledge management
06:01 - Thiago Forte's ‘Building a Second Brain’
10:24 - Digital hoarding
12:53 - The fun of organizing
14:16 - Levels of utility
19:09 - Can the unstructured nature of AI help?
21:46 - What does a second brain unlock?
25:23 - Time spent searching for information
31:07: LLMs and technology unlocks
34:22 - Personalization
36:24 - Is the second brain a new PA and EA?
38:57 - Challenges
44:32 - Moats and differentiators
Resources:
Stay Updated:
Find a16z on Twitter: https://twitter.com/a16z
Find a16z on LinkedIn: https://www.linkedin.com/company/a16z
Subscribe on your favorite podcast app: https://a16z.simplecast.com/
Follow our host: https://twitter.com/stephsmithio
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Stay Updated:
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Podcast on Spotify
Listen to the a16z Podcast on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
Host
Our brain isn't a filing cabinet. It's very messy. It's very interconnected. The same search for multiple different people should actually yield different results because you think about the world differently.
Imagine if there was just a digital colleague on every team who could sit down at every single meeting, read every doc that was ever written, and had all of the context that was shared across the company and knew exactly what information they could share with who and when they should share that information.
Nat Eliason
You can delete 95% to 99% of everything you have and never feel that pain for the rest of your life.
Host
Does it actually adapt to who you are? Does it learn about who you are? And does it then apply that in future interactions with you, like a human would? I think the running joke here is clippy. It was just ahead of its time.
Since the rise of the computer, humans have been gripped by the idea of having a second brain. But has reality held up to that promise? How many people spend more time organizing their second brains instead of leveraging the information within them? How many people constantly look for a better to-do app instead of actually checking the to-do's that they're organizing? And how many people have an endless stream of data that they'd love to one day process, but they just don't have the right tools or time to do so?
Due to the structured directive nature of computers to date, computers have been a shell of maybe the second brain that we've long hoped for, still incredibly powerful, but also requiring discrete instruction from the director. But within the last year, consumer AI has shown up to the party, now capable of processing simple language prompts and interfacing with unstructured data, possibly fundamentally changing this game.
Today, together with the founders of MEM, Kevin Moody and Dennis Hsu, plus writer Nat Eliason, we explore what's gotten in the way of a true second brain and how AI might change the game, finally unlocking what knowledge management tools have promised for so long. So, can our second brains finally work for us? Let's find out.
As a reminder, the content here is for informational purposes only, should not be taken as legal, business, tax, or investment advice, or be used to evaluate any investment or security, and is not directed at any investors or potential investors in any A16Z fund. Please note that A16Z and its affiliates may also maintain investments in the companies discussed in this podcast. For more details, including a link to our investments, please see A16Z.com slash disclosures.
Let's start with Nat. Nat has worked on a ton of projects over the years, but primarily considers himself a writer. At one point, you were writing a lot about productivity, knowledge management, and that's one of the reasons that we have you here. Tell me about why you got into that space.
Nat Eliason
At some point, I just got interested in it. I think at one point, I adopted the belief, as many do, that the more I learned about productivity and the more knowledge I collected, the more financially successful or happy or whatever I would be. And ended up going very hard down that track because a lot of people do once they get that idea in their head.
Something with the tools just clicked very well for me where something about the way I was using it wasn't as immediately intuitive to people. And then in particular with Rome, for those who remember that it was really like a mania, I think. I just got very lucky that I was super early on it, was using it before a lot of other people. And I think I was one of the first people with a small to medium sized audience who talked about it. And then I think that helps people with much larger audiences pick it up.
Host
Tell me a little bit more about you're saying you seem to have this intuition about how to use them. And then you shared that with other folks. What was it delivering for you and then subsequently others?
Nat Eliason
That's a good question because I'm not sure that I could honestly say all of the effort has delivered a compensatory amount of value in the sense that even as a kid, I very much enjoyed finding interesting bits of knowledge and then sharing them with people or trying to explain them. And so almost like this kind of digital magpie, I enjoy just collecting shiny bits of information.
To the extent that it's helped with writing, most of it hasn't. The only thing that I could say definitely has really helped is a habit that I've had for 12 or 13, 14 years now of taking notes from the books that I'm reading. And so I used to do this on Kindle and now I do it on physical books and use Readwise to extract the highlights. But the medium that I organize those highlights in doesn't seem to matter because I had them in text files at one point. I had them in Evernote. I had them in Notion. I had them in Rome. Like, I've moved them around. I've lost a lot of the formatting and additional annotations so many times that it almost doesn't matter.
Host
You're almost saying it could be on a stone tablet, and as long as you have that there, or is it maybe the searchability? There's only maybe a few functions that you need in order for it to be useful, not all of the feature set.
Nat Eliason
Yes, I think it's really the searching, the indexing and the collecting that are very helpful. But pretty much all the other features often get in the way or become distractions or give you this sense of productivity, right? Like, oh, I'm doing all of these. I'm organizing my knowledge. You probably should be writing or playing with your kids or doing something else.
But expanding on that, the thing that's really been helpful is the actual reading the books. Right. Like I wish I had spent more time reading more books instead of continuing to hyper optimize my highlights from the books I had already read.
Host
Maybe there's something meta here, though, where to your point, it's like because you feel like you're being productive with the notes that you take within these knowledge management tools, it makes you want to read more books because you feel like they're more useful. But at the same time, it does seem like there is this false understanding of what you're getting from these tools.
One thing that I noticed was when you and a few other creators saw Rome, like you said, there really was this almost like mania. And maybe something behind that mania, at least it felt to me, was as though there was an unlock. As though the prior knowledge management tools were lacking something that this now provided. So maybe you could speak to that experience.
Nat Eliason
Yeah, it's funny because this all happened at an interesting time where I had gone through Tiago Forte's Building a Second Brain a couple of years before. And when I went through it, I was having these conversations with him about how much I hated Evernote because it really forced you into this hierarchical way of organizing your information. And so you had a folder for home or whatever and then you're putting your notes about your house in there and you have a folder for books you're putting all your book notes in there but pretty much every piece of knowledge should live in multiple places and you could also do tags and stuff but the tags felt clunky.
What was exciting to me about Roam when I saw it was it introduced more of a knowledge graph. I think they might have invented that or popularized it for note-taking tools, right? Which is really, I think, how we think about things, right? Like that's more of how our brain works. Our brain isn't a filing cabinet. It's very messy. It's very interconnected. And it felt like it fit that much better for me. And that's what made me so excited about it. And I think made so many other people excited about it.
We kind of take for granted, if you're getting into knowledge management today, almost every tool has this, right? Notion very quickly adopted this same interconnected backlink structure that Roam popularized. And I think that's great because I use it in Notion all the time now and that feature in particular was what felt so magical because to the point that we talked about earlier where very few things in these tools are actually useful for improving the creative output which I think what you're really optimizing for by using them.
Search is very useful and the capture is very useful and I do think that these bi-directional relationships between bits of information are super useful as well so that you can log a few connections on something. As long as it's connected to two or three other things in your second brain or whatever you want to call it, it will be very easy to resurface it later. Much easier than if you have to pick an arbitrary folder to put it into, at least for me.
Host
You have to remember the route, right? You're saying with Evernote, you have to remember, oh, there's this thing hidden in four layers of folders and I have to remember it's there versus you're saying the interconnectivity allows you to surface it more easily, almost like stumble upon it, would you say?
Nat Eliason
Yeah, a little bit more like that. And the thing that I liked about it too was any hierarchical file system requires very deliberate placement of each piece of information. You have to think about it a lot where you put it. It might not seem like you do, but you kind of do because you're saying, okay, in 10 years, if I don't know I need this piece of information, how do I accidentally re-find it? Whereas with a much more widespread hyperlinked knowledge graph style, you can kind of just slap 10 different relationships onto it and you'll probably be able to find it again in the future.
Host
That's so interesting. I was filing something away because I'm still in ancient times. I still use Evernote, but I was filing something away and I had this thought as I was doing so yesterday of just, I will never see this again. Like it was in that folder where I'm like, I haven't revisited this in years. And so why would I in the future?
Nat Eliason
I had a few people reach out to me over the last week or two because Evernote is shutting down their US office and a lot of people are migrating out to Evernote. And they said, hey, I need to migrate all of my stuff into a new tool. What do you recommend? And I said, well, don't migrate anything. Just start using a new tool. And then for the next three months, see which pieces of information you end up needing and then go migrate them. But what you will probably find is that you can delete 95 to 99% of everything you have and never feel that pain for the rest of your life.
Host
It's so true. And in a way, it reflects on the fact that so many of us are digital hoarders, where if we did the same thing with physical items, we'd end up in these homes, just boxes and boxes and boxes. And in a way, because it costs so little, and it is kind of out of sight, out of mind, we do it digitally.
But that kind of brings me to this question. Do you think that maybe the way that these knowledge management tools haven't quite lived up to their promise, is that just because we misunderstand the way our own brains work and what we really need? Or is it a facet of these tools not having the right technology, maybe the right feature set yet?
Nat Eliason
I think it might be more of a false promise issue, because I think if you look at, say, the Notion marketing or the Evernote marketing, they advertise themselves as a wiki, as a digital filing cabinet, and they do those things very well, right? They allow you to collect and organize information. And I think the false promise that many of us believe or have bought into or whatever is that if you organize information, you will write better articles. You will make more money. You will be happier. You will get all of these benefits from it, right? That one, I think, is probably just not true.
Andy had this great tweet where he was like, you know, for all of the influencers talking about personal knowledge management and note taking in those things, remarkably few of them have written a great book or won an Emmy or an Oscar or actually done anything that incredible with their knowledge management systems. The main use case seems to be talking about your knowledge management system.
Host
Yeah.
Nat Eliason
And I think he was kind of brutally honest or brutally correct about it. Like I looked at that tweet and I was like, wow, I feel very seen right now.
Host
I mean, I've seen other tweets similar, which are like, yeah, if you want to learn from the best founders, they're busy building companies, right? Not writing tweet threads.
Nat Eliason
Yeah. And there are obviously exceptions and things, but I make this analogy all the time that 99.9% of the best books ever written were written on a typewriter or by hand. Like if you think that you need a good writing app to write your book, you're just wrong. It's just not true. History has shown us this is not true.
Host
Exactly.
Nat Eliason
So I do think that there is this big element of the other thing they're delivering is fun, right? And we don't like to admit that the reason we read productivity books or watch motivational YouTubes or stuff is because it's fun and makes us feel good. And that's part of what they're delivering too. Like it's fun to organize your stuff, right?
I had this really funny experience. I guess our older daughter's almost two now and one of her favorite hobbies is to just organize random things like opening the pantry and pulling stuff out and moving it from one container to the other or taking all the mixing bowls and stacking them in the correct sizes. And I'm watching her do this and I go, oh, like this is just hardwired in me. Like there's this part of my brain that likes moving things around and putting them in a satisfying order and that's what I'm getting out of these tools.
Host
That is so good because we've all been there, right? I mean, the most meta thing, right? You have in your Evernote or in your Notion, organized Evernote. And it's just like, this is so circular. Or everybody's had the experience of, maybe not everybody's had this experience. Weird people like me have had this experience of getting a bunch of things done and then looking in your task manager and being annoyed that you didn't put those things in there first.
Nat Eliason
Oh, yeah.
Host
And then you add them. Then you add them and then check them off so that you can feel good about yourself for the day.
Nat Eliason
I know. And you somehow convince yourself that you did the right thing. Instead of following the things you had outlined were important, you did unimportant other things, but they still must be checked off.
Host
No, totally. So I think you're right. I think there is this level of just humans wanting to feel productive, and these tools can sometimes validate that. And sometimes I do think that they can help us. I mean, if I truly had to remember off the top of my head all of the quote-unquote important things that I had to do, I just couldn't. So there is a level of utility here.
Nat Eliason
Oh, totally. I mean, the number of times I had this experience of writing an article and then I think like, I feel like I've seen this or I've felt this idea somewhere before. And then I look over at my bookshelf and one or two books pop out that remind me of what I'm talking about. And then I go into my note taking tool and surface my highlights from those books. And then I like immediately have a quotation that I might have saved 10 years ago from a book that I can use in the piece that I can reference. Like that's so useful.
Host
Right, right. But the useful things were reading the book and capturing the highlights and then being able to search for it. And it kind of stops there. And it's being able to get the information you want at the right time and not having to do as much digging.
And so with that in mind, if we think about things along the spectrum of actual utility that these tools are indeed bringing and then this false promise. Tell me a little bit more about how you've maybe moved closer to that utility side of the spectrum.
Nat Eliason
I really think the next big utility is going to be a note-taking tool that offers custom GPT or whatever embeds as a service for your knowledge graph. Because I've seen people do it. Dan Shipper has that great project he did where he put all of Andrew Huberman's podcast transcripts into a GPT embed model. And then you can just query it with anything you want to know. And it feeds you back Huberman's answers from podcasts.
Host
Right.
Nat Eliason
Theoretically, any note taking app should be able to offer that. I'd pay like a thousand dollars or more for this very happily where I could just say, OK, here are my notes from like four or five hundred books now, thousands of articles, every little idea I've written down over the last 10, 15 years. Here's all of it. I just want you to index it. And then as I start writing, just give me a little pop ups along the side or when I ask for them, give me a little pop ups to say, oh, you had this idea or oh, this idea from this book or this idea from this article or whatever. Like these are all relevant to what you're doing right now, because I'm pretty sure we can actually already do that with the tools that are available on the market.
Host
Yeah, nobody's just created a consumer side version of it. That's like literally a second brain, right? That's literally your previous thoughts and work and effort being processed by this external cognitive entity and then fed back to your current working mind to enhance what you're trying to do without you having to go look for it. And that would be incredible. Like that would be so useful. I would use that nonstop every day.
And if we just break down what the difference is there, it feels like maybe something you're pointing at is the proactivity. You are having, as you're saying, a second brain support you in a way where you don't have to go and say, hey, I need this. Let me go search for this. It's popping up and saying, hey, I've actually gone through all of this unstructured data that you've compiled over years and years.
Nat Eliason
Yeah, I would say it turns your note-taking tool from a means to surface known unknowns. So, right now I can say, I know that I know this thing, but I don't remember it exactly. I know that I have notes from what your food ate, but I don't remember what this note was. I will go find it. It does that very well. But with this, it could provide you with your unknown unknowns. It's making connections that you haven't thought of yet.
Host
Exactly. Exactly. It can look at every single sentence of what you're doing and say, oh, you actually wrote an article about this six years ago. I forget about articles I've written all the time, right? Like somebody will say, oh, I really love that article. Or they'll send me links to something and be like, oh my God, I wrote that?
Nat Eliason
Have you ever had that experience where you go reread it and you're like, did I write this?
Host
Yeah, yeah, it's super weird.
Nat Eliason
Totally. They're impressed or maybe like annoyed sometimes where there's this feeling of, oh, I already wrote this article three years ago and I kind of forgot and now I'm rewriting the same article. And that would just be so powerful because you don't have to try to remember the surface level of everything you've stored. Like it's handling that for you and just feeding you back things that are yours.
Host
Because there's definitely going to be this phase, I think at least for a while, of AI helping to enhance high-performing creators, right? Like if you look at GPT-4's writing, it's better than 90% of people, probably 95 or 98% of people, but it's way worse than the good writers.
Nat Eliason
Than the top 1%.
Host
Yeah. And it's actually pretty hard to get a ton of value out of it for the parts of writing that you're good at. But if it can actually surface stuff for you to use, right? Like if it can handle some of that search for you and whatnot so that you can produce a lot more, produce faster, right? Like that starts to get pretty interesting.
Nat Eliason
Yeah, you can imagine how the unstructured nature of AI can actually maybe surface some of these more interesting connections where it's, again, you're talking about one concept, but it's like, hey, this isn't directly related, but there's a similar arc, there's a similar learning.
My dream tool would just be a blank page where as you start writing, words get underlined or sentences get underlined and very subtly. So it's not going to interrupt your flow, but it's there as a little note. And then whenever you want to take a break, you can go back and hover over it and it'll pop up and show you the stuff that you've written about or done or said in the past might be related to what you're talking about right there. And then you can surf through it at your leisure and all of this just being done on the fly as you write without you having to interrupt yourself or without being interrupted.
Host
Right. And what's really interesting about that is we've obviously seen how different AI tools have been used for code. And when I think of many of the UIs that have been designed for code, they originally started with this idea of like, oh, it's just going to write the code for you. And similarly, they came to the understanding that actually developers still want to code, but they just want suggestions, especially when those suggestions are likely to help them, right?
And so you can kind of design the tool to say, oh, I'm pretty sure if it's like a 95 plus percent chance this is related, I'm going to showcase it. People even have their own dials to say, I want it to be as broad or as precise, depending on what kind of article I'm writing. And what's really magical about that is the more you write or have written or the more you do, the more useful the tool becomes and the more powerful you become.
ChatGPT is a very, or really any of these, is a very democratic tool right now in the sense that everyone has access to the same quality of recommendations. But if you have your own private custom model that's been trained on everything you've ever done and your style of writing, and really you writing at your best. Because I think everybody who writes has had this experience of they sit down and they're just on fire and they bang out an article in 30 or 60 minutes. And at the end of it, they're like, whoa, that was sick. Like who wrote that almost? And you're sad when you don't get that feeling because you know it can be better. You can be really on it, but you can't have it all the time.
Nat Eliason
Right. You could theoretically train it on your best work and then have it help you configure anything you're writing to emulate you at your best. And that's pretty magical thought, too.
Host
But I love that idea of it helping you become the TEDx better version of yourself as opposed to what it does now, where it basically just raises the floor for everyone.
Nat Eliason
Right. Yeah. I mean, as we discussed, like maybe a true second brain.
Host
So on that note, final thing is just if you imagine a tool like this where an AI can parse your personalized unstructured data, it can be proactive and it can surface things as you need them. What do you think this unlocks?
Nat Eliason
There's this interesting element or world that we're getting into of the valuable thing is the ideas, but everybody receives ideas in different ways. For example, one thing I realized about myself at some point is that I have a very hard time processing auditory information. Like I don't remember it. It just doesn't really imprint for me. But when I read things, they stick with me really well. And so if I read a book, I can remember a ton from it. But if I listen to an audiobook, I don't remember anything. And some people prefer the spunkier, punchy Twitter thread style. Some people prefer the long form essay style. Like some people would prefer a short form video of the idea.
And so if you have an idea and you can turn it into one of those forms, something that's trained on you should be able to help you produce those other forms of your work to help that idea reach the most people possible. And we're seeing something else in tandem with the potential for that, which is like platforms aren't really letting you use them as funnels anymore. Early internet marketing with social media 10 years ago or whatever, like your Facebook and your Twitter and whatever were all to drive traffic back to your site, right? Where you could get email signings or sales or whatnot. And it's way harder to do that now.
Host
It's way harder.
Nat Eliason
Well, because they actively punish.
Host
Exactly. Yeah, yeah, yeah.
Nat Eliason
They punish it. They don't want you to do it. And so you actually want to create native stuff for each of those platforms for the people who want to spend time on those platforms because that's what's going to get rewarded. But now you're not creating one article. You're trying to create like 10 assets off of each idea, which is a huge time suck.
And so it's interesting to think too like what would it look like if you had this kind of content assistant who you train not only on all of your writing and stuff but on your preferred format for short and long form videos and train on your voice so that you can immediately create like a podcast from your articles and all of these things so that you can be this hyper distributed idea person. That world is not very far away. It probably like less than two or three years out.
Host
I think what you said that's interesting there is in your unique way because you can hire agencies, you can bring on other folks and many people do that already. But I think maybe the nugget there is, if you were able to take one nugget and repurpose it in your unique style over and over, that does seem special. And that does seem like you can't quite do that today.
Nat Eliason
Yeah, you made a really good point there about agencies, right? Because I've been reached out to by a number of short form video agencies where they say, oh, you looked at your TikToks and we think they could be better. Here's an example of how we improved it. And I looked at it and I'm like, I've seen 10 other people on TikTok with this exact same style of editing. You have templates that you can just copy and paste for everyone. And it probably works to some extent, but then people start to note it. They start to see the edges of it.
And so if you can actually have something like this where it learns your preferences, right? Like the fact that Midjourney doesn't remember the images that I like and their settings to recommend those kinds of settings for the future is very annoying. Again, that doesn't seem like a complicated thing for them to do. But obviously they have 100 other product decisions. But I think that era of personalization using your past work is coming and I'm very excited for it.
Host
Yeah, it's hard to believe that won't be on the horizon. Speaking of what might be on the horizon, next up is our chat with the founders of MEM, a company trying to utilize AI to deploy a version of the second brain that Nat and I were just exploring, but not just for individuals. In this conversation, we dive into the why now, but also the cost of making this a reality.
But first, here's a stat about just how much productivity is lost within organizations. Knowledge workers apparently spend 2.5 hours a day, which is around 30% of their time in a workday, searching for information. And so I'd love to just hear, like, what are your reactions to that?
Kevin Moody
Yeah, I almost think that's probably an understatement, the 2.5 hours number. It's definitely still relevant, if not increased since 2016. I think in part because it's so much easier to produce unstructured information, share information, the barrier for creating content and sharing it within your team and being productive as a part of a team has gone down.
But I think something interesting there, you mentioned 2.5 hours per day just searching is probably a hidden time sink too, which is you don't even know that you are looking for some sort of shared piece of information. You just begin doing your work for the day or for the week. And at the end of that week, you realize you've just reinvented the wheel, that somebody else on your team or some other team in your company did that exact same work. And it already exists in some spreadsheet somewhere or some document somewhere.
And then I think the question I have in my head is how much time are people actually spending then taking those things and then performing really mundane transformations or tasks on top of what they found? And I would imagine that's kind of at least another few hours, right? So I think what's really interesting is we're now entering this world where a lot of that work and not just search, right?
Search is kind of just the beginning of where people are going to get value out of these new technologies. But I think it's going to be really interesting to see how the entire workflow of a knowledge worker changes over the next few years.
Host
Exactly. And I feel like if we go back and look at the arc of knowledge management, let's truly go all the way back. You get the ability to write, and people are doing this on stone at first. At some point, the printing press arrives. Then you have individualized typewriters. The computer shows up at some point. The internet gives you access to almost everyone around the world these days. So you have this promise of technology, which has rung true. It has given people the ability to codify and share information and knowledge in exponentially better ways. Yet at the same time, if we bring ourselves back to that stat, it's surprising that there still are incredible inefficiencies in collaboration. What do you think is preventing us from having this really streamlined back and forth between folks within an organization or even as an individual?
Kevin Moody
What's really interesting is all of the things that you mentioned, all of these devices in the past, they've actually just primarily been broadcasting devices. If you really think about what is core to collaboration, sharing and broadcasting is only one aspect of it. The other component is how do you actually digest and consume that piece of information? We've never truly had hyper-personalized consumption devices. Search is very much a personal problem. It's about, "Hey, I'm looking for this piece of information." And the same search query for multiple different people should actually yield different results because you think about the world differently. The tools we've used up to this point just don't model that reality.
If we look at it from the perspective of one piece of information and its life cycle, when information in an organization is captured, it's often really hard to know all of the people and all of the contexts in which that one piece of information could be useful. A book is useful when somebody chooses to read it. How people discover that book is usually through recommendation or marketing. But in an organization, so much information is created on a daily basis. The times where that institutional knowledge would be best used is weeks, months, even years down the road. The best effort attempt historically to organize that information is to use a traditional knowledge base. The person capturing that information puts a lot of time and effort into organizing it into a certain folder or file structure. Despite their best efforts, that structure makes a lot of sense to them and varying levels of comprehensibility to everybody else on their team. Usually by the time they move on to another team or company, that organization makes zero sense.
I think one fundamental unlock and trend we're seeing is that historically, after information was created, the onus was on the creator to not only distribute but also organize that information within a company. Now we think there's an opportunity for information to not need to be organized. Instead, some automated system or AI can come in and match every piece of information to the context and situation in which it would be best used. That way you can get past all of those inefficiencies.
Host
Totally. It seems like there are maybe two aspects here. One is this idea that humans want to document, but in order to document, you have to spend so much time. Some people spend more time organizing their second brain than actually using it. That's one part. But then there's another part, which is there's already this vast amount of unstructured data that other people have created. Given the technology that's evolved, what is the opening here? Are there new approaches that exist now that we have access to these LLMs? How are you guys thinking about turning the page?
Kevin Moody
The organizational structure we rely on is still very much the folder. The folder is this skeuomorphic representation of the filing cabinet we used to have. When computers were first developed in the 1950s and 60s, we said, "People understand how filing cabinets work, so why don't we just put filing cabinets on this computer so it's easier for people to adapt?" That begs the question: it's been 60 years since that time. What makes this moment special where we can actually eliminate the folder? We think the answer is yes. The missing ingredient has always been a lack of contextual understanding by machines of human language and the knowledge that humans produce. This new generation of LLMs demonstrates reasoning capabilities. That's where the magic starts to happen—when you can marry the reasoning capabilities of an LLM with the vast storage capabilities of computers from the past.
One way to think about this: instead of having manually organized folders, you have automatically generated folders. At one point, I thought that was the direction that made most sense. But what has become apparent with large language models is to flip that model on its head. You don't want to organize a piece of information into one or even five folders. You want to organize it into almost an arbitrary number of folders—the different ways in which you're going to need to recall or retrieve that information. Large language models now allow us to take any piece of text from any domain—medical, real estate, technology—and comprehend it in such a way that when somebody needs to make use of that knowledge, they can ask simple natural language questions, communicate in their own voice, and find the right answer without any intermediate categorization step.
Host
Something that's really drawing my attention is this idea of proactivity. Not only can it reorganize your information in different ways, but it can actually step up and say, "Hey, this is going to be useful at this time. I know you're working on this kind of project. Have you considered this?" Which again, someone else in the organization maybe has already done. How are you guys thinking about that dynamic, which also feels fundamentally new?
Kevin Moody
The running joke here is that Clippy was just ahead of its time. The idea of Clippy and this proactive assistant—people have been attracted to this for a long time. It's embedded in the sci-fi fantasies that society has. But for proactiveness to not be annoying and to cross that boundary into truly useful and delightful, you actually have to have a deep understanding and the ability to reason about someone's life and what they're thinking about at that moment. If you think historically, even today with tools like ChatGPT, the quality of our interactions with computers is still limited by the instructions we explicitly provide them. We used to have to provide instructions in code. Now we can provide instructions in English. But we're still providing instructions.
This is where things will get really interesting. If you have an understanding of who this person is, what they care about, what they know, then you can flip that model on its head. Instead of me constantly having to instruct this machine, what if the machine will just do things for me and then confirm afterwards?
Host
Yeah, you evolve with it. You can prompt it initially, but then it can also run on its own. You can give it feedback and iterate instead of strict rules like "deliver me this specific email reminder every morning at 9am." But something that's coming to mind is the cost of all this. We're talking about so many different applications that you're tying into—constantly working with data, organizing it to some degree, parsing it, saving it somewhere. It has to be retained. Where are we in terms of that? It's so much more powerful that maybe a new business model can be built around this idea. You imagine how much people pay EAs, and this is kind of paralleling that.
Kevin Moody
Cost is a really interesting question. We think a lot about this because at the most fundamental level, we want to democratize access to this sort of intelligence and give every person the power of their own personal AI that can help them think better and do more. There are two ways we're currently focused on monetizing. The first is via the individual plan. You can equate it to other products on the market—a free-to-use plan as well as a paid premium all-access plan. We want to continue to figure out how to drive the price down. One of the really promising trends is that the cost of compute and running these models is coming down by an order of magnitude every several months. Given that trend is likely to continue, we think we'll be able to serve all of these things at just an incremental cost above storage. Storage becomes the limiting factor, interestingly enough.
Separately, one thing you touched on that I completely agree with is this idea of giving each person their personal EA. That changes things because if you think about the value of note-taking apps or knowledge bases traditionally, it has been almost exclusively focused on information retrieval. The value ends at search. After you receive a list of documents, you're done. But we can actually go far beyond just retrieving a list of documents now. We can actually do things with them. We can help you think through problems. That is a much more valuable problem to solve than pure information retrieval.
Host
Yeah, it's reminding me of the future that many have painted where our AIs interface with other people's AIs. The idea of meeting time and how expensive it is. There are tools that trend on Reddit where you can calculate what a meeting costs a company depending on who's attending and how much they're paid. C-levels are extremely expensive. This is painting a really lovely picture, but I assume it's not as simple as plugging into GPT-4 and calling it a day. What are some of the things you're running into that you're willing to share in terms of getting past those humps to really implement this future?
Kevin Moody
There's a lot that goes on from the shiny demo moment to a really useful product that you or your team can use day in and day out. A lot of it comes down to how much knowledge or information have we indexed and made useful on your behalf. A lot of it is a data processing and pipeline engineering challenge. We spent a lot of time focusing on making that really robust, reliable, secure, and performant. That's quite challenging. When it comes to large language models and applications of those along with search and retrieval, all of those things are evolving by the day. It's a combination of figuring out how to apply and innovate on language model technology while simultaneously building this very robust data process and pipeline.
On the product side, there's this very rosy picture that can get painted in people's minds. When an assistive product can't do all of those things out of the box, it can sometimes be disorienting for a new user. How do I know what it can and can't do? How do I trust that it can do the things it says it can? How do I come to learn about its new capabilities as they evolve over time? That's the other challenge we face as the product evolves and as we unlock these capabilities over months, not years.
Host
Maybe it'd be helpful for the audience to understand what some of these capabilities are. What are some of the less obvious ways that this comes into play? How does this really change the way people are working?
Kevin Moody
I'll speak to a few different use cases. One feature we have in MemX is called "Similar to this Mem." As you're working on a new document inside of Mem, we do always-on search across everything you've captured or folks across your team have captured and shared across the organization. As you're working on something—let's say a monetization strategy doc—if somebody else across your organization had come up with some ideas months earlier, that would be surfaced in real time. You'd be able to connect the dots between your new thinking and something that had been done before, saving yourself that one week of going down a rabbit hole when you could just reach across and have a conversation with that person to get up to speed.
Another thing we're more recently rolling out to our MemX users is what we call "Chat with Mem." It's an end-to-end experience where you can type in a question like "What were the key insights from my user interviews last week?" and get an answer synthesized across all the knowledge Mem has access to. You can also ask it to collaborate and do thought partnership-style work. For example, "Generate a sample podcast script for this podcast I'm going to have with the founders of Mem." Based on meeting notes you had taken from one or two interactions, Mem would be able to proactively suggest what that script could look like.
Going back to what we were talking about earlier, the real magic happens when instead of you having to say "Give me a podcast transcript for Mem," you don't have to say anything. It'll proactively anticipate that you need that and provide it for you. It'll look at previous podcasts you've done with similar people. It'll look at the information you and your team have about them and combine that to give you that automatically.
Host
Totally. Something it's reminding me of is this idea of narrow information and broader information. There's a time dimension to it as well. Your company might set quarterly goals, yearly goals. But at the same time, every day you're focused on your to-do list. Connecting those in a way that makes sense to you. I tweeted this a while ago: "I want an AI that calls me out on my bullshit." It's hard to hear that from a human. It's like, "Steph, you're moving in the wrong direction. You're not focused on the right things. You said you wanted to exercise this amount. You said you wanted to go to sleep at these times. You're not doing it." I think there's an opportunity here. Personalization is so inherent in some of the developments in AI, but to personalize the type of support you're getting. Maybe some people want something more harsh. Other people want something kind and welcoming, reassuring. There's opportunity to personalize not just the format of data coming back, but also the type of interaction people want.
Kevin Moody
I love this example. We've been thinking a lot about personalization with the Chat with Mem conversational experience. Mem has the assistant. I think we're going to have to add that as a potential knob: "Call me out on my bullshit."
Host
Exactly.
Kevin Moody
A key fundamental unlock in how we think about personalization is not just "Does it have access to my personal data and knowledge?" but rather "Does it actually adapt?" Internally we call this adaptive AI. Does it adapt to who you are? Does it learn about who you are? And does it then apply that in future interactions with you like a human would?
Host
Maybe before we close out, one thing I ask basically any company that's touching AI—which feels like every company these days—is how do you differentiate in this world? Is it about building your own models? Is it about this personalization flywheel you can get going? Is it about the fact that you guys have cleverly downloaded so much data from these companies, for them of course, but really utilizing that? How are you thinking about that moat?
Kevin Moody
To some extent, it's all of the above of what you just said. But the whole is greater than the sum of its parts. For us, it's the personalized AI, the proactive AI, and the adaptive AI. Those are the pillars that make up what we see as the unique experience. We're seeing all of these insanely cool demos all over Twitter all the time. These are things people spin up in two to three days. Then they go and try the product, and nine times out of ten, they realize it actually just doesn't work. There's a growing sense of fatigue. A lot of people are starting to not believe that some of these things work. Part of that is because it is extremely hard, particularly when you're working with a non-deterministic system like a language model, to get reliable results and to get what you need every single time. We think there's a huge opportunity to differentiate on quality.
Host
On that note of broken promises, I'd love to close out with your raw reactions around what the future of knowledge management will look like. For me, up until 2023, it's felt like it can certainly be helpful, this idea of knowledge management or the tools that exist, but it's just not quite a second brain. It takes so much work, so much organization, so much effort to produce something usable.
Kevin Moody
The biggest drawback of the promise of the second brain is how much active energy it takes to maintain. The future and the unlock of what the second brain should be is that all of the active work will get replaced with passive, automatic work being done on your behalf. The actual prize of that second brain will be having true augmented thought, augmented memory, and increased abilities to work through all the information you've had before and apply it to whatever challenge you have in front of you.
Host
Yeah. Just imagine this: imagine if there was a digital colleague on every team who could sit on every single meeting, read every doc that was ever written, had all the context shared across the company, and knew exactly what information they could share with who and when they should share it. That's the future we're heading towards. That's the future I'm really excited about.
Kevin Moody
I'm very excited about it as well. And I'm going to hold you guys to this bullshit meter.
Host
If you liked this episode, if you made it this far, help us grow the show. Share with a friend. Or if you're feeling really ambitious, you can leave us a review at ratethispodcast.com slash A16Z. Candidly, producing a podcast can sometimes feel like you're just talking into a void. So if you did like this episode, if you liked any of our episodes, please let us know. I'll see you next time.