OpenAI’s personalization leads, Christina Kaplan and Samir Ahmed map the shift from an “assistant with a notebook” to Pulse—the part of ChatGPT that quietly preps your day while you sleep. We unpack how short- and long-term memory work across sessions and why April’s subtle update changed the experience, show how daytime chats stay aligned with overnight prep, and close on the big questions: privacy, consent, and why this is an assistant/representative—not a digital clone.
------
💫 LISTEN TO THE FULL EPISODE
https://pod.link/1813210890
https://youtube.com/watch?v=cDrllt2zn5M
------
TIMESTAMPS
0:00 Intro
1:03 Why Memory Mattered
6:00 User Reception
9:45 Under the Hood: Short vs Long Term
12:20 Behavior Shift & Data Strategy
20:26 What is Pulse?
------
RESOURCES
Christina Kaplan
https://x.com/ChristinaHartW
Samir Ahmed
https://x.com/PageOfSamir
------
Not financial or tax advice. See our investment disclosures here:
https://www.bankless.com/disclosures
No summary for this episode yet.
Hey, BanklessNation, we got some extra bonus content for you here on the podcast feed. This is an episode from Limitless, our sister podcast that focuses on AI and Frontier Tech. If you remember earlier this year, we were just doing a ton of AI content on Bankless, just because AI is supremely interesting and worth paying attention to. But we were making so much AI content that it just started to crowd out all of the crypto content that we also wanted to keep doing. So we made a second podcast called Limitless and you should go subscribe to it. The episode from Limitless that you're about to hear it right now is with Limitless host Ajaz and I as we interview two open AI team members who are in charge of memory and personalization of chat to beauty.
They're the ones who helped chat to be evolved from just a dumb LLM chatbot to your personal assistant who can remember everything about you and make guesses about your interests and just overall be helpful. And perhaps be a friend rather than just an inert chatbot. It's not often that open AI team members go on podcast so we were very privileged to be able to host Samir and Christina to get all of our questions answered about our favorite little chat assistant and what is going to be able to do for us in the future. So I hope you enjoy this episode from Limitless. If you do enjoy it, make sure to click the link in the show notes to go subscribe to the Limitless podcast so you can say up to date with the rapidly evolving world of AI.
So let's go ahead and get right into this episode of Limitless. I'm so excited about today's episode. We are joined by Christina Kaplan and Samir Ahmed who both lead memory and personalization at Open AI. Samir, Christina, welcome. Thank you. I was so excited to be here today. Okay. You are both solely responsible for creating the most valuable mode that's ever been discovered in AI memory and personalization. In fact, I remember the very moment you guys released the memory feature because five seconds before that, I was ranting to my friend about how annoying it was that chat GPT had no recollection of who I am when I opened a new chat.
And it was like this light bulb moment when off where I stopped viewing chat GPT as this tool and more of a friend and that's an incredibly sticky product experience. But I want to hear about it from your side. What was it like to develop chat GPT's memory feature? Give us the inside scoop. What was it like to go about creating this vision around memory? I think thanks for the generous introduction there, just I think we probably would classify it slightly different. And to be totally candid, memory and chat GPT predates both Christina and me joining the team. I can rewind all the way back to 2022, chat GPT comes out and I'll give you a little bit of an analogy here that I think is a truly opt way of how we think about it.
And 2022, sort of like imagine you had an assistant in a room, you walked in, you asked it question and it answered natural language and this is the first time you see in a computer like answer a natural language and gives you the answer. You leave the room, stops working, your assistant stops working. You walk back in and you say, hey, how's it going? Ask another question. Assistant does not remember who you are. No idea. Sometimes shift, but it really is not the type of experience that you would normally have in a situation where we're working in the assistant. So fast forward, maybe to 2024, it's almost like we gave chat GPT a notebook and it could write certain things down as you were talking to it.
And you would say something, chat you write it down, it's best to know what's going on. You leave the room, you come back, you'd ask another question and it would like skyward through the notebook to help answer the question it had. It's a little bit like maybe the movie Memento where you got tattoos on you and you have some clues, but it's not a perfect picture. So you know, I've been thinking how can we make this better? There are a lot of people involved here, but that's when the April memory update, that's around the time we came up with our latest variation of memory. So the latest variation of memory, we had a assistant, a person that had a notebook with information about you, but still very limited.
Like might understand your name, but doesn't really understand you or who you are or really can't carry a conversation from new conversation to new conversation. So the update to memory that we launched in April was really trying to bring a more natural memory to chat GPT. So taking this like person with, you know, Memento style tattoos to be like a real person that remembers you that can like pick up a conversation from where you left off. So that's really what inspired this launch in April is turning chat GPT's memory into something that's more natural, that is the beginning of what you might expect from like a real assistant that is like the same person in the conversation time after time that you come back and talk to them.
Yeah. And that's when I think, you know, that released early April, I mean, that's funnily enough how, you know, we got in touch because we'd listen to, I think, a podcast you've done on this. Yeah. Yeah. Actually. What was it like? So we were talking about memory. I think Miyajah's shots were all very inspired just by what could happen next? What doors this unlocked, you know, in hindsight now as a chat GPT user, I'm like, oh, yeah, this seems like a very obvious like feature to unlock. But before it got delivered, I don't think anyone really knew where the arc of this product was going. Again, now it seems obvious.
Maybe you could put us in your shoes as you were, as you were listening to us like a chitchat about our experiences with memory, what was going through your guys' heads? Yeah. Actually, like, Christina had just gone on vacation and I was just, you know, scrolling through everything on Twitter or looking for different coverage of it. And, you know, the change was not like a visual feature that you could see. And so not everyone picks up on it right away. And I remember someone forwarded me a link to the podcast and I was a little skeptical and I was like, okay, let me, let me read, let me listen for a limit list has forked off from Bayclists.
So as you said, crypto pod, I texted Christina, I said, you got to listen to these crypto bros. Talk about chat GPT and she was like, I was going to have to go on and see you're basically like bullied me over the course of multiple days to listen to this podcast. She was like, this is like the thing you have to do. It was really interesting to hear you both talk about this launch and to hear, I think like David, you talk about it's a small step, but maybe it's a small step that's really a big change. And I mean, Aja, we like DMed you on Twitter immediately to talk because we were just so curious.
Like, your reaction was like much stronger, but I'm very grateful to Samir for influencing me. Listen to this on vacation. Yeah. Because you made it do like a three factor off. We have we DMed you. Yep. I wrote like, do you approve this? Yeah. Yeah. From our openly eye accounts, and then I got a mutual friend, three factor authentication before Aja has been talked to us, but yeah, I didn't believe opening. I was listening to the limitless podcast background that turns out, turns out we say some interesting things. Yeah, the context for that is that, you know, in crypto, there's a lot of scams.
And so in somebody from opening, I text you messages you on a very public social media platform. You're like, what's going on here? Can we color in a little bit about what was the bigger, the broader reception of memory when it was introduced? Because I think that we're just to kind of jog our listeners' memories because that was, you know, so many months ago, half a year ago in time flies. I was skeptical. I honestly can't necessarily remember what I was skeptical about. Yeah. I know I remember a judge being very excited, but like give us the range of like feedback and reception that judgeability users had to the memory feature.
This was a change that was mostly under the hood, except we did release a notification to share with people that this change was happening. And it kicked people into a conversation that was something like, tell me based on everything you know about me, about who I am and like make it catchy. And I think their reception was twofold. There was like really strong reception actually stronger than I think we had originally anticipated to that prompt. Like people were really excited to see how Chashi Bt had been understanding them and like really learning about themselves from hearing about Chashi Bt's perception of them.
But I think that we were surprised by the reception like a jazze, honestly. Like hey, this really changes the experience because other than that one notification, there really wasn't much to it visually. And we sort of hypothesized that this natural evolution of memory would be really meaningful. But it was a surprise to us how many people actually like felt that in their experience. And a lot of people will like extrapolate, come to, you know, jump to different ideas from that point in time as soon as they see it. And so it was really, really interesting to just see different takes on this. But you know, to ground as in like how we think about it, a lot of it has to do with this just a universality of memory and how we can sort of meet people where they are.
And there's a little element to this around like everyone has a different experience with Chashi Bt. If you're, you know, it's living in San Francisco or if you're living in Indonesia, if you're in Brazil, everyone has a way that they communicate with other humans. And memory helps sort of you know, like make the playing field universal so that people all over the world are able to like communicate with Chashi Bt at the level that they understand. And it's not like mapping it to, you know, the, how people communicate or other computers. Humans have been talking to humans for tens of thousands of years, everyone sort of understands that.
Humans have been talking to computers or interacting computers for 30 years, but in clicks, like widgets. And so that's maybe not as natural and not the best way to communicate and tackle higher order concept discussions. Hey, Jaws, I'm curious to replay a bit of like your reaction because it was very strong and also like how you think about it now a few months later. Okay, so how I thought about Chashi Bt pre memory was it was like talking to a friend that had amnesia, you'd have a conversation, you'd get into a topic about something and then a couple hours later, it'd be like, Hey, who are you?
Tell me about yourself. And that kind of broke the illusion, maybe illusions of the right word, but it kind of broke the experience a little bit. And so when I saw that memory update on my app, what you described is a kind of small internal under the hood update meant a lot more to me because I knew that over the next few days, I'd be having less of those, Hey, this is me conversations and more of more of just conversations that floated to something much more bigger that compounded. When you guys think about Chashi Bt and the evolution of the product, I'm a psych major and I find it very easy to put into metaphors a lot of how Chashi Bt works or at least how I understand it to work.
So like the short term, long term memory, like the short term memory is literally what is the last four prompts that the user and I have just been discussing. So let's retain that information first, but also in my context and my response and let me also understand a little bit about the deep truths that I know about this user and their interests and their hobbies and I will frame my response based on like the long term memory that I understand the user to be. What do you guys are thinking about Chashi Bt? Do you think of it in a cognitive psychology lens? Yeah, we look at it. I think, you know, we try our best to look at some of the prior art here and in that scenario, it's really helpful to understand like how humans interact with humans and some of the advantages and pitfalls there and Chashi's memory is today nowhere as good as humans memory and sort of understanding the gist of people, interactions and the fidelity in the triggers.
So there's a lot that we can draw on from the sort of existing cognitive precedence. It's like a much more natural way for people to interact with with something as well. Like on the other end of this is a person. So a person like I am interacting with Chashi Bt, I interact with like many other people, it's much more natural to interact with something that you expect to be an assistant in a way that you would interact with another person. So I think a lot of the, like at the end of the day, this really comes back to like not Chashi Bt, but the user. Like how do people expect something to interact with them and like how do we meet everyone where they are and like what they expect as the user?
I can't exactly remember what I was so skeptical about, clearly that skepticism has dissolved because I remember just maybe one, two weeks after this feature got released that I realized like, oh, this product gets better the more I tell it about myself and a lot of people would reach out to us further down the line, you know, weeks, months and then mentioned that this is one of their favorite features. And you know, I would always ask, is it a single moment, a magic or is it a slow burn? And you know, different people give different responses, but for some people it's a slow burn. Like they just realized that things have shifted and like Chashi Bt is behaving in a way that we're clearly it understands them.
And I think it has to do with maybe how you're using it everyone uses it in a different fashion. Yeah. I'm not sure the memory feature unlocked. I think what is many people's not favorite prompts, but I think a prompt that many people have at Chashi Bt, which is based on everything that you know about me. Who do you think I am or what do you think my personality is? Or some like hold up a mirror to me and tell me what you think I am. And so it kind of turns Chashi Bt into a diary in a sense is like I have like queries and prompts like help me plan a trip that I want to make. But also the trip that I want to make tells Chashi Bt a little bit about myself.
And so every single prompt it it gives it's like a little bit of just like here's one more shade of who I am. And it really encouraged me to like give Chashi Bt all my data. Tell me all my interest. Tell me the secrets that I've never told anyone before. Yeah, I talked to us about the arc of how user behavior changed with the introduction of the memory feature. It's a good question. I actually would say user, my user behavior has changed much more with, well, I think both with enhanced memory, but also pulse, which came out last week, which is a kind of like natural evolution from memory as well.
But I think with memory like I started sharing with Chashi Bt more context. So instead of just going there with a question that I wanted an author to immediately like I knew that this context would come up in like future conversations with Chashi Bt. So if you share like, hey, I'm looking for a fish forward restaurant for tonight. Like, help me find that. It's kind of unclear to Chashi Bt like, why am I looking for that? Am I looking for it? Because like I'm pescatarian. And so it shifted my behavior into being more along the lines of like, hey, I'm pescatarian. I'm looking for a restaurant tonight.
Can you like help me find something? And like I've started sharing facts along the way as opposed to just like going in with a question like I would in like a traditional search product. And then like down the line, as Samir mentioned, it's like a slow burn. You see those facts come up in the future. And so now Chashi Bt, if I'm like asking about a restaurant, it will suggest like fish forward pescatarian restaurant, friendly restaurants and I can just like expect that now. And so I've started just sharing like facts about myself in context that I like expect to be helpful in the future. It seems that this this approach with Paulson with the data you guys are amassing is solely meant to kind of help a better user experience for the person using Chashi Bt, right?
It's like this personalized experience that helps them improve and get better. But I do also want to address the elephant in the room, which is you guys now own so much data and not just any data, very personal data. I tell Chashi Bt everything and very willingly, very consentingly. And I have to ask what are the plans with this massive honey pot of data? Are they any kind of like thoughts on new products or maybe new experiences that you could do with something like this? Yeah, I mean, I think we're very focused on like helping people achieve really meaningful things in their life. I definitely, you know, Sam has said to like Chashi Bt will probably be the most like sensitive account that people have.
And like we take this very, very seriously, but there's also so much to be gained for this. Like I have many personal experiences in the health domain. For example, I was going to get vaccinated for a trip I went on in July and I had already shared some of my prior like vaccination forms as well as my labs that I had done with Chashi Bt. And I asked the nurse that I went to go get vaccinated with like, Hey, what vaccinations do I need to go to this trip in like a month or so? And he gave me four vaccinations that I needed. And then I also asked Chashi Bt, like just to check and see what Chashi Bt thought and Chashi Bt gave me five vaccinations that I needed was like, what is the difference here?
And the nurse had looked at my prior vaccination forms and Chashi Bt had pulled out that I had low immunity to varicella from a lab I had done early last year and was like based on your vaccination forms, you have these four that you need and then you also have low immunity to varicella so you need to add that one as well. And I think that's an example of like such a sensitive use of my data like I have literally uploaded all of my like labs and vaccination forms to Chashi Bt but it's helped with such like individualized outcome. I wouldn't expect anyone to be able to go look at every single form I've ever shared with them before for every single like doctor's appointment.
And so now I know that I can like go to Chashi Bt and ask like, Hey, I'm going to this doctor's appointment, like what's relevant for that? But at the same time, like I am a user of Chashi Bt sharing my like health information with Chashi Bt and I think we take that like very, very seriously and want to make sure that people are able to get a lot of value out of Chashi Bt in the way that they want but yeah at the same time like really taking data privacy and like security really, really seriously in the work that we do. So I could imagine some property, some thing like sign in with Chashi Bt on this website and I go to some non open AI website and I sign in with Chashi Bt and now it's my agent, my LLM, my chat that is piped in to this this website, my identity signed in with this website and all of a sudden this website inquiry is like, Hey, what does this user want to see and my LLM could could answer them.
These are just my thoughts about what you could do but there is some notion about like the data and knowledge that Chashi Bt knows about me could be extended to the broader internet and the internet can finally be truly personalized to my interests. Do you, when you guys think about the product, is there a, how over the mark am I? I think that, you know, if you look at it back to our like, like assistant intern analogy interns in the room, you go in, you talk about some stuff, you mentioned the, you know in my case that like I recently had a son who's nine months old now and I come back tomorrow and the system's like, Oh, hey, like how's it going?
Maybe here's a tip around like what you should expect in terms of like the development cycle and like when they're speaking or they're babbling, this is what it means. If we extrapolate that, you know, and we just keep following that arc, I would love for that assistant to be able to go into the real world and you know, do things on my behalf or represent me on my behalf to solve my goals. And it's just, you know, today, chat to ET as a property can deliver so much value. But if you look at the arc of this, there's things that happen all over all over the internet. And I think like aspirationally, if you had an assistant, you'd want them to be able to go and solve problems all over the internet.
Talk to me about how you align an AI towards a human's goal still, right? Like, when I think about like, solving the problem for us. Yeah. So like, when I think about me and you person, like making a new friend or learning deeper about a person, it takes so many different types of inputs. I'm looking at the expressions on their face, listening to the tone of their voice, and then I'm listening to the actual words that they're saying, not to mention that they have a lot of past experiences that influence the words that actually come out of their mouth. When I think about the chat GBT relationship, I'm just, I'm slamming a bunch of letters.
Sometimes they make no sense. So a lot of typos, how do you process that into an AI and say, this is the thing David needs to do, or this is the thing that you just needs to build? Well, we are at an amazing research lab. So we, one thing that's really special about the personalization team too is we have like an end to end research product team. So we're able to make progress really quickly on the research side based on what our goals are in the product. And we have a similar side at the beginning. It really takes a village to make personalization happen, and we have some amazing researchers working on this problem.
And it works the other way too, from the product end of it. If you pull out chat GBT pulse today, you know, you get to the bottom of the page and it will say, you know, curate for tomorrow. And that's effectively, you know, a goal that you could set for tomorrow, or something that you want for tomorrow. I mean, it doesn't have to be for tomorrow necessarily. You could set a longer term aspect like I mentioned, like, oh, give me up today with developmental milestones, or it could be somewhat, you know, trivial, like, I'm a form of the one fan. And these races happen like at absurd times in the morning, and I'll always say, like, keep me updated with form of the one news, but do not spoil the race for me.
And otherwise, love you. Very angry. And there's no, like, that's that there's no way you could communicate that in any other tool that has existed prior to chat G and get that level of like, you know, captures level of nuance to it and provides me utility in that case. Yeah. I already am doing this with like the curate function in polls as, as Samir mentioned, like I'll say, hey, I'm going to a trip next week. I'm like going on a trip next weekend, help me plan for my trip. I'm like, that's a goal I have to like plan a great trip to like London for a wedding that I was just at and chat to beauty is like sharing like coffee shops and pescatarian restaurants that I might like and how's me kind of like look ahead and see like, what's up coming in my life?
And, and I'll just like start sharing things like, this is my goal. This is what I'm doing and sort of expect chat to beauty to like meet me where I'm at and help me help me do that better. Let's get into to pulse. This is a brand new feature that Sam Altman announced and credited you both specifically as the next step in memory and personalization. I kind of think of it as like my own personalized chat GPT. I've gone into the habit every evening actually before I go to bed of talking to it. To me, you just give an example of saying, you know, tell me about the iPhone news, but don't tell me who won because I want to watch the race.
I've been doing similar things for all the other tropes of my life. You've explained kind of how it works, but let's pop open the hood like what's actually happening underneath that you've explained memory and kind of like putting together the identity behind David, the identity behind Ejaz. Tell us about this next step of personalization and how it works. Well, yeah, first of all, this is like a feature that took a village and we have an amazing amazing team that helped build pulse, but it really is that next evolution of chat GPT. So you have an assistant that you go into the room, you start talking to them, and now they know who you are every time you come back.
But when you leave the room, they stop working. And so you have an assistant that basically like only works in your one-on-ones effectively. And like that's not someone that I would hire to be my assistant if someone that might know me and understand me, but only do work when I'm there, that I generally have to watch them do. And with pulse, we started to think about how can chat GPT in understanding you, understanding what's important to you and your goals in life help you when you're not there. So you don't have to spend all of your time in chat GPT. And the goal here is not that people are spending all their time in chat GPT.
It's that actually we're more successful when chat GPT is doing things and helping you and you don't have to be there. So you come back every morning and there's like new value for you to get from your assistant that was like effectively doing work when you want to. So basically behind pulse is like, we try to understand what's going to be important to you in the next few days, upcoming. We introduced calendar and email connectors as part of pulse as well. So not just looking at memory, but also what's upcoming in your calendar, what's just happened in your email and how can chat GPT like understand all this information, understand what's important to you and that help you prepare for your day.
It is important to note that, you know, it jams when you wake up and you scroll to the bottom of your pulse page, you know, it ends. And so to sort of reiterate Christina's point there, we are trying to get you prepared for the day, help you accomplish whatever that goal is, whether it's a gym goal or it's some sort of event you're planning for and then, you know, get back to your day. And if we do that, then we can take the time and the background with chat GPT can figure out what's important and, you know, spend the rest of the time that you're not interfacing with it, getting work done, which is kind of what you would want from most of your assistants.
Yeah, you can kind of think of it as like while you're asleep, chat GPT is like trying to process all this information you shared with it to understand how it can help you the next day. So then you wake up and there are like things that are ready for you that right now are mostly content based. So like, what can we, what can your assistant share with you that's helpful? But you can imagine you wake up and your assistant's like, hey, I wrote this email for you. Do you want to send it or like, hey, I, you know, prepared this for you. Do you want to go do that? And so I think the goal here is like becoming more and more like helpful and actionable over time.
Hey, everyone. If you want to listen to the rest of Christina and Samir, I'm going to make you go over to the limitless feed to do that. We're cutting you off halfway. There is a lot more good stuff left in this episode and also on the limitless feed in general. So to listen to the rest of the episode and to also just stay ahead of the curve when it comes to AI and other world-changing tech. Go subscribe to the limitless podcast. There's a link in the show notes.