Podcast Episode Summary
The podcast episode discusses the rise of deepfakes, a type of artificial intelligence (AI) technology that can create realistic audio and video recordings of individuals. The episode features Vijay Balasubramanian, co-founder and CEO of Pindrop, and Martin Cassato, A16C general partner, as they break down the technology, policy, and economy of deepfakes.
Main Topic: Deepfakes and their detection
Key Points:
Takeaways:
Participants:
Recommendations:
Deepfakes—AI-generated fake videos and voices—have become a widespread concern across politics, social media, and more. As they become easier to create, the threat grows. But so do the tools to detect them.
In this episode, Vijay Balasubramaniyan, cofounder and CEO of Pindrop, joins a16z’s Martin Casado to discuss how deepfakes work, how easily they can be made, and what defenses we have. They’ll also explore the role of policy and regulation in this rapidly changing space.
Have we lost control of the truth? Listen to find out.
Resources:
Find Vijay on Twitter: https://x.com/vijay_voice
Find Martin on Twitter: https://x.com/martin_casado
Stay Updated:
Let us know what you think: https://ratethispodcast.com/a16z
Find a16z on Twitter: https://twitter.com/a16z
Find a16z on LinkedIn: https://www.linkedin.com/company/a16z
Subscribe on your favorite podcast app: https://a16z.simplecast.com/
Follow our host: https://twitter.com/stephsmithio
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Stay Updated:
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Podcast on Spotify
Listen to the a16z Podcast on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
Host (Martin Casado)
At the end of last year, there were 120 tools with which you can clone someone's voice. And by March of this year, it's become 350. Being able to identify what is real is going to become really important, especially because now you can do all of these things at scale. One of the reasons that spam works and deepfakes work is the marginal cost of the next call is so low that you can do these things in mass. It's way cheaper to detect deepfakes. We've had 10,000 years of evolution. The way we produce speech has vocal cords, has the diaphragm, has your lips and your mouth and your nasal cavity. It's really hard for these systems to replicate all of that.
Deepfake, a portmanteau of deep learning and fake that started making its way into the public consciousness in 2018, but is now fully in the zeitgeist. We are seeing an alarming rise of deepfakes. Deepfakes are becoming increasingly easy to make. Deepfake videos are everywhere now. Deepfake robocaller with someone using President Biden's voice. Deepfake of President Zelensky. Deepfake. Deepfakes. Deepfakes. Deepfakes. We've seen deepfakes across social media, commerce, sports, and of course, politics. And at the rate that they're appearing, deepfakes might sound like an impossible problem to tackle.
But it turns out that despite the decreasing barrier to creation, our Defender tool chest is even more robust. So in today's episode, we'll discuss that with someone who's been thinking about voice security for much longer than the average Twitter user or even high-ranking politician wondering where this all goes. Today, Vijay Balasubramaniyan, co-founder and CEO of Pindrop, joins A16C general partner Martin Casado to break down the technology, the policy, and the economy of deepfakes. Together, they'll discuss questions like, just how easy is it to create a deepfake today? Like, how many seconds of audio do you need?
And how many tools are available? But also, can we detect these things? And if so, is the cost realistic? Plus, what does good regulation look like here in a space where we so quickly? And have we lost a grip on the truth? Listen in to find out. But first, let's kick things off with how Vijay got here. As a reminder, the content here is for informational purposes only, should not be taken as legal, business, tax, or investment advice, or be used to evaluate any investment or security, and is not directed at any investors or potential investors in any A16Z fund. Please note that A16Z and its affiliates may also maintain investments in the companies discussed in this podcast.
For more details, including a link to our investments, please see A16Z.com slash disclosures.
Guest (Vijay Balasubramaniyan)
I've been playing in the voice space for a really long time. I'm going to date myself, but I started working at Siemens. And at Siemens, we were working in landline switches and EWSD switches and things like that. And so that's where I started. I also worked at Google and there I was working on the scalability algorithms for video chat. And so that's where I got introduced to a lot of the voiceover IP side of things. And then I came to do my PhD from Georgia Tech. And so there I naturally got super interested in voice security. and ultimately Pindrop, which is the company that I started, was my PhD thesis, very similar to the way you started off your life as well.
But it turned out to be something pretty meaningful. And ever since then, it's been incredible what's happened in this space. This is why I'm so excited to have you on this podcast. To many, deep fakes are this new emergent thing, but you've actually been in the voice fraud detection space for a very long time. So it's going to be great to see your perspective on how things are different now and how things are more of the same. And so maybe to provide a bit of context to get started from, deepfakes, they've entered the zeitgeist. Maybe talk through what they are when we say deepfakes and why we're talking so much about them.
Host (Martin Casado)
We've been doing deepfake detection for like now seven years. And even before that, you have people manipulating audio and manipulating video. And you saw that with Nancy Pelosi slurring in her speech. All they did was slow down the audio. It wasn't a deep fake. It was actually a cheap fake, right? And so that is actually what's existed for a really long time. What changed is the ability to use what are known as generative adversarial networks to constantly improve things like voice cloning or video cloning or essentially try to get the likeness of a person really close. So it's essentially two systems competing against each other.
And the objective function is I'm going to get really close to Martin's voice and Martin's face. And then the other system is trying to figure out, okay, what are the anomalies? Can I still detect that it's a machine as opposed to a human? So it's almost like a reverse Turing test. And so what ended up happening is once you start creating these GANs, which are used in a lot of these spaces, when you run them across multiple iterations, the system becomes really, really good because you train a deep learning neural network. And that's where the deep fake comes from. And they became so good that lots of people have extreme difficulty differentiating between what is human and what is machine.
So let's break this down a little bit, because I think that deep fakes are more talked about now than they were in the past, right? And so clearly, this seems to have coincided with the generative AI wave. And so do you think it's fair to say that there's a new type of deep fake that is drafted on the generative AI wave and therefore we need to have a different posture or is it just the same but brought to people's attention because of generative AI?
Guest (Vijay Balasubramaniyan)
Generative AI has allowed for combinations of wonderful things. But when we started, there was just one tool that could clone your voice, right? It was called Liabird, incredible tool. It was used for lots of great applications. At the end of last year, there were 120 tools with which you can clone someone's voice. And by March of this year, it's become 350. And there's a lot of open source tools that you can use to essentially mimic someone's voice or to mimic someone's likeness. And that's the ease with which this has happened. Essentially the cost of doing this has become close to zero because all it requires for me to clone your voice, Martin now, requires about three to five seconds of your audio.
And if I want a really high quality deep fake, it requires about 15 seconds of audio. Compare this to before the generative AI boom, where John Legend wanted to become the voice of Google Home. And he spent like close to 20 hours recording him saying a whole bunch of things so that Google Home could say in San Francisco, the weather is 37 degrees or whatever. So the fact is that he had to go into a studio, spend 20 odd hours recording his voice in order for you to do that compared to 15 seconds and 300 different tools available to do it.
Host (Martin Casado)
It almost feels to me that we need like new terms because this idea of cloning voices has been around for a while. I don't know if you remember this, Vijay, but this wasn't too long ago when I was in Japan. And I got this call from my parents, which I never do. And my mom's like, where are you right now? And I'm like, I'm in Japan. And my mom's like, no, you're not. And I'm like, yes, I am. She says, hold on, let me get your father. So my dad jumps on the line and he's like, where are you? I'm in Japan. He's like, I just talked to you. You were in prison and I'm leaving to go bring $10,000 of bail money to you.
I'm like, what are you talking about? And he like listen someone called and said that you had a car accident and you were a bit muffled because you were hurt and that I needed to bring cash to a certain area And like your mom just thought to call you while I was heading out the door Right So of course we called the police after this and they said this is a well scam that's been going on for a very long time. And it's probably just someone that tried to sound like you and muffling their voice. Right. And so it seems that calling somebody and obfuscating the voice to trick people has been around for a very long time.
So maybe just from your perspective, Do we need a new term for these generative AI fakes because they're somehow fundamentally different? Or is this just more of the same? And we shouldn't really worry too much about it because we've been dealing with it for a long time.
Guest (Vijay Balasubramaniyan)
Yeah, so it's interesting it happened to you in Japan, man, because the origin of that scam. Early on, I went with the Andreessen Horowitz contingency to Japan. This was way back. This was like close to eight, nine years back when I was talking about voice fraud. the Japanese audience talked to me about Ori Ori Sagi, which is Help Me Grandma. So it's exactly that. At that point in time, it had started costing Japan close to half a billion dollars in people losing their life savings to the scams. Right. So in Japan, half a billion dollars close to eight, nine years back. So the mode of operation is not different.
Right. Get vulnerable populations. right to get into an urgent situation believe they have to do it otherwise it's disastrous and they will comply what's changed is the scale and the ability to actually mimic your voice the fact is that now you have so many tools that anyone can do it super easily to before if you had some sort of an accent and things like that they couldn't quite mimic your real voice But now, because it's 15 seconds, your grandson could have a 15-second TikTok video, and that's all that's required. Not even 15 seconds. With five seconds, and depending upon the demographic, you can get a pretty good clone.
Host (Martin Casado)
The one thing that's really close home is in commerce, right? Like financial institutions. Even though Generative AI came out in 2022, in 2023, we were seeing essentially one deepfake a month in some customer, right? So it was just one deepfake a month and some customer would face it. It wasn't a widespread problem. But this year, we've now seen one deepfake per customer per day. So it has rapidly exploded. And we have certain customers like really big banks who are getting a deep fake every three hours. Like it's insane, the speed. So there has been a 1400% increase in the amount of deep fakes we've seen this year in the first six months compared to all of last year. And the year is not even over.
Guest (Vijay Balasubramaniyan)
Yeah, so, you know, deepfakes existed, But if you think about deepfakes affecting, and deepfakes right now, you can see, right, in the political spectrum, they're there, right? So election misinformation with President Biden's campaign happened. We were the ones who caught it and identified it and things like that. What was the specifics? Are you allowed to talk about it? Yeah, no, no, for sure. What happened is early on this year, and if you think about deepfakes, they affect three big areas, commerce, media, and communication, right? And so this is news media, social media. So what happened is at the beginning of an election year, you had the first case of election interference with everyone during the Republican primary in New Hampshire got a phone call that said, hey, you know what?
Your vote doesn't count this Tuesday. Don't vote right now. Come vote in November. And this was made in the voice of the president of the free world, right? President Biden, right? That's the craziness. They went for the highest profile target. and you should listen to the audio. It's incredible. It is like President Biden. And they've interspersed it with things that President Biden says, like what a bunch of malarkey and things like that. So that came out and people were like, okay, is this really President Biden? So not only did we come in and say this was a deep fake, we have something called source tracing, which tells us which AI application was used to create this deep fake.
So we identified the deep fake and then we worked with that AI application. They're an incredible company. We worked with them and they immediately found the person who used that script and shut them down. So they couldn't create any other problem. So this is a great example of different good companies coming together to shut down a problem.
Host (Martin Casado)
I want to get into next, are we all doomed? Is it possible to detect these things like that? But before we do that, it'd be great if, since you probably are the world's expert on voice fraud, you've probably seen more types of voice fraud than any single person on the planet. We know of the Ori Ori Sagi, which is basically what I got hit with. Can you maybe talk through some other uses of deep fakes that are prevalent today?
Guest (Vijay Balasubramaniyan)
Yeah, so, you know, deepfakes existed, But if you think about deepfakes affecting, and deepfakes right now, you can see, right, in the political spectrum, they're there, right? So election misinformation with President Biden's campaign happened. We were the ones who caught it and identified it and things like that. What was the specifics? Are you allowed to talk about it? Yeah, no, no, for sure. What happened is early on this year, and if you think about deepfakes, they affect three big areas, commerce, media, and communication, right? And so this is news media, social media. So what happened is at the beginning of an election year, you had the first case of election interference with everyone during the Republican primary in New Hampshire got a phone call that said, hey, you know what?
Your vote doesn't count this Tuesday. Don't vote right now. Come vote in November. And this was made in the voice of the president of the free world, right? President Biden, right? That's the craziness. They went for the highest profile target. and you should listen to the audio. It's incredible. It is like President Biden. And they've interspersed it with things that President Biden says, like what a bunch of malarkey and things like that. So that came out and people were like, okay, is this really President Biden? So not only did we come in and say this was a deep fake, we have something called source tracing, which tells us which AI application was used to create this deep fake.
So we identified the deep fake and then we worked with that AI application. They're an incredible company. We worked with them and they immediately found the person who used that script and shut them down. So they couldn't create any other problem. So this is a great example of different good companies coming together to shut down a problem.
Host (Martin Casado)
I want to get into next, are we all doomed? Is it possible to detect these things like that? But before we do that, it'd be great if, since you probably are the world's expert on voice fraud, you've probably seen more types of voice fraud than any single person on the planet. We know of the Ori Ori Sagi, which is basically what I got hit with. Can you maybe talk through some other uses of deep fakes that are prevalent today?
Guest (Vijay Balasubramaniyan)
Yeah, so, you know, deepfakes existed, But if you think about deepfakes affecting, and deepfakes right now, you can see, right, in the political spectrum, they're there, right? So election misinformation with President Biden's campaign happened. We were the ones who caught it and identified it and things like that. What was the specifics? Are you allowed to talk about it? Yeah, no, no, for sure. What happened is early on this year, and if you think about deepfakes, they affect three big areas, commerce, media, and communication, right? And so this is news media, social media. So what happened is at the beginning of an election year, you had the first case of election interference with everyone during the Republican primary in New Hampshire got a phone call that said, hey, you know what?
Your vote doesn't count this Tuesday. Don't vote right now. Come vote in November. And this was made in the voice of the president of the free world, right? President Biden, right? That's the craziness. They went for the highest profile target. and you should listen to the audio. It's incredible. It is like President Biden. And they've interspersed it with things that President Biden says, like what a bunch of malarkey and things like that. So that came out and people were like, okay, is this really President Biden? So not only did we come in and say this was a deep fake, we have something called source tracing, which tells us which AI application was used to create this deep fake.
So we identified the deep fake and then we worked with that AI application. They're an incredible company. We worked with them and they immediately found the person who used that script and shut them down. So they couldn't create any other problem. So this is a great example of different good companies coming together to shut down a problem.
Host (Martin Casado)
I want to get into next, are we all doomed? Is it possible to detect these things like that? But before we do that, it'd be great if, since you probably are the world's expert on voice fraud, you've probably seen more types of voice fraud than any single person on the planet. We know of the Ori Ori Sagi, which is basically what I got hit with. Can you maybe talk through some other uses of deep fakes that are prevalent today?
Guest (Vijay Balasubramaniyan)
Yeah, so, you know, deepfakes existed, But if you think about deepfakes affecting, and deepfakes right now, you can see, right, in the political spectrum, they're there, right? So election misinformation with President Biden's campaign happened. We were the ones who caught it and identified it and things like that. What was the specifics? Are you allowed to talk about it? Yeah, no, no, for sure. What happened is early on this year, and if you think about deepfakes, they affect three big areas, commerce, media, and communication, right? And so this is news media, social media. So what happened is at the beginning of an election year, you had the first case of election interference with everyone during the Republican primary in New Hampshire got a phone call that said, hey, you know what?
Your vote doesn't count this Tuesday. Don't vote right now. Come vote in November. And this was made in the voice of the president of the free world, right? President Biden, right? That's the craziness. They went for the highest profile target. and you should listen to the audio. It's incredible. It is like President Biden. And they've interspersed it with things that President Biden says, like what a bunch of malarkey and things like that. So that came out and people were like, okay, is this really President Biden? So not only did we come in and say this was a deep fake, we have something called source tracing, which tells us which AI application was used to create this deep fake.
So we identified the deep fake and then we worked with that AI application. They're an incredible company. We worked with them and they immediately found the person who used that script and shut them down. So they couldn't create any other problem. So this is a great example of different good companies coming together to shut down a problem.
Host (Martin Casado)
I want to get into next, are we all doomed? Is it possible to detect these things like that? But before we do that, it'd be great if, since you probably are the world's expert on voice fraud, you've probably seen more types of voice fraud than any single person on the planet. We know of the Ori Ori Sagi, which is basically what I got hit with. Can you maybe talk through some other uses of deep fakes that are prevalent today?
Guest (Vijay Balasubramaniyan)
Yeah, so, you know, deepfakes existed, But if you think about deepfakes affecting, and deepfakes right now, you can see, right, in the political spectrum, they're there, right? So election misinformation with President Biden's campaign happened. We were the ones who caught it and identified it and things like that. What was the specifics? Are you allowed to talk about it? Yeah, no, no, for sure. What happened is early on this year, and if you think about deepfakes, they affect three big areas, commerce, media, and communication, right? And so this is news media, social media. So what happened is at the beginning of an election year, you had the first case of election interference with everyone during the Republican primary in New Hampshire got a phone call that said, hey, you know what?
Your vote doesn't count this Tuesday. Don't vote right now. Come vote in November. And this was made in the voice of the president of the free world, right? President Biden, right? That's the craziness. They went for the highest profile target. and you should listen to the audio. It's incredible. It is like President Biden. And they've interspersed it with things that President Biden says, like what a bunch of malarkey and things like that. So that came out and people were like, okay, is this really President Biden? So not only did we come in and say this was a deep fake, we have something called source tracing, which tells us which AI application was used to create this deep fake.
So we identified the deep fake and then we worked with that AI application. They're an incredible company. We worked with them and they immediately found the person who used that script and shut them down. So they couldn't create any other problem. So this is a great example of different good companies coming together to shut down a problem.
Host (Martin Casado)
I want to get into next, are we all doomed? Is it possible to detect these things like that? But before we do that, it'd be great if, since you probably are the world's expert on voice fraud, you've probably seen more types of voice fraud than any single person on the planet. We know of the Ori Ori Sagi, which is basically what I got hit with. Can you maybe talk through some other uses of deep fakes that are prevalent today?
Guest (Vijay Balasubramaniyan)
Yeah, so, you know, deepfakes existed, But if you think about deepfakes affecting, and deepfakes right now, you can see, right, in the political spectrum, they're there, right? So election misinformation with President Biden's campaign happened. We were the ones who caught it and identified it and things like that. What was the specifics? Are you allowed to talk about it? Yeah, no, no, for sure. What happened is early on this year, and if you think about deepfakes, they affect three big areas, commerce, media, and communication, right? And so this is news media, social media. So what happened is at the beginning of an election year, you had the first case of election interference with everyone during the Republican primary in New Hampshire got a phone call that said, hey, you know what?
Your vote doesn't count this Tuesday. Don't vote right now. Come vote in November. And this was made in the voice of the president of the free world, right? President Biden, right? That's the craziness. They went for the highest profile target. and you should listen to the audio. It's incredible. It is like President Biden. And they've interspersed it with things that President Biden says, like what a bunch of malarkey and things like that. So that came out and people were like, okay, is this really President Biden? So not only did we come in and say this was a deep fake, we have something called source tracing, which tells us which AI application was used to create this deep fake.
So we identified the deep fake and then we worked with that AI application. They're an incredible company. We worked with them and they immediately found the person who used that script and shut them down. So they couldn't create any other problem. So this is a great example of different good companies coming together to shut down a problem.
Host (Martin Casado)
I want to get into next, are we all doomed? Is it possible to detect these things like that? But before we do that, it'd be great if, since you probably are the world's expert on voice fraud, you've probably seen more types of voice fraud than any single person on the planet. We know of the Ori Ori Sagi, which is basically what I got hit with. Can you maybe talk through some other uses of deep fakes that are prevalent today?
Guest (Vijay Balasubramaniyan)
Yeah, so, you know, deepfakes existed, But if you think about deepfakes affecting, and deepfakes right now, you can see, right, in the political spectrum, they're there, right? So election misinformation with President Biden's campaign happened. We were the ones who caught it and identified it and things like that. What was the specifics? Are you allowed to talk about it? Yeah, no, no, for sure. What happened is early on this year, and if you think about deepfakes, they affect three big areas, commerce, media, and communication, right? And so this is news media, social media. So what happened is at the beginning of an election year, you had the first case of election interference with everyone during the Republican primary in New Hampshire got a phone call that said, hey, you know what?
Your vote doesn't count this Tuesday. Don't vote right now. Come vote in November. And this was made in the voice of the president of the free world, right? President Biden, right? That's the craziness. They went for the highest profile target. and you should listen to the audio. It's incredible. It is like President Biden. And they've interspersed it with things that President Biden says, like what a bunch of malarkey and things like that. So that came out and people were like, okay, is this really President Biden? So not only did we come in and say this was a deep fake, we have something called source tracing, which tells us which AI application was used to create this deep fake.
So we identified the deep fake and then we worked with that AI application. They're an incredible company. We worked with them and they immediately found the person who used that script and shut them down. So they couldn't create any other problem. So this is a great example of different good companies coming together to shut down a problem.
Host (Martin Casado)
I want to get into next, are we all doomed? Is it possible to detect these things like that? But before we do that, it'd be great if, since you probably are the world's expert on voice fraud, you've probably seen more types of voice fraud than any single person on the planet. We know of the Ori Ori Sagi, which is basically what I got hit with. Can you maybe talk through some other uses of deep fakes that are prevalent today?
Guest (Vijay Balasubramaniyan)
Yeah, so, you know, deepfakes existed, But if you think about deepfakes affecting, and deepfakes right now, you can see, right, in the political spectrum, they're there, right? So election misinformation with President Biden's campaign happened. We were the ones who caught it and identified it and things like that. What was the specifics? Are you allowed to talk about it? Yeah, no, no, for sure. What happened is early on this year, and if you think about deepfakes, they affect three big areas, commerce, media, and communication, right? And so this is news media, social media. So what happened is at the beginning of an election year, you had the first case of election interference with everyone during the Republican primary in New Hampshire got a phone call that said, hey, you know what?
Your vote doesn't count this Tuesday. Don't vote right now. Come vote in November. And this was made in the voice of the president of the free world, right? President Biden, right? That's the craziness. They went for the highest profile target. and you should listen to the audio. It's incredible. It is like President Biden. And they've interspersed it with things that President Biden says, like what a bunch of malarkey and things like that. So that came out and people were like, okay, is this really President Biden? So not only did we come in and say this was a deep fake, we have something called source tracing, which tells us which AI application was used to create this deep fake.
So we identified the deep fake and then we worked with that AI application. They're an incredible company. We worked with them and they immediately found the person who used that script and shut them down. So they couldn't create any other problem. So this is a great example of different good companies coming together to shut down a problem.
Host (Martin Casado)
I want to get into next, are we all doomed? Is it possible to detect these things like that? But before we do that, it'd be great if, since you probably are the world's expert on voice fraud, you've probably seen more types of voice fraud than any single person on the planet. We know of the Ori Ori Sagi, which is basically what I got hit with. Can you maybe talk through some other uses of deep fakes that are prevalent today?
Guest (Vijay Balasubramaniyan)
Yeah, so, you know, deepfakes existed, But if you think about deepfakes affecting, and deepfakes right now, you can see, right, in the political spectrum, they're there, right? So election misinformation with President Biden's campaign happened. We were the ones who caught it and identified it and things like that. What was the specifics? Are you allowed to talk about it? Yeah, no, no, for sure. What happened is early on this year, and if you think about deepfakes, they affect three big areas, commerce, media, and communication, right? And so this is news media, social media. So what happened is at the beginning of an election year, you had the first case of election interference with everyone during the Republican primary in New Hampshire got a phone call that said, hey, you know what?
Your vote doesn't count this Tuesday. Don't vote right now. Come vote in November. And this was made in the voice of the president of the free world, right? President Biden, right? That's the craziness. They went for the highest profile target. and you should listen to the audio. It's incredible. It is like President Biden. And they've interspersed it with things that President Biden says, like what a bunch of malarkey and things like that. So that came out and people were like, okay, is this really President Biden? So not only did we come in and say this was a deep fake, we have something called source tracing, which tells us which AI application was used to create this deep fake.
So we identified the deep fake and then we worked with that AI application. They're an incredible company. We worked with them and they immediately found the person who used that script and shut them down. So they couldn't create any other problem. So this is a great example of different good companies coming together to shut down a problem.
Host (Martin Casado)
I want to get into next, are we all doomed? Is it possible to detect these things like that? But before we do that, it'd be great if, since you probably are the world's expert on voice fraud, you've probably seen more types of voice fraud than any single person on the planet. We know of the Ori Ori Sagi, which is basically what I got hit with. Can you maybe talk through some other uses of deep fakes that are prevalent today?
Guest (Vijay Balasubramaniyan)
Yeah, so, you know, deepfakes existed, But if you think about deepfakes affecting, and deepfakes right now, you can see, right, in the political spectrum, they're there, right? So election misinformation with President Biden's campaign happened. We were the ones who caught it and identified it and things like that. What was the specifics? Are you allowed to talk about it? Yeah, no, no, for sure. What happened is early on this year, and if you think about deepfakes, they affect three big areas, commerce, media, and communication, right? And so this is news media, social media. So what happened is at the beginning of an election year, you had the first case of election interference with everyone during the Republican primary in New Hampshire got a phone call that said, hey, you know what?
Your vote doesn't count this Tuesday. Don't vote right now. Come vote in November. And this was made in the voice of the president of the free world, right? President Biden, right? That's the craziness. They went for the highest profile target. and you should listen to the audio. It's incredible. It is like President Biden. And they've interspersed it with things that President Biden says, like what a bunch of malarkey and things like that. So that came out and people were like, okay, is this really President Biden? So not only did we come in and say this was a deep fake, we have something called source tracing, which tells us which AI application was used to create this deep fake.
So we identified the deep fake and then we worked with that AI application. They're an incredible company. We worked with them and they immediately found the person who used that script and shut them down. So they couldn't create any other problem. So this is a great example of different good companies coming together to shut down a problem.
Host (Martin Casado)
I want to get into next, are we all doomed? Is it possible to detect these things like that? But before we do that, it'd be great if, since you probably are the world's expert on voice fraud, you've probably seen more types of voice fraud than any single person on the planet. We know of the Ori Ori Sagi, which is basically what I got hit with. Can you maybe talk through some other uses of deep fakes that are prevalent today?
Guest (Vijay Balasubramaniyan)
Yeah, so, you know, deepfakes existed, But if you think about deepfakes affecting, and deepfakes right now, you can see, right, in the political spectrum, they're there, right? So election misinformation with President Biden's campaign happened. We