The podcast episode discusses three big ideas for 2024: the rise of the developer as a buyer in financial services, a new age of maritime exploration, and the potential of computer vision to make sense of vast amounts of video data.
Main Topic:
Key Points:
Participants:
Takeaways:
Implications:
A new age of maritime exploration, the rise of the developer as a buyer in financial services, and more applications for computer vision and video intelligence. We asked over 40 partners across a16z to preview one big idea they believe will drive innovation in 2024.
Here in our 3-part series, you’ll hear directly from partners across all our verticals, as we dive even more deeply into these ideas. What’s the why now? Who is already building in these spaces? What opportunities and challenges are on the horizon? And how can you get involved?
Topics Covered:
00:00 - Big Ideas in Tech 2024
01:39 - Big Idea: The Rise of the Developer as a Buyer in Financial Services
07:03 - Examples of financial service infrastructure products
08:40 - Building products and cost/selling structures
09:56 - How financial institutions will adopt new technology
13:07 - Regulatory shifts and updates
14:09 - The impact on customers
16:30 - Big Idea: A New Age of Maritime
18:15 - The challenges of maritime exploration
19:56 - Why is 2024 the year of iInnovation in maritime exploration?
23:32 - Space and aerospace exploration’s impact on maritime
26:51 - Geopolitical supply chain and climate applications
29:40 - Autonomous fleets
31:49 - Key challenges in modernizing maritime
34:11 - Opportunities for builders in the space
36:23 - Big Idea: New Applications for Computer Vision and Video Intelligence
38:06 - The current use of video and it’s data
38:53 - The unlocks in hardware and software driving change
41:40 - Emerging applications and use cases
43:20 - Video and privacy
44:49 - Why is 2024 the year of change and innovation?
Resources:
Find Angela on Twitter :https://twitter.com/astrange
Find Grant on Twitter: https://twitter.com/grant__gregory
Find Kimberly on Twitter: https://twitter.com/kimberlywtan
View all 40+ big ideas: https://a16z.com/bigideas2024
Stay Updated:
Find a16z on Twitter: https://twitter.com/a16z
Find a16z on LinkedIn: https://www.linkedin.com/company/a16z
Subscribe on your favorite podcast app: https://a16z.simplecast.com/
Follow our host: https://twitter.com/stephsmithio
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Stay Updated:
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Podcast on Spotify
Listen to the a16z Podcast on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
Host
This has dramatic implications not only on how financial services are built, but then also the services that we receive as consumers and businesses. How much of that data is actually being captured and utilized in some interesting way?
Grant Gregory
Maritime in many ways has been the genesis of a lot of pieces of technology that have fundamentally changed the world.
Angela Strange
You can imagine a very low maintenance cost of financial services, which will open access to many more people.
Host
Where else can AI be applied that isn't what we've been seeing with all the exciting generative, creative stuff? And thinking about how these technologies can actually work in these more brick and mortar physical use cases. Very similar to Amazon. You can't boil the whole ocean at once. You need to thread the needle and go from books to the everything store.
Intro music fades in and out
Interpretable large language models, a new age of maritime exploration, democratizing miracle drugs, and anime hitting the mainstream. By now, hopefully you know that we asked investment partners from across a16z to preview one big idea that they believe will spur innovation in 2024. Our team compiled a list of 40 plus builder-worthy pursuits that you can find at a16z.com slash big ideas 2024.
Today, we close out our three-part series around these big ideas together with three more partners from across our verticals. In parts one and two, we explored major trends in bio and health, consumer, and games. But today, we shine a light on the future of American dynamism and fintech.
So, who's the newest buyer in financial services? And how can Unlox and artificial intelligence change the value of unstructured video data? Plus, how on Earth – pun intended – is it that we know more about the surface of Mars than our own seabed? Let's dive in. Pun intended again.
As a reminder, the content here is for informational purposes only, should not be taken as legal, business, tax, or investment advice, or be used to evaluate any investment or security, and is not directed at any investors or potential investors in any a16z fund. Please note that a16z and its affiliates may also maintain investments in the companies discussed in this podcast. For more details, including a link to our investments, please see a16z.com slash disclosures.
First up, as software continues to eat the world, it also shapes the ultimate buyers of our products. As the industry has moved from, quote, "marble to code," a16z general partner Angela Strange believes we're seeing the developer rise in influence, ultimately laddering up to the kinds of products that are made.
Angela Strange
I'm Angela Strange, a general partner on the a16z fintech team, and I think in 2024 will be a significant rise of the developer as the buyer in financial services. Historically, financial services infrastructure purchases were mostly driven by the economic buyer – "What's my ROI?" – or the business lead – "Does this solve my use case?" But there is now a third, increasingly influential constituent: the developer.
Look no further than Moves' growing FinTech Developer Conference and its associated 4,000-strong community. In tandem, developers at larger financial institutions and insurance companies are becoming more influential in buying decisions. The rise of the developer as buyer in financial services companies of all sizes favors new entrants. For fintech companies that pride themselves on a great developer experience, this will play to their advantage.
Fintechs are already prioritizing the creation of developer sandboxes to let customers try before you buy, and are even open sourcing parts of their solutions. The developer buyer would, of course, prefer to get a sense of how the product works prior to implementation. But isn't that strategy also better for everyone? For large financial institutions selling their infrastructure, appealing to the developer will be a new muscle that may require improvements in product architecture, including up-to-date documentation. Still, it's clear these institutions are recognizing the need to influence the developer as well.
Host
All right, Angela, I watched your talk from FinTech DEF CON a few years ago that documented this multi-generational shift from marble to code. I love that line. And the ability also for almost any company to participate in this financial ecosystem, not just banks. I think it'd be great if you could touch on that history to really set the stage for this important new buyer being the developer.
Angela Strange
If you ask most people who has influence in the $25 trillion financial services industry, they'd probably say the finance leads or the lines of business leads. What's happening now is there's a third, very influential constituent: the developer. This has dramatic implications not only on how financial services are built, but also on the services that we receive as consumers and businesses.
Any time you talk about a big shift like this, it's sometimes helpful to walk through the big eras to underscore the importance. This is where the "marble to code" framing came from. Not that long ago, banks were built out of marble and they were only concerned with keeping physical money safe. Fast forward to recent history: the mainframe arrives. Banks obviously have to keep virtual money safe. Those mainframes are still where 99% of dollars in the U.S. are settled.
The trend we've been talking about over the last several years has been the shift to "as a service." It's taking some of the elements of the banking stack and making them such that financial services moves from something that traditionally only banks could do to now something that any company can do. Examples: Lyft can add bank accounts for its drivers, or Procore can add payments and bank accounts for their plumbers.
What has happened is any developer at one of these companies – and even at the banks – has discovered that even though we have these as-a-service layers, there's still a lot of stitching that needs to go on to put these things together. Developers are very smart. Anytime they find themselves building something over and over again, they will find a way to automate that and oftentimes open source it. We're starting to see all of these very well-used, prolific, open-source libraries that are solving what used to be esoteric problems, but that are used by millions of developers all around the world.
This force shift is taking the as-a-service layer and exploding it even further. You can think about it as almost having Lego for banking – different composable blocks that all fit together in different kinds of ways. The added bonus is many of those are open source. The smartest people from all around the world can contribute to these, making them even stronger and better. So what does that do? You can build way better products, much faster. It's starting to attract some of the smartest engineers, who are now working on financial services products.
Host
I love that. I think maybe it'd be helpful for the listeners if you could give a couple examples of those financial services infrastructure products that you say were previously driven by the economic buyer or the business lead that now you think are really being influenced by these developers.
Angela Strange
Exactly. Many vertical SaaS companies, for instance. If you're providing an operating system for any type of business, it's a very natural extension that you might want to add payments. Traditionally, payments expand the dollars you are able to get from your customers. It gives you more margin. It makes people stickier. It was a very economic decision that this is the right thing to do. So let's pick the infrastructure.
What has happened is companies that have done this historically have ended up with: "Well, now we have one system that helps us accept the money. We have another system that helps us store the money. We have a different system that helps us disperse the money. Now when we're trying to create these good user experiences, we're stitching these things together."
To use an example of Move, the company that has started this large developer conference: if you can provide composable blocks of all the different things that you want to do in payments without any of these middle layers, engineers are able to build much better products and much more seamless experiences. As a result, they are becoming very influential in the buying decision because it's going to drive the revenue and the product experiences that these companies are able to do.
Host
Absolutely. Anytime we see a shift in who the buyer is, that naturally also influences the way products are built. Maybe you could speak to that. If we now see this buyer, how does that ultimately influence how these products are expected to be built and maybe also how they're expected to be sold?
Angela Strange
I used to work with this great VP of engineering, and I was on the product side. What I loved the most is anytime I could come up with the best product experience versus some of my counterparts who would say, "Well, this is hard to build." His expression was always: "It's just software. We can build anything."
In financial services and payments, that hasn't always been the case because you've been limited by how things are stitched together, what systems you can tap into. But if you can imagine the absolute best product experience, and there are some really unique ways to integrate financial services into software platforms, and if you could have the most composable bricks of how to do that, then you can drive the best user experiences. The product-first thinking that's happening in financial services is very much coming to the forefront, both on the consumer side and on the business side, because now we have this great composable architecture.
Host
Where do larger financial institutions come into this? They're not necessarily known as being the most technically savvy or the most composable code. I think something that you mentioned in your talk that we referenced at the beginning is that 40% of bank code is still in COBOL, which is pretty legacy. I think you even said that it's not really being taught very widely anymore. How do we square that circle of these larger financial institutions and this walk towards something a little more technologically driven and with developers at the center of that?
Angela Strange
The most oft-cited statistic, which I think has stayed very constant, is just the level of banking infrastructure has been around for a long time. COBOL is an old language. There's a lot of code written in COBOL. It is very hard to find COBOL developers right now. There's also a lot of legacy software. Much of financial services is built on enterprise software that has been around since the 60s, 70s, and 80s. The narrative has been that banks are never going to rip a lot of this out – it's just way too risky. I think that is starting to change.
I did this talk in 2021 and there was already a ton of momentum towards developers. It's now almost 2024 and there's an entirely new platform shift driving even faster change: generative AI. There's a lot of talk in financial services around the risks posed by generative AI. There should be more talk around what are the risks of not moving quickly enough towards this effect. We're already seeing that a lot in financial services and in insurance. CEOs from the top down are really rethinking their strategy: how can they leverage this platform shift?
How does that impact financial services infrastructure? I think it challenges the notion that some of this infrastructure will never be replaced. Take a loan origination system, for instance. There have been new loan origination systems, and it's been very hard to get that new tech in. One of the reasons was the new tech was better, but probably not 10x better. Whereas now with Gen AI, it's like: "Great, we've reimagined the workflow. It's going to take you one-tenth as many people." If you take an AML system, for instance, we're going to automatically write the SAR reports for you. The products that are able to come along are so much better that it's challenging the notion that some of this old software is just never going to go.
Point two on COBOL: does it make sense to entirely rewrite systems in days past? Probably not. But if you look at GitHub Copilots, depending on the engineer, that's 30 to 100 percent increased productivity. One school of thought is: "Well, now you can just rewrite it faster." But you can imagine a world where LLMs get so good that you could feed in large portions of code written in COBOL, and they would spit out the same functionality in a different language. We're not there yet, but the space is moving so quickly that this change and this shift is very much going to change some of these notions that have been around for a very long time.
Host
Totally. It's a very foundational shift. Maybe one other shift I'd love for you to touch on are the regulatory shifts happening at the same time. We did an episode recently where we talked about how different jurisdictions are implementing open banking or sandboxing. I'm curious to know how you think those also fit into this trend of the increasing involvement of the developer.
Angela Strange
The open banking trend in particular is pretty interesting. The U.S. is a little bit different than some other countries like the U.K. and even Brazil that have an open banking mandate from the government that banks have to share their data. You can think: does it make sense for every bank by themselves to independently develop and maintain all of these different types of APIs? Or is that an opportunity for broader open source projects, broader standards, such that it becomes a lot easier for financial institutions to maintain some of these open connections and a lot easier for other software companies to connect into them?
Host
Just to round things out, I think it's very exciting that the developer is playing a greater role. But maybe the question that listeners are asking themselves is: how does this ultimately impact me? How does the customer ultimately see different kinds of financial services with this developer role becoming more prominent? What do you think this does to the kinds of products that can be created?
Angela Strange
I think this is the most exciting part. You can talk about infrastructure, but what does better infrastructure do? It enables better consumer and better business experiences. I can think of a couple examples. There are still 2 billion people that are underserved from a financial services point of view around the world. There are many reasons for that. But one of the reasons is that if you want to stand up banking infrastructure with all the software, especially in the U.S., it's going to cost you $10 to $30 a month just to keep the lights on. That makes sense if you're going to get a mortgage and all these different types of products, but it doesn't if you're going to have a low balance account.
If you now have – and there are several examples – open source cores where you can just grab the software for free and build around it, you can imagine a very low maintenance cost of financial services, which will open access to many more people. That's one theme I'm excited about.
The second is financial services might have more edge cases than any other industry. The number of different ways that you can pay, different payment types, different sites – it's a huge pain. There's now an open source ACH library, and engineers from banks are running trillions of dollars through this library, catching all of these edge cases and fixing it. Stuff is going to work better. If everyone incorporates this hardened library that the best people against the world are testing against, all of us are going to have better products over time.
Host
I cannot wait. I think you said in your talk what the ACH manual or PDF was what, 500 pages long?
Angela Strange
Yeah, if you want help sleeping, you can download it.
Host
Well, it's great to hear that this problem is not only being solved by one company, but that problem is now becoming distributed by the smartest people, the smartest developers. This is a very exciting big idea. Thanks for sharing with us, Angela.
Angela Strange
Thanks for having me.
Transition music
Host
Next up, we move to the maritime economy. Technology is tangibly impacting our world on land – think self-driving cars – in air – think swarming drones – and even in space – think the exponential number of satellites and reusable rockets. But what about the sea?
Grant Gregory
Hey everyone, my name is Grant Gregory. I'm an investment partner on the American Dynamism team, and this is my big idea for 2024: a new age of maritime exploration.
Generations ago, our ancestors took to the seas to explore, and yet today we know more about the surface of Mars than we do about our own planet's seabed. A new age of maritime exploration is changing that, and founders are leading the way. Maritime faces similar reliability and engineering challenges as air and space, and many of the technologies pioneered by the latest space age can be readily applied here too. Meanwhile, the size and importance of the commercial and defense markets provide substantial reward.
We're seeing companies like Flexport, Ceronic, and SailDrone, and many others have already started modernizing maritime. We anticipate that continued geopolitical, supply chain, and climate disruptions will further accelerate the demand for change here. AI, hardware, and computer vision present opportunities to transform our cities, ports, and trade networks with autonomous, modernized ferries, container ships, and fishing fleets. Robots will help sustainably mine precious materials from the seafloor, map and survey waterways, and monitor the health of our ecosystems. New generations of naval and coast guard vessels, ships, and submarines will set out to protect our supply chains and our shores. Technology is once again returning to maritime.
Host
All right, Grant. You say that we know more about the surface of Mars than we do about our own planet's seabed. This is kind of mind-blowing if you really think about it, because we're so close to the sea and it's so integrated into our industries like defense and the supply chain. So why is this? Why do we know more about Mars than our own seabed?
Grant Gregory
Great question. On the surface, it seems kind of silly, but when you think about the raw surface area here, it's quite massive. The ocean covers 70-plus percent of the earth. Trade is somewhere north of 55 percent of global GDP, and over 80 percent of that by volume is getting transported on the sea. You're dealing with something that has substantial scale that we don't have a lot of great line of sight into.
When we can look up into the stars, there's plenty of light. If you're looking down into the water, you can only go so far before it fades into black. As a result, historically, we've had very little literal visibility into the ocean. Most of what we actually know about the ocean seafloor today has been gathered from gravity data from satellites. It's a useful starting point, but the resulting resolution we have is only about two square miles. When you compare that to something like our maps of Mars or Venus, those are, by comparison, 50 times more detailed. It's pretty astounding, especially when you consider how important the ocean is for life.
Ryan Peterson at Flexport has a great line: the oceans are the circulatory system for the world. Fortunately, I think there are a lot of trends pointing in the direction of us actually understanding our oceans much more visibly.
Host
Totally. I think you make a great point that it's literal darkness when you get not that deep, and our oceans are pretty vast. Maybe you could share a little bit more about the reality of the maritime economy. When we're talking about the ships or the logistics that we all rely on, what does that look like in 2023? And maybe you can also touch on why it feels like that's been largely untouched by some of the 21st century technology that we're seeing in other industries.
Grant Gregory
One important thing to call out is that maritime is a category that historically has been marked by pretty profound innovation and changes. You started with something like the sailboat, which today is quite de minimis, but at the time was very substantial. You created the sextant, the submarine, sonar, and then the shipping container, which reduced global costs of transportation for goods by something like 99%. Maritime in many ways has been the genesis of a lot of pieces of technology that have fundamentally changed the world and give us today.
But interestingly, a lot of the current state of the art is very analog. We're talking about an industry that still operates largely with pen, paper, and maybe emails and phone calls. Part of that is just there's an inherent amount of friction in trying to make logistics work and work on time. As we've globalized, the margin for error has increased substantially, and we're starting to see some additional pressures in the past few years in a number of ways.
Host
Why in 2024 does it seem like there's a true tipping point here to change that equation?
Grant Gregory
The past three years are a good place to start. Whether it's COVID, supply chain disruptions, or geopolitical conflict and strife, all of these things are intimately connected to our oceans and global trade. As a result, we've seen some pretty significant dislocations in the past number of years. During COVID, we had the Ever Given ship blocking the Suez Canal. We had the LA port congestion famously. We've seen a rise in piracy. More recently, we had the Titan submarine implosion. They all point to the fact that our supply chains are intimately connected. Maritime is at the heart of that, and the way of conducting things analog is not going to work anymore.
There's also some other larger deep currents here. One is the International Marine Organization has been establishing new rules and guidance for both emissions, energy usage, and broader visibility and data maintenance. Ship owners now have a real desire and need to figure out how to make their fleet more observable, reliable, and performant. You're also seeing a real rise on the DoD side with renewed interest in the South Pacific region. Again, that's tied to observability, deterrence, resilience, and a lot of these factors.
On the final part, encouragingly, we're seeing a wave of startups that are entering more of a maturity stage. Flexport is a great example, and there are plenty of others that have proven out this is a real market and there's real opportunity here to digitize it. It's difficult, but it's possible. Equally, we're seeing people from a lot of the other American dynamism companies like SpaceX, Tesla, and Anduril. They're taking their learnings and experiences and bringing them over to the ocean.
Host
Right. Some of those companies like SpaceX are specifically in aerospace. What are the innovations, whether in aerospace or otherwise, that we can actually borrow now that we're heading into 2024? What can be kind of copy and pasted or evolved as we go to maritime?
Grant Gregory
There's a lot. A great way to delineate it would be: there's the processes and understanding how to build quickly and scalably, and then there's the actual technology. If you take an overly simplistic lens to all of this, space and the ocean are both very unforgiving environments. If you have a hole in your rocket, it's going to explode. If you have a hole in your boat, it's going to sink. The status quo here is that there are unrelenting physical forces acting adversarily against anything that you're creating and putting into that environment. That creates a dynamic where everything you're building from an engineering perspective has to be both resilient, hardened, and incredibly performant in a whole range of scenarios.
The water is also a very difficult environment. Electronics and water don't mix well at all. There are limited sensing capabilities. A lot of the sensors that we use in other categories like radar and LIDAR, GPS – they don't really work on the water, and they definitely don't work underwater. You're dealing with an environment where everything's moving: wind, waves, currents, tides, boats, and wildlife. All of this needs to be hardened.
A good example of some of the advances you can see – whether it's machine vision, robotics, autonomy, other capabilities – is Arc Boats. They've done a great job of encapsulating what the future of maritime looks like. From a process and team perspective, Mitch and Ryan brought the Tesla and SpaceX vision and mission to maritime. They're not just creating consumer boats that are electrified. They're actually building better boats that are more user friendly, more functional, and way more appealing to the average consumer. While they're doing that, they're also creating a manufacturing process that understands the factory is the product. They're doing that in a way that scales beyond just their first ARC-1 boat, but allows them to eventually expand beyond to other product lines. I think all that together is quite important.
We're seeing plenty of additional interesting developments in underwater imaging. Space ultimately had to do a lot of things in-house and vertically integrated. We're seeing a similar approach with maritime.
Host
Right. Arc is such a good example. We talked to Mitch semi-recently, and I think I used the term "copy and paste," but you brought up a really good point: the aerospace industry got the ball rolling, but we now need entrepreneurs to basically take that technology and specialize it for these different industries. He made a great point that a car will continue rolling down the street for a pretty long while even if the engine isn't running. A boat will stop immediately. Each of these industries is unique.
Maybe you can speak to some of the different applications so folks can get a sense of what may be on the horizon. If we do incorporate these new innovations, what are the kind of geopolitical, supply chain, or climate applications that you are seeing built or that you see on the way? And maybe also how far are we in that trajectory? Are these coming in a year, five years, ten years? What can we expect?
There's a lot of change happening and there's a dearth of problems to be solved. I think the good news is that we're seeing a ton of blue space here in terms of what can be done. And in some ways, we're quite early in this chapter. But in other ways, many of these companies are progressing quite rapidly and have been adding for a while. So you're seeing some pretty profound changes, maybe on the observability front.
Something that's been really interesting is you have a problem that expands from deep water navigation and autonomy that starts with route optimization and emissions management, but it also ends up in your ports. One thing that was pretty mind blowing is that the majority of our trade in the U.S. is tied to inland navigable waterways. You have a mix of ocean water and sediment that's constantly changing the seafloor. The current way we navigate this is we manually, every 100 feet, try to measure where the bottom of the seafloor is. As a result, it's changing and very inaccurate.
This is something sonar and other technologies historically have been great at solving. Now we're seeing companies with machine vision and other technologies fastening this to the bottom of boats and doing it in a synchronized manner, so you're able to have a live map of where the seafloor is, how many ships can go down a specific port path, etc.
The other way to think about this is you're taking a lot of the raw analog instrumentation, digitizing it, similar to what Flexport has done with customs and freight forwarding and now financing. Then you're adding sensors to existing vessels and infrastructure, using all that data to capture and create more interesting and efficient route optimizations.
The final thing that's been really interesting is companies like ARC, Ceronic, and Anduril with their dive platform that are building new versions of vessels from the ground up with modern day assumptions on how these vehicles should operate in a digital world. As a result, we're seeing some pretty impressive development on hardware that re-envisions what something on the water should look like. Now you don't have to account for people on a boat. You can have something that lasts longer, can go under the water, and can focus on mission planning.
And maybe one specific application you can speak to is the idea of autonomous fleets. What does that enable? You've mentioned in your big idea the potential for mining or observation. What does the ability—and I know the idea of autonomous fleets isn't necessarily net new in 2024—what does that enable? Are there second or third order effects of having that autonomy, which we're also seeing increased on land, but instead in water in this case?
Grant Gregory
Autonomy is interesting because there are so many applications. And to your point, it's been discussed for many years. I think the reality is there are going to be different waves of autonomy in maritime. There's going to be the actual autonomy for deep water navigation, which frankly is probably less difficult than some of the other problems. Once you're in a port, you're navigating against other vessels against a shifting tide and also the seafloor.
Then there's also ideas of whether we can ferry people from one port to another and actually make water transportation and navigation much more efficient, renewing it in a way that most people right now don't. More broadly on the defense side or even on some of the more fringe cases, the goal is to create vessels that can go where people can't. Whether that's the seafloor and mining precious metals in areas where we can reduce our reliance on other countries for raw imports, or patrolling our coasts covertly in our alleys and protecting them, or just navigating other issues, a lot of this stuff is quite useful. To date, we've been quite limited based on where people can go. The Titan implosion is unfortunately a good example of the reality that humans can't survive very well under immense pressure in the water.
Host
That was definitely an unfortunate case. Speaking to that, there are going to be challenges along the way to some of the applications you're describing. You already spoke to how going deep underwater is just inherently hard, even when you're on the surface. It's just much more complex than being on land. So what are the key challenges you expect on this path to modernizing maritime?
Grant Gregory
Like any industry that has a robust history, it's going to be difficult to change. There are many things tied together. There are structural challenges, technological ones, and ultimately challenges with adoption and distribution. When you're dealing with something in the physical world, those are often the hardest things to tackle. That's where friction is really high.
For entrepreneurs, probably first and foremost, the most pressing thing is having a foundational understanding of how the maritime industry works and how your company fits into that picture. Oftentimes, this means finding an initial beachhead market and understanding how you can enter that market and then expand into a larger prize. Very similar to Amazon, you can't boil the whole ocean at once. You need to thread the needle and go from books to the everything store. Some of the best founders we've talked to in these categories have been able to articulate a very clear understanding of both how the broader ecosystem works and how their company fits into it.
On the technical side, it's a double-edged sword. A lot of the tech we're talking about that can be ported over from other categories like aerospace can be brought over pretty readily. But at the same time, the reality that it is functioning so well is because it is a quite difficult category to build for.
Probably most importantly, once you build it and you understand what you want to do, you still have to sell this to customers. This is a category where the people in the industry are quite smart, but it's very difficult to convince them to change because most of what you're trying to sell to them deals with mission-critical applications. They can't have downtime, and they're already dealing with huge backlogs and stresses. They oftentimes need to have proof of work. They need to see verifiable evidence that what you're doing will save them money and time. As a result, there's a huge onus on being able to deliver something rapidly in a cost-efficient manner.
Host
Totally. And by the way, I have to say, I love your water analogies. You said you can't boil the ocean and also vast blue space. So to close things off, there's a lot of opportunity here. That's clear. You see a lot of different companies attacking these kinds of problems. If you were an entrepreneur—and there's probably lots listening—I think this is the kind of idea that gets people up in their seats thinking, "Wow, I can really build something real with my hands." We talk about software and hardware coming together. What opportunities are you most excited about? And again, if you were an entrepreneur or builder, how would you even think about starting?
Grant Gregory
To start, understand that there's a vast blue space here. As a result, you need to be really articulate and intentional about what you want to solve. You're going to be tempted to address plenty of other problems. The reality is having focus here is going to be paramount to a successful company. From there, you earn the ability to operate and expand and do much more.
Another interesting idea we've seen is that in categories that are really resistant to adopting software, oftentimes hardware is a great Trojan horse. You can sell to a customer base that is used to purchasing some form of hardware. From there, you're able to layer in software capabilities and use that as the wedge from which you can expand.
To carry on the autonomous vessel and vehicle side of things, we're seeing in defense and in many categories an asymmetric advantage to having high volume and low cost. In this world of defense but also observability, I anticipate there are going to be a number of companies that are able to provide swarms of vessels, both on the surface and subsurface, that are able to not only protect our shores and our allies, but detect environmental damage, issues in our oceans, and ultimately help us observe our fisheries and other supply chains much more effectively.
Host
Absolutely. Well, I hope we have this conversation again soon. And that quote we discussed at the very top will have flipped, where we at some point know more about our own ocean seabed than we do about Mars, or hopefully both. We know a lot more about both next time. But Grant, thank you so much. This was great.
Grant Gregory
Thanks so much.
Music transition
Host
Finally, as software continues to eat the world, what do we do with all that data generated? Specifically, can unlocks in computer vision make sense of the vast amount of video data we collect, potentially modernizing industries from transportation to agriculture and even to mining?
Kimberly Tan
Hi, I'm Kimberly Tan. I'm an investment partner at Andreessen Horowitz on the American Dynamism and the Enterprise team. And this is my big idea for 2024. I believe that in 2024, we'll likely see new applications of computer vision and video intelligence in the real world.
I think leveraging insights from video data has become pretty commonplace in the enterprise to help companies make better informed business decisions. But this capability could be even more powerful in the real world, given how rich and comprehensive the nature of the available data is. However, many industries today still lack modern systems to actually capture and make sense of that video. Oftentimes, customers actually have no existing video infrastructure or use pretty legacy video systems that are difficult to integrate if you actually want to use modern software.
We see businesses tackling this problem by leveraging a hardware and software model, allowing them to sell both the hardware video cameras as well as the software to customers. These businesses often tailor the go-to-market approach to target a very specific customer with particular needs. For instance, companies like Flock Safety are just examples of this hardware and software model where they've built large businesses around keeping residential neighborhoods and schools safe. We think the same success could be found in other industries, such as transportation, industrials, agriculture, and mining.
Host
All right, Kimberly. So this in a way is a whole new twist on the idea that software is eating the world. In this case, it's software is eating the physical world in a way. So maybe you could just give us a sense of just how much video is actually currently being captured.
Kimberly Tan
Definitely. And by the way, I think "software eating the physical world" is a great articulation of the broader American Dynamism thesis that we have at the firm that we're really excited to invest behind. I would say there's a vast amount of video data being captured just given the general prevalence of cameras, either on smartphones or in a lot of places that we live our day to day lives. The real question is how much of that data is actually being captured and utilized in some interesting way versus just passively existing on different devices and not actually being analyzed or processed in any way.
Host
Yeah, that makes sense. I think we're all very familiar with how much data each of us individually is capturing. But what unlocks in the hardware or the software to process the data actually allow us to better leverage this video? And also, what has contributed to just how much data is being collected?
Kimberly Tan
The reason I'm particularly excited about this thesis in the next year or so is I feel it's the confluence of a lot of things that are finally good enough that were always on the cusp of being possible, but now have hit some cliff where we can see really large venture scale outcomes.
First, the proliferation of cameras and availability of video. There are just more cameras getting installed for different use cases where the insights aren't being leveraged as widely as they could. Either on people's smartphones, home nest cameras, cameras in people's workplaces, traffic cameras, etc. The availability of just having the data there is one thing we're reaching a tipping point on.
Second, tech is just becoming broadly more cost efficient and available. First through cloud cost dropping such that you can actually do more computation in the cloud, which has historically been a barrier given just how much data there is residing in video and how expensive it is to process that data. Then on that point, increases in edge computing capacity through cheaper chips and camera quality per dollar, allowing you to run more complex and larger models on better cameras at lower cost, reducing bandwidth constraints you would have had sending it to the cloud.
Third, there's just broadly innovation on the models themselves. Everybody now knows Transformers and how exciting it's been for generative AI innovations like ChatGPT. While Transformers were designed for language tasks initially, they've actually been applied in vision applications as well and work quite well for things like image classification and object detection versus the status quo previously. Seeing Transformers applied in the vision space will be really exciting. Once you have the video, being able to query it and look at what is in that video using something like generative AI, where you can query natural language instead of having to write a bunch of code to understand it in a meaningful way.
There's also a business model understanding question. A lot of people thought for a long time that selling into these difficult verticals was tough. Now that we have companies like Flock Safety proving it is possible, people can apply those lessons into other verticals where it hasn't currently been applied yet.
Host
Absolutely. So it sounds like there is an element of the cost curve changing, elements of innovation, and specifically LLMs changing the game, and through that, business models evolving. Could you speak to some of the applications that you think can emerge here? You mentioned transportation, agriculture, industrials, and mining. Give us a sense of the types of applications that might sprout from these different factors coming together.
Kimberly Tan
I want to preface by saying there are probably way more than we can even envision, so these are just examples that I think are exciting. In transportation, for example, there's a lot of back and forth that happens with confirming that you're giving the right item to the right person at the right time and charging the correct amount. Today, a lot of that is done through very manual emails, invoice processing, reconciliation, confirmation of receipt of items, compliance on specific tariffs, etc. Through computer vision, you can identify that this was the item we gave to this person at this time and just cut out a lot of that inefficiency.
In industrials and other pretty large scale industries, there's a lot of labor or OSHA compliance on workplace safety and conditions that have to be met. Inspectors come by. You often have to fill out all these checklists and make sure. Through computer vision—none of which requires actually monitoring the people themselves—you can make sure the conditions are safe for the folks who work there.
In something like agriculture, the bread and butter of that industry is livestock or crops or whatever you're growing. There are a lot of insights you can gain without having to have somebody manually looking at it all the time about making sure the weather conditions are correct or the crops are healthy.
Host
Yeah, that makes a lot of sense. I think people can easily imagine those use cases. But what about the use cases where this video is deeply ingrained in our everyday lives? The natural question as it relates to that scenario is how we avoid the kind of intelligence that is a slippery slope into a Big Brother scenario. How would you calm those concerns, or how do you see regulation potentially playing a role in this video centric world you're describing?
Kimberly Tan
I think this is a really important question and topic that all companies in the space and we monitor pretty closely. Privacy will continue to be a very important question. It's hard to say how regulations will shake out, but there are a lot of things companies can do around both data rights and data privacy concerns to make sure who actually owns the data rests. There are lots of things around how long you're actually allowed to store the video for. Even in computer vision itself, what are you tracking? Are you tracking just the license plate? Are you tracking just the position of a certain piece of equipment at a certain time instead of tracking any individual person? There's a lot that can be done to make sure people's privacy rights are protected while allowing us to use the technology in a way that makes people's lives better. But it is one where companies have to work very closely with the stakeholders on both the regulatory as well as the personal and business side to make sure everyone feels comfortable.
Host
Absolutely. And of course, this is a big idea for 2024. We spoke a little bit to this and the different trends coming together. But why do you think this is the year where we're really going to see a tipping point in terms of widespread adoption? And maybe you could speak a little bit more to what you hope to see builders come and work on this coming year.
Kimberly Tan
We've talked a little bit about this before, but I think it's just a lot of things coming together to make this the right time to do it, both on the cost side. There's a little bit of a labor element—labor shortages in a lot of the industries we're talking about that maybe opened the door to software innovation where people were not as used to buying software in the past. The general focus that people have on AI today naturally lends itself to the question of where else can AI be applied that isn't what we've been seeing with all the exciting generative creative stuff, and thinking about how these technologies can actually work in these more brick and mortar physical use cases. And a lot of companies have now grown up to be successful companies that have employed this model. A lot of new founders who are starting companies looking to see which companies they admire will have these companies as models to potentially emulate or take lessons from, whereas that wasn't true a couple of years ago.
Host
Yeah, absolutely. We spoke about this at the very beginning, but it does feel like software is penetrating more and more of our world since the decade that has passed since Mark originally wrote that piece. This idea that software is definitely penetrating the physical world is ringing very true and feels a little unstoppable. So it's going to be very exciting to see how different builders leverage this new technology and focus on video.
Kimberly Tan
Definitely. We're very excited to see it as well.
Host
All right. I hope you enjoyed this full three-part series. If you did miss part one or part two, make sure to go check those out as we explore seven more big ideas in depth. Plus, if you want to see our full list of 40 plus big ideas for 2024, you can head on over to a16z.com slash bigideas2024. By the way, there you'll also find all our crypto big ideas, which we didn't cover in audio. But if you do want to learn more about them, you can also go check out our sister podcast, Web3 with a16z, which also covered these crypto big ideas in their previous episodes.
I really hope these big ideas get you excited about just how much change is in the air and also how much opportunity there is still to build. And if you're listening to this now, why wait till 2024? It is time to build.