Go back

Episode 12 - State of the AI Industry

49m 41s

Episode 12 - State of the AI Industry

The discussion centers on the current state and future trajectory of AI. A core theme is that demand for AI is virtually infinite but constrained solely by the availability of compute infrastructure. The year 2026 is anticipated to be pivotal for the maturation of AI agents, particularly multi-agent systems capable of handling complex, multi-step tasks in both enterprise and consumer settings. However, a major "capability gap" persists; most users, including the hundreds of millions using ChatGPT weekly, leverage only a tiny fraction of AI's potential, similar to using electricity only for lighting when it could power many more appliances. Healthcare exemplifies rapid adoption, with AI augmenting medical professionals and aiding patients, though regulatory progress is needed. From OpenAI's perspective, compute investment is directly tied to revenue, necessitating a multi-dimensional strategy across cloud providers, chips, products, and business models to fund the pursuit of AGI. The conversation concludes by arguing that the AI surge is foundational, not a speculative bubble, as evidenced by solid usage metrics like API call volume, which reflects genuine utility and growing integration into daily life and business operations.

Transcription

8367 Words, 45123 Characters

English
Hello, I'm Andrew Maine and this is the OpenAI podcast. Today, our guests are Sarah Fryer, CFO of OpenAI, and legendary investor Vinod Kostla of Kostla Ventures. In this discussion, we're going to talk about the state of the AI ecosystem, whether or not we're in a bubble and how startups and investors can succeed as AI progresses. Unlike something like Netflix where they're running so many hours in the day, I think of it much more like infrastructure like electricity. Demand is limited not by anything other than availability of compute today. I think the conversation we need to have is what will people do? 2025 was about agents in vibe coding. Now it's 2026. What's the story of 2026? I think we matured in vibe coding in 2025. I don't think we've matured in agents. So agents, especially multi-agentic systems, will mature to the point of having real visible impact. Whether you're in enterprise and you have a multi-agent systems doing full-task, like running an ERP system for you, doing all the reconciliation every day, accruals every day, tracking contracts every day. I think that on the enterprise side. But today, on the consumer side, it's still a hassle to plan a trip. That's a multi-agentic thing that looks across a lot of different things from your food preferences to the restaurant preservation, to airline schedules, to your personal calendar. Those will start to mature, I think, a year from now. So I'm pretty excited about that. I think models and robotics and real world models that go beyond, well, beyond robotics, like general intuition will all start to happen in the next year. So I think those are areas to look for. There's usual functions like memory in LLAMs, continual learning in LLAMs, reduction of the impact of hallucinations, those are all areas I could go on. There's half a dozen areas in which AI doesn't do as well today. That will be start to be addressed. Yeah. And I think that it's baseline, what Venota is saying, is 26 is the beginning of closing this capability gap. So what we know is we've handed people massive intelligence. Right? We've handed them the keys to the Ferrari, but they are only learning how to take it out on the road for the first time. We need to give consumers more and more easy ways to go from chat GPT is just a chat bot, call and response. Most people use it today just to ask questions. But how do we take it towards being a true task worker that books that trip for them, or helps them get a second opinion on what they just heard from their doctor, or enables them to create a menu for their diabetic child, right? How do we help them really move from simple questions into actual outcomes that make my life better? And then on the enterprise side, it's that same continuum. How do we close the capability gap? One of the things we know from our state of the enterprise AI and the enterprise report that our chief economist put out at the end of last year is on the frontier versus just even the median corporation. The average number of messages or the median is about six acts, which will tell you that six acts the usage from a company that's already on the frontier. And we know that frontier isn't even pushed to its max. So for us, it's this focus of how do we help consumers move along that continuum to true agentech task working? And then for enterprises, how do we create a much more sophisticated, vertical, least specialized outcome for enterprises that allows them to go from maybe a very simple chat to PT implementation, the whole way to something that's transforming the most important part of their business. For a healthcare provider, it might be their drug discovery process. For a hospital, it might be the time to admit a patient to get that patient back into the community. For a really large retailer, it might be just larger basket sizes, higher conversion rates, and much happier customers. So it's the basics of closing that capability gap. So I might add one other perspective. We've talked about the number of areas in which the technology will advance and capability will advance. I would venture to gas today off the people using AI, whether it's personal or enterprise. Some single digit percentage are even using 30% of the capability of the AI. So this percentage of people who using 30% or 50% let alone 80% of the AI's capabilities will keep increasing. I think that's a 10-year journey before people learn to use AI. I've seen this. Some people kind of pundits confuse adoption curves for capability curves. That's come up where you've seen people. So that's the point I make. It's a force multiplier because today we have over 800 million using chat GPT today, 800 million consumers, weekly using. But that number should be in the billions. And then what percentage use are they using it for? It's like we've just turned electricity on in the home. We've wired up the home and they've turned on the lights, but they have no idea that they could now heat their home. They could cook. They could curl their hair. There's so many things you now can do. And analogy I've used is that email didn't really get much better between 1990 and the year 2000, neither did mobile, but usage went way up. And the problem wasn't like, oh, we need better email, we need more better mobile. It's like people should learn all the things they could use it for. Right. Yeah. And in a more sophisticated way, like mobile is always one that's interested to me because when mobile took off, people just took their desktop websites and turned them into mobile. And they were really hard to scroll, but I guess you at least had them in your pocket. But then you realized you had a GPS. So now you could have Uber and now you could do things with location or you had a camera at your fingertips. Okay. So now, yeah, I can take photographs of all my friends, but I can also snap, you know, a check and deposit it into my bank account, although we should fix the whole paper check thing. But that's on the side. It still seems like a, but I can just take a photo of this and now I get money in my bank account. Yeah. But you know, those, those, that all existed in the minute mobile was available to us, but just the, you know, the, the ability for human ingenuity to come to work on it. So I think you're right. I don't even know if we need more intelligence than we have today to vastly increase outcomes. But of course, the models are going to keep getting more intelligent as well. You mentioned health. And that's one of the really kind of high stakes things we think about when it comes to just however the most important thing. And it's kind of fascinating to think about the just, you know, a few years ago, we got Chad GPT and we're using it for very simple applications. And now we're trusting with HIPAA compliant data. Do you look at that as sort of a marker of how fast or how well things have been accelerating? Are there other ones like that you think about to say, okay, now we know we're some new level health is clearly one of those areas. I've long believed revolutionized health by making expertise be a commodity in all areas of health. The problem with health is regulatory. So first, there's constraints on what AI can do. AI can't legally write a prescription, even if it's better than human beings at writing a prescription. That is not only the FDA, but it's actually beyond the FDA into the American Medical Association institutionally controls that function. So they will be incumbent resistance in a lot of areas. I think we can talk about it if you like. But diagnosing is still a constraint because the FDA controls that. There's no AI approved as a medical device yet. So that all, fortunately, this administration is doing a very good job of moving quickly and taking the appropriate level of risk. So I'm pretty pleased to see what's happening there. On the health front, we see in our data 230 million people every week ask chat GPT a health question. 66% of US physicians say they use chat GPT in their daily work. I'll tell you at a personal level, my brother is an HDU doctor in the UK. So his job is, you hit the ER, they don't know how to triage you. So they send you to him. You kind of don't want to show up to him. He's expected. He's very good. He's very good at what he does, but it means you're not in good shape. But he's expect to have an almost an encyclopedic knowledge of every disease that ever existed. So I always give the example. He works in Aberdeen in Scotland. If you shut up with malaria, he will not think of that. That is not in his pattern recognition. And yet, I could have happened. I don't know. You went in vacation summer. You got bit by mosquito, Bomy showing up in an ER room in Aberdeen. What chat GPT can do or what the model can do is really act as a great augmentation to the doctor, which is why I think 66% of them are using it. And that number is only growing. It's probably already much higher. And so I think it's just a great example of where something like health or getting the benefit of our doctors being able to have always the latest research in front of them, always the latest known interactions say between someone's drug regime and what they're living through and experiencing as individuals. But it also puts some independence back into consumers hands. So now I get the opportunity to ahead of time do some research on what my symptoms might be saying. So I can have a much more educated conversation with my doctor. It allows me to maybe get a second opinion or know that I want to go ask for a second opinion. It also, we go very fast to these extreme places. But just to even things like, hey, I've got 20 minutes a day to exercise, I know I'm suffering from type 1 diabetes. What could I do in 20 minutes? Or my daughter has an interesting issue with the food she eats. And so it used to be a super just frustrating thing to go to a restaurant event because we'd have to almost ask the server so many questions. And now we can photograph a menu. Chat suggests what are likely the best dishes for her to order. And then we can have a bit more of a of a terser conversation, but a bit more productive on what's going to work. And it has just changed how we think about just eating. Takes it away from all about the food to why we're going out for dinner together. And so I think there are all these just examples of something like health. It's already happening. And it's going to keep getting better and better. And then to denote its point, I think regulatory environment is going to have to catch up. It's no matter what kind of system you're under, the cost of medical care is exceeding the GDP of every country, the rate at which increases. And it seems like we need a AI, we need it now. And it can be helpful. And as you pointed out, it's the first time the cost of medical intelligence has dropped year over year. But that comes with a lot of demand for compute. And we have a lot more questions that we want to have answered. And certainly people can see the need for more compute. But the scale and scope at which OpenAI is investing in compute is incredibly huge. We're talking numbers that are just really hard to fathom. How does OpenAI determine that need? What are the metrics you're looking at to think that like, yes, we need to spend this much? So first of all, we are trying to make sure we stay investing in compute to match the pace of our revenue. And we've seen a really strong correlation between in-period compute and in-period revenue. I'll give you an example. If you just go back in 23, 24, and 25, our compute was 200 megawatts, 600 megawatts, we ended last year at two gigawatts. Against that, and it's really easy because the numbers match up, we exited at 23 at 2 billion in ARR, so 200 megawatts, 2 billion. We exited 24 at 6 billion, so 6 billion, 600 megawatts. And we exited last year a little over 20 billion, 20 billion, 2 gigawatts. Actually, it's been accelerating. So that's just even if you look at the slope of the line, it says more compute, more revenue. Now, there is definitely a timing mismatch because I have to make decisions today about making sure we have compute in not even 26 or 27, but 28, 29 and 30. Because if I don't put in orders today and don't give the signal to create data centers, it won't be there, right? Today, we feel absolutely constrained on compute. There are many more products that we could launch, many more models that we would train, many more multimodality things we would explore if we had more compute today. So for example, even in the last year, I think the overall hardware investments globally has gone up by something like 220 billion dollars. That's just how much actual spending has gone up. If you look at chips, chip forecasts have gone up similarly about $334 billion. So it's not just OpenAI. The signal from the whole environment is AI is real. We are in a paradigm shift. We need to invest to give people the intelligence they need to do all the things we just talked about, for example. So back inside of OpenAI, we do spend a lot of time going very deep on what is our demand signal in consumer and enterprise and developers. We think about what's the mosaic first at the base? On an infrastructure layer, how do we create max optionality? So we want to be multi-cloud, multi-chip, and that gives us an interesting layer at the infrastructure layer. One tick up at the product layer, we also want to become more multi-dimensional. So we used to just be one product, chat GPT. Today, we are chat GPT for consumer with all of the blades inside it, healthcare, and so on. Chat GPT for work, but we also have Sora as a new platform. We have some of our transformational research projects. One tick up, we also then have a business model ecosystem that's becoming much more multi-dimensional. Began with a single subscription because we launched Chat GPT and we needed a way to pay for the compute. We now have multiple price funds. First Chat GPT subscriber, by the way. I love you for that. Multiple subscriptions. We went to the enterprise and had SaaS-based pricing. We have credit-based pricing now for places where high value is being found. People want to pay more to get more. We're beginning to think about things like commerce and ads. And then of course, longer-term, I like models like, for example, would we do licensing models to really align, let's say in drug discovery, if we licensed our technology, you have a breakthrough that drug takes off and we get a license portion of all its sales, it's great alignment for us with our customer. So kind of if you think about those three tiers, I actually think of it like a Rubik's Cube. So we went from a single block. One CSP, Microsoft, one chip, one product, one business model to now a whole three-dimensional cube. And one of the things I love about a Rubik's Cube, I'm probably not getting the number exactly right, but I think it has 43 quintillion different states it can be in. I always blew my mind when I was in university. So now just think about that cube spinning. So we pick a low latency chip going alongside something like coding that's 5X the pace that people expect. We can charge a high end subscription for that. So it's almost like you line up the cube and you get three colors on one side. We could spin the cube again and say low latency chip, faster image gen, more free users come in, but that creates more inventory for ultimately perhaps an ads platform. So you can start to see how the goal in the last 12 months has been creating more and more strategic options that allow me to keep paying for the compute we need to really achieve our mission. AGI for the benefit of humanity. So the way to simplify that is demand is limited, not by anything other than availability of compute today, whether it's Sora or more broadly and then there's price elasticity, elasticity where demand is infinite for compute. So I think that's the way to think about it. Yeah. We haven't even started to exercise the price elasticity lever. It's just we can't fulfill demand. Right. And it's limited by compute. So all the people talking about bubbles and things, I think are on the wrong track. They have no sense of how large this changes and how much more demand elasticity there's a need for API calls. As one of open areas earliest investors, you made a bet early on. You saw where this was headed, but you've saw the dot com bubble. You watch what happened there, but you've also seen other things. The mobile revolution you've seen has happened with other areas. And you mentioned the term broad. And is that sort of where your conviction comes from? It's just how many different areas it touches. Yeah. Look, when we invested, we had one simple metric. There was no projections to look at, no product plans to look at, no chat GPT to look at. It was very simply the idea. If we develop anywhere near close to human intelligence, let alone supersede human intelligence, it's it's impact is going to be huge. So it was this hand-baby approach, like the consequences of success are really going to be consequential. So why not try try that? People, there's also this funny notion of bubble. People equate bubble to stock prices, which has nothing to do with any other than fear and greed among investors. So I always look at bubbles should be measured by the number of API calls. Or in the dot com bubble, which people refer to, it should be amount of internet traffic. Not by what happened to stock prices, because somebody got over excited or under excited. And in one day, they can go from loving Nvidia to hating Nvidia because it's overvalued. Those generations want reality. The reality is the underlying number of API calls. If you look at internet traffic during the dot com bubble, prices may have gone up violently and gone down violently. There's no bubble detected in internet traffic. I would almost guarantee you, you won't see the bubble in number of API calls. And if that's your fundamental metric of what's the real use of you AI, usefulness of AI, demand for AI, you're not going to see a bubble in API calls. What Wall Street tends to do with it, I don't really care. I think it's mostly irrelevant. Great for press articles because press has to fill their column inches. But it's not reality. So prices of things aren't reality or stock prices. Private company valuation. The reality is what's the actual demand for AI, which is the number of API calls. And I think if I heart back to that moment where you were looking at 1999, the value people were getting from the internet at the time was actually very, it was so young, so nascent that you couldn't really see how it was changing their lives. I do think that with AI, it's happened so fast that change. It's very real. As a CFO, forget about being a CFO of open AI, but as a CFO, what I see happening in my organization is truly taking tasks that previously I would have kept to having to add more and more people doing fairly mundane things. Let's take something like revenue management. So in a team that does revenue management, they have one of the things they do every day is they have to download all the contracts that we signed the day before or through the week, and they have to read all of those contracts to make sure there's no terms sitting in it that are unexpected, that are effectively non-standard terms, because a non-standard term means that there could be a revenue recognition change that has to happen. And that's a very big deal for a finance team. That's the number one thing usually your auditors come into audit you on. The pace at which we are growing, the number of contracts every day is going up in multiples. So my only choice in a pre-AI world would have been hire more people. And imagine what those people's jobs are like. You come to work every day and you read a contract and then you read the next one and the next one. It is so mundane and such drudgery and it's not why people went to school and learned about the accounting field or thought about being a finance professional, but that's kind of the job we hand them as a mandatory level job. Today, using our own tools here at OpenAI, I now have overnight all of those contracts are pulled out of a system. They are put into a tabular database, the Databricks database in our case. The agent or the intelligence is able to go through. It shows me exactly what is non-standard and why it suggests what therefore the revrec is, but it also suggests the insight, which is should this term even be here. Did the salesperson just give away something they shouldn't have? In which case, I go and I coach them. Is it actually telling me something about my business? It's starting to shift in which case this non-standard term is actually should become a standard term. And I'm actually what I'm experiencing is a shift in my business model, which might actually be a good thing. Or perhaps I want to find a different way to help get the customer what they're looking for. The salesperson what they're looking for, but maintain my revenue recognition, my current business model. I know that my more junior entry level people are over on the right of that discussion, and they're refining the job they loved. That to me is why it's not a bubble because the value is real and tangible. It also means I probably can have a smaller team. I can have a much more high performing team, a much higher morale on my team, better retention rates for it. All of these, I can put into like numbers to say my business is now healthier. And I think that's the piece when the press is trying to lead with the bubble conversation or whatever they just miss that we are investing with demand. If anything behind demand at the moment, a bubble to me suggests you're investing ahead of demand and there's going to be a gap. And you look at productivity numbers. They're going up in the companies that are adapting AI, especially the newer set of tech oriented companies. The numbers are just absolutely amazing. So one of my favorites is a little company called Slash, about 150 million ARR. They have one person in the company, only a controller because they adapted an AI-oriented ERP system. They replaced NetSuite with it. And it's just amazing what they can do. And the CEO was apologizing to me. He might have to hire a second person. And they're moving really rapidly. I just saw a story. Somebody replaced 10 STRs with one STR and AI, essentially that one STR remaining super-wise. I've been hearing two stories about where instead of hiring somebody that's in an area that doesn't create growth, they can now then when they hire higher people that are created, a lot more growth for the company. And that's why you're seeing a lot of these tech companies just build so fast. You know, that old phrase, the future is here now, but it's not evenly distributed. Yes. I see all these single points of huge productivity gains and efficiency gains are agility gains, the ability to move faster. But very small percentage of the people in the world, in the US or worldwide have adapted these or even no things exist. And so this issue back to demand, I think these ideas, some of these examples, will spread to everybody over time. And you'll see an exponentially growth of adoption of these technologies. That's why I don't think demand is the question. Yeah. The node is absolutely spot on. I think McKinsey did a study that showed for companies that are more in the top quartile, their productivity is measured by any financial metric you would pull is up in the 27 to 33%. That's a really meaningful jump. I think where you were going is, it doesn't just mean fewer employees overall. There's definitely a place to shift people over into more growth oriented jobs. I was hiking this weekend with someone who runs a very large consulting company that you all would know of. And he was talking about how his, in his, what he thinks of on his back end systems, the leader there is now talking about her organization as people plus agents. And she has a one to five ratio, one person to five agents. But on the front end, they're actually back at rehiring to grow because clients need more help now to think about deploying AI. So it's actually shifting back, I would say, to the jobs people want to do, not the jobs that maybe were just open to them because more and more of the world had become this kind of, you know, so much information that people were parsing it. And now we're finally back to a machine and agent intelligence parsing it. I want to touch back on the consumer side. You mentioned to ads. And certainly the argument we made that with ads, you can increase the benefits to people. You can provide more services, more AI. You can help pay for the compute and people get more out of those tiers with that. But that brings up the question, though, of trust. And when people think about AI initially even asking questions, people worried about what does Chad she be to do with my information. Once you have ads in play, people worry about that because it's often just a big question of how does that affect the rest of the product and the org. Yeah. So I think you started in the right place, which is today 95% of our users use our platform for free on the consumer side. And that's absolutely where our mission is, right? AJ, for the benefit of humanity, not the benefit of humanity who can pay, right? So access is very important. From an ads perspective, I think number one, we have to just make sure everyone understands you're always going to get the best answer the model can provide you, not the paid for answer. And I think other platforms have fallen back into that where you're not sure it's a sponsored link or is this truly the best outcome? We have a north star, which is that the model will always give you the best answer. I think the second thing to understand is that there can be a lot of utility in ads. So we want to make sure people know when it is an ad that they're working with. But for example, if I do a search for a weekend getaway to pick your favorite city, I don't know, San Diego, an ad for Airbnb might actually be very helpful. And you might even want to have a discussion with the ad or with the advertiser in that case, in a chat GPT setting, it's very rich, but you're clear that it's an advertising setting. And I think this is where there has to be more innovation on what feels endemic to the platform, not just kind of the old world of stick banner ads on things. And I think the third and final thing for me is again, there always has to be a tier where advertising doesn't exist. So we give the user some choice and some control. But we're very mindful of your data. When we released health, we were very clear your data is off to one side. It's not been used to train on and so on. And I think we just need to keep giving users that kind of that trust is everything for opening eye and that we're going to stand by those principles even when it comes to things like ads. On the consumer side, is it going to be a world where you're going to have a lot of subscriptions to different AI services? I think you'll have every model. Most people will have more than one subscription. Media is a good example. Most people have more than one subscription media. And so that's a good proxy for consumer behavior. Different people will pick different choices, including free choices, which is ad supported media too. So even the same services you can get for pay or for free. I think you'll see a wide range of diversity. How do you think about though the expense of going to a different platform? So I like chat, GPT memory. I'm finding it more and more helpful because as I ask about one thing, remember something we talked about maybe weeks ago, months ago, pulse, which is today not widely distributed, but it's the way I wake up in the morning now. So it's so amazing. And when you start connecting it to things like your calendar, so it's not just saying, you know, you say are very interested in AI data centers, which clearly it must think I'm the most boring person on earth, because this is what I see a lot of. But it also says, hey, on your calendar, you're going to be sitting down with the node today. You know, remember a couple of these things, like it's so helpful. But if I am multi homing, I'm losing the benefit, which is not the same as if I subscribe to the Wall Street Journal, the economist in the New York Times. They're not really losing out. If I go read another places in the same way, or I'm not losing out. Yeah. So I do think memory is an important question. Whether they'll be one per wear or more than one per wear of the models. On each model, there'll be multiple services that may offer different trade-offs. Yeah. So even whether you're talking health or media, even on the opening of models, there's multiple people providing services. So that's what I was thinking of multi homing, but obviously I don't think opening has to be 100% of the market. I hope so. I'm going to say I hope so too. I'm okay with that. It's an interesting business model. I think it's hard for people to wrap their heads around because like Netflix is a great company, but there's only so many hours on the plan that people can watch Netflix, right? And mobile is great, right? I only need so many minutes of mobile per week or whatever to do that. With AI and intelligence, you can have more intelligence. I can buy more and get better answers and do this. And I think I'm still trying to wrap my head around about where that goes, the idea that you start at one level of free, use it for free, then you go to a smaller tier, and then as it becomes more useful, you start increasing that. Where does it go? So I think unlike something like Netflix where they're running so many hours in the day, I think of it much more like infrastructure like electricity. How much electricity do you use in the day? I don't know. I walked into a room today and there was a fan blowing. It was really nice. I cooled it down. There are lights on around us right now. There's so many, I charged my phone overnight and it worked for me all day. So I think that the state we live in today is much more, I call on chat GPTI and vocat as opposed to intelligence just being baked in. Like I think this will be the big change over the next couple of years. You'll kind of look back almost, it'll feel a little toy-like that we used to do this thing and instead it just is everywhere around us. So it's not really quite answering the question you're asking but it's that I don't get so caught up that there's only so many hours for people to do things because I feel like almost everything I do in life requires intelligence because I'm walking around hopefully with some intelligence up here. And if I can get that augmented, I think it's going to surprise us. Like as we were talking before we got started, you said about on your phone when you suddenly discovered you had a flashlight and a camera. It is, you say that, it's so obvious. And yet with chat GPTI, every time I discover kind of a what feels like almost a slightly cute use case, I'm so blown away by it. Like, yes, remorning. I do love the economist. I wanted to read the editorial. I didn't really have a ton of time because of running upstairs to get ready. So I took a photograph of the editorial because they're very good. They put it on one page and I asked chat GPTI to read it to me. And it did it. And I was like, oh my god, this is awesome. So I just think there are all these moments where we're just getting started and multimodal I think is probably the biggest because phones taught us to talk with our thumbs. And I think this new world we're moving into, there's going to be new hardware that just really help us understand that we can talk, we can listen, we can see, we can write, and do all of these things in a very human way that we're just scratching the surface off. So let me give you a different frame on that. I agree with all of that. If you look at what we talked about the internet earlier and the bubble associated with it, but what the internet did is give you access to a lot more stuff whether it was media, YouTube videos, or TikTok, or you name it, information of any sort. But it's expanded it to the point where no human can actually use the internet fully. I think of AI as given your limited to 8000 some hours a day, some of which is meant for sleeping, it'll make your time much more efficient. So the internet exploded information available to you to the point where you couldn't use it. And I think what AI will do is filter it to make your every hour the most effective hour if you know how to use it. So intelligence will reduce the world to what is most relevant to you personally. And I may have a different set of priorities than Sarah. So I think of intelligence as summarizing the world to the most relevant things for me and the most relevant things to her which are different. So I think that's where there's almost unlimited capacity for intelligence to be used to reduce information when the internet exploded information. Yeah. Yeah. We've talked a lot about consumer side and it feels like it opened eyes very much winning the consumer side. Question comes up about enterprise and how is opening eye and going to compete and win in that area. So I think we're already winning in this area. What I see is you know 90% of corporations are saying they either are using open AI or intend to use over the next 12 months right. I think the second is Microsoft and Microsoft using our technology. So I actually think we have this is where the consumer is a really potent part of the enterprise flywheel. So as I said earlier when someone you know you back in the day when you first started bringing your iPhone to work and corporates didn't want you to do that you just discovered you can't say no to the title wave that is consumer preference. So something I'm already using that I've already got in my pocket and I get to work my expectation is work is that least is good if not better. And so that's what's helped drive our internet our actual enterprise business fastest company ever to get to one million businesses on a platform and we did that in about a year and a half. But where to from here because clearly we're just scratching the surface. So some of it is certainly meeting customers in terms of their vertical so that we talk to them in their language and we learn this art of enterprise selling which is let me not tell you all about my products but let me understand your problem. Like what is your board forcing on you Mr. Mrs. CEO. What is the thing your customers most want that you can't deliver? Okay let's start putting intelligence against that we can then drop that down into some light vertical specialization to quite heavy vertical specialization things like RLing models that are very pertinent to a use case like let's say in an energy company it might be really understanding that particular oil well or all the seismic data they have to say what's the recovery we're going to get out of this gas field like that is deep specialization and then I think it gets the whole way to some of these big transformational research projects that we've begun where we're actually almost taking over someone's whole business and helping them rethink it in a smarter faster better way that ultimately drives their key business metrics. So it's a journey I think most corporates have started with wall to wall chat GPT that's an easy starting point they've done some coding and in many cases a lot of coding like when I talked to corporates they're not CEOs are starting to say things like 60% of all my production code was built by you know an agent and I'm like you didn't even know what you know production code meant 12 months ago but now you're saying that that's good because I mean you're tracking it but on agents it's just starting like we only see about 14% of all kind of customers when you go out and just survey US corporates are using something agentech today 14% when I just explained what's happening in my finance organization so I think we are just getting going but I couldn't be more excited about the opportunity it's huge. Okay but if I'm a startup and I look at everything Open AI is doing I might be asking is there room for me what do I get to do? The models we keep getting better and do more and more but I do believe there's lots of room to build on top you know no one company can do everything on the planet there's billions of people who are working that whose job AI can help with I don't think Open AI will specialize in everyone so I think the careful thing to do is is be clear where the models will go Open AI or others and what they will be able to do and how do you use that best to then specialize into a more interesting world? like some sort of specialization where you add something that's additional to the base models and frankly just intelligence isn't the only thing to provide a solution there's lots of other stuff that goes around solution beyond intelligence so I think there's lots of opportunity to build on top of these models and the more powerful they get the number of opportunities to add to it dramatically increases. How do you think about so I think a lot about use cases where there's already a lot of data that's being aggregated perhaps by that startup by that company that you know today I think 95% of the world's information actually sits behind corporate firewalls university firewalls and so on so there's even though we talk about the vast training that's occurred again we're just getting going but I think companies that have already built businesses that have aggregated that data have access to it and then on top of that have managed complex workflows so I often give the example of our procurement system procurement system per say not that complicated but what it does very well is it understands things like delegation of authority so it knows what the board has approved in terms of approval limits so it knows that when this software contract comes in it's over X amount so only I can improve it or if it's beneath that but it knows a VP can improve it it doesn't know that andres of VP but it knows to touch the HRS system and check what's his level and so the whole procurement flow can happen in a way where I have compliance and governance and hopefully makes just the whole company run faster those are places I get interested for startups so where have you got access to unique data with a complex workflow it feels like there's more of a moat around that that we want to work alongside you but you know the general purpose model is not going to do all of that itself yeah no I completely buy that because lots of opportunity I've seen quite a few startups around just permissioning around data yeah yeah like who can do access to what information yeah for example I've seen a whole bunch of startups around customizing to each company the models for their history and their priorities and the agent at the whole identity side of agents I think we're just starting to understand both the risk that can happen when you have agents talking to agents talking to agents but then also how are you going to permission that and then start to think about like agentic commerce like the the complexity that's coming is also quite big so to suggest there's no more opportunity as a startup I think it's never been probably more interesting or fun to be a startup yeah I think there's more opportunities than they've ever been what are you looking for now what gets you excited when you talk to a company well the hardest thing is great people always but I think the other thing that has been in short supply is agency where people sort of have the agency to make things happen that's again comes down to people but there's so much opportunity I think traditional things like knowing a space or experience and space much less relevant now it's more agency we've not talked about the whole new world of robotics and real world models and all that that's a whole space by itself that we probably don't have time for well do we have plenty of time I want to go yeah because we talked about where we're headed here and you you famously talked about kind of the role of 2050 and things are moving fast models are getting faster and more capable and where do you see things like robotics at it well I think two years ago when I gave a talk at Ted I said the robotics business both bipile and other robots will be a larger business in 15 years than the auto industries today we think of auto industries want the larger businesses on the planet and this other thing will be larger I don't think there's very many automotive companies who thinking of the world that way they're thinking about how do you use a robot in the assembly line not that that business is larger than their current business all driven by the intelligence of robots so massive opportunities for startups there and we're seeing a lot of activities yeah and we and I think sometimes we underestimate so when you think about robots in the home right people very fertile area a lot no one's really had a breakthrough though there's so many different issues around the complexity actually sometimes the more time I spend an AI they actually the more respect I have for the human condition in a way because our ability to move around the world and do you know if you watch like the people in robotics getting so excited about a robot folding clothes you know perhaps my 18 year old I'd be just as excited about but for the average human I assume they can fold clothes but I think but you do get a little stuck in your head that they have to somehow be a human but it turns out there may just be these breakthrough moments like for example a companionship in the home right we have an aging population what's one of the biggest you know we talk about epidemics in the world lonely as probably one of the biggest epidemics what does someone living alone maybe it's just lost a spouse value most just someone to converse with in a way that feels intuitive and human we see people using chat UBT more and more for this conversation but is there a humanoid ask breakthrough or it turns out you don't need it to make coffee or full clothes or do the dishes although that would be good too but it might just be something a little bit more simple that still adds a lot of value and is just the the first crawl of crawl walk run of this kind of future that Benota is talking about where that whole complex is X times more valuable ever than we saw in automotive's I think that it's it's interesting because we can sort of think of kind of like our present and put robots in places and do things like that it's really hard to think of when you really have extremely low cost labor manufacturing etc and then the world you can build from there because you know we can look at that's a good solution for now but when the cost of building a wonderful state-of-the-art assisted living facility where we can put a bunch of people together the cost drops I think that's the thing I have my the hardest problem is for me is to really think like what does it really mean when you lower the cost we learn the cost of intelligence what does it mean we really lower the cost of labor my personal view sometime probably to it then the the next decade you'll see a massively deflationary economy because labor will be near free expertise will be near free most functions will be almost zero cost how it exactly plays out a little hard to tell how purchasing power versus production of goods and services plays out but I expect we'll see a hugely deflationary economy at a level people on planning on this so there's social aspects of adoption of AI that hasn't been handled the at I think the conversation we need to have is what will people do I get asked that a lot how will people make a living I think the minimum standard of living governments can assure people is going to be much much higher without needing to on an income I mean I can't imagine much better primary care like 10x more primary care than today doesn't happen for a dollar a month I have a hard time imagining how that happens it will be true it costs almost nothing to have free primary care free education almost AI tutors for every personal tutors for every child that's already happening so there's a set of services that'll be free there's some hard nuts to crack housing is the hard one you know for people in the bottom half of the US population they spend 40 some percent of their income on housing and food so there's some hard nuts but I do think both are addressable by robotics and better approaches well this has been a very interesting conversation I'm excited to see where things are headed thank you both for joining us here on the podcast thank you thank you

Podcast Summary

Key Points:

  1. AI demand is currently limited only by compute availability, not by a lack of applications or user interest.
  2. 2026 is expected to see the maturation of AI agents and multi-agent systems for complex tasks in both enterprise (e.g., ERP management) and consumer (e.g., trip planning) contexts.
  3. A significant "capability gap" exists where most users utilize only a small fraction of AI's potential, analogous to early electricity adoption where people only used it for light.
  4. Healthcare is a key adoption area, with AI augmenting doctors and empowering patients, though regulatory frameworks need to evolve.
  5. OpenAI's compute investment directly correlates with revenue growth, and strategic expansion across infrastructure, products, and business models is necessary to fund the mission toward AGI.
  6. The AI boom is not a bubble when measured by real usage metrics like API calls, similar to sustained internet traffic growth during the dot-com era.

Summary:

The discussion centers on the current state and future trajectory of AI. A core theme is that demand for AI is virtually infinite but constrained solely by the availability of compute infrastructure. The year 2026 is anticipated to be pivotal for the maturation of AI agents, particularly multi-agent systems capable of handling complex, multi-step tasks in both enterprise and consumer settings.

However, a major "capability gap" persists; most users, including the hundreds of millions using ChatGPT weekly, leverage only a tiny fraction of AI's potential, similar to using electricity only for lighting when it could power many more appliances. Healthcare exemplifies rapid adoption, with AI augmenting medical professionals and aiding patients, though regulatory progress is needed. From OpenAI's perspective, compute investment is directly tied to revenue, necessitating a multi-dimensional strategy across cloud providers, chips, products, and business models to fund the pursuit of AGI.

The conversation concludes by arguing that the AI surge is foundational, not a speculative bubble, as evidenced by solid usage metrics like API call volume, which reflects genuine utility and growing integration into daily life and business operations.

FAQs

Multi-agentic systems, especially for enterprise tasks like ERP management and consumer applications like trip planning, are anticipated to mature significantly. Additionally, advancements in models, robotics, and real-world intuition are expected.

AI assists doctors by providing up-to-date medical knowledge and aiding in diagnosis, with 66% of U.S. physicians using ChatGPT in their daily work. It also helps patients research symptoms and manage conditions, like creating diabetic-friendly menus.

OpenAI observes a strong correlation between compute capacity and revenue, with compute scaling from 200 megawatts to 2 gigawatts as annual revenue grew from $2 billion to over $20 billion. Demand for compute currently outpaces supply, limiting product launches.

OpenAI is expanding from a single subscription model to include multiple pricing tiers, enterprise SaaS, credit-based pricing, and exploring options like commerce, ads, and licensing models. This diversification helps fund compute investments for AGI development.

No, the speakers argue that bubbles should be measured by real usage metrics like API calls, not stock prices. They note that AI demand is constrained only by compute availability, with underlying adoption showing sustained growth, unlike speculative market fluctuations.

The capability gap refers to the difference between AI's potential and how much users actually leverage it. Currently, only a small percentage of users utilize even 30% of AI capabilities, highlighting a need for better tools to transition from simple queries to complex task automation.

Chat with AI

Loading...

Pro features

Go deeper with this episode

Unlock creator-grade tools that turn any transcript into show notes and subtitle files.