Go back

Coreweave: AI Bubble Poster Child Or The Next Tech Giant? — With Michael Intrator and Brian Venturo

61m 54s

Coreweave: AI Bubble Poster Child Or The Next Tech Giant? — With Michael Intrator and Brian Venturo

CoreWeave, a company valued at $42 billion, is deeply involved in the AI industry, providing infrastructure for AI training and inference. They have built data centers across the US with a large number of NVIDIA GPUs. The company's success is attributed to its focus on parallelized computing and a software stack optimized for AI workloads, making them a preferred choice for many AI labs and enterprises. CoreWeave's differentiation lies in its ability to deliver a highly differentiated product that meets the increasing demand for AI computing. Despite the narrative that big tech companies could build their own data centers, CoreWeave's expertise in optimizing computing resources and providing tailored solutions has made them a valuable player in the AI ecosystem, allowing them to serve a wide range of clients effectively.

Transcription

10287 Words, 56836 Characters

Is AI a bubble or the biggest boom of our lifetimes? The fate of one company, CoreWeave, may tell us everything we need to know. We'll be back with the company's founders right after this. Fiscally responsible, financial geniuses, monetary magicians. These are things people say about drivers who switch their car insurance to progressive and save hundreds. Because progressive offers discounts for paying in full, owning a home and more. Plus, you can count on their great customer service to help when you need it, so your dollar goes a long way. Visit progressive.com to see if you could save on car insurance. Progressive casualty insurance company and affiliates potential savings will vary, not available in all states or situations. Welcome to Big Technology Podcast, a show for cool headed and nuanced conversation of the tech world and beyond. We have a great show for you today because in studio with us are the founders of CoreWeave, CoreWeave CEO, Michael Intrader is here with us. Michael, welcome. Thank you very much. Great to be here. And CoreWeave's Chief Strategy Officer, Brian Venturo. He's also here. Brian, great to see you. You both are running one of the most fascinating companies in the AI boom. Everyone has used you effectively as a Roshart test to read in their beliefs or insecurities about what's going to happen in this AI moment. Some people think that you're the poster child for the AI bubble. Others think that you're perfectly positioned to take advantage of the boom in building that is occurring as demand goes through the roof. A couple stats about you. As of today, the company is worth $42 billion. After an IPO earlier this year, you've built eight new data centers across the US in a third quarter alone. And the latest reported numbers have you in possession of something like 250,000 of NVIDIA's GPUs, which are the chips that companies use to run. AI models and grow them or train them as they like to say. Let's just start off with this because it's been heck of a ride for you over the past couple of years. What has it been like being on the front lines of this AI build out? Tuck a little bit. Help people feel it. The speed at which it's boomed and what it's taken to do something like build eight data centers in a quarter. It's exhausting. All right, so let's start with that. It's been exhausting. Yeah, it's, you know, you hit it that out, right? Like it has been incredibly exciting. It has been an unbelievable year. I mean, we just, we just IPO'd really eight months ago and it feels like it's been two lifetimes. The company is moving at incredible speed. We are building a massive percentage of the global AI infrastructure that's required to allow artificial intelligence to be what it is. And when I say massive, it's, you know, like a meaningful percentage. What's your estimate about the percentage? Oh, that's tough. You know, look, a lot, a lot is, you know, we don't, we think of, we think of ourselves as providing enough of the compute that that we have the ability to be relevant in the debate of how AI is going to be built and how it's going to run into the future. And so we don't know what the numbers are, you know, it's, there's, there's lots of different providers of technology they're being used and there's no real good way to kind of put your fingers on the data. But, you know, meaningful, right? And that's an exciting place to be. And it's, honestly, when we talk about this in the company all the time, it's a privilege to come into work and focus your energy, your creativity every day on building a component of this, this, of artificial intelligence, which is the issue of our time in many ways. And we get to really sit there every day and pit ourselves against those issues, which is great. I mean, I have a ball. I'm taking a shot at this hold on. Before we move on, I think that that's really around, let's call it the practical side of it, right? And when your company growing as fast as we have, where we had maybe 100 employees three years ago, now we have 2,500 employees or so, there's an emotional side of this too, right? And, you know, sometimes since the IPO, we've been under this spotlight in the world of like, what are they doing? How are they doing it? Are they executing or are they doing this? And, you know, internally, we always set the highest bar for how fast can we do something, how high of a quality can we do it at? And, you know, as this industry is expanded so rapidly, like, there are things that happen, right? And, you know, you have weather that impacts construction at a project, you have a truck that hits a bridge, like, you have all of these random exogenous or idiosyncratic things that happen in a supply chain. And then it comes back to us and it's like, the world is like, wow, you failed, right? And inside the company, from a culture perspective, it's been so important for us to manage, like, listen, we're doing something at a scale, no one's ever done before at a speed, no one's ever seen before. Of course, things are going to go wrong, but take perspective, like, see how much we've done, right? And, for our employees, it's, if you're moving at a million miles an hour and you hit a speed bump, it's okay, right? It doesn't change the trajectory of what you're doing. It just, like, it just provides the battle scars that doesn't happen next time. Yeah. Now, I can imagine it's a rough and tumble world trying to build this with very demanding customers, very important technology that you're deploying, and the speed is crazy. I mean, it is interesting looking at your founding story. You really started working on providing infrastructure for crypto. Was it like a theorem mining or something like that, and then pivoted in a very smart way to this AI moment, establishing a relationship with Nvidia, that we'll talk about that, that's proven to be very useful and helpful for you and probably for Nvidia as well. And now, you're, again, hyperdrive building data centers, and the data centers are, if I have it right, largely licensed, or the capacity is rented out, mostly the tech giants. I mean, the core customer is Microsoft, something like two thirds of the demand according to your, your public filings is Microsoft, but there are others as well. So, we actually spoke to a company, a customer concentration in our last earnings, so we can kind of, there's no customer that represents more than 30% of our backlog. And so, we've done an incredible job. It's been a focus of the company, everything from sales all the way through the build cycle to really begin to broaden the reach with which our solution touches artificial intelligence. So, Microsoft is an important customer, and a large credit worthy and formidable part of the AI ecosystem at large, but they are, we've done a really good job bringing on other wonderful clients, wonderful customers that are going to continue to kind of use our solution as they build their products and deliver them to market. Okay, and I definitely want to get into customer concentration in a little bit, so, but that's a good preface to what we'll touch on, and already some new data to me, so a good to hear that. But I wanted to, again, just get into what it takes to build these things, these data centers. You're assembling them with incredible speed, so I just want to hear a little bit about like on the ground. What does it take to put together these data centers? So, the, historically, let's say two years ago, we were able to go out and buy capacity or lease capacity that was much further through the development cycle, right? They were basically, the shell already existed, it was a fit-out construction process, which means going in and installing like the last, last pieces of the cooling infrastructure, cabinets, conveyance for all the cabling, all the hundreds of miles of cabling, we have these things. But it's shifted over the past year, is that now we're doing much more the spoke in-house design, right, to make sure that we're meeting the needs of what our customer's deployment is going to be, right? So, it's everything now from, okay, how is the cooling and electrical distribution designed? How are we ensuring electrical redundancy and reliability? How are we cooling the air cooled side of these things? Because you have liquid cooling, there's still a component of it that has to be cooled with air. I'm going to pause on that. Sure. These chips run extremely hot, right? So, the extremely hot cooling, people talk about cooling for those people who are coming to this for the first time. Being able to run an AI Dennis data center, you've got to be able to cool the chips if you want to be able to be successful. So, long-term. This is one of the things that I think the market misunderstands, right, is that everybody believes that there's some differentiation in the plumbing of the liquid cool data center, right? That's not where the differentiation lies. It's all the same pipe and valves and fittings, like everyone's using the same things there. The differentiation comes after you turn it on and how you control those systems, okay, right? And that's what we've done incredibly well as a company, that we've very consciously not spoken about externally for the past couple of years, because it is our secret sauce, is how we provision, validate, and manage those data centers all the way from the power, cooling, infrastructure, up through the GPUs, the servers, and it's why the most valuable companies in the world, the biggest AI labs, actually use us to run their most critical training jobs, right? I mean, it's herculean task, right? It's important to understand that when you're thinking about the ecosystem, right, and you're thinking about the different neo-clouds that populate in what's in the neo-cloud. So, the worst term ever. I hate it. Think of it as like, you know, in the common vernacular, you know, everybody knows who AWS is, you know, Amazon, they know who Microsoft is, they know who Google is. Those are the hyperscalers, right? You throw Oracle in there if you'd like. But then there's a class of providers that can deliver this infrastructure and, you know, we are the leader among that. And what is important to understand that if you took all of the other neo-clouds and added their GPUs fleets up, we would still be a multiple of all of them combined in terms of the number of GPUs that are up and running and delivered to clients. And so, when Brian is talking about, you know, things that the market is struggling to understand, it is, it's important to understand that what differentiates us, what's allows us to be as successful as we have is that the software suite that we have built allows us to take the commodity GPU and deliver a decomoditized premium service that allows people to extract as much value from this infrastructure as possibly can be extracted. And that's really what Corviv is doing. And it's why when Brian says, hey, you know, the leading companies in the world and the leading labs in the world are relying upon us to deliver our service, that is why. It's because the product that ultimately they receive is the product that will allow them the greatest probability of being successful at using the GPUs to deliver the products that their company is building. Right, so just to put it in plain English, always helpful for me. When a company, like a Microsoft, will work with you on building infrastructure for artificial intelligence, you've built some proprietary pieces of the puzzle, like your cooling system, like the software that runs the data center, and that allows them to get more out of the chips than they would have typically. Yeah, and the nuance here is that when you build one of these data centers and it has 3000 miles of fiber optic cabling, and it has a million optics that connect into the switches. Like these things all fail, right? And when they fail, the way that training jobs are run today is if one component fails or one component limits the performance, the balance of the training run is going to be governed by the worst performing component, right? And our entire job is to build the automation that predictive analytics, you know, the machine learning models around saying, okay, we're seeing a problem here, how do we gracefully handle these things? So it has the least impact on our customers' jobs, right? And that's the core we've secret sauce. Okay, is that we have the world's largest data set of how these things run, how they fail, and we've built all the recovery mechanisms, and the software intelligence to help our customers run these things. Is the demand that you're getting from your customers? You mentioned you know training very well. Is it mostly training the AI models? Because, well, that's what a lot of the infrastructure has been used for, build scaling these models, throwing more compute at them, throwing more data, making the models bigger, and then the ideas that the models get better. So are you seeing most of your demand in the training side of things, or has it gone to inference where like companies are actually using the models and deploying them into production? It's a great question. And I think it talks to the split or this kind of delineation of where the market's been for the last three years and where it's going. You know, our customer base for the last three years has primarily been the largest AI labs and enterprises that are building the capabilities of AI, right? And it's now shifted from the people building those capabilities to the people that want to use those capabilities to change business outcomes. And this is where all the enterprise adoptions coming from. You know, it's one of my favorite services out there is Lovable, right? You go to Lovable, you can build any app you want. There's a chatbot that helps you go through it. You know, we're finally starting to see people chain together these capabilities to build real products that solve problems. And our business for the last three years has really been around the creation of those capabilities and has very quickly shifted to include not just the creation of them, but the deployment of them and use in business practices, right? So one of the things that I didn't expect was that what looked like training two years ago is how inference was going to look today, right? Is that you're still dependent upon highly connected storage, you know, your backend networks become critical to this because the models are so large. So there's really no difference between training infrastructure we deployed to build those capabilities and what our customers are ultimately using to serve them. So has inference overtaken training for you? We serve a tremendous amount of inference, but you know what, no, I actually don't know the answer to that. Six months ago, I would have said it was two-thirds training and one-third inference. It's probably close to 50-50 now. Okay. But there's also some of our big customers that they go from, they'll use a campus for training, those launch new product, they'll have to spill over for inference. You know, a lot of this is very dynamic and it's been built to be so. Yeah, I just made provide a segue to some of the other subjects that you'll ultimately get to in this podcast, but you know, for me, watching inference, understanding that inference is the monetization of the investment in artificial intelligence is one of the most exciting trends that exists within AI. And we have a front row seat across the entire cross-section of almost every large, important lab that's building this stuff and watching them increasingly move from, let's say, one-third inference climbing towards 50% and at times, it's even over 50% of the fleet being used for inference. It's just an amazing indication of the scale of the demand to use artificial intelligence to serve customer inquiry. And that means everything. All right, one more question about this. Yep. Why does Corey need to exist? I mean, we're talking about these big companies like Microsoft. Why wouldn't they just build their own data centers? Why are they licensing it from a third party? So it's a great question. There was a void in this market, right? And there's a couple of pieces here. The biggest clouds in the world today are built off the cash engines of peripheral businesses, right? Google's built on search, Amazon's built on retail, Microsoft was built on enterprise software. We came pretty much out of nowhere, right? And are the moment in time for us to be able to get ourselves into this position was driven by crypto, right? You mentioned earlier that we came out of, you know, Ethereum mining. We were able to leverage the revenue from Ethereum mining to go out and build and deploy additional scale so that when crypto went away, we had the infrastructure in place and we hopefully had enough clients that we became like we were an escape velocity, right? So, you know, we recognized that compute was going to be valuable. We didn't necessarily know at the time what it was going to be valuable for. Like, I don't think Mike and I ever had this idea of like, there's going to be this hundreds of billions of dollars a year and CapEx for AI, but you know, we had the thesis that compute is going to be incredibly valuable. We wanted to own a lot of it and we looked at that compute resource as an option. Like, and we said, okay, what are the best things that we can do with this? And that's how we've always approached different business problems, right? It's like, what is our asset? How do we monetize it the most effectively? What's the most valuable way to use this? So, I'm going to jump in here on this, but I want to go back to something that we kind of talked through as we started this, right? Is that like, we've built a software stack from the ground up to optimize for the use cases associated with parallelized computing. We do it better than anyone else. The reason we exist is because we deliver a fantastic product that is highly in demand. And incredibly differentiated. And so, you know, we serve the largest players, but we also serve a ton of other AI companies that are building applications where they have the choice to go and use us or to go and use one of the hyperscalers. And many, many, many of them choose to use our solution because it allows them to more effectively deliver computing. And one of the things that's really just lost on this is that there's not an understanding of how fundamental the change from cloud 1.0 into cloud 2.0 as you move from, you know, sequential computing into parallelized computing. And when you made that leap, right, from, you know, hosting websites and data lakes into driving parallelized computing for artificial intelligence, it stands to reason that a fundamental change in how compute is used will also require a fundamental change in how you build the cloud to serve it. And we took advantage of that transition to build best-in-class solutions. Right. And that's why we exist. So, I've heard an argument made that basically the big tech companies, you know, to build these data centers, they have to forecast to hand out years in advance, it's a massive capital commitment, they're not sure whether it will pay off. And CoreWheave is useful to them because you're taking the risk and then they will be able to use your capacity and sort of rent it out as opposed to having to make these big investments on their own. And, you know, it's their as is if things go wrong. Yeah, look, you know, that is a, that is a narrative. I don't think that actually tracks with the reality of the situation. I think the reality is situation is is the large hyperscalers are building as fast as they can. Google went out and just, you know, released a press release where they're building $50 billion worth of infrastructure while they're still buying from everyone else they can. Microsoft is building internally and they're buying from, from, from lots of other plays. What, what I feel like that, that argument is model fitting, right? It is somebody's got a preconceived notion of what this is going to look like and now they're reconstructing the factual, the facts on the ground to fit that model so that they can say, look, I'm right. But the reality is is that I look at it very differently, right? I look at the way that we built our competitive advantage over, you know, the hyperscalers, the way that we built our competitive advantage over other, uh, neoclots and the way that we did that is we understood that this type of computing was going to be important and we built the infrastructure and the software to be able to serve it when the demand emerged and we did it in a very risk-managed way. When I look at the future, when I think about, the, the, the investments that go into building a, an AI factory and I think about how much money is being put into the data center versus how much money is being put into the compute that goes inside of the data center. I think about the data centers as being basically an option on being able to provide and be relevant for the delivery of compute into the future, right? We take our risk dollars as a company and we invest in the long poles and the long poles are really twofold. One is building the best software in the world and the second one is having access to the data center capacity to be able to deliver compute when a wave of demand hits this market that requires you to deliver it. You can't just wake up and say, hey, I want to deliver a gigawatt worth of, uh, infrastructure. What you have to do is you have to start years in advance building that gigawatt of infrastructure so that you're in a position that when your customers say, hey, I just produced a new way of using AI that's going to require a gigawatt worth of infrastructure, you're able to serve it. We're going to have a tremendous portfolio of infrastructure that is going to be able to be deployed into the future and we're really excited about that. We think it's a wonderful way to go about building our business. Right. And and that's the question about the bet, right, is that um, you're betting that AI is going to continue to be adopted at a wild rate. That's not entirely accurate. Okay, let's hear what we are doing is we are making the majority of our investments by taking long term contracts from credit or the entities using those contracts as a way of raising money to build the infrastructure where the demand and the credit and the capital has already been, uh, um, secured. Right. So let's say 85% of our exposure is to deliver compute to investment grade or AI labs or other large consumers of compute. Right. The other 15% is our exposure to long term contracts to be able to do that exact thing in the future. And that's the way I look at it. I think it's a much better way to think about how we're taking on risk, how we're dealing with leverage and how we're positioning ourselves. If the market continues to grow, we're in a great position. If the market stabilizes in an around this, we're fine. If the market contracts, there's some new technology, then we will be left with some portion of that 15% that we may be in a position where it has to wait for a few years before the market grows back into it. And we are fine with that. We think of it from, and, and, you know, people have talked about how the founders of this company kind of look at the world with the different lens because we don't come from Silicon Valley, you know, we come from the commodity space, we come from Wall Street, we think about option value, right? When we think about compute, we think about what is the option value associated with it? When we think about the data centers, we think about what is the option value to be able to build to be relevant in the future? And that's the way we kind of go about allocating our risk and securing the contracts that we have in place right now. Yeah. And, and, you know, to speak to one thing here, you talked about if the market contracts, I think that we would love for that because it presents tremendous opportunity for us. How, right? I mean, you're in a position where there's going to be distressed assets, there's going to be consolidation possibilities. Like, that's when opportunity really comes in, and, you know, there's a lot of times where we sit there and say, okay, we're looking for M&A, we're looking to invest in things, but the valuations don't make sense. And for Mike and I, you know, we've made our careers on waiting for those opportunities and saying, okay, these are the things that I want to buy when things don't necessarily go right for them. Right? And, you know, that's really what excites us. You know, one of our, one of our other founders last week, he got on the phone with me, he's like, I love this Brian. I'm like, what Brian? He's like, this is the one where you start. Like, you're so focused on like, where are the opportunities? How do I go, take things over? And, you know, it's, I say it to some people every once in a while, is that I feel like when there's headwinds in the market, it's actually easier to do this job. Right. Right. Then when the tailwinds are kind of blowing it a thousand miles an hour. But can I ask how have you set up the company to make sure that you're not the distressed asset when the contract, if I mean, look at our, look at our construction of customer, of our customer contract portfolio, right? Is everybody last year talked about how customer concentration and exposure to Microsoft was a bad thing? But they have a better balance sheet than the US government. Right? Like, I'm not worried about them performing in their long-term obligations to us. Like, that's basically the best possible position we can be in. And we've been super thoughtful about the way that we choose which customers to work with and how we manage the credit exposure. So that we're like, we're certain that the investments we make will be paid back. And if you look at the people that are providing us the, the debt to do those projects, like Blackstone, right? They're the, some of the most sophisticated people in the world. And for their underwriting committee, committees to come in and say, yes, I want to do this, and I want to scale it up as aggressively possible. Like, you're telling me you're going to pit some financial analyst against John Gray? I'm going to go with John Gray. Yeah. Well, you know, I mean, maybe a second on just like kind of one of the fundamental building blocks of how we have expanded the way we have and how we use debt. Because I think that's one of the misunderstood components of how you build or how we have built this company. And so it is really important to understand that we, the way that we build the components is, we go into the market, let's use Microsoft, because we've used them, but there's lots of other clients you could use and they're totally interchangeable. From the perspective of the structure is still the same. We go to them and we say, hey, you know, we've got, we've got access to, to this data center, they say we need compute, we say, okay, we're going to sign a contract, they sign a contract for five years. We structure that contract in a way that we can go back out to the black stones of the world and we can borrow money from them to go ahead and build the infrastructure to deliver to Microsoft. Within the five years of the contracted period with Microsoft, we pay for the infrastructure, we pay for the op-ex, we pay for the interest, and we earn an enormous margin on the infrastructure. So yes, there is debt. We're not arguing that. We believe fundamentally, when you build any type of infrastructure at this scale, debt is the correct way to go about doing it. The examples run through history, whether you're talking about building a power plant, building a distribution grid for electricity, whether you're talking about the telephone, whether you're talking about the steam engine and railroads, like you go throughout history. This is the tool that you use, right? We didn't invent anything new here. We just took a tried and true method and applied it to the specifics of depreciation associated with this asset, of the obsolescence curve associated with this asset and made the contours so that it worked in an airtight manner so that guy is like John Gray or Blackstone or any Black Rock or any of the big lenders could look at it and say, I understand how they're going to underwrite this. I understand the risk in this. I understand that these guys are going to deliver compute to that balance sheet. They're going to get paid back. And when they get paid back, we're going to get paid back. So let's lend them the money. And that's lost on the market. They think we're running around with this incredible capacity to take on risk, but that's a really low risk approach. Matter of fact, it's way more low risk than saying, hey, we're going to do it on equity because we're saving our equity for the long polls that you've got to invest in. That's where you want to put your bullets. You want to use the debt markets to deal with a depreciating asset. It's the way it's done. It's the way it's been done throughout history. Yeah, by the way, it's great that we're able to have this conversation. This is what we want to do on the show is take this complex stuff, talk about what the reactions have been in public speak with the principles and actually get the story. So thank you for talking it through with me. And on that note, let's continue. The argument I think that would be made is not that Microsoft isn't good for the money. The argument would be made that General AI is still a developing category. It hasn't really shown the ability to turn consistent profit. And so the companies that are investing in a big way in it may one day wake up and say you know, we can't we don't really want to do that build out. Open AI, for instance, let's just use them as an example. They have something like 1.4 trillion committed to spend on infrastructure. I think open AI might be the only ones that believe that they'll actually spend that 1.4 trillion and maybe they're investors. So what do you think about that risk that AI is because AI is new and not as predictable as you would have in a different category, you know, financed by debt, that therefore it is riskier even if the credit rating of a company like Microsoft is golden. So when you're couple of things on open AI because they're, you know, they are the tip of the spear in many ways for artificial intelligence. They have a franchise that has 800 million monthly users of their product, which is fully one tenth, one out of every 10 human beings on the planet. Yeah, logs on to open AI as a growing tech product in history. I use it all the time for everything. I am addicted to it. And I don't even find it in like a bad addiction way. It's an amazing product. I won't argue with that. So you've got this product that's out there. And then you have this 1.4 trillion dollars, which I believe has been confirmed by everybody, but open AI who would actually probably have issues with that number in terms of how much they're spending when they're going to spend it, what are options, what are firm, all those kind of things. And so I just think it's a, you know, there's an incredible amount of people out there that are talking through how this is going to be done, when it's going to be done. And I don't think that they necessarily have all the correct information. That's number one. Number two is that, you know, you listen to both Brian and I talk about how we think about credit. We're pretty sophisticated how we think about credit. We've built our entire careers long before we started this company thinking about risk management and credit. Open AI will be a percentage of our credit exposure. Just like Microsoft will be a percentage of our credit exposure. And the way that you manage credit against a unbelievable potential company, but a company that may not have the credit rating that is strong enough to support their aspirations or they may have to tone it down or they may is you just make them a limited percentage of your overarching business. And you accept the risk on that while you mitigate the risks using credit from other companies like meta that we signed a $14 billion contract with like Microsoft. I mean, it's just incredible companies. And so you just think of them as how much investment grade exposure am I going to take? How much non-investment grade exposure am I going to take? And what's the correct ratio? And how am I going to mitigate that over time? And that's the way we look at it. And what happens if one of these companies over time wants to walk away? Let's say meta says, yeah, actually artificial intelligence, we can develop it much more efficiently or Microsoft says, yeah, AGI is actually a decade away, not three years away. Yeah. So AGI being a decade away, six decades, it doesn't matter. Like the way you were asking about how you run a company in this dynamic environment, how you run a company that's going through this type of scaling. And I talk about this internally to the company all the time. We need to be directionally correct. The world is incredibly fluid. The world is incredibly dynamic. We are at the absolute bleeding edge of a new technology that's redefining the world. You're not going to get everything right. But directionally, you have to go ahead and build a company that's moving in the correct ways to be able to take advantage of this super cycle that's going on. What do I think if meta says, hey, we're going to, you know, we're not going to continue an invest? That is their prerogative as a company. But that doesn't in any way mitigate their contractual obligation to us through the term of the agreement that we went to Blackstone with and said, we're going to borrow money because we have a firm contract with meta. That's not open to renegotiations. They can't say, yeah, you don't want this. Like the current set is, is, is, and you know, there was a wave of this that took place, you know, about a year ago, Microsoft is walking like, what are you talking about? This is a AAA company. They don't walk away from anything. If they make a contractual obligation, that's a contractual obligation. The, even the idea that they would walk away from it is deeply misleading to the market. Okay. There's been some analysts that have talked about one more thing on debt, then we'll move on. Some analysts that have talked about core weave borrowing more money because they spend more money than they can get structurally. So they borrow to pay interest on the last loan. I need to talk about how these, like these actual debt instruments are structured from like the box perspective and how the controls around these things are, like that'll put this to bed. Yeah. So like let's just be done with this. Yeah. There's a lot of, a lot of analysts that have a lot of opinions based on a deeply incomplete understanding of how these are built. So maybe two seconds on it and Brian, you can kind of keep me on the rails here. I'm pushing you off the bridge as much as I can. But like, once again, going back to the contract, we did a contract with Meta, right? When we did a contract with Meta, we go ahead and we sign the deal with Meta. We go, we borrow the money from syndicate of landers and then we go and we buy the infrastructure to build that facility. We run the facility. When we run the facility, as we're delivering GPU capacity to Meta, Meta sends money, but it doesn't come to us. It goes into what's called a box. Money flows into the box and then it goes through a waterfall. The first thing it does is it pays off the op-ex associated with the power and the data center. The second, after it's done paying that, the second thing it does is it pays the interest to the lenders. The third thing it does is after it's paid all of the expenses, is it releases back up to our company and also principal and principal and interest. So that it completely amortizes within the five-year term of the contract with Meta. But there's no, it's controlled by somebody else. And the important piece of this is like it's not that it's, hey, we just barely pay off the interest. The coverage ratio in that box is excellent and it can be underwritten at a very narrow spread based on the risk analysis of the most sophisticated lenders in the world. They're not lending us this at 22%. They're lending this at, you know, 250% over, excuse me, 250 basis points over, so far, right? Which means basically they're looking at it as like, this is a low risk transaction to get their money back. It's not some crazy, you know, you know, yolo structure. It's an unbelievably risk mitigated structure that's built to simply go ahead and allow us to build the infrastructure, deliver it, and then take the revenue. Now, when you're scaling a company at the rate where scaling, it tends to make sense that you're going to be investing all over the place. And we are. We're investing in data centers. We're investing in software. We're investing in people. We're investing in, you know, the companies that we're buying to help us reach up the software stack and provide more value. We're doing all of those things, which is exactly what we should be doing right now as this space opens up. Whenever we see an opportunity, we look at it against all the other opportunities that are out there and say that one makes sense for us. It drives the company forward. The idea that you're at risk from the debt, I mean, any time you have debt, there's risk. I'm not going to argue that point because you have to generate revenue. But what are you talking about? You're talking about operational risk on the GPUs that are in the box, right? You know, one of the things for us and why are spread on that interest rate is compressed over the last two years is we've demonstrated incredible capacity and capability of delivering that infrastructure. The first time we did one of these debt syndicates, I got paraded around the whole world that had to sit with every single underwriter, being asking me questions about what are the doors to get into the data center? What was the floor made out of them? Okay, guys. There was so much risk around our ability to operationalize it. That has been put to bed now where everyone knows that we can do this and we can do it at scale. That cost of capital is significantly compressed. I mean, it went from, you know, what was it? So far plus eight hundred to no, so far plus 1350 down to so far plus four hundred, right? Once again, like for those who don't understand what that means is the higher the the higher the interest rate, the higher the risk. And what you're seeing is the lending market understand that we have the capacity to deliver this infrastructure and that they are willing to lend us money at increasingly lower rates because they look at it as a lower risk transaction. Okay, I have so many more questions and we have only 15 or 20 minutes left. So let's take a quick break and come back and talk about a few things that I find really fascinating. That is the depreciation on these AI chips, maybe a little bit about the financing structures and then power. I think we need to talk about powers. Let's do that when we're back right after this. You want to eat better, but you have zero time and zero energy to make it happen. Factor doesn't ask you to meal prep or follow recipes. It just removes the entire problem. Two minutes real food done. Remember that time where you wanted to cook healthy but ordered pizza? You're not failing at healthy eating. You're failing at having three extra hours every night. Factor is already made by chefs designed by dietitians and delivered to your door. You heat it for two minutes and eat. Inside there are lean proteins, colorful vegetables, whole food ingredients, healthy fats. The stuff you'd make if you had the time. Head to factormeals.com/bigtech50off and use code bigtech50off to get 50% off your first factor box plus free breakfast for one year. The offer is only valid for new factor customers with the code and qualifying auto-renewing subscription purchase. Make healthier eating easy with Factor. We're back here on big technology podcast with the founding team or two-thirds of the founding team of CoreWeave. Michael and Trader is here. He's the CoreWeave CEO and Brian. The touro here is here. He's the CoreWeave CSO Chief Strategy Officer. We talked previously or in the first half about how these chips run hot. Let's just talk a little bit about the life cycle of these chips. I'm trying to figure this out. There's two differing opinions. One is that GPU like the Nvidia H100 or the GB200 will burn as hot as it possibly can for like two or three years and then effectively be useless like meltdown. It's like the life cycle of a car compressed into a couple of years. The other side of it is that the GPUs can last but they get less valuable over time because more powerful GPUs come out that are multiples in terms of their ability to do AI calculations compared to previous generations. Can we just start with the basic physics of this? How long do these things last? Last year is when we saw the hyperscalers that were around in 2010. Amazon, Microsoft, and Google finally retire their Nvidia K80 fleets. The K80 was a GPU that was introduced in 2014. It was active in their clouds almost fully utilized for 10 years. The number of changes in architecture and efficiency advancement and performance advancement over those 10 years was massive. Just last week, we entered a multi-year contract to renew Nvidia A100s, which are the GPUs that were introduced in 2021. We're already going beyond the five-year contract life for GPUs that came out four years. The idea that these things burn out in two or three years, it's kind of bunk. From a physical perspective, within three years, these things are all still under warranty. If they break, they get replaced. This is not they run hot. These things are designed to run hot. GPUs that we had deployed in 2019 are still running, still have customers on them. Some of it is customers that are deploying Grace Blackwell with us today. They're going to use Grace Blackwell for their most frontier or bleeding edge use cases. They're going to train their biggest models. They're going to do the things that they need the newest latest chip. It's Nvidia's latest chip. The things that they need the most firepower to do and they're going to run their inference on hoppers or they're going to run their inference on ampere, the A100s, or they're going to run different steps of their pipeline on A100s or they're going to run parts of their pipeline on CPU compute. There's always going to be a use for these different levels of compute infrastructure. It's just where is the economic value there? It's not a useful life question. Where is the economic value in that time? This is where the questions start to build up, because the chips run. We agree on that one. Now I've been taught. Thank you. The chips run. Now, the question is, when it comes to power, right? Let me finish this question and you can answer the last one, but I just want to finish this one. I really do want to hear, but let me just put this out there and then you can answer whichever way you want. The old generations of Nvidia GPUs, they're much less powerful than the newest generations. There's the great black well that's out now. There's a viewer Rubin that's coming out. The argument is that these newer chips, even if the A100, the hopper, can continue running, the new chips are so much more powerful than the value, because those A100s are being sold at $20,000, $30,000 a pop. The value of those chips are going to be much less because of the power of the newer generations. Then if you think about it again, if these companies move from training to inference, right? If, for instance, let's say hypothetically, there's a diminishing return to training the bigger model, then those more powerful chips can be used to run inference, and then a company like Koroi, which has hundreds of thousands of the older generation of chips, is faced with a depreciation problem compared to the most powerful ones. So let's go through this couple of different ways. All right. I feel like the depreciation narrative is being spun up by folks. Yeah, people that don't understand the space. They've never been in a data set. So my theory here is it's being spun up by a bunch of folks who couldn't spell GPU two years ago, and now they are out there as experts on how it actually works. So let's actually go through the different pieces of it. The most important tool that I have for understanding what the depreciation curve or the obsolescence curve of computers is not what I think, right? It's not what, you know, some historic short things. It's what are the buyers, the most sophisticated companies in the world willing to pay for today? And when they come to me and they put in a contract for a five-year deal, or a six-year deal, in what world do I not think that they who are the consumers of this understand that there are new, more powerful chips coming out? Of course they do. They understand it, but they also understand what their various use cases are, and they are saying to themselves, I'm going to buy this because I'm going to need it today. I'm going to need it three years, and I'm going to need it in five years. And what the use is within my system will change, but it didn't become useless. It hasn't become obsolete, right? And they know then do stuff's coming, yet they're still buying it, because they know better than someone who doesn't know anything about how compute is used. My opinions around depreciation are informed by the only entities that get to vote in my world, which are the folks that are paying for the compute over time. Those are the guys that get to vote. Everybody else is just looking at guessing, right? That's number one. Number two, is Brian kind of made a point that we just had somebody come back and re-contract for a term, for a term deal, the H-100s. No, at H-100s, at 95% of the value of what they were originally sold for. Once again, not showing this catastrophic depreciation curve that has been voiced out there. I just, once again, for me, it's about the data, because I need to make the decision to buy this infrastructure or not to buy this infrastructure. And so I've got to kind of look through the noise and decide, you know, are the big hyperscalers, are the big labs, are the big buyers of this infrastructure who are looking at this saying, this stuff will be useful for us for the next five years. Let's go ahead and buy it. Or should I go and turn to somebody who's never really understood how the cloud works, what a GPU is, what are the different uses as it moves through from the most cutting-edge models to other uses within the training as they go all the way down through inference to simpler, smaller models. And I think that's the way you got to look at this thing. It's like, what are you talking about, man, if Microsoft and Meta and the other big buyers are coming in and buying for five and six years, I don't really think that anybody else really should or gets to have what I would consider to be an informed opinion on depreciation. And since I'm selling on term contracts specifically to insulate my company from the depreciation curve, right? I know how much I'm going to make because I've sold it to Meta for five years every hour of every day. And they're going to pay for it every hour of every day. What the curve looks like inside of that five years, that's already been priced into the deal I did with. Sorry, good. Sorry. Well, I was trying to interrupt you there because I think that the, in addition to the H100s which came out in 2023, right? We signed a term contract for the A100s. And like within like the 95% of an original price range for on, like on term last week or two weeks ago, like that's crazy. Those GPUs are already five years old. And they're like that useful life is there. And everyone is saying, oh, it's not useful. Like, they have no idea. They don't actually have the data. We're sitting on all this data. We talk to every single one of these customers. And you know, one of the interesting things that happened over the past years, everyone was saying, well, where are all the enterprises last year? And the enterprises weren't there because every AI lab in the planet was like, was in a food fight for capacity. And the enterprises couldn't fight their way in, right? And now as we're finally getting enough supply to make it available to many people, like the ground swell of enterprises that are coming into use this stuff is overwhelming, right? To the point that we're, we're still choosing what customers we want to work with, right? We are like, this is a supply constraint environment, right? And the supply constraint keeps getting tighter and tighter and tighter, right? For these customers. Okay, I have two more questions. Hopefully we have time to get through both of them. Let's do it. We got to talk briefly about this circular financing question just to set it up. In video, owns 5% or so of core weave according to reports, it has agreed to spend 1.3 billion over four years to rent its own chips from core weave according to reports. And you also buy the GPUs from Nvidia. So can you talk a little bit about like, is this too tight of a relationship? Is this like sort of demand, you know, sort of propping up supply, which is propping up demand? Nvidia has made two investments in core weave. They made an investment of 100 million dollars and then they made an investment of, and that was early, that was in the the B-round, I believe. At a $2 billion valuation? Yeah. And then they made an investment of $250 million at IPO. Core weave has raised $25 billion to build and scale its business. I'm pretty sure that they don't think of their investment of $300 million as the secret sauce to standing up the largest company in the world. It's just a ridiculous narrative. So look, the reality is, is you've got a systemically imbalanced market, right? There are not enough GPUs out there to go ahead and support the demand for compute for artificial intelligence. And when you have such a disequilibrium in a market, it is not unusual to see companies working together to try to align interests and drive compute build out, or any other industry as fast as possible. Nvidia has been a wonderful partner of ours. And they have entered into a relationship with us, which is great. They've entered into an invested in other companies, which is great. They're trying to invest in the ecosystem and cultivate the build out of what they considered to be, you know, a generational change in the way the world is going to work. And I agree with them. But do I think it is circular financing to invest $100 billion hoping that we're going to then go ahead and spend billions and billions of dollars? It doesn't make any sense, right? You know, what their strategy is, I don't think it's really prudent for me to kind of guess at what Nvidia is doing. I think of it differently. I think of it as there is a relationship that exists between us and Nvidia. We provide the most performant configuration possible of their infrastructure and deliver it to the consumers of computational power. And they appreciate that. They build incredible infrastructure that allows us to build our business and we appreciate that. And, you know, it's sort of like you're being distracted by a fly on the butt of the elephant. And, you know, that's what this is. You're talking about a very diminimous sum of money that was invested. I mean, it's a lot of money, but not in the scope of what we're talking about here. It's a diminimous sum of money from the perspective of, you know, the company is worth $40 billion. It was just a good investment. They looked at what we did and they said, these guys rock. We're going to invest in them, right? So, you know, once again, depreciation is one of the narratives that you hear continuously, circular financing is one of the narratives you hear and bubble is one of the narratives year old. The other way of looking at it is just the largest companies in the world can't get enough computing. They're desperate to get their hands on it so that they can serve their clients because it is profitable for their business. And, that seems to have a lot more there there to me. Right. I know we're running out of time. Can I just ask the power question? And then we can head out. Satya Nadella was on a podcast recently and said he has more chips than he can plug in because the power is basically the constraining factor for him. Yep. There's been so much. I mean, we talked about you guys building eight data centers in the most recent quarter. So much build out. People are talking about how it's going to maybe even raise consumer prices for energy. Is power the limiting factor for the continued ability to build out AI infrastructure? So, the constraint moves, right? And right now, I don't think that power itself, meaning grid connections and the generation capacity is the limiting factor. Right now, it's the construction and trades. So it's human labor and supply chain that are limiting factor is that you went from a market that was building maybe one gigawatt of data center capacity a year to a market that's building 10 gigawatts of data center capacity a year and all of the trade unions, like they don't scale the same way, right? And you're in a position where you may have had a labor force of a thousand people building a data center and 200 of them were experienced tradesmen that had apprentices. And now you have 1,000 people and 20 of them are experienced tradesmen and everyone else is kind of apprentices. And you know, that stretches the supply and construction, you know, supply chain very, very thin. So I think you're running into just this like temporary transient problem of projects are taking longer than people thought they would, right? That's the big blocker is that you walk in and you say, okay, I have a data center being turned on next week and during your energization process something goes wrong. You know, okay, now you're set back by 40 days, right? There's hiccups that are happening along the way because things have gotten so stretched, because demand has been so insane and has been increasing at a step function every six months for the last three years. But the power is there. The power is there today. Oh, yeah, that's the key word, right? It's like it's it's this is a you got to think about this stuff over time, right? What will happen is data centers will be built power within the grid will be consumed. And as that power gets consumed, they'll need to be new power brought online in order to provide for the future growth as well as all the other uses for power that are are required in growing, you know, independent of artificial intelligence. And that will be a challenge for the US grid over time. It will be the challenge for you for grids all around the world. But at the moment, it's, you know, what what is the problem that you're facing today? What is the problem? You're going to be facing in three years in three years. Power is going to be an issue today. It's it's it's it's power choice. But power is going to be an issue until somebody like some college kid at Stanford is going to come up with a better way to run this in the software side and they're going to generate crazy efficiency. It's like we saw that with deep seek back in January. The world freaked out that this all of a sudden got more efficient. We needed to happen like 10 more times, right? It's like those efficiencies are good. It brings in new use cases. It lowers your cost like your cost per token or cost per task. And for this to be like to really permeate society and develop the most like the most good for humanity, we need the cost to drop a lot, right? So like someone's going to solve those problems. And I hope they solve them soon. All right. Well, Michael Brian, so great to speak with you. Thank you for taking all the questions and talking through the tricky stuff and some of the fun stuff. And we hope that you'll come back soon. Thanks for having us. Thank you. All right, everybody. Thank you so much for listening and watching. If you're here with us on YouTube or Spotify, and we'll see you next time on Big Technology Podcast.

Podcast Summary

Key Points:

  1. CoreWeave is a company at the forefront of the AI boom, worth $42 billion and operating data centers with NVIDIA GPUs.
  2. The company focuses on providing AI infrastructure and services for training and inference, serving large AI labs and enterprises.
  3. CoreWeave's key differentiation lies in its software stack optimized for parallelized computing, allowing for more effective utilization of computing resources.

Summary:

CoreWeave, a company valued at $42 billion, is deeply involved in the AI industry, providing infrastructure for AI training and inference. They have built data centers across the US with a large number of NVIDIA GPUs. The company's success is attributed to its focus on parallelized computing and a software stack optimized for AI workloads, making them a preferred choice for many AI labs and enterprises.

CoreWeave's differentiation lies in its ability to deliver a highly differentiated product that meets the increasing demand for AI computing. Despite the narrative that big tech companies could build their own data centers, CoreWeave's expertise in optimizing computing resources and providing tailored solutions has made them a valuable player in the AI ecosystem, allowing them to serve a wide range of clients effectively.

FAQs

CoreWeave has experienced rapid growth and is considered a key player in the global AI infrastructure. The company's value has soared, and it has expanded by building multiple data centers and acquiring a significant number of NVIDIA's GPUs.

CoreWeave has faced challenges related to speed and scale, with significant growth in employees and infrastructure. The company focuses on maintaining high-quality standards and managing issues in the supply chain.

CoreWeave fills a void in the market by offering a highly optimized and differentiated product for parallelized computing. The company's software stack is designed to meet the demands of AI applications effectively.

Inference plays a crucial role in monetizing AI investments, and CoreWeave has seen a shift towards increased demand for inference capabilities. The company leverages its expertise in providing highly connected storage and optimized infrastructure for both training and inference purposes.

CoreWeave offers a specialized software suite that enhances the performance and management of data centers, especially for AI applications. The company's focus on delivering premium services and extracting maximum value from GPUs sets it apart in the market.

CoreWeave leveraged revenue from crypto activities to build scalable infrastructure for AI. The company recognized the increasing value of compute resources and focused on optimizing their use for AI applications.

Chat with AI

Loading...

Pro features

Go deeper with this episode

Unlock creator-grade tools that turn any transcript into show notes and subtitle files.