Go back

Here's How The AI Bubble Bursts — With Paul Kedrosky

67m 4s

Here's How The AI Bubble Bursts — With Paul Kedrosky

Paul Kydroski contends that the massive AI infrastructure buildout is a bubble, driven by unprecedented capital expenditure that now exceeds historical benchmarks like railroads and electrification in scale and speed. He emphasizes that data center investments, often framed as real estate projects, are fundamentally different due to ongoing capital needs for GPU replacement and the hyper-deflationary nature of tokens, which are falling 70-80% annually. This requires astronomical demand growth to justify returns, which he deems improbable. Kydroski argues that AI models are commoditizing and converging, eroding pricing power and pushing labs to move up-market, a strategy that is costly and may fail. He attributes the investment surge to groupthink, check-size filters among large capital providers, and the seductive "call option on AGI" narrative, which he rejects as a logical fallacy. A collapse could be triggered by macro shifts, post-IPO investor disillusionment, or regulatory changes, with cascading effects through credit markets. Kydroski avoids direct AI investments and broad index exposure, though he consults for hedge funds with related trades. He notes China may be insulated by state backing but risks overbuilding. Ultimately, he sees AI as transformative but destined to become a utility-like commodity, with current labs earning only utility-level returns, not the explosive growth investors expect.

Transcription

13181 Words, 73211 Characters

English
If we are in an AI bubble, what could an unraveling look like? Let's talk about it with investor and analyst, Paul Kydroski, right after this. Welcome to Big Technology Podcast, a show for cool headed. And nuanced conversation of the tech world and beyond. We have a great show for you today. You're gonna tackle what I think is the strongest argument that all this AI investment is going to lead to, well, a collapse because our guest today, Paul Kydroski thinks that we are in the midst of an AI bubble. He has been making the case far and wide and has not backed off despite the fact that this technology has gotten much better over time. And so this will be a really fun discussion to ask, basically, even if everything goes right, are there economics on the downside gonna be so bad that it will still fall apart? So, Paul, it's great to have you on the show. Welcome. - Sure, great to be here. - All right, let's just start with the spending and the return necessary to make that investment pay off. Right, if we're in an AI bubble, as you argue, there's gonna have to be some level of overspend and then an inability to make those returns materialized. So first off, can you just talk about the magnitude of spending going into the AI buildout today and how that compares to maybe previous infrastructure buildouts and the rest of our economy right now? - Sure, I mean, there's a thousand ways to kind of put it in context for people, but one of the ways I try to do it is to compare it to, as you say, prior infrastructure buildouts, so you can go back to the 19th century and canals and railroads or you come forward to the 19, well, the late 19th century and early 20th and talk about electrification and rail electrification or the interstates, World War II re-armenant, the fiber-optic buildout, these are all these moments in Western economic history, in particular, US economic history where we had these massive infrastructure investment. Then in some ways, not obviously the analogies are never perfect, but in some ways are analogous to what's happening today. So one way to think about the sizes of each of these moments is to think about their contribution to GDP or you can think about them in terms of their contribution to GDP growth, you can think about them in terms of their contribution to non-residential fixed investment. There's lots of ways to back into this so you can kind of provide some context. And it doesn't really matter anymore which one of those you use were the winners. So we're now currently larger than everything except for, and this was an unfortunate analogy I made recently on a German interview, as I said, we're now larger than everything except for World War II re-armenant, which doesn't play as well in Germany as it does everywhere else, but nevertheless, the point being that as a percentage of GDP, as a percentage of non-residential fixed investment, as I've documented for like the last year or so, in terms of its contribution to GDP growth. In all of those metrics, we've now exceeded some of the largest capital expenditure kind of proxisms, impulses in Western economic history. And again, you can say to yourself, well, so what or anything else, but that's sort of a separate question. So the point to start off with is this is a really, really unusual moment in terms of the scale of capital expenditure normalized against all of these other CAPEX moments. And then we can get into whether or not any of those analogies matter or whether this time is different, the favorite sort of responses to these kinds of things or all sorts of other stuff. But the point is we've now reached that moment. And it's now, in lots of other measures, it's now the largest tech. It's now the largest piece of the high yield bond market. It's now the largest piece of the financial services of the investment grade bond market. So in terms of new issuance, tech companies themselves are now at a point where for the last two years, people repeatedly told me that it really didn't matter because they were doing a lot of cash flows. And so we'd only become worrisome if this was becoming out of debt, well, guess what? As of the second quarter of 2026, this is now more than 50% of the funding for data centers is external financing, which is obviously the term of art for off balance sheet and out of your own cash flows. And now, of course, the same people who were saying that a year ago, we're saying that that would matter is now say, well, that's perfectly fine now. So by any of these metrics, GDP, non-residential fixed investment, percentage of GDP, percentage of GDP growth, off balance sheet financing, we're now at a point where this is a remarkable historical moment full stop. - Yeah, and a way that I like to talk about this is, first of all, it's not only a bigger magnitude than these previous build-outs, but it is a bigger magnitude contracted into a fewer number of years. So just to put a fine-- - That's a really important point. - Yeah, yeah, that's a really important point. For example, to put that in context, electrification took almost 30 years. The build-out of the US Railroad was a multi-decade proposition. The interstates were a decadal proposition. Even the build-out of the fiber optic backbone was probably four and a half to six years, something like this. So this is a higher scale of spending happening at a much more rapid pace. So, and that matters in the context of capital markets because you don't have time to slow down and consider exactly what's happening and where are the returns going to come from. But that's a problem for another day, but just to put it in context, that's an appropriate context. - Right, and so if you have, let's say, a build-out that goes over a couple of decades or even five years, you have these, I think this is what you're talking about. You have these stop points where you put some investment in, you get some time to marinate in your projections, and then you say, should we put some more in, right? And of course, in many of these build-outs that we talked about, there were collapses. But what we're seeing now is this rush in to invest in the AI infrastructure build-out without those natural stop points and the numbers are bigger. So we're looking this year, it's looking like big tech alone. We'll put something like 700 billion in towards CapEx this year. I think last year was something like 350 to 400 billion, and next year was projected to be 1.5 trillion in build. Now, you mentioned a lot of the different dynamics about where this money's coming from, and that's important. But let me just put this to you to begin with, with the level of investment that we have coming in to this type of build-out, what is the return that's gonna be necessary to justify these investments? So let's just take 700 billion. What is, even investors to, I don't know, not go under, or I guess a lot of this is big tech. Like, what are the numbers that we need to be looking for for those numbers to be rational? - So you have to turn it around and look at it from the standpoint of the providers of capital. So alternative uses of capital and what return I could get on the same capital in another context. So the way that I try to analogize this loosely, and this is very loose, is that data centers from the context of many capital providers are real estate. They're really just multi-tenant apartment building. It just so happens there's no humans in the apartment building. There's just GPUs. And so from the standpoint of providers of capital who look at these as project finance, and then by that measure, try to compare the returns they're getting on this to the returns they're getting from doing project finance. So think about it in the context of commercial real estate, a strip mall, a multi-tenant apartment building, or whatever else. So increasingly, the providers of capital for these things look at it in that context and say, well, what's the yield in terms of I'm contributing a hundred billion dollars to some massive meta-project? What's my reasonable cash flow expectation? Very much analogous to what I might expect from the cap rate on the multi-tenant apartment building, and is this competitive on that basis? So that's the short answer to your question is, it's very much a market-based return that's required. The scale of the money is irrelevant in some weird context, 'cause it's really all about what sort of return can I expect, and how does that compare to comparable investments? So in, again, in this context, CRE is the most comparable investment from the standpoint of external capital providers. So they say to themselves, we're looking at cap rates around 6.8%, 6% is that reasonable? Well, that compares reasonably well to the following five projects, but not particularly well to this project. So what it's provided is a way of putting the returns from these things in context. So it's wrong to say, for better or worse, we're going to be putting in a trillion, therefore I need a hundred trillion out of this. That's not the way investors are looking at this, and it will lead you down the wrong path if you take that approach, because now you're forced to say, well, I'm going to have to estimate what percentage of some giant number I'm going to earn over the next five years. And that's where you get into these loony arguments from some of the sales side analysts where they'll say things like, well, the TAM, the total available market for human labor, is like $12 trillion. If I get 20% of the TAM, this is ridiculous, right? This is just completely, you know, CD or PAN speculative stuff. So it won't get you anywhere in terms of understanding the calculus that's driving people to provide the off-balance sheet financing for these projects. So the right way to think about it, for better or worse, is to analogize it to commercial real estate and ask yourself what kind of cap rates they could get on comparable projects, and that is really the answer. Now that leads you into a trap, but nevertheless, that's the answer in terms of thinking about what kinds of returns are required to justify continuing providing a capital. Okay, this is really important table setting here, and I think this is sort of worth digging into a bit because the way that you're framing this is actually suggesting that we don't even need to hit the best case scenario, right? So like a way that I thought about it is almost everything needs to go perfectly in order to return on these investments because they're so big. But if you're saying that this is just like being invested in the manner of a typical real estate investment, then that perfection. is actually not necessary and my level of concern goes down here. So let's say let's take an example. I'm meta. I invested a hundred billion dollars in data centers. So let's say you're like looking at like I don't know you could help me with the math here. You want to get us like a six percent return or 20 percent return on your investment. You might not might only need to get 120 billion back. You know if you're going to compare this to a to a real estate investment and now that I'm thinking about it and like well meta makes what like 30 40 billion a quarter. That might be imminently possible with you know the outlay. So where's your concern here? Well the concern is that the nature of the investment is profoundly different from real estate. So what you're really entering into a project that not only has current capital requirements but has ongoing capital requirements. This isn't just now and then I'm going to have to replace a tenants drywall. This is a project would require wholesale replacement of most of the hardware and probably changes in the cooling system and probably changes in other aspects of these data centers continuously and probably you know depending on the math anywhere from a four to seven year period. So it's nothing like an apartment building in the sense that most of the capex occurs up front and then it generates recurring a new eddy cash flow from which I would that I bask in and generates compelling returns back to my investors. This is much more like a utility with a non-regulated utility who has continuing capital requirements which continually dilute the returns because you're having to raise more capital all the way down the path and this will continue for the lifespan of the project. So what you end up from at the standpoint of an investor you end up with a duration mismatch problem right. So I've got what looks like a long duration project like an apartment building that's actually a short duration project in the sense that most of the underlying assets need to be turned over relatively frequently or at least upgraded. Now you can get into all kinds of traps the Michael Burry thing with respect to like well what's the proper depreciation schedule for you know GPUs or whatever but the point still stands that you not only have up front capital requirements but do you have continuing capital requirements. So that's that's problem number one in terms of thinking or making the direct analogy to commercial real estate back to data centers. And the second one is that you need to also think in terms of the nature of why those replacement happens. Some of the replacement happens because of the MTBF the means behind between failure of GPUs which varies depending on what the GPUs are being used for and the generation of the GPUs. So we have some GPUs that are failing inside of modern data centers on an 18-month cycle. Some that are failing on a much longer period. So we've got constant churn just from that standpoint and then we have familial upgrades in terms of upgrading to new generations of GPUs that cause upgrades. And then we have the whole replacement cycle of maybe we won't have GPUs in some of the upcoming data centers. They'll be increasingly you know inference specific A6 and we're seeing lots of that going on. So that's problem number two. Problem number three is for the you we've got we're paying a fixed rate of return on a depreciating asset not just a capital but also in terms of the the thing under the hood that's generating the cash flow. So what's generating the cash flow data centers can be thought out of as factories and the thing that they produce the widget that they produce is this thing where you domestically call tokens and these tokens are among the most rapidly depreciating assets we have ever seen in a modern economy that they've continually been following 70 to 80 percent year over year on a constant performance basis for at least the last four years and there's no reason to expect that to change. So we've got at least three different problems here in terms of making that naive comparison to commercial real estate and saying okay everything's going to be fine look look these guys are good for it and we've got these long-generation contracts. We have a rapidly we have depreciation of the data centers. We have the continuing capital requirements and then we have this unprecedented problem of a hyper deflationary commodity at the core of the revenue generation engine of these of these so-called data centers. None of those existed in the context of any other cycle in the past. Railroads weren't going through hyper deflationary cycles and neither were real electricity so fiber certainly wasn't fiber was actually the reverse became more valuable over time so all of this is really unusual and makes the naive analogy to commercial real estate that brings in those kinds of investors who have showed up in huge numbers because they see this analogy incredibly fraught and probably perilous for them. Okay so there's a lot here and I you know I don't have a dog in this fight but I'm going to do my best to advance the counter arguments to your arguments here and you tell me what you think of them. Okay and maybe I can do you know two in one here so the depreciation that you're talking about is because 50% I think you've said 50% of the cost of data centers is in the GPU and the GPU has a lifespan you know someone some people say three years right this is the typical depreciation argument you put let's say a Nvidia H100 in there three years later yeah it either fails like you said or you have to replace it with a black whale or a rubit whatever it might be. So and so therefore these these expenses in the data centers aren't just like you invest a hundred billion dollars in a data center and you get to live off the land for 20 years investment is you know you have to continually feed that data center with more money in order to make it work. So which doesn't work in the context of the NPV calculations that underlie a typical real estate project obviously that's completely different from the kind of math that we use to justify a multi-tenant apartment building for example. And then you know further on what you what you mentioned is that the tokens right with the things that these GPUs produce they are depreciating they are getting cheaper no one will argue with that. The I'll just say they're not really depreciating they're actually staying the same value they're just deflating there is a difference. Okay right deflating right that what you used to pay for token is much cheaper than it was previously. Yeah okay so here's here's what the counter argument would be wrapped up into one. The counter argument would be you know as tokens have gotten cheaper people have wanted more of them because the the AI models that used to use them have become a more powerful and be more capable. So therefore you know even if those tokens are cheaper people just the demand for the outputs of these factories have grown by a magnitude sometimes you know 10 20 30 X then they were previously. And as you do that you know as that demand has grown you know people are willing to use even the older chips at rates that would be higher than when they initially came out with the less powerful models. So I was speaking with Corrie at the end of the year last year or beginning of the year this year you know around the New Year time and they said they were actually renting out H 100s for higher prices than they had previously. So all of what you said is true the counter argument that they would make is yes and they're demand for the tokens is higher and the old hardware is working well beyond that chip that typical three to five year estimate that people expected. So what is your thought when people say that? So there's a whole bunch of nested arguments in there. So let's take them on kind of one at a time. The life span of a GPU in terms of just looking at it from an MTBF standpoint I mean time between failure standpoint depends very much on what it was used for in the in its in its in its adolescent years inside the data center. The analogy I often make is if you could buy a used car both two you two use cars one of them both as they both have like 5,000 miles on them. One was driven in a you know 72 hour nonstop race across the country. The other one was driven that was the only that's with all the 5,000 miles came from and the other one was driven to church on Sunday for a year which car would you buy? Well I think we would all buy the car that was driven to church on Sundays. I want nothing to do with the one that was raised in some kind of you know bubble gun rally across the country. So the in the context of GPUs what we have is a generation of GPUs that were largely used for very intensive training purposes and so the the failure rates of GPUs used so intensively for training purposes are much higher than inference specific usage. So yes there's no question that if a chip is used exclusively for inference which is to say token completion in response to prompts then the life span will all else being equal likely be longer and if I have if I have a chip that didn't fail during training then I can I repurpose it potentially to be used for inference. Sure there's no reason but in aggregate there is this problem that the failure rates of chips that were used for training is very different from the failure rates that were used for inference. So we have this kind of mixed population of chips inside of data centers with very different failure rates and people have a tendency to conflate this and just pretend that it's all the same thing and it's not and that's not very helpful because if you actually talk to people who are running data centers they will say this is exactly what we're seeing as we see much higher failure rates. So there is this sort of blended problem that you have to understand the nature of what the chips were actually used for and that's only going to become more profound in future because increasingly I've often I often joke that the the frontier model company that will the most valuable frontier model company in future will be the one that stops pretending to train models and actually just moves on to harnesses and moves up the stack because what we're seeing increasingly if you look at things like the epic composite index and other things is that well models are still improving they're improving at a much slower rate and I often do this kind of Pepsi Coke test where I'll put a couple of different models in front of people using some kind of a harness like open code and ask them to tell the difference and everyone thinks they can tell the difference and the reality is no one can tell the difference. And so right this point of convergence that we're increasingly the thing that differentiates models outside of marketing is price which is one of the reasons why on tables like open router or whatever else. It's now dominated by Chinese models. So we're rapidly seeing this move away from any kind of premium pricing in terms of the models themselves, which is, and I'm trying to get to the point about this kind of Jevin's paradox, which is really what you're pointing to this idea that as models get cheaper, we use, we use, our tokens get cheaper, we use more of them. And this is a, this is a common idea. And you know, we've seen it repeatedly play out in different ways over the last 150 years. But I think this mostly speaks to the enumercy of people that they don't understand what a compounding price decline of 80% means in terms of what you would have to see in terms of growth on the other side. You have to see around a hundred million fold growth over the next six years in terms of tokens. Is it possible? Absolutely, it's possible. Is it likely? No, it's not likely, but it could happen. But let's not pretend that it's probably, that it's one of the most probable outcomes to throw out, to throw out this and say, but Jevin's paradox, but people will use more, is to really dodge the core problem of the geometric decline in the price, which will only continue and get faster now that we've got increasingly price-based competition because of the convergence of models. So that problem not not only doesn't go away, it gets even harder in future. And you know, now you're competing with sovereigns who have state subsidized token prices, as it's China, probably the canonical example. And so all it just becomes increasingly difficult to make the ricans of returns that your investors expect given the comparable cap rates that they're comparing them to. So this idea that, but it will swork itself out because prices will continue to climb and magically will just use enough. Is his both historically naive, this argument gets made all the time, has been made repeatedly in prior tech bubbles and people wave their arms and say this and it almost never works that way. And it's worse this time because at the core is this deflating commodity called tokens that is being used to pay a fixed cap rate in terms of what the expectation is from investors who fronted capital for these instruments. So is it possible? Sure, but think about some of the carnage that it's already creating. You know, Alex Carp was complaining on CNBC the other day. I'm sure you saw it. Yes. That these companies are increasingly marching up market and trying to eat other, but the reason why they're marching up market is because they see this coming and they're looking for higher return places to be because they see the collapse in the fundamental commodity that they're selling. No different than, you know, goldmine are deciding they need to start making jewelry. This is the same phenomenon playing out. So they're marching out and so that's going to have collateral damage in terms of them being seen as fair and unbiased players, which will then play into the likelihood of companies going down the path of, you know, sovereign data centers and doing token inference generation inside of inside their own organizations as that becomes increasingly possible. So I think there's no doubt that we'll see this continuing growth, but whether or not the growth will be large enough to compensate for what will essentially be an asymptotic collapse to zero in terms of the price of tokens is mathematically a very hard argument to make. Okay, so this is a great point to dig into as well. So Carp, of course, went on CNBC and talked about how you can't trust the Anthropics and the OpenAI's of the world with your data because they'll take your data and they'll build their products that are, you know, sort of compete with yours. Obviously, they're competing with Palantir, right? Because they're going to go in, they have these, you know, Palantir has forward deployed engineers now OpenAI and Anthropic have forward deployed engineers and they have effectively the intelligence underlying a lot of what Palantir is doing, right? So if they sort of go up market, you know, you can all of a sudden, and this has sort of always been the fear about these AI companies is their AI would be smart enough that when they see companies building on top of it, they would just go in and take their business. So to me, seeing Carp on CNBC, yes, he was he was sounding concerned about what OpenAI and Anthropic might do to, you know, quote unquote your business, but he's also talking about what they were doing. Oh, there's no question to his business. There's no question. Yeah. And then just just from like, because we're talking about the economics of these buildouts and whether these companies will be successful from a pure like sort of ruthless business perspective, is this the way that they can actually make these investments pay off? Is they say, all right, well, we have the intelligence because that we will agree that that technology is good in some areas. No, it's good. And I mean, and I think let me just jump in here for a second because this is a common misconception is that I actually think this is probably the most, yeah, yeah, yeah, it's probably the most transformative technology for the last 100 years. And, and that's I, you know, it's obviously a strong claim, but I genuinely believe that, but that's not the same thing as saying that therefore it's fundamentally justified in by default, justifies the investments being made on its behalf. These are two very different things. And as a matter of fact, the former is almost required for the latter to fail, right? Because if it wasn't a good story, who the hell would show up with lots of capital? Absolutely right. And you know, on this show, we're all the time, we talked about how like we we think that this technology is real. And you know, you got to question the economics because of many of the things we're talking about. All right, but let's just go back to this argument. So they're coming at let's say they're coming after Palantir. And Thropic is coming after Figma, right? And you know, sort of the list goes on. And you know, there's always been this like, is does the entire economy effectively become like a wrapper on top of these AI models? And if so, what's to prevent the AI companies from going out and building into verticals that have been successfully captured by other companies? And so even though it, you know, it's ruthless, et cetera, it's going to make Alex Carp jump out of his seat and, you know, various TV appearances. Is that the route to, you know, having the, the business opening in and Thropic, having the business to pay back the investment? Because if you're able to do that and jump up market, you can, you know, potentially justify all this investment by creating these massive businesses. Yeah, I just think it's reversing the logic. And I have no sympathy for Carp whatsoever. May, you know, Palantir can burn or not burn. It doesn't matter to me. But I think it's reversing the logic to say that if you're, if the idea is to say, I need to find a way to justify the investment. Therefore, it's okay for Frontier models to move up where up market, eat the economy and become a legopolis. Then I guess that's okay. It's, I think this is a cart before the horse problem is because we're not trying to, I'm not in the business of justifying what they're doing by coming up with societally toxic mechanisms that therefore make it work. That's not at all appealing to me anymore than it would have been because we heard these same arguments way back in the go-go days of Microsoft. Long ago, whenever Microsoft first launched Windows and some of the early operating systems were coming out, one of the things that happened was people built applications on top of the operating system. Microsoft saw those applications were doing really well and guess what they did. They launched their own. Now, most of the ones they launched were garbage. Microsoft turns out for a long time wasn't particularly good at launching applications, but they got better at it. And over time, eight, a host of different applications in spreadsheets, word processors all over the place, they essentially removed the oxygen supply for all of those different markets and moved up market. So that's not unprecedented. So it's not surprising at all that we'd see these companies do that. The difference this time, obviously, is we have a, we have a generic, a general purpose technology that has much broader applicability. So in theory, you can do this across a host of other domains, which at the very least should be cautionary and can do it at a much faster rate. The only thing I will say in defense of, you know, weird sort of defense of the frontier companies is, and it's the same thing I say with my venture capitalist hat on, as we have companies or start up show up all the time that say I have this amazing technology that's really high alpha, we should be bought by every hedge fund and so on. I'm like, okay, fine. Why are you telling me that? And they're like, well, what do you mean? And I said, if your technology is so good and you can generate a competitive alpha with it, don't be an idiot. Go out there, raise some capital and invest it directly. Don't tell other people. So the fact that they're telling other people about this alpha generating technology is by default a reputation because if it actually worked, they wouldn't tell me. So the same logic applies to the frontier companies. So if the frontier companies technology is so amazing that it can eat the entire economy, why don't they just ingest the economy and stop selling it to us? Why are they even bothering to sell tokens at all? Why not just move up market immediately? So what that tells you is, in the same way that these companies launching hedge fund tools don't actually have things they can do, they're frontier model companies. No, perfectly well. They can't do that. They know perfectly well. They can't move all the way up market to generate those kinds of returns and the proof is in their own behavior. That was basically Carp's argument, which is, why are you selling tokens? If you can increase my sales by 2x, what do you take? No, no, exactly, we're sending that up. That's right. And it's compelling. It's a compelling argument. You can argue that it's because Dario and Tropic is so darn ethical that he refuses to do that. And I guess it's possible to see him as unlikely. No, of course. This is good to go back and forth and talk through the arguments here. The argument would be that basically this technology is so new and it's moving so fast that it's going to take time to figure these things out. And so you can't just like, on day one, that fable comes out or you have mythos in house, go ingest the entire economy, you have to do this like step by step. And a case in point is a clawed design where like, and Tropic has been watching the design, of course, like my Krieger, he's to run product there was on the board of Figma. And that's led to this whole issue and made Dylan Field like one of the Anthropics biggest critics, the FedMCO. And so instead of of like going out and saying, we're just going to do this wholesale, we'll do it step-by-step. We'll see what the technology is capable of see how people are using it, see what other solutions are out there, and then go ahead and build. And it just goes to this whole concept of the deflation of tokens is like, you know, it seems to me that we're at this point where everybody agrees that these models underneath are commoditizing and owning the model is valuable only in your ability to customize your own products to have that like deep sync between your products and what the models you build that nobody else could have. Sure. And that's where this is going. Yeah. I think that's broadly true. And I think I don't necessarily agree with you that everyone believes these models are commoditizing. It still feels to me. That's true. You know, iPhone version 4 era, when people get all excited about a new release, and then everyone winds because they say, well, this didn't change the world, and it's not, you know, AGI. That's kind of like the fourth iteration of the iPhone where people want to believe that there's breakthroughs still coming, and there were huge breakthroughs in the early days of launching large language models. But now it's not just commoditizing, but I've, you know, some data that I often show people that shows a kind of convergence that's also happening. So it's not just that there's kind of a plateauing phenomenon going on. It's that the variance among models, the best practices across all of these different models has kind of, as converged to a large degree, reducing the variance in terms of the composite performance of various models, which means that the opportunity costs for changing models is much lower. So if the opportunity cost is much lower, unless they can lock me in, there's a huge incentive for me to constantly arbitrage and play back and forth across them, which is hence the rise of Chinese models, why deep seek is doing so well all of a sudden, and why, you know, again, is in others, and why open code is emerging as a, you know, viable tool for many people, because there's this sense that I don't not really locked in at all. And the convergence means that the model differences while there are so minimal as I can't tell the difference in a kind of Pepsi Coke phenomenon, which again, to cut to the investment chase, suggests that the competition then becomes much more about marketing, expenditure, and other form of costs, and price. So both of those algorithms, really, in terms of the investment returns for this asset class. Correct. And so this is sort of, I think we're both seeing it in a similar way, which is that the economics is going to force these companies to go up market and that's where things get interesting. Yeah. And I think that's going to accelerate with these, assuming the IPOs happen, that's going to accelerate with the IPOs, because public markets investors will look at the underlying economics of this fund of the commodity called tokens and say, so what else you got? Right? And say, what are we going to do next? What do we, what markets are you going to move into? And so that's going to increase the pressure to do this absorbent of move up market. And then you get into this problem that, and this was my complaint early on about the SaaS, SaaS apocalypse earlier this year is, there's a deep misunderstanding about why companies buy software. It's not because they think service now or sales force or whoever is somehow, you know, bold innovators that cannot be replaced. No, it's because they have a problem. They don't want to build themselves and they want someone to sue or shout at. That's it. And so when you start building it for yourself, this notion that companies are going to increasingly use these frontier tools to build things for themselves or vice versa, that the frontier companies are going to be sued and shouted at by everyone on earth for building vertical apps for them. This will rapidly be disabused because it is a terrible business. You do not want to be in that position of continually having to service people whose main utility for your product is having someone to shout at or sue, which is again, it's a gross exaggeration, but it's a misunderstanding of why verticalize software exists and why those companies exist to service the peoples in those verticals. And to just naively say, the frontier models companies will blively race up market in service of their new public investors is to misunderstand why those markets exist in the first place. Right. I mean, maybe they'll have to though. That's the same. No, no, no, they'll have to, but that's what my point is is that it won't be easy. It won't be easy and even more importantly, it'll probably be very painful and costly. And so be careful what you wish for, I think is where you get to on that one. Okay. Let me make one more of the labs arguments and then I actually want to get into some more of the weaknesses that you see in that I see. Okay. The other, you know, you kind of winked at this time, you know, the people that believe this time is different. This is not like super, a super technical argument. This is sort of like the general argument that you might hear. It would be- It's the only in argument. Yes. Would be somebody saying, you know what, Paul, this is different. You have these labs who've built magical, you know, thinking computer machines. Yes, they're, they're investing a lot, but in tech, what you do is you build an asset. You find a way to scale it through computers in some way and you mark it up and people will buy it because it beats any other alternative. And what you've seen recently is like even in the past, let's say, six, seven months, the capabilities have scaled dramatically. You've been able to like now leave these computers alone and they can code on their own and do a decent job to the point where like they're not just useful for engineering, they're useful for all types of work. And so over time, you know, that there will, despite the fact that so much has been invested, like we said, you know, maybe $2 trillion that are coming between this year and next, that will be so economically useful that the business is going to have to work out. And there's this is sort of why people are rushing toward it. Your thoughts? Sure. But again, this is this is this is a plastic logical fallacy of assuming what you're trying to prove, right? So you you race ahead and say it has to work out because I need it to work out. And and I'll go more deeply into this whole question of of this time is different thing. The the corollary to the this time is different thing is all that there's always something useful left after these moments, right? Then the idea that there's always some important some useful assets left after the fiber bubble years later, we could, you know, we could use the fiber for things, even though half of railroads are eventually abandoned because of over building railroads are still hugely valuable. That's all true. But it's kind of an on-sequiter. Well, of course, it's true. We didn't build it because it was useless. We build it because it was useful. The issue is what are the what are the consequences of massive over building in terms of spiraling consequences in the broader economy, you know, increasingly some of the largest purchasers of of data center related debt or insurance companies. We know what happens when ever insurance companies get in the middle of this stuff. We've seen it in the global financial crisis. We've seen it repeatedly. So that's the right question is not, you know, oh, you know, pat people on the head and say this is all going to work out because it's always worked out in the past. One, well, it's always worked out in the past. It's nearly taken out the global economy at least four times. So that's worth noting. And the other, the other issue is, and this is, I think, the more insidious one that people miss because you'll see people refer to, there's this woman named Carlotta Perez who wrote a book called Technological Revolutions on Financial Capital, which in a sense is the Bible for many of the most, I don't know, bullish partisans pushing some of this stuff. And they'll say, well, this is what has to happen. It has to, we have to have this kind of huge moment of spending and waste and everything else. But then it works out. Here's the problem with that argument. In prior episodes, people didn't know that. That's a really important distinction. We've created this reflexivity. We're now, we justify overspending on the basis of prior overspending haven't worked out. Well, in prior episodes where that happened, people were not justifying the overspending by saying, say, in real electrification, you know, this may look bad, but it worked out in railroads. No, no, no, no. You don't get to play that game. We didn't have that. So now what's happened is it's become a hermetically sealed, almost a flywheel, in a sense, because we're justifying things on the basis of information that we didn't have in prior episodes and using that to justify an even larger overbuild. And that's why the notion that this time is different. It is different, but it's different in a really dangerous way. Okay, so I hear that, except that the argument that I was trying to, like, put forth on your plate here is, you know, is a little bit different, I think. Like the argument that I'm trying to get you to respond to is the, Paul, it is AGI, man. Like, this is a, you know, so what is your response on that for? Feel the AGI. So, yes. So the question then that turns into this one of, what would you pay for a call option on AGI? Essentially, the argument is you cannot possibly overspend because the value is like saying, what would you spend for a call option on immortality? Well, the mathematically I should be willing to spend anything. Similarly, I call option on AGI is, there's no discountable net present, no discountable net present value that is too large. So when should you start down that path? Once you, I accept that premise that this is, you know, feel the AGI or feel the immortality, then again, I'm into this trap of, well, yeah, absolutely. But the problem is that I'm now, we're now going along with this cultish idea that we both now agree that, you know, what you should be trying to approve, I should assume. And therefore we should be willing to spend anything. And it's simply a, that becomes a, like a toxic board game. It's tennis without a net, right? There's no, there's no way for us to have a reasonable conversation once the other side of the conversation is what would you be willing to play for a call option on immortality? Are you willing to pay for a call option on AGI? So that, you don't need that argument. We should be able to make an argument and say that this technology is very powerful and very important and transformative. And here's the way it's going to change things without having to have, you know, it's, it's like in classic sort of agnostic theory, this idea of inserting God into every gap an argument where you can't find a good argument. This is a God of the gaps argument. I'm inserting AGI because now that allows me to create an undiscountable call option that I can't price, therefore I should be willing to spend anything. And I reject that. Don't you think that all the money that's going towards this AGI or AI build out, the people writing the checks have been told the AGI argument. And they're far just by all of the economic weaknesses that you've pointed out in our discussion are basically writing that check for a call option on AGI. To a degree, investors that I've talked to are very cynical. So they're perfectly happy to use that in front of their own LPs, but they don't believe that in house. They look at this very cynically and with very cold calculating eyes and compare it to other similar real estate projects. It's really compared to other sorts of project financing from hydroelectric dams to long lived capital intensive projects. That's the hurdle that it has to clear. In terms of promoting it, sure, we can call these AGI factories. I was talking to a regional document development official in New Mexico recently who had a hyperskiller show up and tell him, don't you want to be part of AGI factories? I was like, what? This is the picture being made because you're signing up for the future because now you can help us build the factories that dictate the future of AGI. All of these objections you might raise in terms of the kinds of tax evidences that they want with respect to water and power and real estate and other things doesn't matter because think about the scale of the call option I'm offering you and it's a get out of jail free card and it's really, I think, unfortunately offensive. But nevertheless, it's more marketing than anything else and when I talk to the largest investors who are putting capital into this, they'll use it with their own LPs but they don't do it in partner meetings. Interesting. So they don't do it because they don't actually believe it. No, they don't believe it. Not that they don't believe it. I'll put it differently. It's not that they believe it or don't believe it. They just couldn't be bothered caring because they think they're material. It's non-material. So then why are they? Okay, if you're speaking to these folks, you're seeing the clear problems here. What is the justification that they make in their mind? Let's say they take everything that you say and they give it credence. The fact that we've talked about, you have to replace the GPUs. Token prices are going down to make this work, the demand would have to be like a hundred X. What it is. I think it's more like a million X but okay. A million X. Okay, let's just say that. A million X. Why aren't these in the checks? No, it's it's a bit crazy. But yeah, so why are they so many checks, but you might say the same thing. It's back to the Harold Purse line back at the during the financial crisis. As long as the music is playing, I keep dancing. This is that, right? This is as long as the music is playing, they're all going to keep dancing because there is absolutely no incentive as any of the largest capital providers on earth from sovereigns down to private equity and private credit to walk away because you get pressure from LPs saying why aren't you participating in this and then even worse as a sovereign as a sovereign wealth fund. And I've been inside these folks is that once you're managing hundreds of billions of dollars, you start looking at opportunities not in terms of their economic value, but in terms of check size. And you say, I need to write a check for fill in the blank, a hundred billion dollars because I do not want to write a hundred one billion dollar checks. So this weird filter starts happening where you now these projects are like, look at my friend, Saudi, Qatar. I have this project that's perfect for you. You want to write 50, a hundred billion dollar checks. No one else on earth can you write it other than these giant data center campuses like the meta project in Louisiana or take your pick. And so once you become a develop a check size filter, the world starts to twist on its axes and that's why these projects become even more interesting because there's just nothing else out there like them. So I will just respond by saying everything that you just said sounds crazy to me that that is the way people operate. Oh, I was inside. I'll tell you a funny story. I was inside of a 700 million dollar venture fund at one point that turned down five terrific projects. So this is at a very small scale. So think about it now as a sovereign because because the entrepreneur we want the entrepreneur wanted four million dollars. And the fund wanted to write a 20 million dollar check and said, you know, I can't do a four million dollar check. And they walked away from four terrific projects. And I thought that is absolutely to use the technical term that shit. And then I thought I'll never see that again. And I've now seen it repeatedly inside of the some of the largest funds on earth looking at projects through the filter of can I write a large enough check because I have this much out. I have this much capital burning all in my pocket. So it doesn't mean that I'll just give it to any random. I'll write checks to anybody for anything. But it does change the way that you filter the landscape of viable investments in a really truly perverse way. So these point masses of capital worldwide are part of the issue. Right. So to basically sum it up, we've talked like for 40 minutes so far about the logic of investing in these in these AI projects. And we've gone through all the logic and I've made all the arguments. You made the count arguments. And basically what you're saying it boils down to is this is just a group think and convenience thing, which is why all this money is going this direction. There's a huge component of that. There's also this and I've made this I make this argument all the time that the largest bubbles in US history usually had either to do with technology, loose credit, government policy, right. Some combination of these things. The US in particular is very good at ones that also include real estate. So we can add that to the mix. So technology, real estate, loose credit, government policy. This is the first moment in US history that sits at the intersection of all four of those. So it isn't it shouldn't be particularly surprising that we have people who live in each of those bubbles who feel as if they can justify what's happening on their own basis. So I have real estate investors who see this as a real estate project. And they're like, look at it. I do long duration high-capics projects all the time. Don't tell me what to do. I have technology people telling me this is the most important technology in history. People always tell us that these things are going to win. They always work out. It's the Andrew Salney and argument. So and then the other are the other piece that's pushing this to a real cliff is that it's also seen as a scene as an existential battle with some of our competitors around would as well competitors around the world like China. So there's this government component where we must win. We must win because to not win is to somehow, you know, foreshadow some to free to decline. And so the notion, the idea of sitting at the intersection of those four forces is incredibly important because you get into it with four very powerful justifications, just one of which is the large funds with point masses of capital who need to write large checks. So the checks will keep coming until the music stops. On the other side of this break, I want to talk about what would cause the music to stop and what happens when it stops playing. We'll be back right after this. Hi, everyone. Alex Cantowicz here. I want to tell you about a documentary I've made with Gravity to explore the future of AI agent security. To find out if we're truly ready for autonomous agents, I sat down with MIT professor Ramesh Rosker for a White House CIO to Recipate in Michelin's Group Chief Data and AI Officer, Ambika Rajagopal, and Sharon Guy, a former executive at Alibaba. They each offer unique insights into this evolving landscape. We conclude with Rory Blundell, CEO of Gravity, to discuss the path forward. With Gravity leading the way, join us on this journey. You can watch the full documentary at the link in the show notes. One thing I've noticed about companies adopting AI is that they're often making decisions based on how they think work gets done, not how it actually happens. Without real visibility, it's easy to automate the wrong processes. That's exactly the problem Scrib was built to solve. Scrib is a workflow AI platform trusted by 94% of the Fortune 500. Scrib Optimize gives leaders a view of how work actually happens across their organization, showing which workflows take the most time, and where there are opportunities to improve. Optimize automatically discovers workflows across approved business applications, even when a process starts in Salesforce and ends somewhere else. It identifies bottlenecks, explains why they're happening, and provides recommendations with estimated time savings, with manual documentation, and its private. User data is anonymized by default, sensitive information is redacted, and nothing leaves your firewall. To see Optimize in Action, head to Scrib.how/BigTech and mention Big Technology for a 30-day risk-free trial. That's s-c-r-i-b-e.how/BigTech. Today's executives are more threatened, more exposed, and more vulnerable than ever before. Corporation spend billions on workplace security, but what happens when a threat finds your executives outside the office? 70% of attacks on executives happen at home, or away from the office, and Ironwall understands a terrifying reality. If someone has a grievance against your company, the first place they turn to is Google. It takes them about five minutes to find one of your executives' home addresses online. And if their personal information is sitting on the open web, they're far too easy to find. The team at Ironwall knows this better than anyone. They've protected some of the most targeted executives and individuals on the planet for almost two decades. Protect your people with continuous personal data removal, proactive prevention tools, and emergency support. So, when someone goes looking for your executives, Ironwall ensures they hit a dead end. Go to Ironwall.com/BigTechnology, fill in the quick form, and request your free risk assessment. The team will show you just how exposed your executives are, and how to lock it down before threat reaches their front door. That's Ironwall.com/BigTechnology. Stop online threats before they become real world attacks. This episode is brought to you by AvPoint. [BLANK_AUDIO] Everyone's racing to roll out AI right now. Co-pilots, chatbots, agents doing real work. But here's the part nobody loves talking about. All that AI runs on your data, and most teams have no single way to see it, secure it, and prove it's under control. That's exactly what AppPoint does. For 25 years, they've been the trusted layer beneath the world's most demanding data. Now extended across your entire AI estate. Your data, your cloud, and the agents acting on your behalf. It's how more than 28,000 organizations deploy AI with confidence. So innovation scales without scaling risk. It's a single platform instead of a pile of tools, bringing security, governance, and resilience all together. AppPoint, the unifying trust layer for AI. Learn more at AVPT.co/BigTechnologyPodcast. That's AVPT.co/BigTechnologyPodcast. We're back here on Big Technology Podcast with Investor and Analyst Paul Kodroski. You can go and sign up for his great newsletter at PaulKodroski.com. All right, Paul. We talked a little bit on the first side of this break or before the break about the money will keep coming until the music stops. I imagine it would take something dramatic for the music to stop playing. What do you think could be the compelling event? So the argument I make is people fall into this trap of saying it's going to be this or it's going to be that. I think it's actually over-determined in a statistical sense, meaning that there are so many different ways it can stop. That the only thing you can say is that it's going to stop because it could stop because of a macro event that changes the hurdle rate that external capital providers are looking for. If I'm suddenly looking for high single digits and not six and a half anymore, well, then all of a sudden data center projects with their deflating underlying token comprising looks much less competitive so that changes things dramatically given than more than half of data center projects now or half of the capital for data center projects now are external financing. So that changes things dramatically. So the providers of capital pulling back is an obvious source. And then obviously the post IPO phenomenon, if having these companies having to generate competitive returns on the back of a deflating commodity and then moving up market and discovering the returns aren't there as they move up market and they continue to spend aggressively on CapEx. Investors become unhappy about it very, very quickly as we know from hanging around this stuff for a long time. So it wouldn't take very much to have people feel like this is a much less compelling investment opportunity than I felt like because they're having to immediately abandon the thing that I thought they were selling. And now they're having to move up market and chase applications. I'm not that excited about that anymore. So there's a host of these different pieces. Another one obviously is, and we're seeing rumblings of this already is that as this becomes increasingly the state versus state existential battle that you can see export controls instituted. So we can't use Chinese models, Chinese models, Chinese companies can't use US models. We started balkanizing the market. The balkanized market looks much slower and smaller. Well, I don't know what I'm willing to pay for that. That changes things. Government involvement. So we're talking already about Anthropic. Or I guess it was open AI, having potentially a 5% US sharing it. How do I feel about that as an investor? Do I want the US as a co-investor in my company? What does that change? What multiple should I be willing to pay? You can go down all of these paths. And if these things are truly capex intensive, much like the railroads or much like utilities, as I've argued. And we see this already. And in Microsoft and some of the other hyperscalers, then there's a rewriting required. I'm not willing to pay a 30 times price earnings multiple in a company that essentially has a utility class capex usage. And it's sort of an asymptotic decline back towards a more utility-like hurdle right. So there's so many ways this can break. And the way it doesn't break is if it's actually a call-up show on AGI. Right. That seems like the only way. Because I'm looking at the-- I made a list of the different arguments that you can make for the fact that anything these big AI labs are going to sell with the price will inevitably come down and won't support the investment. We've covered a number of them. But the open source models out there can make the proprietary model cost come down. You've talked about this in the past. There are these small models. So you have small models out there that are doing as good of a job in some areas as the big models and they can bring the cost down. Then another thing I wrote down is Zuck. Mark Zuckerberg probably sees it to his advantage to not have open AI and anthropic dominate this next paradigm. And he's already trying. Well, first, he started with open source. Now he's starting with his new proprietary model, but the cost is like 25%. Then you add that in the fact that all these super apps that are coming out, which is sort of like the prayer for these companies, on the product side, which we just both, I think, agreed is going to be more important. Well, you're going to have a super app from Open AI. You love a super app from Anthropic. You're going to have a super app from who knows what. And all of a sudden, you're just like, why am I paying all this money to use the super app? If I could just use a different one for cheaper-- Well, and even more-- No, no, for sure. And even more fundamentally, these super apps are whatever you want to call-- I think of them as harnesses, right? They sit on top and work to straight what models they're doing. So harnesses like cloud code, like codex. But I think it's being renamed. But anyways, codex, like open code, or whatever, all of these increasingly are like the analogy I use is it's kind of-- you've got a bunch of bratty kids. And the models are kind of bratty kids. And the harnesses are really, really high functioning nannies. And so they take the bratty kid and they make them actually do useful stuff. So much of the improvement we've seen in the last 18 months has really been about the imposition of harnesses, effective nannies sitting on top of bratty kids, and not about the actual structural improvements in the models themselves. And that's a sort of a huge misunderstanding. But it's reflective of where we're going in the future that investors increasingly are going to look at this stuff and say, well, why am I continuing? Why are you continuing to spend $1 billion on a huge training run for a model that may be out in 18 months? Because let's not kid ourselves. Like, GPT 5.6 was not a massive training run. This was a relatively modest enhancement on an existing foundational model that was pre-trained, pre-trained probably two years ago now. And most of the gains we're seeing are harnesses and post-training, which things like what are called reinforcement learning with human feedback, RLHF, all of these other tools that are now coming in after the fact. Once investors look under the hood and see more and more of this, they'll be questioning, why are we spending so much on pre-training? Why are you doing billion-dollar training runs anymore? If most of the gains and models are coming from post-training in RLHF and some of these other tools that are even quantization and whatever else, there's going to be immense pressure for the companies to cut back on that spending, which will have huge knock-on consequences across the hyperscalers and across the board, because that's the food system they live in. That's the food system they rely on. So it's another way that this can potentially fail is when the realization strikes that a lot of this or increasing fraction of this training expenditure could be wiped out with almost zero consequence for the future utility of what we will get from these models, given the increasing reliance on harnesses. OK, and so then the obvious follow-up here is, well, what happens when the music stops playing, if it does. Yeah, so then-- Assuming you're right, because we're talking about, again, a compressed, massive investment cycle with many companies betting, as you could say, their future on it, all this off-balance sheet financing, which we really didn't get into today. But it's not being financed in traditional ways. We're seeing the return or the highlight of credit to false swaps again. So talk a little bit about what happens if this goes under. Well, so it's in many ways. And now it goes to what happened during the global financial crisis, is that we find out how it is metastasized across the economy, because there's an increasing fraction of the institutional investor population that mathematically-- because this is such a large fraction as a percentage terms of issuance in both high yield and prime. So both high yield and investment debt over the last six, 12 months, and it's a growing fraction of it going forward, mathematically, they must beholden this stuff. So you're in it, whether you like it or not. And so people are realizing that they're in it, even by holding an S&P 500 index fund, because of the concentration of hyper-scaler and AI-related names, which is something like 40 odd percent now. So even by trying to diversify, you're still in it. But it's even more insidious than that, because it's sitting inside of what will-- euphemistically, might think of this higher-grade investment bonds that are increasingly being taken up by hyper-scaler-related debt. And then that, in turn, is rapidly-- it shows up in a place like Pimco first. And then they'll flip it, and it ends up inside of some insurance company. It'll be spreading across European banks. It'll be in all the same places that we were like to startle defined US real estate and CNBS debt. And then subsequently, quite a default swaps and could see S2 back in the 2007-2008-2009 period. So it's literally following the same playbook just with a different asset class. That is scary. So how are you playing it? I mean, you are an investor. Are you shorting certain things? Or what is your plan here? So my day job in large parties and venture capital, and so for the most part, we just don't invest in it. It's not obvious how to invest around AI because one of the worst things you can do as a venture capitalist is get into a marathon where there's a thousand participants they're all at the start line they're all well-funded and well-trained and it's like oh my god I kind of have to outlast all these people to get to the finish and so you you really have to pick your spots and try to stay away from these sectors where people are concentrating capital and doing it in a way that leads to much poor return so for the most part you know we've been we're very active in a host of different areas but not not AI which is perverse because it's not because we don't believe in AI it's because we believe it's structurally a terrible place to be as an investor and then on a more personal level in terms of you know assets I just very low to invent to commit any haven't committed new capital to any sort of broad index class passive categories in over two years for that reason because you just whether I like it or not prior commitments now amount to a much larger commitment to this asset than I would like already so I'm already over invested in this stuff just by the fact of having a pulse and having some assets in the market and so you have to be very careful but not having it grow in a really you know in a way that you wouldn't otherwise have noticed so it's sort of personally and professionally I take a different approach but they're all kind of mirrors of each of the other right now this is not an investment advice podcast I have to say that but you're you're not like for someone with such conviction that this is you know all going to come down you're not taking any like personal big short position where you could benefit I mean you even have a time you think this goes down right right you're in a half sure sure yeah yeah so it's not my job but I mean you know I and I get more pleasure from sleeping well at night as the honest answer but I will say so I'm I'm I'm working with two very large hedge funds who put on some fairly complicated positions that I've been working with for close to a year now so I am indirectly all biases on the table very closely associated with a couple of very large trades related to this stuff and you know if it works out it works out for me and them I see class you two more before we go yeah sure already have to run okay I just want to ask you about about China so China has a very different approach here right it is effectively it is the you could tell me if I'm wrong here for my understanding the government is basically backing a lot of this so if everything goes up it's just like government allocation you know wasted which like is that's you know it happens around the globe on a Wednesday right it's not like you know their whole system collapses so do you think that they're insulated much more than the US system which relies much more on the private investment in data centers and AI training you know given like let's say this all starts to collapse China will still have the technology and you know that's ultimately right I think we agree what you know I mean what matters in the end will be like actually I don't know I don't want to pull towards your mouth but like effectively what we're left with is pretty important so China might have no economic collapse and you know a technology inside of this thing that they can keep investing in it and and feel good about to a degree the problem that China has and I've been doing a lot of work on China lately is that much like what happened with battery manufacturing much like what happened with solar that there is this huge incentive across the country to impress the central government by building these things locally and so the Chinese premier has been recently cautioning the provincial governors stop building so many data centers because this is now the new thing it was battery plants it was solar so manufacturing and for a while 40 years ago was hydroelectric dams so China has a history of under of consumers understanding and regional and central governments over spending in which led to you know massive investment real estate and go cities I expect to see the same phenomenon I'll be it with a little less social consequences once all of this turns out to be it'll be much like what happened with their overbuilding in apartment buildings and residential and industrial space over the last decade which they I mean they definitely shook a little bit but they didn't crumble from it which is destructive which is instructive and I think it'll look a little like that and that's in large part because this is an economy not as reliant on consumer spending as Western economies in the US in particular yeah so Paul can I summarize what your position is which is basically we have a technology here that is commoditizing that is effectively you know any move beyond just selling sort of like pure intelligence is not going to be easy and alongside that we have a data center build out that is getting a ton of money based on this prompt on the promise that it will pay off but ultimately will be much more expensive than people anticipate and that is going to lead those two factors combined will lead to an inevitable collapse yeah and the only the only piece I would add to that is that structurally one of the reasons why the data centers will become an even more fraught business even with all of the other pieces working out is that this technology came to market faster than any technology in modern history and reach to billion users faster than any so under the hood there are vast inefficiencies the technology industry is very good at wiping away vast inefficiencies whether it's through the launching of new silicon or improving in software compilers or anything else so that's all a long way of saying that we should expect token deflation to continue and even accelerate in future because of how quickly this stuff came to market and how many opportunities there are to drive efficiencies so that creates just incredible pressure on the underlying economics okay last one for you what does AI look like after all this like is there you know even though that there's a prop there there will be problems ahead in your view there will be a winner the technology will continue to advance do you think I mean you know I know that investing based off of a call option on AGI might be unwise but do you think that there's a chance that that is where this technology goes what does the future look like in your perspective not this generation of technologies there's a deep structural problem with large language models that they can't they can't easily update the model weights in real time so in that sense these are not dynamic systems and you know you am LaCoon and others the former researcher at Metta who's now off doing his own world model thing sort of there's lots of people who will point we'll we'll say the same thing and so that I doubt that this is the this is the path but I do think it's incredibly valuable technology that in a sense will disappear and in that it will become like electricity it's a utility it will become underlying a host of other things that go on all the time and I will no more know who provides my tokens than I do from which hydroelectric dam the power came from the power in my MacBook right now so the open AI and Anthropics of the world their future is like a power dam I don't know who I don't know where they are who they are but I guess they exist and they'll earn utility like rates of return okay Paul thank you so much really appreciate your time today yeah sure no problem all right great well folks do sign up for Paul's newsletter it's at Paul Kadroski dot com this has been great I hope we can do this again thank you again to Paul and we'll see you next time on big technology podcast

Podcast Summary

Key Points:

  1. Paul Kydroski argues the current AI investment surge is a bubble, with spending exceeding historical infrastructure buildouts in scale and speed.
  2. Data center investments are compared to commercial real estate, but face unique issues: ongoing capital requirements, GPU depreciation, and rapidly deflating token prices.
  3. Token prices are falling 70-80% annually, requiring massive demand growth (potentially millions-fold) to justify returns, which Kydroski deems unlikely.
  4. AI models are commoditizing and converging, reducing differentiation and pricing power, pushing labs like OpenAI and Anthropic to move up-market, which is costly and difficult.
  5. The bubble is driven by groupthink, check-size filters among large investors, and a "call option on AGI" narrative, not sound economics.
  6. A collapse could be triggered by macro events, post-IPO investor pressure, export controls, or realization that training spending is inefficient; consequences would ripple through credit markets.
  7. Kydroski avoids direct AI investments and new broad index exposure, though he consults for hedge funds with related positions.
  8. China may be partially insulated due to state backing, but risks overbuilding similar to past sectors.
  9. Kydroski believes the technology is transformative but will become a utility-like commodity, with current labs earning utility-level returns.

Summary:

Paul Kydroski contends that the massive AI infrastructure buildout is a bubble, driven by unprecedented capital expenditure that now exceeds historical benchmarks like railroads and electrification in scale and speed. He emphasizes that data center investments, often framed as real estate projects, are fundamentally different due to ongoing capital needs for GPU replacement and the hyper-deflationary nature of tokens, which are falling 70-80% annually. This requires astronomical demand growth to justify returns, which he deems improbable.

Kydroski argues that AI models are commoditizing and converging, eroding pricing power and pushing labs to move up-market, a strategy that is costly and may fail. He attributes the investment surge to groupthink, check-size filters among large capital providers, and the seductive "call option on AGI" narrative, which he rejects as a logical fallacy. A collapse could be triggered by macro shifts, post-IPO investor disillusionment, or regulatory changes, with cascading effects through credit markets.

Kydroski avoids direct AI investments and broad index exposure, though he consults for hedge funds with related trades. He notes China may be insulated by state backing but risks overbuilding. Ultimately, he sees AI as transformative but destined to become a utility-like commodity, with current labs earning only utility-level returns, not the explosive growth investors expect.

FAQs

AI infrastructure spending is now larger than most historical capital expenditure moments, including canals, railroads, electrification, and fiber-optic buildouts, except for World War II re-armament. It is a remarkable historical moment in terms of GDP contribution and off-balance-sheet financing.

Unlike real estate, data centers require continuous capital for hardware replacement and upgrades, and the tokens they produce are hyper-deflationary, falling 70-80% year over year. This creates a duration mismatch and makes the real estate analogy fraught.

While token demand may grow, the compounding 80% price decline would require an implausible ~100 million-fold increase in token usage over six years. This makes it mathematically difficult for demand growth to compensate for the price collapse.

They are seeking higher-return places because the core token commodity is collapsing in price. However, this move is risky because it misunderstands why vertical software exists, and it will be painful and costly to service those markets.

It is often used as marketing to justify massive spending, but large investors are cynical and don't truly believe it. They use it with LPs but make decisions based on comparable project finance returns, not AGI potential.

It is over-determined: a macro event changing hurdle rates, post-IPO disappointment, export controls balkanizing markets, or realization that training costs are unnecessary. Any of these could trigger a pullback from external capital providers.

Chat with AI

Loading...

Pro features

Go deeper with this episode

Unlock creator-grade tools that turn any transcript into show notes and subtitle files.