Eric Schmidt: Singularity's Arrival, the 92-Gigawatt Problem, and Recursive Self-Improvement Timelines | 241

We're living through a historic moment right now. The next thing that's really interesting and terrifying also is recursive self-improvement, but we don't have it yet. What we do have. (dramatic music) I keep asking my friends, when does the asymptote arrive and when does the curve slow down? It is actually true that there is a limit to our craziness. We have not found it yet. And that's the great thing, frankly, about America. The American competitor, not enemy, the competitor is China. They have lots of money, they're very, very smart. Their work ethic is equal or stronger than ours, and they dominate key industries. But at the moment, it sure looks to me like the robotic hardware of China is the winner. I don't want to lose the robotic revolution, in my view, the way we lost the electric vehicle revolution, at least on the low end. It's possible, but it requires. (dramatic music) Now that's the moonshot, ladies and gentlemen. Eric, do you remember the first time we met? Yes, Larry Page introduced me to you because he was on your board. Yes, so I got a call from Eric out of the blue, which was a great honor, and said, Larry says I should meet you, when you can be down here in. Or up here in San Francisco, I was in LA, and I said, how about tomorrow? (laughing) Typical beater. And I remember something which was so. I love the story. We sat down to lunch at Charlie's Cafe, and of course I'm running a nonprofit, and my mission is always raising capital for nonprofit. And so we sit down to lunch, and before we get started, you said, Peter, so what is your highest level of giving a membership? And I said, well, Eric, it's our vision circle, for $2.5 million, and you go, okay, I'm in, now let's have a conversation. I'll buy them all. It was crazy. (laughing) Yeah, oh, there you go. (clapping) But somehow you have, the reason, when we spoke, the reason I wanted to come here, is this has become the epicenter of the abundance movement, and the abundance movement is correct. That's the important thing. Thank you. (clapping) I just wanna thank you for all the support you've given to myself, X Prize, all these years, so grateful for that. So, let's start with a question that I'd love to hear you expand on, which is we're living through a historic moment right now. Could you define the moment we're in, and give us sort of a state of the union of what's going on in AI? We're 10 or 15% into the impacts of this, and you can see it, you can feel it, and some of it will happen, some of it will take longer. So for example, Hardware ticks longer than software, sort of robots take longer than digital systems on traditional hardware, things like that. The next thing that's really interesting and terrifying also is recursive self improvement. It's not happening yet. And so it's easy to convince yourself that you're gonna have human agents, sorry, computer agents that are human-like completely within a year or two. We don't have the science for that yet. People are working on it. I can describe how I think it'll play out, but we don't have it yet. What we do have is reasoning systems that are perfect partners for human beings, for good and bad. And that has a lot of implications. So if we stop today, which we're not, and it's not stopable or controllable by any government or any single individual corporation, we would still have advanced humanity because of these reasonings. - How fast do you imagine this it can accelerate? - There's a thing which I call the San Francisco consensus. And the reason I call it is 'cause everyone in San Francisco believes this. Everyone I know anyway, which is that it's easy to understand. This is the year of agents, which we can discuss. Why agents will take over everything this year. During this year, the scaling of the use of agents and reasoning will sort of grow at this enormous rate. Everybody's out of heart, everyone's out of luck, just today. It's a real boom, right? It's like the biggest boom I've seen and I've been through three or four of these in my career. In this thinking, once you have recursive self-improvement, where the system can begin to improve itself, you have intelligence learning on its own and this argument, it will learn faster than we can 'cause we're biologically limited. And the way this is expressed in San Francisco and I'll give you a simple example, you have a tech company with a thousand fantastic AI researchers. So one day they turn on AI research, that is an AI research agent. Well, how many AI research agents do you have? Well, as many as you're limited by electricity, right? You don't have to feed them, they don't eat housing, there's no more housing in San Francisco, you're all that kind of stuff. You don't have those problems, you don't have an HR department for them, if you will. And you don't have to pay them, you just have to feed them electricity. So how many could you have? Well, maybe a million of these agents. Now, in AI, the way you've made progress is you have clear metrics that the reasoning or testing or whatever the evaluation framework is better. Right? So that's what happens. So in that scenario, the slope goes like this because you're already at this slope, then you add more people, then you get the agents and you go like this, and this is essentially a super intelligence moment. The belief in San Francisco is this occurs within two to three years. The evidence in favor goes something like this. Cloud code came out a couple months ago, the latest one, Opus, whatever it is. 4.6. Yes, thank you. And everyone I know in the Bay Area that's doing software says it was 80, 20 now, it's 20, 80. The best analysis I can come up with is it's not the Cloud code part, it's that the underlying LLM can produce more reasoning over time, better quality tokens over time. It's a deeper thinker. Right? And all the labs now are competing for that. This is not just the size of the context we're into, it's actually the reasoning skill and the length of which you can think. It can just think longer and produce more stuff. Right? I watched this stuff when I moved to the Bay Area when I was 21. And I was a programmer in high school way back when. And I was a pretty good programmer. And I watched what it does and I go, my God, I'm over. There's not a thing that I could do that it cannot do. So when they wrote a Seacompireller in Rust, I could, it's over, like declare six. So I think part of this is because the people who are building it are also seeing the diminution of their own skill. They're being forced to go from programmers, which is what I'm very proud to have been, to being the director of a programming system. Right? And the most likely scenario, by the way, there's a lot of implications for this. One is that it's always been true, speaking as your local arrogant programmer, that the very top programmers were 10 times more than the ones right below. There's something special about the mathematical reasoning skills of programmers. Those people will become more valuable, not less valuable, because these systems need to be controlled by humans at the moment. Those people will be capable of grasping the parallelization and the activities of this. It also means that you're going to have, in my view, a relatively small number of very large companies. Yeah. And this is a big deal. Yeah. And a very large number of very small companies, because you don't need as many people. And you're watching that play out this month. I mean, this all happened in the last three-- in one startup I'm involved with, I'm talking to the programmer, who's perfectly brilliant young man. And I said, well, what's the truth? He said, well, here's what I do. He's working on UIs of various kinds. And he said, I write the spec of what I want. And then I write a test function, an evaluation function. And then I turn it on. And I said, what time? And he goes seven o'clock in the evening. And I go, OK, what do you then do? Well, he has gender with his wife. And he goes to sleep. And I said, do you wake up? No, I sleep very well. When does it finish? Oh, four in the morning. And then he gets up, has breakfast. Does whatever he does. And then he sees what's been invented. I mean, it's mind-boggling. And this stupid example I use with this young man, this is what the power of these systems are. If you can define the evaluation function, and you can let it run. And if you have enough hardware, you're inventing worlds. I mean, this stuff would have taken me six months and 10 programmers at Google to do the same thing. And it's poor guy sleeping. Just so funny you say that, because I was literally backstage. They said, Eric Schmidt's coming now. And I have my lid open on my Mac. And I'm trying to get the jobs onto the clouds. I can close the lid. Because if you close the lid, it'll break the jobs. So I've got these six-conquering cloud 4.6. You can leave it open on the-- It's like important. You're doing Tony to wrap for me. You're important too. No, it's crazy. Because when we got together in Davos, just what, two months ago, it was in this kind of auto-complete mode. You'd write the code, and then it would help you get it done. You're about 10 times more efficient, but you're still babysitting it. Now, literally, it's working right now. When I get off stage, it will have solved six problems that I launched. And I appreciate the excitement in the industry. But I can tell you, when I used to work on BSD, I basically worked at Berkeley on Unix at Bell Labs, and at BSD Unix. And programmers invent what they need. And so we invented the first email system and the first messaging system. And nobody thought about it. It was like, well, we just need this thing. So one key thing to understand about digital intelligence is the first inventors are the people who are solving problems of themselves who are programmers. You shouldn't be surprised by this. You should have expected this. The other thing that's interesting about programming is it's both scale-free, which means there's no particular limitations except electricity. You don't need a lot of data, and you already have GitHub and the equivalents. And it's also a fairly limited language set. So the number of language components, if you will, compared to human languages less. Smaller language, clear objective function, all you need is electricity. Now, far from this go, it'll get to the point where you don't have the ability to do completely new things. Isn't it really quaint and crazy to think that we can sit here and say, yeah, I wrote a ton of code when I was younger? No one will ever do that again after the end of this year. It'll be like writing a horse. Well, there's not many skills that we all used to have. But I do have a proposal for universities. Those of you who are associated with universities used to stop everything else you're doing in the university right now and design a course for freshmen, men and women, who starting in September, which is a prompt engineering class. Why university? Why not in high school? God, you're so aggressive, Peter. Let's start with universities. You can improve my idea. I thought 18-year-olds would be young enough. Maybe you think it's younger. Here's the most important thing. Spend a quarter or a semester. The first thing they learn in university is how to use these tools. Universities are completely opposed to my idea, as usual, because it violates every one of their tenets. But if you think about the student-- and I mean every student, liberal arts, math, whatever-- this platform will be the expression platform for their art, their music, their writing, and so forth. Why wouldn't you teach them immediately, Peter, improve my proposal? No. I just feel like that AI is going to impact every student in high school today. And that they're living in a natural life by not engaging with it. And when they hit universities for those that still exist-- Well, plus your kids are that age. And so they're literally right now doing exactly what we were describing. People here who have teenagers-- you know what I'm talking about, because they're all in it already. So I think that's an improvement to my argument. There's a problem of age restriction. You really have to think about vulnerable teenagers with this technology. I did some analysis of where the real problems are with this stuff. A simple summary is that, at some point, there will be jobs impact from this stuff. We're seeing it in software, and we're seeing it in certain customer service industries, not across the board. At some point, that will happen. That's an issue. Another one is, how do we, as a country, maintain our moral values while we're also racing against China? Another one is the impact on young people. It is not OK for 13-year-olds to be committing suicide because of an LLM. It's just not OK. It needs to be addressed. It needs to be addressed right now, for sure. And there's all sorts of other issues. The other one I came up with was, in agent orchestration, agents can be combined. I've always been worried that when you put the agents together, especially if they're from non-compatible vendors, you get unpredictable effects. So these are problems to be solved. So we herald the future, and we solve the problems that it brought. We're going to talk about China and government and jobs. But before we do that, I want to say-- I'm in the savor of the moment, it's kind of mode right now, because I feel like the world, a year from today, will be nothing like the world today. And all everything we're doing right now, I've enjoyed so much for so long. And I just want to savor the moment. But reminisce for one minute about the fact that, well, you were running Google. The transformer got invented there. The TPU got invented there. Dennis Hassabis solved protein folding, which is now universally used. Does the work in-- I think it does the work in an hour that used to take a PhD student four years. There are four years. Yeah. It's like 300 million times more efficient. All of that-- and all the diaspora from that. All the people working in the field in San Francisco, as you mentioned, they all were your people. And so you were there at the creation of everything we're experiencing right now. Is there anything like that profoundly strikes you about that moment? Have you even realized at the time that I feel-- I think when you're making history, you typically don't know it. I give a lot of credit to Larry and Sergey, because they were ahead of me. I'm an operating CEO. And they pushed and pushed for excellence. And I'll give an example. In the early years of Google, Larry would-- my favorite interaction was one day I said, we need to hire some people doing Java. And Larry and Sergey said, this is the stupidest idea we have ever heard. And I could never tell with them where they were being serious or not, or they were just joking with me. But their argument was that real programmers were programming one level lower. Today Google has many thousands of things. But they were so precise and so driven to excellence in technology that I could not fool them. I couldn't market around them. I needed to have the technical expert. And they say, oh, that's boring. Don't do that. That's another one of your ideas. We want a new idea. And I give them a lot of credit for it. But what about the TPU in particular? That to me-- because I didn't even hear about it until much later, and it takes years to build-- design and build your own internal chips. And now it's about to explode. I don't know how much is public or not. But it's just-- Well, so the TPU version 1 was essentially a matrix multiplier of a particular con. When they went to version 2, they changed the algorithm in a complicated way. And it's particularly good for inference. Whether it's brilliance or just luck, those decisions made 10 years ago set up the TPU as the perfect inference engine. And for everybody's benefit, inference is what the reasoning steps that I'm describing on. So Google is particularly well positioned. As you know, Nvidia purchased GROC for the reason of getting that-- Get trying to catch up to what you thought of 10 years ago. And what's interesting about Nvidia, if you look at them, I was looking at the Ruben architecture. They managed to do-- Nvidia managed to do what Intel could never do. Intel could never get control of the complete server architecture. And they tried. Nvidia has managed to build real supercomputers that you can really buy with enough time and money and so forth. And it will really be delivered to you. And it just do the whole thing. These are major industrial achievements. And that's why both companies will do incredibly well. Right? For that reason. In the AI exponential growth right now, and talking to me about where the constraints are, you were in Congress talking about energy, chips, people, capital, where are the constraints right now? Well, it's interesting. I started a data center company with my friends. In my testimony, I said there was an estimated 92 gigawatts shortage of power in America between now and 2030. And by reference, a nuclear power plant is about 1.5 gigawatts. So it's about 60 nuclear plants. And we're doing essentially 0 or 1, right? Depending on how you count. So I got interested in the question of what's the real resource constraint in America and its electricity? We have the universities. We have the smart people. We have the economics. And we have these amazing finance people who will give all of us billions and billions of dollars on a wing in a prayer. There's no country where the finance people are sufficiently crazy to do that. It's not true in China. It's certainly not true in Europe. And these guys are incredibly jealous of the American financial system. So I always start, thank you to the finance people for funding our dreams, whether they work or not. Thank you. So there's usually a retort at this point where people say, well, the algorithms will ultimately require less energy. I am sure that that is true. There is this property that is the power of the hardware goes up as the algorithms become more efficient. You don't need less power. You need even more power and even more computers because we discover new uses. - Jevons better docs. - Oh, Jevons better docs. And so I think that because humans have trouble with exponentials, everyone says, oh, well, in six to nine months, it'll be the bubble and so forth and so on, there's no sign of this. We've been, I and a team, I've been working on this for years. the ultimate law, the ultimate essentially scaling laws are not done yet. I keep asking my friends, when does the asymptote arrive and when does the curve slow down? We've not seen it yet. There will be one. Right. We have not founded yet. And we're running to the wall. You think it's a limit to the capital or a limit to, if you just add more and more and more scale and parameters, something just doesn't work. Well, the first question is, is there a limit to the capital available? A gigawatt of power corresponds to about $50 billion of hardware, software, data centers, on the order of depending on what numbers you use. So 100 gigawatts is, do the math. And we raise $5 trillion over five years. Yeah. That's a strength of America. Could we double that? You know, we're getting, the data center build out is 1% of the GDP of America growing up. Yeah, right now. We'll go back to a follow-up program. Right. Right. And the current estimate of electricity use in America is that electricity, 10% of the electricity in the United States will be used in the data centers. And these data centers, these are not the data centers I used to build at Google, which seemed tiny by comparison. They were immense at the time. The standard data center that's being built is on the order of 400 megawatts. These things are plus or minus. And they're about a half a mile long and about 500 feet wide. Right. And they're essentially airflow machines. Take the air, send the air out, cool it in the middle using typically air cooling. And then they have a water system inside to keep the chips. And in videos, in example, the chips are water cooled and also the HBM3E and now the four memories put out so much heat that they have to be water cooled. The chips are two kilowatts. I mean, this is insane. These things will kill you. You want to hear something truly astounding and funny in hindsight. When you bought deep-mind, everybody thought it was like 800 million bucks or something. 600 million. 600 million. Everyone thought, why on earth would you waste 600 million dollars on this zero revenue AI? All it does is play go. And then years later, it came out that the acquisition paid for itself just by controlling the air conditioning more efficiently in the data centers, the entire acquisition price was paid off. And that became the AI that's changing the world. And the credit of that one actually goes to Larry Page. Larry had studied AI when he was a Stanford grader student. And we always deferred to him in this thing. And he said, this is the best team. And I think Elon and Larry competed over it. There was some complicated kerfuffle there. And so Jeff Dean, who's the chief scientist, went over and then he and I basically finished the deal. And I still remember, in one floor, these sort of British people and led by a sort of Greek, British person and demis. And they were smart. Google's full of other smart people. To give you an example in 2016, so demis announced is that we're going to win the game of go. I figured, well, and by the way, at this point, they're a separate group. We've let them alone because they have to grow and figure out what they're doing and all that. And this is the patience of capital. We could let them do that. We didn't require that they do anything. And so he goes, I'm going to go and say, well, I'm going to come to. And I said, OK. So I fly to Korea and it's all one floor and I go and I meet the team that's been winning the game. And of course, all of these Koreans, they're all very excited about this because they know they're going to beat the computer. And so the Koreans are in one room. I'm in another. I go to the Korean room and they're all saying, we're going to beat the crap out of this Google, Google group. And I go into the Google room and it's very quiet and there's a monitor. And basically what I now understand is an RL prediction mechanism of whether we're winning or not. Yeah, cool. OK. And it starts at 50/50. So I watch. I go listen to the Koreans talk for a while and then I go watch the screen and it goes to 51%. OK. And then it goes to 52%. And then David, who is the guy who's the architect, says, well, we just plan for it to get to infinity. OK. So basically it's the abundance theory. So it's just boom. And everyone is, all the humans are crushed. And people are crying. Yeah. Yeah. Yeah. Welcome. And then I understood the genius of the Deep Mind People. And you can see this today with Gemini. Gemini 3 is probably the broadest of the non-Chinese systems in terms of its depth. And because it's multilingual, multimodal, and so forth. And so many moments in your life are just turning points in history. And I don't know if you realize them in the moment. But that was one of the last moments where humans used to look for challenges where the computer could try to catch up like chess. And then I think Go was the end point. Now it's-- And we knew that, by the way. We understood that Go, the game of Go, was sort of incomputable by normal algorithms. Yeah. There was lots of math that said you couldn't solve it. And so it was the common-- they came up with a two-tree model with two different RL trees. So one of the other things I learned about these things is it's not just write me a Go program that will win the game. You actually have to understand the game and so forth. So they took the same team. They got bored with Go having won. So then they took the same team and had them work on protein folding. Yeah. And in protein folding, they took a whole bunch of protein scientists, which I know-- You go, wait, just think about the genius of that. Like, nobody would ever connect the game of Go. But that's demis-- solving all of biology. But Demis had always wanted to work on this. Larry and Sergey were very interested in this. And protein folding is the perfect problem because you had-- I defined endpoint. You had a defined endpoint. Yeah. So what happens is people get excited about AI, but you need to have a validation function, because these things don't have common sense yet. You have to show them what it's good. Ultimately, they produced this thing called Alpha0, which essentially self-learns. Let's talk about data centers in space. I'm in favor of it. Eight, eight, nine months ago, no one was discussing this. I mean, all of a sudden-- You do know why I'm in favor of them? I do. Why? You can mention it as you wish. But all of a sudden, everybody's talking about them. What are your thoughts? I'm a part owner of a rocket company, and we need-- Which I love having you come into the space, community. You understand this far, far better. It's-- Rocket science is named that for a reason. Rocket science is really, really hard. And I don't know that much about rockets, although I certainly know how to manage tech people. But I think that the opportunity is large and interesting. There are challenges. There's an issue of getting heat off of-- again, you know this is better than I do-- getting heat off of it, because you don't have oxygen. And you also have radiation issues. Those have to get addressed. But it makes the business plan for every rocket company that's large enough. The small guys aren't going to launch it, but relativity space and blue origin and SpaceX. I mean, you know, Elon's predictions were, I think, a launch per hour to populate the constellation he wanted. But do you think technically we're going to get there? Well, the technology is understood. What's interesting about that? Especially for the data centers and space for heat dissipation. Yeah, the radiation. And radiation is understood. To me, it's a business question. And the question is, where should the data center be? Should it be in space with these other issues? But it has other benefits, including infinite power and so forth, versus on the ground where you have fiber. And, you know, it's not shaking too much. Yeah. I mean, the energy argument says space wins by far. And I think the cooling is a very big challenge. But I think it's largely figured out now. And then the politics of space. You know, one of the turning points in AI history also is you're getting in front of Congress and saying, hey, we need to find almost 100 gigawatts. And at the time, it seemed outrageous. And now, of course, it's mainstream. And it looks like, you know, the crazy investors are solving the problem. You're unleashing the money. Welcome to American capitalism. Yeah. Tech industry. I mean, we have another set of problems. Well, for the next frontier is space. But there's no investment community in space. There's also no military jurisdiction in space, or maybe there is. I would have never thought my childhood dreams of going to the moon in Mars would be fueled by data centers. Never. Well, mine can't carry you at the moment, but he can in the future, maybe. Yeah. All the way. I read a time op-ed piece you wrote last night. China can dominate the physical AI future. Or, what did you-- can you summarize that for us? It was an important-- so in the geopolitical context-- and I've said this many times, I'll say it again-- the American competitor, not enemy, but competitor, is China. I think it's-- by the way, I think it's an important distinction for you to make. Not-- not enemy competitor. And how to understand them as a competitor? They have lots of money. They're very, very smart. Their work ethic is equal or stronger than ours. And they dominate key industries, right? With respect to robotics, we somehow decided it was OK for them to dominate the electric vehicle industry. This was an error. To be very clear, it's an error. Why do you not understand it's an error because we don't allow their cars in? It's been some time outside of this country in Chinese cars. Trust me. They are real competitors. They've done a great job. As I understand it, China is capable of vertical integration and build these gigafactories at a scale that we can't for all sorts of reasons. That's got to get addressed. So if you want to compete and I want to compete and win with China and I compete not in any way, I want us to have the same kind of system. So in robotics, it turns out robotics, you can understand robots as essentially actuators. These little stepper motors, click, click, click, click, click, click, and a brain, ignoring the appearance and the Google, you know, eyes and all of that kind of stuff. It turns out that the industry of the electric vehicle produces the same kind of motors and the same kind of systems. They have an expertise that we don't. My own view is that at least for very low cost, China is going to win that. And that was what I was trying to say in that piece. And I worry about that. Now today these are not particularly useful. You know, they're fun toys. They're a replacement for the dog. If you get mad at your dog, sorry, I love dogs. But you get the idea. So we need to address this. But at the moment it sure looks to me like the robotic hardware of China is the winner. At the low end. I'm not talking about the high end. I'm not talking about this offensive stuff. I'm not talking about industrial robots. And if you're confused, watch the unitary robot dance with the humans. Yeah. It came out about a month ago. We have a unitary here in the tech hub and the co-founder will be on stage with us later today. Pay attention to them. They're very, very impressive. And I spent some time with them last time I was in China. And they're one of many. And the way the China works is that they have brutal competition, brutal, brutal, it's like unbelievable. I was talking to my friend. We teach at Stanford. And he said, you know, in China, we don't have the board dinner. We have a tour meeting we get back to work. And there's no preamble. We're not, you know, we don't say hello. How are you? How's the family? That kind of stuff. We're boom, boom. Right. It's just cultural. Yeah. And the work ethic, the precision and the scale that is possible in China is a real competitor. Interesting. Because the Chinese model very much has a well-built out supply chain with many vendors in the loop. We've been on a worldwide tour of all the humanoid robotics companies, just like Winston and I guess. But when you look at the gigafactory and look at Elon's vertical integration, then also the red adcock, it figures the same thing, it's all vertically integrated. Why? Because there's no vendor. I have no choice. Absolutely. So it appears that, again, this is the abundance group. It's the abundance club. The way you get to abundance, you should drive prices down and you get vertically integrated. And Elon in our country pioneered that to his credit. Right. The old joke about Google was we would build anything including the buildings. Well, Elon is actually doing that. Right. And why? Not because he's insane, but because he actually, that's how you drive costs down. Yeah. He truly believes, and I'd love to get your take on this. He truly believes that the robot building the robot is imminent. And I didn't get it until we toured the gigafactory and I realized that almost all that's automated already, it's just the last piece is the human controlling a few knobs. And that, you know, the humanoid robot can actually do. Let me define the boundary because it's important. These use batteries, for example. Batteries are predictable, straightforward manufacturing processes at huge scale. Things like that will have gigafactories. One of the questions I've of course used, LLMs, to do my deeper search as a new person in the rocket company was how much of the human labor to build a rocket could be replaced by robots. The current limit, which of course will change, is in our company we have these extraordinarily talented, essentially, assembly people. And they're more than welders and they're more than mechanics. They understand precisely how the little, the tubes and so forth and so on go together and they use precise tolerances. That kind of assembly is beyond current robots. I'm sure it will eventually show up, but not for a long time. People don't realize the majority cost of a rocket is labor. Exactly. And for them, when they get inside the rocket, they understand what they're doing and they see what's wrong and they use human judgment. We don't have those systems yet. Now perhaps we will in the future or perhaps this will be one of the last things to go. But at the moment, high skilled mechanical labor is very important. Low skilled labor of any kind gets swept up. So both of those, there's AI self improvement and then there's robotics building, robots self improvement, both of those loops. We talk a lot about closed loops being, if I can interrupt you. The term I like to use is learning loops. In a business, try to figure out all the different learning loops and then try to accelerate the learning, fastest learner wins. Sorry. Well, I'm going to leave the witness here a little bit. But if you asked Danielle LaRouce over at CSALE a year ago, Eric Bernoulli-Soon at Stanford a year ago, do we need one more big breakthrough in AI core science? Or will scaling what we've already got lead to self improvement and then that will be all we need to get to AI and self improvement. I spent the last week doing RSI reviews, recursive self improvement reviews. The scientists do not agree on the exact approach to work yet. So I think it's too early to know that question. There's evidence that it will work. There are tests in the lab that show it, but they show it in limited cases that are kind of demos. Real recursive self improvement is the following. Start now, learn everything, discover things and tell me what you learned. That query doesn't work yet. We're seeing all of the frontier labs sort of constantly leapfrog each other, right? I mean, literally every week it's the new model. Unbelievable. And it's extraordinary. Do you imagine they're all converging towards the same endpoint or is anyone going to pull ahead? So if you go back to this question of capital, how much room is there in the world for these companies? How many can there be? I'm going to make some numbers up. And these are made up. I think there's at least 10 in the world at this scale. I think there'll be a few in China. I think the majority will be in the United States, the usual suspects most likely. I think they'll be if they might be one or two in Europe, depending on their electricity costs or a problem. There might be one in India, right? There's not going to be one in Russia because of the war and so forth and so on. So can the world accommodate 10? Yes. Do they track together? I don't think so. What are the key things to understand about China is China's approach, which is produced DCV4, QAN, Kimi version 3, etc. and more coming. It's all open source, open ways. They've managed to do this with our ship limitations against them, which annoy them no end. It shows you how clever they are. They're also the Chinese strategies a bit different. It's less central computing and much more edge computing, which has to do with enveloping their Chinese customers with AI around them all the time. We're much more AGI, ASI-centered, which is fine. So the patterns are diverging. Within the companies, it's a jumble now, but fundamentally, Microsoft and Google have these large cash flow streams from enterprise, so they can fund that. And Throbbing has done a fantastic job of raising money from those other companies and they use as Google TPUs. They've become the leading player in this sort of clawed API within the enterprise agent system. And OpenAI is now shifting a bit of its strategy to include the new things it's doing. I don't think we can predict. But the key thing to understand is that they need so much money. Look at what Sam is trying to raise. They need so much money that they're forced into these situations where they have to win those battles, and they're busy winning them. I mean, this is all good. I think it's, in a year, we'll know better at the answer to your question. I have two questions I want to close us out with that. I think they're important. You made a statement a couple of times once in our podcast, once, elsewhere that regarding AI safety, the world may need to have a modest Chernobyl-like death event in order for us to wake up. Do you still believe that's the case? Yeah. And by the way, I'm not endorsing that. I'm doing it as a descriptive, not as a pro-scriptive. What are the real dangers of this? They're biological dangers. I mean, there's obviously the dangers of kids and democracies and so forth. Let's think about, like, a biological attack, a nuclear attack that's spawned by these things. It may take such a tragedy, hopefully a small one, to awaken the world to understand that these things are or they do have negative power. And so I can imagine I'm making this up that there's some bad thing that happens. And then all of the leaders, China, the US, all have a meeting. And we basically say, like, what are we going to do? We're in brutal competition. We hate each other. I don't like you. You don't speak the same language, blah, blah, blah. But we are all in it together over this issue. My sense is that will happen, but I don't know when. Oh, we had a congressperson on this stage last year and one of the crowd asked, how much time do you spend talking about AI in Congress? Yeah. Well, it's definitely way less than 1%. And so without that wake up call, I don't see how you have-- I mean, governments-- I spend lots of time with governments. Governments are super busy, right? And they're driven by political things. They're driven by, at least in democracies, by political sentiment. I'd like us as a nation to focus on the following. I want to win the AI race. I want us to do whatever it takes to do that. This government is doing a very good job of making energy permitting more accessible. The rate at which data centers are getting built is now accelerated, solving the grid problems. I also want lots of immigrants in our country, because those immigrants, at least the high skills immigration, is what we need, because we need the smartest people in the world on our side to build these systems. This is a unique moment in history, right? [APPLAUSE] I would take us home on a positive note. So you said we're going to get to ASI at some point, whether it's two years out, five years out, someplace in this next decade. So the questions is, what steps can we take to steer artificial superintelligence towards abundance, towards uplifting and in alignment with humanity? To make this abundance thesis materialize, what's your advice to us, companies, governments? There's an over-reliance in our society on people like me to work on this. Why don't we have the smartest people in politics, history, human psychology, governance, ethics working together to make sure the stuff stays in human values and human alignment? I want the system that we build in America to reflect American values. The values of freedom and freedom speech and freedom of association, all those things you learned in college. And excuse me, in elementary school and high school, they're still important to our nation. They're the enablers for the next generation of our children and grandchildren. I desperately want that. And I don't want America to ever get on the wrong side of that battle. There's lots of people working on this. Lots of people understand the technical details. I happen to run an informal group that discusses this every week. So it's possible. But it requires political will, and it requires an understanding that this can be done without screwing up the genius of America. In other words, I'm not suggesting slowing anything down. And you said it so well, shaping it, making sure we don't cross lines. Like I already mentioned the underage kids problem. That's a line we can't cross. We've got to solve that problem. There are others. [MUSIC PLAYING] [MUSIC PLAYING]