Go back

20VC: DeepMind's Demis Hassabis on Why AGI is Bigger than the Industrial Revolution | Why LLMs Will Not Commoditise & We Have Not Hit Scaling Laws | Bottlenecks in AI & The Energy Crisis Caused By AI | Whether AI Will Do More to Harm or Help Inequality

35m 49s

20VC: DeepMind's Demis Hassabis on Why AGI is Bigger than the Industrial Revolution | Why LLMs Will Not Commoditise & We Have Not Hit Scaling Laws | Bottlenecks in AI & The Energy Crisis Caused By AI | Whether AI Will Do More to Harm or Help Inequality

In this interview, DeepMind’s Demis Hassabis discusses AGI, defining it as a system with all human cognitive capabilities and predicting a high chance of achievement within five years. He notes that compute is the biggest bottleneck for both scaling models and conducting experiments, but scaling returns remain strong, though slower than initially. Key missing capabilities include continual learning, advanced memory systems, long-term planning, and consistency—current systems exhibit “jagged” intelligence, excelling in some areas while failing at elementary tasks in others. DeepMind’s recent progress is credited to organizational changes that unified talent and resources, allowing them to act like a startup and regain a leading position. Hassabis believes the gap between frontier labs and others is widening, as algorithmic innovation becomes crucial; open-source models typically trail by about six months. He envisions AGI as a tool for a golden age of scientific discovery, particularly in drug discovery and medicine, but notes that clinical trials remain a slow process that AGI could eventually help streamline through simulation and patient stratification. Safety concerns include misuse by bad actors and ensuring future autonomous systems stay within guardrails, with international regulation needed to set minimum standards. Overall, Hassabis is optimistic about AGI’s potential but emphasizes the need for careful development and oversight.

Transcription

6862 Words, 38383 Characters

English
The returns are still very substantial, although they're a bit less than they were, obviously, at the start of all of this scaling. I would say about 90% of the breakthroughs that underpin the modern AI industry were done by either by Google Brain or Google Research or DeepMind. Those labs that have capability to invent new algorithmic ideas are going to start having bigger advantage over the next few years. The last set of ideas are sort of, all the Jews has been run out of them. Now, I sometimes quantify like AGI, the coming of AGI is like 10 times the industrial revolution at 10 times the speed. This is 20 VC with me Harry Stubbins, and I'm so excited for the show's day. I walked to this interview, and I described it to my mother like this. We have amazing guests on the show, but very few, honestly, will be considered in the same realm as Newton, Turing, Einstein. Our guest today is one of the greatest minds on the planet, and I consider myself incredibly lucky to have had the chance to sit down with him and discuss what we did today. This is a truly special one, and one that I'll remember for a very long time. Enjoy the episode, and I so appreciate the time we had with a very special human being, and thrilled to welcome Damace Asalvis at DeepMind. But before we dive into the show's day, did you know the industry average for booking a business trip is 45 minutes as a massive waste of your team's time? Or would anivan your employees can book a trip in just seven on average? Anivan is the AI-powered travel and expense platform designed for companies that value efficiency. It drives real business impact through high employee adoption and automated policy control. Now the built-in AI approves in policy bookings and blocks the rest automatically. This allows finance teams to stop chasing receipts and skip the month than chaos, and you get this real time visibility that can save your company up to 15% on your travel budget. And that's why leaders like Visa, Stripe, Figma, and even anthropic rely on Nevan these days. Go to Nevan.com/20VC today to see for yourself, and you'll get a chance to win two business class flights anywhere in continental US. No purchase necessary rules apply. Head over to Nevan.com/20VC now. Once Nevan simplifies the travel, air will exemplifies the spend behind it. Founders, let's get real about the growth tax. You've raised VC funding and you're scaling globally, and it's no longer about shipping product. It's about orchestrating operations across continents, but suddenly your payments and finance stack is choking your growth. You're logging into lots of different banking portals, waiting days for transfers, and reporting across entities. It's operational drag and it's at your scale. It's costing millions. That's why I'm so excited to partner with Air Wallix. Air wallets are more than just a banking alternative to HSBC or city. Air wallets brings you an intelligent financial operating system that powers how global businesses operate and grow, allowing you to manage and automate banking, treasury, payments and spend. The most exciting part for me, they're heavily investing in agente finance. If you're scaling globally, you need a banking and finance platform that's borderless, real time and intelligent. Check out Air Wallets today and see how they're helping thousands of businesses like Canva, McLean, and Deal. Scale at airwallets.com/20VC. Terms and conditions apply. Your money's a safeguarded, not FSCS protected. See airwallets.com for more details? While air wallets helps your money move globally, Vanta helps your security keep up. Security and compliance done wrong is a giant headache. Security and compliance done right though? Well that's Vanta. Vanta helps you earn trust and speed up growth. No spreadsheets required. For startups, low on time and resources, Vanta becomes your first security hire, using AI and automation to get you compliant, fast and unblock really big deals. And if your big enterprises, Vanta is your AI-powered hub for compliance and risk, bringing together data from across your business and automating workflows so you can prove trust at any moment. Vanta scales with you at every stage. That's why top companies from startups like Cursor to enterprises like Snowflake choose Vanta. Do security and compliance right? My listeners can get $1,000 off Vanta by going to vanta.com/20VC. That's vanta.com/20VC. For $1,000 off Vanta. You have now arrived at your destination. Dennis, I'm so excited to be doing this. Thank you so much for joining me today. Great to be here. Now there are many places that we could have stopped, but I was watching actually the documentary that you did, which was fantastic. And I actually wanted to start on AGI. Definitions are very varying. You've been very thoughtful about what it means to you. And so I wanted to start. Can you explain to me how you think about it today? So we get that as a kind of ground center. Yeah, we've been very consistent how we define AGI as basically a system that exhibits all the cognitive capabilities the human mind has. And that's important because the brain is the only existence proof we have that we know of in maybe in the universe that general intelligence is possible. So that for me is the bar for what AGI should be. It's the worst question. How close are we? Everyone has different things. And it's very difficult when you have a very prominent figure saying it could be as early as 2026, 2027. Yeah. I mean, I think, look, I've got a probability distribution around the timings. But I would say there's a very good chance of it being within the next five years. So that's not long at all. Is that close as a new thought? Has that changed over time? Not really. Actually, when you-- it's funny, my co-founder Shane Legg, who's chief scientist here, when we started out deep mind back in 2010, he used to write blog posts predicting about when AGI would happen. And bearing in mind, in 2010, when we started, almost nobody was working in AI. And everyone thought, AI basically did work. And with the greatest of events, no one was reading the blog pages. No. But they're still there on the internet for people to check. And we used to do this extrapolation of compute and algorithmic progress. And basically, we predicted around 20 years it would take from when we started out. And I think we're pretty much on track. What are the biggest bottlenecks when you look today in the documentary set you just never have enough compute? What are the biggest bottlenecks when you look at where we are today? I think compute is the big one. Not just for the obvious reason of scaling up your ideas and your systems as the scaling laws as they're called, keeping them building bigger and bigger architectures with more and more parameters. And as you do that, you get more intelligent systems. But the other thing you need a lot of compute for is for doing experiments. The computers, the cloud, is our workbench, basically. So if you have a new idea, a new algorithmic idea, but you want to test it, you kind of got to test it at a reasonable scale. Otherwise, it won't hold when you actually put it into the main system. So you need quite a lot of compute if you have a lot of researchers with lots of new ideas. You mentioned world scaling laws. A lot of people suggest that we're hitting scaling laws and we're starting to see that plateauing effect. Do you think that's true? No, I don't think so. I think it's a bit more nuanced than that. So of course, when the leading companies all started building these large language models, you're getting enormous jumps with each generation of new system. You know, maybe they're almost like doubling and performance. At some point, that had to slow down. So it's not kind of continuing to be exponential. But that doesn't mean there isn't great returns still for scaling the existing systems up further. So we and the other frontier labs are getting a lot of great returns on that kind of compute expansion. So I would say the returns are still very substantial, although they're a bit less than they were, obviously, at the start of all of this scaling. Where are we behind where you thought would be? I think actually, in most areas, we are ahead of where I thought we would be. If you think about things like the video models or even now with our newer systems, like Genie, they're interactive world models, which I think is kind of incredible if you sort of step back and think about it. I think if you'd show me that five, 10 years ago, I would have been pretty amazed. So I think in most domains, we are ahead of where the field thought. There's still some big things missing, though, like continual learning. These systems don't learn after you finish training them, after you put them out into the world. They're not very good at learning further things. And I think some critical capabilities are that. Why is that? I'm sorry to ask Blunt and basic questions. Why do we not have continuous learning? Well, people haven't quite figured out yet. And all the leading labs are working on this, like how to integrate new learning into the existing systems that you spend months training. Of course, the brain does this very elegantly, right? And probably through things like sleep, reinforcement learning. So you just kind of get consolidation. It's called in the brain, where your memory is during the day are replayed. And then some of that information is elegantly incorporated into your existing knowledge base. And perhaps we, I thought for a while, maybe we need something like that to incorporate new information along with the existing information base. You mentioned video models. You mentioned kind of media and image. It seems that DeepMind has progressed very quickly and caught up slash overtaken other providers. I think I'm tweeting. I think you liked it. But I basically tweeted what I used and how it's changed over time. And DeepMind now has my number one for research for new shows. It wasn't that way before. What has led to the acceleration and progression of DeepMind in a way that it wasn't maybe there two to three years ago? Yeah, well, we made some organizational changes. So I think we've always had the deepest and broadest research bench at Google and at DeepMind. I mean, if you look at the last decade or plus 15 years, I would say about 90% of the breakthroughs that underpin the modern AI industry were done by either by Google Brain or Google Research or DeepMind. So one of our groups, if you think they're like AlphaGo and reinforcement learning and of course, Transformers, these are all the key breakthroughs. So I would back us to sort of make those breakthroughs in the future if there are any missing ones. and I think we've basically. helped put together all the talent from around the company, sort of pushing in one direction. And then we talked earlier just about compute resources. It was also about combining all of our resources together so we could build the biggest models rather than having two or three versions around the company. So I think a lot of it was assembling together all the ingredients we already had and then kind of pushing with relentless sort of focus and pace, acting almost like a start-up really, to get back to the frontier and be ahead in many areas. You say if anyone's going to do the breakthrough, it could and should be asked. Yes. When you think about that, is continuous learning the next breakthrough that you're most excited by? I think there's quite a few things that are missing. There's continual learning. I think there's a lot of mileage in looking at different memory systems. At the moment we have these long context windows which are kind of a bit brute force. You just put everything in them. I think there's a lot of interesting, probably, architectures to be invented there. Then there's stuff like long-term planning, hierarchical planning. These systems are not very good at planning at long time horizons, many years into the future, which we are with our minds. We can do. There's quite a lot of problems I think that still left to overcome. Maybe one of the biggest is consistency. I sometimes call these systems jacket intelligences because they're really amazing at certain things when you pose the question in a certain way. But if you pose a question in a slightly different way, they can actually still fail at quite elementary things. A general intelligence shouldn't be that sort of jagged. When you reposition files and you set up agents to perform in certain ways, and then the files can be configured. It can be completely full-sled. Exactly. A hundred percent. That's a disaster. Well, I mean, the general intelligence, if you think about how our minds work, it shouldn't have those kinds of holes in it. We said about a plateauing of scaling. Was everyone taught us about a commoditization of models in terms of capabilities? Do you think we see that or do you think we see one to continue to accelerate ahead of the others? Yeah, I feel like maybe the three or four leading labs now, which we're one, I think the gap is starting to pull away. Because a lot of these tools also help you build the next generation, so things like coding tools, math tools. It's getting harder and harder, I would say, to e-cout the same gains from just the same ideas. I think those labs that have capability to invent new algorithmic ideas are going to start having bigger advantage over the next few years. As the last set of ideas are all the juices being rung out of them. You were very open with a lot of your research for years, and we see many very good quality open models. How do you think about the future of open? I have many portfolio companies that use frontier models, and then they use that to set a benchmark, and then they use open models to kind of get as close as possible with more cost effectiveness. What does that future look like? Yeah, I think it's probably similar to what we're seeing today. We're big supporters of open science and open models, and we've done many, many things, obviously, from the original Transformers to AlphaFold. These are all things we've sort of given out into the world and to help the research community. And we plan to continue to do that, especially in applied domains, scientific domains, applying AI to science, which is obviously my passion. But increasingly, what you're going to see is the open source models are probably one step back from the absolute frontier. It usually takes about six months for the open source community to sort of re-implement and figure out what those ideas are. But we are also pushing hard on a kind of suite of open source models called Gemma, which are, we're determined to kind of make best in class for their sizes. So specifically for small developers or academics or the beginnings of a startup, I think they're perfect for that and also edge computing too. So we're very interested in open source models for certain types of applications. How do you think about a world post-LR lamps? You have different people with different views, your Alan Akun's with very different views. For me, I don't think it's a kind of disagree with you and on a few things in terms of, I think there might be, there's 50/50 chance there's some things maybe missing that we still need to make breakthroughs, impacts their world models, these kinds of approaches. But my betting is pretty strongly is we've seen how successful these foundation models have been. They can do incredibly impressive things. I don't think that's going to go away. We're still seeing gains from the returns from the scaling laws. I think the only question really is when you think about a future AGI system is an LLM foundation model going to be the key component only or is it the total system. So I just think it's a question of, is there anything else needed? I don't think it's going to get replaced. I think it's going to get built on top of these foundation models just like the way we do with our world models. When we think about that in future, five years now, as you said, potentially with AGI, what does that world look like? Many people have different concerns. If we just start generally, what does that world look like? I think on the positive side and the things obviously I've spent my whole career in life building towards AGI is I think it will be the ultimate tool for science and medicine. So in terms of advancing scientific discovery, finding cure-istered diseases, I think we need that kind of technology. And so I hoping in five years plus time will be sort of entering a new golden era, golden age of scientific discovery. So my mother's got multiple sources. So it's something that I'm always most excited about. The thing I worry about is actually kind of drug discovery, the process of getting it through all the trials and knowing that it takes a decade before my mother will actually get any benefit from it. How do we solve that? Yeah. So I think we'll get to that point soon. First of all, what we're doing is after we did the AlphaFold project to do protein folding, then we spun out a company called isomorphic labs, which is doing extremely well. And that is supposed to, you know, the idea there is we're focusing on solving the rest of the drug discovery process, which is a lot of chemistry, designing the compounds, checking it's not toxic and all the different properties you need for drugs to be safe. I think we'll have that whole drug design engine ready in, you know, the next five plus five to ten years. Then you're right. The next problem is the clinical trials still take many, many years, right? But I think AGI can help there in terms of simulating parts of the human metabolism, also stratifying patients to make sure that certain patients get exactly the right type of drug that's suitable for their genomic makeup. And so I think AGI can help there too, but I think the real revolution will come when a few maybe a dozen also AGI drugs get through the whole process. And then the government and the regulatory body see that and they have enough data to sort of back test the predictions of those models. And then maybe what we can do will be in the future where maybe ten further years where we can really just trust the predictions that the models are making. And actually then maybe skip out some steps, perhaps like the animal testing is not needed anymore. Maybe we can go up the dosage ladder quicker because you can rely on these models. So I think we've got to do in two steps solve the drug design problem first and then look at the regulatory length of time it takes. Speaking of regulatory. AIS safety is a big topping in a big concern. I think it was, again, I watched it last night over dinner. It was a great watch, which is obviously the documentary. I think it was Steven Hawking he said we must get it right because we might not get another chance. Do you think that's right? Yeah, I do think that's right. I think that is the stakes that we have to deal with. And you know, there's two things I worry about. One is the misuse of these systems by bad actors and they can be repurposed. These are dual purpose technologies. They can be used for incredible good in science and health as we just discussed. But they can also be repurposed for harmful ends by a bad actor. So that's one issue. Second issue is a technical one, making sure these systems as they get more powerful, not today's systems, but maybe in a year or two's time when they become more agentech, more autonomous as we get towards AGI, can they be kept on the guard rails that we want? And I think regulation, the right kind of regulation could help here in terms of making sure there's at least sort of minimum standards from all of the leading providers. But it needs to ideally be a kind of international standards. What is the right kind of regulation? And again, I'm quoting yourself back and this sort of mentioned you're like, I think we need more global coordination, which worries me because we're getting worse at it. Yes. Which I think would be an unwavering truth. Yes, for sure. I mean, that's sort of crazy. The timing that we're in right with this most consequential, maybe technology, the world's ever seen at the same time as a very fragmented sort of international system. And it's not ideal, but I think we're going to have to try and do the best we can to at least come up with a sort of set of maybe minimum standards, some benchmarks that test for undesirable properties. For example, deception, nobody wants to be building systems that are capable of deception because then they could be getting around other safeguards. And then I imagine if things go well, some kind of certification process that basically is almost like a kite mark of inequality that this model has certain safeguards and certain guarantees. And so therefore consumers and companies can safely sort of build on top of it. And I think that is how it should go, ideally, but it does have to be international because of course, these systems are cross border and they're cross territory. Who is that? I ultimate verification system. You obviously started with theme park. I'm probably going, yeah, brilliant. The burger's down too close to the roller coaster. But obviously as a media company, I go through any media platform saying, I don't know what's real or fake. I'm always having to ask what's real fake. Who is that arbiter of verification? Yeah. Well, I think ultimately it's got to be government, I think. But the kinds of technical bodies that would be able to do the technical work would be like maybe the AI Safety Institutes. You know, there's a very good one in the UK that we set up under Prime Minister Sunak and I think it's doing great work and then there's one in the US and maybe some of the leading countries that that have the best research should also have an equivalent body that is staffed with high quality researchers too, that can actually evaluate and audit these kinds of systems against certain benchmarks and I kind of like independently check whether they are meeting the right standards. If I could give you like a magic wand, but there was only applicable to AI safety, sadly, what would be your implementation idea program that you would put in place with this magic wand? Yeah, I think we need some kind of international body, maybe similar to the atomic agency, something like that that perhaps the AI safety institute sort of feed into and the research community has to also do this and be involved in like what are the rights set of benchmarks to check what types of traits, what types of capabilities. Maybe there are other safeguards too, like, you know, it's it would be desirable to have AI systems output tokens that are not human readable. So, you know, in some kind of machine language that we couldn't understand, I think that would introduce a new vulnerability. So there's quite a few sort of things like that, which I think most of the leading labs would agree probably not best to do. And then these bodies would, you know, these institutions would test against those things. And I think that would give the public confidence and, you know, academia could be involved as well as civil society that these systems are going to get incredibly powerful have been independently checked and audited. And that your magic wand's done now. Yeah. And then we've done the wand wand. Maybe I used it on the wrong thing. Time will tell. You said that about science being one of the most exciting areas of the five years time. I have to ask it because it's one of the biggest concerns is the labor displacement problem. I just had Mark Andreessen on the show actually and he said that I was a, he said I was a Marxist for, I know, which I always like a bush. A green, yeah, Mark's wonderful. So I'm not blaming him, but he was like, it's completely rubbish. Yeah. I don't agree that at all. We've always overpass overcome it. How do you think about the labor displacement problem when you look at how truly capable these systems are? Yeah. And what that does to labor markets? Well, certainly, you know, in the past, with every new revolutionary technology, there's been a lot of jobs disruption. So that's for sure. And I think that's definitely going to happen. So a lot of old jobs, you know, go away or not vibing more, but then actually the history of it is the whole set of new jobs arrive that maybe one can't even imagine before and those are high quality, higher paying. So that's the normal course. Of course, you have to be very careful to say this time is different. And I guess that's what people like Mark are claiming is like, you know, it's the same as as as the last sort of, you know, 10 massive breakthroughs like the internet, mobile and so on. I do think this is going to be bigger than all of those previous breakthroughs, technological breakthroughs. I mean, I sometimes quantify like a GI, the coming of a GI is like 10 times the industrial revolution at 10 times the speed. So unfolding over a decade instead of a century. You know, I've been reading a lot about the industrial revolution. There's a lot of great books about it. That calls a huge amount of upheaval as well as a lot of advances. I mean, we wouldn't have modern medicine today. Child mortality was at 40% back in back pre industrial revolution. So things think you wouldn't want it not to have happened. But ideally this time around, we mitigate some of the downsides a bit better than we did during the industrial revolution. I often listen to amazing voices like yours. I get very excited about how fast it's coming. Yeah. And then I try and stock myself from being too useful and think I should be more wise. Yeah. And I'm told that, you know, we always overestimate what can be done in a year and underestimate what can be done in 10. Is that the truth here? Or is it actually coming faster than we know? I think that's still the truth. I mean, maybe all the top both times, scales of short term, a long term, a nearer than other technologies. But I do think like literally today, as of today and in the next year, things are a bit overhyped in AI. I mean, there couldn't be any more hyped in some ways. But on the other hand, interestingly, I still think it's still very underappreciated. How revolutionary this is going to be in the sort of time scale of about 10 years. We could call that long term. So there's still that dichotomy even today with AI. With the concern around labor markets, there's also a concern around income inequality and the concentration of wealth of few players. How do you see that shaping out with the comment on industrial revolution and what happens there? Well, I think there's different ways that could play out. So, you know, maybe pension funds should be buying into all the big AI companies and making sure that everyone has a piece of that or sovereign funds. Maybe every country should have a sovereign wealth fund that does that. That would be the investment way of doing it. I think also there needs to be thought about if there is this massive productivity gain, but it's sort of narrow where that accrues. You know, how do we redistribute and how do we distribute that so that everyone benefits from these huge gains? And I can see all sorts of ways that could be done, including like providing sort of infrastructure and other things with that additional productivity gain. I mean, there could be unbelievable things happening in the five to 10 year timescale, including like a breakthrough in some kind of renewable free energy. You know, maybe we solve fusion. We're working on that, right? With partners at Commonwealth Fusion, I think AI is going to usher in. You know, maybe we have amazing new superconductors, better batteries, you know, material science. There's all sorts of ways I could see that completely changing the nature of the economy. How do we solve the energy crisis that comes with an AI revolution? What it means in terms of energy requirements is unprecedented. I know it's an incredibly hard question, which I'm delving from really hard question to really, but how do we solve that unprecedented need for new energy? Well, I think actually AI will in the, in the medium to long run more than pay for itself, I think in terms of energy costs. And so, you know, we work on all these projects of like optimizing existing infrastructure, like optimizing the grid. I think we could probably get 30, 40% more efficiency out of our national grids. And then there's like modeling the climate and weather and we have all sorts of the best kind of weather modeling systems in the world. So that helps us work out where the effects are really happening to mitigate that. And then finally, the most exciting maybe is like these new breakthrough technologies, light fusion, like new batteries, superconductors that I think AI will be essential for helping us reach. And then I think we'll be in a completely new energy situation than we've ever been as humanity where I then that will of course help with things like the climate and environment and eventually also help us get into space much more cheaply. Because if you have a, you know, an incredible energy source, light fusion, then you have effectively unlimited rocket fuel because you can just still catalyze sea water. I'm not going to ask you to solve space. Don't mind that. My question was on being in the UK. Yeah. You're in London. I'm in London. I'm very proud to be in the UK. You have been, I'm sure, pushed to prodded at every turn to move to the US. Why have you stayed? Well, I should ask you that question too, but I think I think I saw in London when we started deep mind as a place that and the UK in general and Europe to some degree, there's incredible talent here. You know, we've always had, I don't know what it is, three or four of the top 10 universities in the world with Cambridge and Oxford Imperial UCL, these kind of universities. So we're producing the envy of the world, really. These amazing graduates and PhD students. We have incredible scientists here. We've got rich heritage of that all the way from, you know, churring and Hawking and Darwin Newton. So, you know, we have, and this incredible history of scientific breakthroughs and having great thinkers. So I felt we had all the ingredients and the talent and great engineers here, but it just hadn't been galvanised into an ambitious startup idea, a deep tech startup idea. And, but I felt it was possible and I felt that there was actually less competition here for that sort of talent. And we could even draw in the best talent from the top European universities. And that's what it was like in the early days of deep mind. So I think it was a huge structural advantage for us. And then the final thing is maybe being a bit away from the valley. There is some disadvantage in that you're not plugged into the network and the gossip and the latest trends and vibes and all of these things. We're a little bit out of it here, but I think it's very conducive to thinking deeply about things, being more original about how you think. And I think that's great for things like deep tech where, you know, you don't want to be distracted by the latest fad. You know it's going to be a 20 emission, which is what we knew at the beginning of deep mind. So I think being a little bit away from that maelstrom is quite good. I mean, Parma lucky at Andrew, often talks about being 400 miles away from the valley. It's cool to hear it's going to be an innovative thinking. Yes. So a few thousand miles away. But yeah, a terrible question. Will Europe have a trillion dollar company? You see the Americans always bash us for a lack of large companies. I ping Daniel Ack and be like, come on and do that. Yes, exactly. But we don't have a trillion dollar company. Not yet. I mean Daniel, my will get there with one of his companies, you know, Spotify, Helsing. I think those are two good options. I think there's no reason why we can't have that. I'm going to try and do that with isomorphic, which is headquartered here and I think has a potential to be that that's one of the disadvantage of Europe is obviously we're a combination of smaller markets. So that's one thing we have to kind of ever come. Maybe this EU ink thing could be a good innovation. I'm pulling out the magic wand again. Yes. You can change it. But this time I'm applying to European technology. Yeah. What would you do to implement a growth mindset, a ability to build that trillion dollar company that we don't have to say? I think in the UK, I mean, this may apply to other European countries too. I think unlocking what pension funds can invest in or just for the kind of growth stage, I think we're brilliant at doing the startup idea and getting it to a certain level like we did with DeepMind. But then if you really want to cross that sort of chasm into the trillion dollar global, you know, player, then where are the billion dollar rounds going to come from where you can really take on those that, you know, the existing incumbents? And I think that certainly was missing 10 years ago when I was doing fundraising for DeepMind. And I think it's still kind of missing today, just that kind of level of ambition and the amount the capital markets can support. I read about that some of your early rounds raised. in the set of Malibu. It was quite hard to make. Yes, exactly. We're going to do a quick fire round. Take me to meet Elon for the first time. How was that? Oh, yeah, it was amazing. It was at a Founders Fund because we were both podcasts basics and deep mind were part of a same portfolio, kind of amazing portfolio that Peter Teele had at Founders Fund. I think we were both invited. I think I was invited to my first portfolio kind of conference. I think it must be back in 2011 or 2012, very early days. So we were the small little upcoming thing and I had a small speaking slot. And then Elon was the big thing in that portfolio. So he had the keynote. But then we met afterwards. I think it was in, Elon says it was like we were passing each other in the bathroom or something. We said hi and we both hit off, you know, immediately like as sort of, you know, people that were almost too ambitious in their thinking, perhaps, and love sci-fi and I really wanted to visit his rocket factory. So I was sort of trying to get an angler invite to SpaceX and in LA. And I think I got there a couple, you know, he invited me at the end of that meeting and that was our second meeting in the space effect factory. I love it. I love it. And he's as big as his. Yeah. And then about that. Healthcare Revolution disease eradication that you're most excited about. Again, for me, it's specifically with multiple sources. Yeah. Well, look, I want to literally cure cancer. I know people said that's the cliche. But I actually, what we're building at isomorphic is general purpose. So we're trying to build a platform, a drug design platform that will be applicable to any therapeutic error. So ideally it will help with everything from neurodegeneration, cardiovascular immunology, cancer. Those are the ones we're focusing first. But eventually it should be applicable to every disease error. What are you thinking about that you're not reading about or seeing anyone talk about? So I think a lot of people are worrying about the economic questions around AGI. I worry a lot about the philosophical questions around it. Like when it comes, let's say, "Soon we get the technical right. Let's assume we get the economics part of it right. Both of those are hard." Then there's a philosophical question of what is meaning, what is purpose? We'll find out when we're conscious this is. What does it mean to be human? I think that's what's coming down the road. And I think we need some great new philosophers to help us navigate that. A hard, final question. There are many different ways you could describe what you do. What would you most like to be remembered for your legacy to be? I would like my legacy to sort of be remembered for like advancing science, building technologies that bring incredible benefits into the world like curing terrible diseases. Dammit, thank you so much for putting up with my meandering conversation. You've been fantastic. I really appreciate it. Thank you very much. But before we leave you today, did you know the industry average for booking a business trip is 45 minutes? That's a massive waste of your team's time. Or would an Avan your employees can book a trip in just seven on average? Avan is the AI-powered travel and expanse platform designed for companies that value efficiency. This allows finance teams to stop chasing receipts and skip the month than chaos. And you get this real time visibility that can save your company up to 15% on your travel budget. And that's why leaders like Visa, Stripe, Figma and even Anthropic rely on Avan these days. Go to navan.com/20VC today to see for yourself. And you'll get a chance to win two business class flights anywhere in continental US. Head over to navan.com/20VC now. Once an Avan simplifies the travel, air will exemplifies the spend behind it. You raise VC funding and you're scaling globally and it's no longer about shipping product. It's about orchestrating operations across continents. But suddenly your payments and finance stack is choking your growth. You're logging into lots of different banking portals, waiting days for transfers and reporting across entities. Check out Air Wallix today and see how they're helping thousands of businesses like Canva, McLean, and Deal. While airwallets helps your money move globally, Vanta helps your security keep up. Well that's Vanta. For startups low on time and resources, Vanta becomes your first security hire using AI and automation to get you compliant, fast and unblock really big deals. And if your big end prizes, Vanta is your AI powered hub for compliance and risk, bringing together data from across your business and automating workflows so you can prove trust at any moment. That's why top companies from startups like Cursor to end prizes like Snowflake choose Vanta. That's vanta.com/20VC for $1,000 off Vanta.

Podcast Summary

Key Points:

  1. DeepMind defines AGI as a system matching all human cognitive capabilities, with a high probability of achievement within the next five years, consistent with their original 20-year prediction from 201
  2. Compute remains the primary bottleneck for both scaling models and running experiments; however, returns from scaling are still substantial, though slower than at the start.
  3. Key missing capabilities include continual learning, better memory systems, long-term planning, and consistency (reducing “jagged” intelligence).
  4. DeepMind attributes its recent acceleration to organizational changes that unified talent and resources, acting like a startup to push toward the frontier.
  5. The gap between leading labs (like DeepMind) and others is widening, as algorithmic innovation becomes more critical; open-source models typically lag about six months behind.
  6. Future AGI is expected to drive a golden age of scientific discovery, especially in drug discovery and medicine, but clinical trials remain a slow bottleneck.
  7. Safety concerns include misuse by bad actors and ensuring future autonomous systems stay within guardrails; international regulation is needed.

Summary:

In this interview, DeepMind’s Demis Hassabis discusses AGI, defining it as a system with all human cognitive capabilities and predicting a high chance of achievement within five years. He notes that compute is the biggest bottleneck for both scaling models and conducting experiments, but scaling returns remain strong, though slower than initially. Key missing capabilities include continual learning, advanced memory systems, long-term planning, and consistency—current systems exhibit “jagged” intelligence, excelling in some areas while failing at elementary tasks in others.

DeepMind’s recent progress is credited to organizational changes that unified talent and resources, allowing them to act like a startup and regain a leading position. Hassabis believes the gap between frontier labs and others is widening, as algorithmic innovation becomes crucial; open-source models typically trail by about six months. He envisions AGI as a tool for a golden age of scientific discovery, particularly in drug discovery and medicine, but notes that clinical trials remain a slow process that AGI could eventually help streamline through simulation and patient stratification.

Safety concerns include misuse by bad actors and ensuring future autonomous systems stay within guardrails, with international regulation needed to set minimum standards. Overall, Hassabis is optimistic about AGI’s potential but emphasizes the need for careful development and oversight.

FAQs

AGI is defined as a system that exhibits all the cognitive capabilities the human mind has, using the brain as the only known existence proof of general intelligence.

There is a very good chance of AGI being achieved within the next five years, based on extrapolations of compute and algorithmic progress that predict about 20 years from the start of DeepMind in 2010.

Compute is the biggest bottleneck, needed for scaling up systems and for researchers to test new algorithmic ideas at a reasonable scale.

No, returns from scaling are still substantial, though a bit less than at the start. The gap between leading labs and others is growing due to the need for new algorithmic ideas.

People haven't figured out how to integrate new learning into existing systems after training, unlike the brain, which uses memory consolidation processes like sleep and reinforcement learning.

Organizational changes, combining talent and compute resources from across the company, and pushing with focus and pace like a startup helped DeepMind advance rapidly.

Chat with AI

Loading...

Pro features

Go deeper with this episode

Unlock creator-grade tools that turn any transcript into show notes and subtitle files.