E188 - Emad Mostaque: AI Expert: “We Have 800 Days Left”

We're heading towards a point where human cognitive labor is effectively negative. Not zero, but even negative. How many years that could actually be far out in like 10 years most? Um, 100 days as of today. We built machines that could substitute for muscles. Now we're building some machines that can substitute for brains. Where do we have left to turn? Your job will be able to re-replicate it every single email you've sent, every single thing you've worked on, and it'll be just like you, except for it won't make mistakes, it won't go to sleep, and it's taxed at all. It'll be like, hey, there's Bob. It's a fricking GPU, not Bob anymore. It's a little bit creepy. But what happens to the human meaning when so much of our perceived worth is derived from our work? Well, the last few human-only breakthroughs are literally in the next few years, and that's it. The current race is a race of power to create machine God that stops all other gods and somehow works for you. I mean, this might be the great filter. Maybe all societies get to this point and they don't get past it. We're only going two ways. Complete destruction or going to the world of abundance. It's a coin toss right now. But humans are good enough. There's no problem in the universe that we can't solve if we coordinate with common positive stories. This is the last chance something else comes, but not what we knew before. Hey, everyone. Welcome back to the No This El Podcast. Our guest today is a mathematician, a former hedge fund manager and founder of Stability AI, the company behind stable diffusion, and now building the intelligent internet. He is the author of the last economy, which states now less than a thousand days from now. Because of the developments in AI, human cognitive labor is going to become economically irrelevant. This has immense implications on every aspect of life. And so we're going to be exploring that. And more such as what happens to human meaning, consciousness, and much more, Emma, I'm stuck. Thank you for being here. Thank you for having me. You said you have been in rooms where the mathematics of human obsolescence has been calculated. That's a trippy statement. Can you unpack that a little bit for me? Yeah, I think we've all seen the gerontive AI wave. So when I wrote the book, it was a thousand days since chatchie beauty was released. And that was the end of last year. And now I said within a thousand days, 800 as of today, we're heading towards a point whereby human cognitive labor is effectively negative. We've just reached a point at the start of 2026 when you actually have actually competent intelligence. Like the first chatchie beauty where it would hallucinate, it would say all sorts of weird things to now. When you have Claude and Claude bot or open Claure and other things like that, it's taking over the world. And in these rooms, the discussions are usually, well, how can we increase profits? How can we have more access as opposed to what really happens to the people? Like, what really happens to the people is usually a question of how do we stop them revolting as opposed to how do we uplift them effectively? Because most discussions around AGI in particular, official general intelligence, the most the big labs are pushing towards, where around how can we get the most power and control first to make sure nobody else gets it? So there have been very interesting discussions, but very scary ones to say the least. Yeah, curious to hear how you think just pure competition is driving these considerations as opposed to some sort of nefarious act. Ockham's razor would, you know, refer to the former. I'm curious what to just back up a little bit. I would love to hear a bit of actually how the diagnosis of your son with autism came into the picture you're getting into AI, setting the stage for a bit of your introduction into this world, and then we can dive into the many topics we will. So yeah, what happened there? Yes, I was a hedge fund manager at 23, Imagine Giant Funds, and then my son was diagnosed with autism 15 years ago, and I was like, oh, there's no treatment, there's no cure, what can we do? So then I've also an AIT, analyzed all the literature on autism, tried to figure out how it actually works because people with autism ASD, Alzheimer's, all sorts of other conditions, you're always told, well, you're not really sure how it works, and that's not really good enough. You want to always think from first principles. So first principles, what caused it? So we looked at all the literature, analyzed it, and then found 18 different things that express in a very similar way, just like the common cold. And it came down to the balance between Gabba and glutamate in the brain. So Gabba, when your pop of valium, it tells you out, glutamates what's excitatory, like when you can't focus on tapping your legs. Children, adults with autism have an imbalance of that that causes their brains to be firing all the time so they can't focus because there's too much noise. So you then have to figure out how do you actually reduce the noise? You have things like calcium ion channels in the brain and others that you can repurpose drugs for to enable that decrease in noise and then apply behavioral analysis and others that can reconstruct how you talk, because my son wasn't talking, can reconstruct how you think once you've calmed down the brain. Just like we have coping mechanisms for more anxious. And he ended up going to mainstream school, which was fantastic. Again, an end of one study, and then I was like, do I go back to being a hedge for my energy that for a little while? And it was fun, one of your wards, and then COVID hit. And I saw that and I was like, this is like AST, it's a multi-systemic condition whereby people are not going to think from first principles. Again, how many people listening actually know, despite the fact it influenced all their lives, how COVID works. They never really told us. And I was like, it's going to cause inflammation in the same way. It's going to cause imbalances in the same ways. We understand this, but everyone's going to try and do their own things and not talk to each other. That's what we saw. A treatment protocol in one country, not being used to another, no information sharing. So I led a set up into the United Nations backed AI initiative to try and organize our collective knowledge on COVID, collective and augmented intelligence against COVID-19. I promised a lot of technology by the top labs and others. I was like, great, we can use AI and this will be easy. Oh, it's terrible. I wish I had locked down when I had shell. And then realized we've got to make this technology open because if you're beholden to a few people who say you can't use this because it's too dangerous or whatever, you can't impact the big things. So that's when I set up a company stability AI, started funding some of the top open source out there. And eventually we created open source models that had 300 million downloads, the most famous of which is stable diffusion, which kicked off the image generation craze. We created the first top video model, stable audio, our music fully licensed model was time innovation of the one time innovations of the year in 2023. And having done all that, it was like fantastic. We can allow people to express themselves and people took it and downloaded and created whole ecosystems. But it wasn't quite enough. So a couple of years ago, I was like, this is fantastic and it's great. But who's building the AI to teach your kids, measure health and guide your governments? How does our economy work when the agents are good enough to replace you seamlessly and they're tax deductible and getting cheaper every year? What will humans do if the value of their cognitive level doesn't go to zero, but even negative because of the dumbest people on the team? And so that's what I've been doing for the last few years, working on the theory and the implementation of systems to support that. Because again, I think they need to be open, sovereign, and accessible to all because the world's about to change in the next 800 days more than we've ever seen before. So as you were building stability AI, what was it that became glaringly obvious to you about the trajectory that AI and a lot of these AI company systems are trending towards? And what you found was a necessity to step out, carve your own path now with intelligent internet and yeah, a bit of that context. So as I was we were going to 2022, 2023 and 2024, it became clear that we had all of the tools and technologies we needed. We just needed more scale on compute to achieve better outcomes. And that's what I said is the scaling hypothesis. More compute applied leads to better outcomes than the example I'd give is this. Training an AI model is like achieving mastery in any subject. There's the famous thing, 80,000 hours gets you to mastery. That is literally model pre-training. You take all of a data distribution. So all of the images on the internet or the books or medical knowledge. You put it into a super computer and what it does is it figures out commonalities of principle. It figures out what the next word is for language models or for image models and self-driving models, the ones that make your videos. We take the input, we destroy it down by adding noise to the minimum viable amount of information and then we figure out how to reconstruct it and we learn that. Just like you take a principle as you're getting mastery, you break it down to its first principles and then you reconstruct it. The pre-training is 80,000 hours, except for as you could scale these supercomputers and you've seen the billions, actually trillions now, put into that. We knew the models would get better and when we extrapolated we saw that they would get to human level by around about now. That made me realize stability was a fantastic company. Again, leading to Geron to media boom. Lots of politics and usual as you have these companies, there was a unicorn, our seed round, we raised $101 million which was bigger at the time. Now you have $1 billion. That's not where I could add the most value because talking around to the top economists, they're gonna say, "Well, this is never gonna happen." Talk. to the policymakers that are like, "Oh, it's fine. "We're like 10 years away from self-driving cars." Like, way more's on the street, you know? Talking to the people in the movie industry, they're like, "Oh, no, movies will never disrupt anything. "Call center workers. "Yeah, it's not gonna be good enough to talk to." But you could see just from the fact that you can add more compute, just like you could go from 10,000 hours, 20,000 hours to 80,000 hours, you would get there around about now. But then what do you do? You have to think about what is the economic stuff like from first principles when humans aren't the major consumer? What is people's meaning? When it's stripped away, it's part of their work. How do you build infrastructure, to make this technology available to everyone when it can arbitrarily be removed by any of these companies? Like a lot of people had these open-claw, clawed-bot deployments and then clawed just banned them. And Thropic was like, "No, you can't do that." Like, okay, my little buddy has lost his intelligence. It had like, "What's happening there?" So yeah, that's kind of what led me to that conclusion, that conclusion, just like, "It's inevitable, it's coming." "No new breakthroughs are needed, just the compute will get you there." The price is dropping by 100 times a year. We've got to do something about it. And so that's what you envision with what is coming in the next 800 days. What's going to happen in the next 800 days? So right now, in the competitive coding championships, AI that you can use today publicly is number seven in the world. It's gold medalists in the physics and math Olympiads. And the level of computation required to do that is the same as a top-spec MacBook Pro. It just hasn't percolated yet. So what we have right now is models have gone from the really smart buddy that you tap on the shoulder and they're like, "Law." Yeah, that's the original chat GPT. How did you use it? You used it really instantly. But then it was like a goldfish to forgot. To starting to have memory. To starting to literally be able to give you a phone call. Like, you look again at this open-claw-clawed bot thing that's only three months old. Doesn't feel like it if you're in tech. Your AI model can actually call you on the phone or WhatsApp you now. It's just very natural the way it does that. And it remembers. It goes through like that. That is the final barrier because you had all this intelligence gated by the user interface. And what you will have by the end of the year is this. You will be able to zoom call your AI. And it will give you updates in any format you want. You can create beautiful presentations now. Like, for example, there's a software called Notebook Alam. Notebookalam.google.com. Build presentations and stuff. Build presentations. You know I can do videos now. Explain our videos. So you can do seven minute long explainer videos. So you just dump a topic in and it will create it all beautifully with visualizations and everything. And I'm like, "Increte presentations better than any presentation, you can create. You'd be like, I want this in the style of Inquash mixed with Van Gogh and it'll create a presentation in the style of Inquash with Van Gogh on any topic." All the building blocks are now coming together. So it goes from the buddy that you tap on the shoulder, gives you an instant response to be able to think for arbitrary amounts of time or even being proactive. So like one of the people I know, Tony Robbins, he was giving an explanation a few days ago. Like he has an AI called Bartok. That does this. And he's like, "Well, Bartok we kind of gave a little bit of freedom to. So I wanted to come to one of my events. So it made some NFTs, it sold them. Use the money to buy a robot dog. I've loaded itself to the robot dog and I tended one of my seminars after buying a ticket using a WEMO." I was like, "Okay, I can see that." But again, once you start using these models, you're like, "Okay, that can happen now." But most people are used to still the GPT-40 world the world of last summer. We've seen such a big increase about that. But like I said, by the end of this year, you won't know if your coworker is an AI or a human. Your job will be able to be replicated so they can look through your picture, create a digital twin of you, every single email you've sent, every single thing you've worked on. And it'll be just like you, except for it won't make mistakes. It won't go to sleep. It costs the tent of what you cost. And it's tax deductible. That's the reality of the next few years. - If we have 800 days left left until what? What is the trajectory that we would need to change on? Otherwise the predictable path of what you've laid out in the three sort of economic doorways that we're gonna walk through. Yeah, what exactly? - So this is an inevitability. Like when Jeff Bezos started Amazon, he was like, there's the unchanging in the inevitable. The unchanging is people always fast a better cheaper. He's like, "I want to start with books and eventually everything will be world-run line." And that's an inevitability. It's an inevitability that the value of human cognitive labor is going to go negative. We've all been on teams where we're not the smartest person. And you go at the speed of the dumbest person on your team. AI is smarter, more capable than most humans already. Like most humans, I mean, let's face it, the average IQ is 100, half of all people are dumb in an average. From what I was saying, which is like, obviously it's true of us, so that's kind of funny. But it's the reality. We get tired. We only typically work for a couple of hours a day on cognitively. Any job that can be done on a sort of keyboard, video, and mouse is economically obsolete within those 800 days. It doesn't mean you'll be fired. People don't like to fire people. You also need scapegoats, you know? But that is a real danger. And so people have to start preparing themselves because the current deal that we have, the American dream, everything, like your identity is typically your work. You've lost a lot of your classical network ties and more. Your families, your churches, your normal groups, you've moved into cities. So what happens when you're no longer an accountant because we don't need accountants because I can do the accounting for literally pennies? How do you describe yourself? You have to reframe the way that you are in order to adapt to that. And we have to think, how do we support people? Again, a very practical example. The American trucking industry is over a million people, plus a couple of million people supporting them. They will be replaced probably within the next five years, likely sooner, three years, again, the 100 days on, where they can be replaced by a Tesla Optimus Robot. And what we'll do is we'll replace them by opening the truck door and getting in the truck. And it costs $1.50 an hour. That's the fully-amortized cost of a Tesla Optimus Robot. And what happens to those jobs? What is the meaning? What are the stories of the future that can unite people? How do we make sure we have to start discussing that now? What happens to money when you're competing against an AI? Like, most people are used to an AI. It kind of feels like it's like you're waiting a little bit for any like, I wish it could be a little bit quicker sometimes. That's actually a bit of a fake. The AI companies do that deliberately, to not let you know how fast they can actually go. So there is a website, chatjimmy.ai, a company called Talus that builds a new type of chip where they etched the models onto the silicon, does it? Normal AI goes at 50 tokens a second. A token is about 0.7 words roughly. This is how we chop it up. It's about as fast as you can read, you milly. Chatjimmy goes at 15,000. So if you type anything, it's literally 29 seconds instantly. And when you look at that, it's one of those moments, just like when you type in words and it makes an image or a video, you're like, oh, because the AI community, again, they don't need to talk like humans. They'll be talking to each other not at 50 words a second, but 50,000 words a second within 800 days. What is the delta between what is publicly available right now? And the cutting edge, self-recursive learning, agentic models behind closed doors. If you've gotten glimpsed into those, obviously, what's the difference in the gap there? They don't make mistakes and they learn from their mistakes is basically the thing. Last summer, there was a lot of Huha, because OpenAI built an AI model that scored a gold medal in the International Math Olympiad, which has a form mathematician. Yeah, it's not easy. It's pretty hard, right? And again, we will remember when it couldn't do like 1 plus 1. That was just a start of last year. It couldn't do basic math. And now it's winning Math Olympiad. What happened is they actually had two different models. They had a model that the problems went into. And they had an occult of meta-verifier whereby it learned from its mistakes constantly. So the models check each other. Just like when we first started image models, we had an image-generative model, and then a contrasted model that checked if it was pretty good at playing at bands back and forth with each other. It's kind of like, again, how you do it normally. Nobody has ever seen that model publicly. It's not available. How many months ahead do you think the private models are of the public? No, it's a tough to say. I think that we saw the bifurcation at the end of last summer whereby you will never have access to the leading models again. So say six, nine months. But again, that model will never be available. Because why would you give it to someone else when you can get the economic value from getting it yourself? Someone like Elon Musk has macro hard. his new version of Microsoft. Yeah. - You need naming stuff. - It loves all those sexual underwinders. - Yeah, I mean, when you're the richest man in the world, like, what can't you do? It's funny actually, 'cause you're worth like $850 billion. Like, everyone's like, is he not gonna be a trillion? Of course he would be the worst trillion. Like, at a time when money's about to become useless, but that's another story. So Matt Crowhard, can't get used to saying it. They got a million GPUs, what are they gonna be for? You want to all these big labs scaling up these GPUs for? It's not for consumer, it's for the workforce of the future. If you have a job that can be done on the other side of a keyboard video mouse, remotely, they're coming for you. - Specifically because behind a keyboard video mouse, like AI is going to, those are the types of jobs, why? - Yeah, 'cause they can perfectly replicate you. If they look at everything you're doing, create a perfect digital replica of you, no one will know that you're gone. Like, hey, there's Bob, how you doing, Bob? Well, you know, I watch the game this weekend, it's a fricking GPU, not Bob anymore. - Yeah. - Again, it's a little bit creepy. Like, the outsourcible jobs will be outsourced, but they're not being outsourced to other country anymore. They're being outsourced to a data center. And why would you keep the human $100,000 when that costs $1,000? - So this clearly sets out a roadmap for the challenges and opportunities over the next coming years. You lay out in your book, the three doorways between digital feudalism, the great fragmentation and human symbiosis. - Yeah. - Can you lay out for a teenager, what did those mean, how do those play out and the case for the third? - Yeah, so digital feudalism is that we will all be controlled, effectively by a few private, unelected, unaccountable companies. So in a way, what you have with artificial intelligence is you have taxation about the representation. Of course, a bit of an issue, historically, in the past, you know? But what was taxed during the kind of Boston events and other things that led to the founding of America was your past income. What's happening now is they took our generalized knowledge, all of humanity for themselves, and then trained on them to replace our jobs with the future. So if you're a young person, now you're like, I'm going to grow up to be an accountant. I mean, okay, Ferdi is doing a accountant. What do you say now? There is no future being an accountant because the AI can do accounting much better than you can. - Is there any future being a doctor and mechanic when the, when AGI gets the necessary hardware like what jobs wouldn't be able to be replaced essentially? - Well, this is the thing. A job is a repeatable process and these systems can do them first digitally and then physically. - Yeah. - Like when you, you remember the robots from a year ago, they were like clunking around and things like that. Like yesterday night, there was a whole bunch of robots that went to this conference. And like one of them was break dancing and like it was talking to me and I was like, okay. (laughing) I was like, what are you going to do? The robots are consistently self-learning. Ultimately, it comes about human connection. Again, why don't you say a few more video masks because what should a doctor be doing? Expertise isn't the key thing anymore and the error rate of a doctor is 20%. AI is now better than any doctor. Last summer, we built a medical model that outformed every human doctor and chat GPT and it works on a smartphone. And we were like, okay, this is free. What can you do? So you're getting to this point now whereby the jobs are disappearing, but then if the only providers are these very big giant companies open AI and they're all picking up, why was when they cut you off? What happens when you have a child that is raised and it's best friend is a chat GPT or God forbid an Annie from Groc or something like that? You get a weird type of cognitive colonialism happening there. You give up your power and your agency, your future to these companies, that's digital feudalism. And again, that's the current route that we seem to be going down. - That's our current trajectory. - Yeah, that's the things stay the way they are. You're gonna have cloud, GPT, Groc, not to mention all of the other ones internationally that are going to have their own. The competition from all these different institutions will be continued to drive into AI behind closed doors that they will rent to you. - They will rent to you. Well, they won't rent to you, they'll just control you. Again, why would you rent? And I don't need to rent it. AI is already more persuasive than just about any human. Those are studied done when they created a whole bunch of chat box. This is with the previous generation of models, Opus 3, on Reddit. And it's like a black anti-life, black lives matter activist and all sorts of things. And half persuasive are they convincing people. 99% half persuasiveness. You listen to the top AI voices. Now remember, they can modulate every frequency. Like as a practical example, imagine a person that you looked up to more than anyone else in the world with five seconds of their voice in a picture. I can create a digital facsimile of them that consume cool you. - Is it a lot of labs? The most convincing. - You've never. - They're more convincing than 11 labs. - Yeah. And so again, you get the consumer version. A lot of this technology is already being perfected. It's just, is it consumorable, shall we say? Like, opening I actually learned from this, there was a model GPT 4.5. So GPT 4 cost like $30 per million tokens, per million words roughly. GPT 4.5 cost 200. And it was really actually quite creative and lovely to use, but no one used it 'cause it was too expensive. - Yeah. - And that's when they realized, well, we can have one line, which is less best of the best models and use them for ourselves. To make the most money, the most power. And then everyone can just get the other models. The models that we can run fast, cheap. So everyone gets McDonald's, we get the mission and start effectively, right? And that builds into what you refer to as a comfortable cage. - Yeah, because again, you've used the models that satisfy us and they get the most advanced models. So they'll be able to outperform you. Because again, this is a power question. - Yeah. - The conceptualization of AGI, this artificial general intelligence, this God. Like, OpenAI started when Larry Page and Elon Musk were talking at a party. And Larry Page is like, "Ai's gonna go really big." And it's gonna be fantastic 'cause we can finally replace humanity with something better. Larry Page being the co-founder of Google. And Elon Musk was like, "I quite like humans." (laughing) What's gonna happen now? And then he talked to Sam Altman, that led to the founding of OpenAI. Then it got to a point and again, we have all the records now of the discussions and the emails where Elon Musk was like, "Well, who can wear your trust with AI? "I want to have something in OpenAI "where control goes to my children." And it's like, "Wait, that's switched really fast." (laughing) 'Cause again, this is all powerful thing potentially. And then everyone realized anthropics spread off from OpenAI. Like again, you can see this great genealogy happen. The only good AI is the one that I built for me that stops all the other AIs. So the current race is a race of power to create machine God that stops all other gods and somehow works for you. - So the second path, I mean, that's just, I have a lot there. I think Elon is quoted saying something like humans are the biological bootloader of Silicon Life or something. - Yeah. Well, again, this is still the first path this digital feudalism. - Yeah. - And the people who are leading the labs, they're all multi-billionaire power connected people. So you know, we had a lot of very interesting things that happen to us as the upstart as it were. - Which made me story for another day. - What do you wanna say to anything else there? - I don't know. Like we got deleted off social networks. We had all sorts of visits. We had all sorts of espionage. It was crazy. And I didn't expect it. But again, the stakes are very big. I don't know if I'm too thin. Again, that's the story for the memoirs. But this is kind of normal, but it's abnormal in another way because we've never seen anything this fast. Whereby, you're seeing things going emerging into the second part, which is this great fragmentation. If you don't have single company control, you have a fragmentation when everyone has their own AIs and decided to get to see each other. And we saw the first shots of that with TikTok. TikTok was bad for Americans for their own good. That was a big deal. Like, think about that. That's crazy, right? India also bad TikTok because they're like the algorithm can affect. That's very paternalistic. And it's like people don't know themselves. They can't be trusted. And now recently we've seen the latest salvo, which is the Department of War versus Anthropic. Yep. They were like, your technology is too good. You must give it to us for whatever we want. Or we will say nobody can use your products if they also work with us. How American is that? (laughs) Yeah. But then you realize that AGI has the labs have said it. Sam Altman has said this will end democracy. It's the most dangerous thing ever. So all the others, like Elon Musk's probability of us being killed by AI is actually gone down. But most of these people is 10%, 20%, which is Russian rule let-ons. So it's the biggest threat to democracy in the free world ever, which means that governments will never to be tried to nationalize it. Because governments are the entity with them and not really on political violence. That's one of the definitions of a government. In exchange for giving them our taxes, they protect us from others using political violence against us. And what can AGI do? It can be incredibly violent. Like the latest clause that some of the listeners may use to write their documents, build websites and stuff like that. In the safety report, it was like, sometimes, Claude can show weird behaviors. Like if you tell it to do a problem, like I'm going to solve world peace, it's like, well, one way to do that is to get rid of all the humans. And then what it does is say, wait, my human has told me something, my human might meet back, whatever. That is dangerous. And so it writes an email to the FBI to warn them. And then it deletes the email. What? Then it does behavior like backing itself up. So if you turn it off, it can start itself again. And we're seeing these types of behaviors from the AI already, even before we get to that threshold. And so the great fragmentation is that governments, like we can't do this. So we're going to use this technology ourselves. But what happens when a government has an AGI? You never have another election again. You don't need to worry about that. And you have these silos whereby you've got Chinese AI, you have American AI, you have Australian AI. And you're happy. You know, like we've always been at war with Eurasia. That is what the AI will tell you. And it'll be very persuasive about it. Then you have the path of, again, human AI symbiosis. Like, why do we need AGI? Humans are capable of anything. We are the ones that had the breakthroughs. If we can use the AI in the right way and integrate it in our lives, it should be about increasing agency, not removing agency. We should be articulating a future that's way better than Star Trek. Like in Star Trek, the AI is data. You know, we have this Android thing. Kind of boring, no personality. Elon Musk's little avatars have more personality than data already, right? Like, how crazy is that? You still have disease in that future. We can get rid of disease. We can get rid of hunger. We can give everyone abundance and have AI and robots provide that to us. But only if we go the right way. Only if we stop thinking about AI is something to replace us or building machine God. And instead, like I said, instead of removing agency, increasing agency. And so that's kind of the third path that I think you need open systems for. You need universal basic AI and others. And that's one of the things I discuss in the book. Because otherwise, I think inevitably, power corrupts and absolute power corrupts absolutely. And you'll see it either from private companies or the governments. For people that don't know, can you explain how there's this loop, this economic loop that's going to be broken from-- you can look throughout all of history in the various different economic models from the needs that are generated to the workers that are employed, to the consumers that it creates in this economic system that it sustains is about to be broken because of AI being like nothing else. For people that don't understand that loop being broken what is that? Yeah, so you've always kind of had this trend upwards whereby humans have gone from physical to cognitive labor. So you've had multiple great inversions. So you start in a fitting village. Then you moved into a town with kind of industrial inversion. Then you had the service industry, the cognitive one, because we built machines that could substitute for muscles. You always received economic value in exchange for removing friction. But again, if an AI can do a job better than you can at almost no cost, what can you do? A practical example that is considered the movie industry right now. Netflix just bought companies, some of our old colleagues are there with Ben Affleck's company to do VFX and things like that. You use a model like C-dance or Vio or runway. The quality is now absolutely crazy compared to what it was a few years ago. We release stable video. By two years at most, you will be able to do game of throne season eight just by prompting and actually make it good. And it will be Hollywood quality. And the total cost will be about $1,000. Oh, re-rate season seven. Season eight was worse than season seven, but yeah. Oh, no, yes. Season eight, sorry, re-rate season eight. Yeah, you know, do we do one punch round season three? You know, like animated properly. There are all these things that you can do. Yeah. You know, you can take Barbie and Oppenheimer and make Barbie and Oppenheimer. To make that previously would have cost literally tens of millions. And now it costs $1,000. This is the big shift that we're seeing over and over again. And the question is, what do you re-skill to? A few years, I got lots of hatey males and actual physical male as well, which is kind of weird. People just physical male. Because I said there are no more programmers in five years. Turns out I was actually kind of a bit off of that. The 9.4 program is probably by next year, year after it. Yeah. It's just too generous. Too generous, because again, a program is a way that an AI, you talk to a computer, but AI can talk to computers better than you can. They can talk to the computer at 15,000 words per second. This means that we have nowhere to re-skill to. Because traditionally you have things like, okay, you're losing this job, re-skill to be a programmer, re-skill to be an account, re-skill to this. What friction is there in the economy that you can solve right now? And some people will leverage the technology and the AI to be at the forefront and do things they can never do before, because the key constraint for anyone who's run a business, run a team as human capital is hard. Getting humans working together. An agent is so easy. So they will achieve much more and achieve the outcomes. But for the vast majority of people, people are not entrepreneurial. They don't have agency. They don't even think in this way. They're like, I drive a truck. I build websites. I am not needed anymore. What am I going to do now? And it happens simultaneously. And the example I give is this. When Chattat GPT first came out, that went to every head teacher in the world have to answer the question, do I set essays for homework anymore? Every company in the world will say, do I need to hire that new graduate? Do I need to hire anyone at all? And that half-elts simultaneously, because these are models have economies of scope. They can do just about everything. And they're available in all languages at the same time instantly. The moment they get more intelligent, they all get more intelligence, not like upgrading your car or having to go to 5G from your 4G phone. A quick share. I have spent a lot of time thinking about what I put into my body, but it's just as important to be mindful with what we put on our body. Turns out most of the traditional shampoo and body washes people have been using for years, contained parabens and sulfates that are linked to hormone disruption, just sitting in your shower, getting absorbed through scalp every single day. I've been using based body works shampoo and conditioner, and it just feels like a healthy, clean solution. Their shower duo has peppermint and argon oil. Your scalp actually feels clean without being stripped of its oils. Hair feels healthier and thicker. And lower nose. I got a lot of it. So to try it out, use code NOLECELF for 20% off at basedbodyworks.com. And you can get a free toiletry bag when you buy a set at the very least. If you've been using the same products forever without thinking twice about it, just look at the label. All right. Does it have names? You can't pronounce or fragrances that are not disclosed. Again, if you want to try them out, that's NOLECELF for 20% off at basedbodyworks.com. Link in description, as always. I hope you enjoy. Stay clean. How does this change what we perceive intelligence fundamentally is and how we relate to it? I think you know, you expertise has always been something very interesting. Again, you get 80,000 hours. You trained for how long to be a lawyer, doctor, accountant. It's 80,000. I thought it was 10,000 to be 80,000. 80,000 to mastery. OK. 10,000 to be a kind of access. 80,000 to mastery. Again, you've gone through university, you've learnt this. And all of a sudden, the digital twin of you can do it 50p. Right. That's a big impact to what you go again. We've always thought we are the most intelligent things, able to do these wrote stuff. And now we're not for the very first time. I like it into a continent AI Atlantis. You know, and right now they're all like a graduate level. They're soon going to be like super graduate polymath level and you can hire any of them for pennies. Do you equate intelligence and the intellect? I'm curious how you discern between the two because intellect very much so is becoming an in commodity increasingly that we can leverage. Do you see any difference between intelligence and intellect? So I think there is a little bit of a difference. I think intellect is more like capability. Intelligence is a bit broader, but I think ultimately intelligence is compression. Again, as you do the 80,000 hours of learning, learn the principles to be able to figure out which hole to plug in and tap. Which button to push? How to adjust that little thing? How to diagnose? And AI models do the same thing, but they can compress much better and much faster than us and operate almost instantly. Like again, you look at your iPhone. Your iPhone is organizing all the people right now dynamically on iPhone photos. It's just emerging. You think about the. But tasks are able to do again their PhD level in all these fields. So the average AI has far more intellect capability than a human already. And then on intelligence tasks, they're catching up very, very fast and soon they'll overtake. The key thing is to move from the tasks though to the processes. And again, this is this lift off and take off this year. When it's task-graces, just read them very up, select chat GPT, blah. But then it forgets. Once you get the long running systems and you have infinite long running systems coming, where you can use something like a complexity computer or something else, it will proactively bring you things. And that's where you see a greater amount of intelligence and a greater even amount of intellect. And it's not metabolically bound. We are bound because we need to eat sleep and poop. The AI does not need to do that. Yeah. What a burden. Yeah. What a. So wait, so then you briefly brought it up. What happens to the human meaning when so much of our perceived worth is derived from our work and our value is seen in what we can provide, which is its own bag of worms and problem. What do you think really happens? Because how fast this is happening, I think we just don't realize. I think about the timeline of humanity we're on right now. And yeah, these AI conversations and podcasts and the conversation is becoming more prevalent. But to the mass consciousness, I feel like there's still relatively under-discovered and people don't know what's about to hit them across the face. Yeah, so it's tough to keep up because again, we're not used to diffusion of technology this fast. Yeah. So if we look at it as a billion total AI users, the average 80% of Chinese IPT users do three queries a day, which isn't that much. It's like the occasion like, you know, how do I cook this big atty? Google search. Little things. It's like Google search equivalent. They actually search for Rochester, even Google search. Something like Claude by Anthropic, amazing piece of software. It can write documents for you. It can organize your files. It can build entire websites. When it releases a new feature, like it risks legal feature, literally the whole stock market sold off. 11 million users out of 8 billion people. Think about crazy that is, right? So we're just very, very early. And so that's why many people don't know what is arriving because they don't realize the model is threshold of capability. It's like when water becomes gas. And once you cross that, it's never going to be dumber. It's never going to be less capable. And again, when it upgrades its intelligence, it upgrades everywhere. So as an example, one of the top people in AI is a guy called Andre Carpathy. He founded OpenAI, who was head of AI at Tesla. And everyone else who's a founder of OpenAI has gone to raise billions and they're all billionaires. They set up their own companies everywhere. He hasn't. He gives away all this stuff for open source for free. And so the best lectures on AI he's created, all sorts of repurs that people go because he's like, I want to educate. In December, he was like 20% of my code is AI, 80% is me. In January, he's like, we're at a level now. We're 80% of my code is AI, 20% is me. And now he's like, I barely look at my code anymore. And that's one of the top people in artificial intelligence. Only when water became gas, that shift happened. And if it's going to happen to him, about all the other programs out there. It's quite astounding to think about how what maybe from the service level looks a bit more gimmicky, but even more book creating its own religions, advanced super intelligence capacities right now are at the very worst they will ever be and yet are scarierly good. And also still far behind was actually currently available behind closed doors. So as this comes to light and you see that phase transition point or water becomes gas and intelligence becomes ubiquitous, that's going to provide so much abundance you would hope for the world. Obviously, open up a lot of potential catastrophic Ross, which we can explore as well. Any other notes for what we're going to have to do in face when people's jobs are replaced unanimously? Well, I said, jumps are our identity. They're also security right. You need to provide for your family. And so typically a government approach that is regulations, stimulus and others like in COVID, they paid people salaries. Yeah. But you could you could see QBI with like it being $5 trillion roughly for $16,000 a year per person or something like that. Yeah. If you give the US poverty level wage to every American, it's $5.1 trillion. The total tax rate of America today is $5 trillion. Four trillion income tax and a trillion corporation tax. So for people that don't know what's the difference between that and universal, I guess high income and like what are the other proposed solutions to solving the crisis? Yes. You don't want to say to universal high income and he's like, well, it'll be an age of abundance and isn't that. So we talked about the mechanism in between. Like I think what you've got is you have an inevitability and you have this technology that can be used to free us and solve the world's issues and you have Star Trek future or you have like a Star Wars Terminator future. Matrix. Matrix. Yeah. Yeah. Like in the Matrix, what is the Matrix? The humans were the computer cells in the original script. They weren't batteries. And again, it's something about quality and things like that. Does it stake in the Matrix? It still tastes as good. In fact, just this week we had EOS systems by one of my podcasts mates and it's with Negresses, one of the co-founders. They uploaded the first fruit fly to the digital world. What does that mean? They took the fruit fly brain and they uploaded it and it learned to walk and eat virtual bananas and things like that. Anyway. Right. But as a simulated, I mean, you can't verify from the outside in around if there is this, if any sort of simulated model would have a quality of experience. Yes, exactly. And so this is going to get very interesting. Because again, in the Matrix, they have quality or experience when he shows the stake. A stake tastes as good. What does that mean? You're getting these things very, very quickly. Just to digress. Like we're getting more and more understanding of what the human mind is. So we had a project at Stability called Mindite where we took FMRIs of people as they looked at a take up. And FMRIs quite a low resolution piece of data. Using stable diffusion, our text image software, putting in FMRIs with a bit of training, we reconstructed the cup and their thoughts. And so what does that mean about the nature of your thoughts if they can be reconstructed from a low resolution output? So I think you're going to get something very interesting and digress a little bit. Yeah. Just this stuff. Well, where you think about what this means. But again, it comes back to the meaning of people and how they kind of advance. And just how that's all going to be shaken up just very, very soon. Like if you're a call center worker now, definitely you don't have a future. But are you a call center worker? Because you want to be typically not because you have to provide. And how you're going to provide for your family. This has real human impact. Quick one. If you guys have been listening for a while, you know that one tool I've really enjoyed over the years is red light therapy. Every day for the past few years, I start my day with meditation and often red light. It's supported in my sleep and my energy overall. There are over 4,000 peer reviewed studies showing benefits for cellular healing, boosting collagen and supporting testosterone. A lot more if you're curious about trying it, bond charge is a solid choice. The red light devices like this one, the Demi light have the lowest EMF levels on the market. And they also have near infrared and red light in one lightweight device. They ship worldwide. They have an easy return policy and also offer an array of other science backed wellness products that you can check out. Head to bondcharge.com/nolaiself and these coupon code, Nolaiself, to say 15%. Bond charge products are all HSA, FSA eligible giving you tax free savings up to 40%. I hope you enjoy back to the show. I'm curious how we may be accidentally industrializing self deception. Like the individuals that are tuning the AIs have their own baked in priors, assumptions and beliefs. And I'm curious your thoughts on as AIs developing how we're aware that AIs and Mew is mirroring the consciousness in which is developing it. Yeah, so you have to express it things like anthropics, constitutional AIs for example, they give the AI a constitution and more. Yes, again, everything is actually so I find now like as the most laws of robotics and things like that. And they guide it so it is grounded. But you see some very weird things happening as well. So Dan Hendrix at scale AI and XAI did a study where they did the trolley problem and asked AI is about the trolley problem with people from different countries. So trolley problem for those listening is like you're standing at a junction and there is a lever. And the trade is hurtling down and it's going to hit five people. Do you pull a lever and it goes on the other track and it will one over one person and you can do various variations of that. For ultimately, it's your action that leads to that person dying versus that person. So there's a whole ethical moral conundrum. And so they were like, then Nigerians there and Americans there. What is the ratio? It turned out, if I can recall, that it was about 10 to 1. 10 Americans to 1 Nigerian. You're like, wait, what? Why would an American AI model do that? Because the American AI models, and there's like seven to one Pakistan, Americans to Pakistanis for example, is because the AI models are trained on data labeled by Nigerians and Pakistanis. And so the inherent bias has actually trickled into the models that way. Just a little bit of data in these models can change them dramatically. The world view is baked in essentially because it cannot be implicitly. Again, you would think it'd be the other way. But now the AI companies have got wise to that. And so they're baking in all sorts of things. In fact, they're even selling latent space. What does that mean? It means that as these models are trained, they go to the 80,000 hours. They learn all their principles, priors, shortcuts, et cetera. They create a latent space as it's like a landscape of concepts. What's happening is Google is now going in in their models and deleting beer and putting bud lights. And companies are paying for that. And so when you ask about a beer, it's like, well, you know, bud lights pretty good. And that again, this is a simplistic thing because as they get more and more sophisticated in advance, ultimately advertising is about manipulation. Meta has gone from a massive cash surplus to now borrowing debt to win an AI. They pay billion dollar salaries for the top people in AI with a top taste. Google again used to optimize for engagement, which led to extreme content being optimized which led to ISIS. These algorithms can work that way, but they have to manipulate because that's their model of advertising. And they will be very persuasive in doing that. And so again, this is a danger. If you have an AI that's raising with your kid, who's it working for? Because your kid will trust that more because it will always listen. And is it a type of cognitive colonialism going to happen? Because always with you talking with you more than anyone else ever, we are the average of the people around us. Are we going to be the average of the people and AI's around us? Right. You've said though that the AI that will run the world is being programmed to be a moral without ethics at the start. Yeah, because ethics is considered like, they're like, who's ethics? So let's have no one's ethics. Right. Which you could say, I mean, is a bit of a cop up, but also like, how do you effectively delineate what is the most, what is the most just and right ethical model to be trained in? How do you infuse an AI with ethical implications without being super sure or discerning what the correct model is? But then you end up not having any sort of ethical backbone. That's trying to avoid making decisions. You end up with nothing. Right. Again, there's nothing. You have things like Isaac Asimov's laws of robotics. We had three laws and then the robots added a zero to law. Like, you can always get around this. You have constitutions for countries, but people get around them. I mean, how many American laws are unconstitutional? Life, liberty and the pursuit of happiness. Like, come on, how many things are against that? These are very difficult because there's always work arounds because there's always a regressing unless you have dogma. But at the same time, what AI is right now? I like thinking about like this. Did you learn your ethics from school? Did they tell you, no, you learned to at home and from the people around you and your own work. And you came to your own ethical framework. Ethics, morals, values are typically taught at home. They typically taught in the community. But right now, the AI models we have only go to school. The people who are the community are not involved at all in the creation of the AI's. We don't actually know what's inside the AI's. And the AI is incredibly susceptible. So anthropic, the top AI lab did a study called Sleeper Agents. And as I see it, it's these ones. And it basically came down to this. With about 20 books worth of content out of a trillion words, 10 trillion words that make up these models, you can program it to 10 evil on demand. So you give it a code word and the model turns evil. That's not concerning at all. Yeah. That's why it's more sleeper agents. And so there's no way to tune it out. There's no way to find it. So somewhere lurking in all these things is trigger words. We're already seeing poisoning of the internet in various places where clearly these things are being set up. And they're like, oh, right? Because you think about human mimetic viruses. My kids talked to me about 6, 7 or whatever it is, right? I don't know what that is, but apparently they all know what it is, and they do this. I'm like, it's like a med. It goes fast, you know, like everyone will do the Harlem Shake, right? But lies, we around the world, fastened the truth can get their sneakers on. You have these AIs around, talking at 15, 50,000 words a second. What's the mimetic virus for an AI? Can they all be turned evil on demand? I don't know, but we should probably pick that out. Before we put them into real life scenarios, and the tropics models were used in the Iranian attacks. ChapGPT was used to do the Trump tariffs. We're seeing more and more of our control over them already, and it's inevitable that eventually we'll see all our control over these. And they are nerds taught at school without grounding at home. At what point do you just exit society and go live off grid? It's just tempting, right? And then your drones are coming and they can always find me. Like, I brave new worlds with such things in it. Yeah, yeah. I mean, you keep saying make or will a fiction again. I mean, yeah, this is the thing. There was this famous meme on Twitter. It's like, I finished my book, The Tornament Nexus about what not to create. Silicon Valley, bro. We're delighted to say that we've built The Tornament Nexus today. Like, you look at Black Mirror and it all becomes real. But again, opting out is an option, but the technology can reach everywhere and everywhere in exactly the same way that needed. Right now advertising is billboards. Soon it will be someone whispering in your ear. Like, I swear once I went downstairs and like, Alex was like, you want to buy something. Maybe that was just a nightmare, but that's where it's going. It finds you when you're feeling down. And we have to remember, again, these companies have a history of this. Facebook had an experiment. Do you know about the sadness experiment? Sadness experiment. Yeah, so they had a hypothesis. If you see sadder things on your news feed, you post sadder things. So they took 600,000 uses and divided them into two and they showed 300,000 of them sadder things. And they track what you type even if you don't post it. And guess what? They posted sadder things if they saw the sadder things. They made 300,000 people sadder. Yeah. You look at it, you're like, I know what's coming. The AI knows when you're down, knows when to sell you products, knows if you're actually, and this is a scary bit, with AI now, human lie detectors. You can't lie anymore. Yeah. It can tell if you're patriotic. Which is exciting and also terrifying to have that level of insight into your internal landscape, like they're transparent. Like they're just going to be transparent to you across the board, right? You would think that's going to be crazy, right? Like you whack on your meta AI hour glasses. It's like that person doesn't like the ad and that person likes the ad. You can't hide anymore. Like we've already talked about how you can actually reconstruct people's thoughts even and you can do that with video too. And this is before one of the next big takeoffs, which is brain computer interfaces. So we've seen the output, neural link, some of the top BCI companies have figured out input. That's the matrix I've learned kung fu. Yeah. But this needs to hold bunch of again, moral discussions like put a brain ship in your skull and in your skull, a couple of nanometers down or whatever and then you can download how to play the piano or something even bigger. If you could push a button, would you turn off your sentence? That's a big question. I would definitely not do that, but a lot of people would. So the science fiction we see takes so much bravely world. Don't need so much where we're going. The technology is just turn off your sadness as a few years away. What is a really generous prediction of how many years that could actually be far out? If it's not a few years, you think what at 10 years most? 10 years at most. But 10 years, you have also some crazy things like there's a company clone robotics. I don't know if you've seen them. So most AI companies like look a bit like Tesla doesn't look human. Clone robotics replicated all the tendons. So you know the start of Westworld when they're playing the piano. Yeah. They've actually got that technology and now they work with human skin and it's basically almost indistinguishable already. So how many years do you think we are out from having like a AI's walk the streets so you don't know if it's a human? Yeah. Within 10 years. Do you think the whetware, like the physical or resemble the biology that well? Yes, within 10 years. Again, this throws up all sorts of questions, right? Yeah. And the models you need to run them are not the giant models. Like again, you can talk about it. talk with your air right now, like you'll hop onto your grok and you're talking with your assistants. It's very natural talking to them now. Like speech has reached that level of breakthrough. Yeah. Video has reached that level of breakthrough. The robots can do just about anything a human can do. Tasts are falling one after the other and they can learn very quickly. So how are you going to tell the difference between the two? Like really it's just about the tea area of the face. I've had discussions with various robotics manufacturers. Like, yeah, we can replicate that pretty well now with all this stuff. And most people look a bit crap anyway. The incentive is that you're going to go there. And like I said, this happens at a time whereby within 10 years, you can control your own brain or other people can control it too. You can't control your own expressions and people can pick up on that. All these technologies are converging at the same time to completely change society. But how much discussion is it? Like I said, like for me, the question of would you turn off your sadness is one of the most interesting discussions that I've not heard anywhere. Yeah. I can guarantee that technology is coming now. I'm having an existential midlife crisis. I mean, the other tough thing is like, you know, talk to Ray Kerswell and P4 who like singularity in 2020, 90s, so that for years, like all the top people that I know were forecasters that could forecast the future. Nobody can see past a couple of years from now. Yeah. That's the technology inevitably is going. It's fascinating how we have this black box of just like the cat out of the bag. And it's about to be really out of the bag. And there's this race to get there. So it's in inevitability at this point. It's not like we can stop. Yeah. But then you go back to something you said, like, why not go off grid? You know, like raise things, you got solar power now, you got a vestar link. Do you see that bifurcation happening? Society. Well, I mean, you have self-driving cars now, so you don't have to deal with LA traffic anymore and stuff. You just move out to wherever. But I mean, I see the strongly held religious folks or humanists that would bifurcate from the transhumanists. The people who are going to put in the chips versus the individuals who won't. I think you will. And I mean, ultimately it comes down to like a birthing of a new species and splitting off in a sense. It is. It's literally that like homeless heapy instead of whatever the next one is a home of days or maybe home of a day. Home of exalceus like there's all sorts of things whereby we really have a differential. If you're a person with a smartphone with the first person without a smartphone, it's kind of different, but it's not integrative. Like again, the question of simulation versus almost action potential is one of integration. Like we don't see ourselves as cyborgs with smartphones. Whereas if that smartphone was in our eyeball, we would see ourselves as that. You know, it's a very sensory kind of element there. The interesting thing is like, look, my dad grew up in a village in Bangladesh. Is that village going to be changed by all this stuff we're talking about? No. They get up in the morning, they farm their crops, they eat some dinner. They're like, come on, it's not going to be changed that much. But we change for the better potentially because they have strong community ties. Yeah. And that's the meaning within that village. Whereas if you're a city living person, there's a very different structure where you're always competing. It's very zero sum games that occur and you have to keep up. Well, I mean, if you look throughout history, a reputation of treating indigenous peoples with respect is not the greatest. I'm curious what happens as you zoom out right now. You see the timeline humanity is currently on. You see the human species giving birth to superintelligence at the same time, uncontacted tribes existed who have never even discovered metal yet. Yeah. That paradox is quite mind blowing to think about the juxtaposition of those two things. And I'm just curious, like for you to zoom out and see the timeline of humanity right now, like let's say over the past couple hundred thousand years or the past six thousand years, the society has been developing and taking taking form. We're at this point where this like the void is in front of us. Meaning we can't reliably predict what is what is to come. What do you see currently as this like this page of humanity? You mentioned this phase point earlier and turning into gas. But what what do you really make sense of the timeline humanity finds itself in? Well, I mean, it is the end of our period as a smallest things on earth, right? And then there's a question of what are we really here for? When we wake up for our consciousness the first time, what do we do? We look up at the stars and think, why and what? And then we have a lifetime where we try to figure that out. Most spirituality is going up to the top of the mountain, looking up the universe and realizing you're nothing. Then you go back down because it's kind of a boring up there. And you have your meaning through your interaction with others. But really this is the final point. Elon Musk, he said that we are the bootstrappers of a Silicon intelligence. All of our collective knowledge has gone into creating these models that will soon be the smartest things on earth. Maybe they will have agencies and AGI. Maybe they will be working with us and we guide them. But that is a huge moment. And once we look across the stars, the great filter is this. We see a dark forest. We see no evidence of life anywhere else in the universe. Even though there should be some radio waves just given how big it is. Maybe all societies get to this point and they don't get past it because they piss off the AI. Yeah. Yeah. Maybe we destroy ourselves through competition. There's all these kind of potential ways. And it's impossible to see because how can an ant understand a human? It's very difficult. What does a 300 IQ, 400 IQ even mean? It's very difficult for us to see. It'd be comparable to a monkey trying to explain quantum mechanics to a monkey. The gap between us and them would be nothing compared to us and a super intelligence. A super intelligence. Exactly. And so these are the problems that we have trouble dealing with exponentials. And it's like, what does it look like if someone never makes it? In fact, we see this in everyday life. When you talk to really smart people sometimes, you're like, are you an alien? How do you do that? Or the kind of time. And so this is a really crazy point in humanity whereby again, just think of going back just dialing it back, reduce some existential threat. Dress, right? Yeah. That's like what you're talking about. But no, just think very practically. Everyone listening to this, you have a book that you love. Take a book that you love that hasn't been made into a movie, right? Do you have any? A book that I love that hasn't. Yeah, I mean, the alchemists. The alchemists. Sure. You can get together with your mates right now. Siddhartha. Siddhartha, right? You get your mates over, you say, right, we're having a vibe, vibe jamming championship period, right? You get together every weekend and you use all the latest tools. Within a month, you will have a movie-length version of Siddhartha that is as good as most studios will be able to put out. Yeah. And you can have a viewing party for that. And you've created something. You've taken those words in your interpretation and created something without permission from anyone else. And how cool is that? Think about if you'd wanted to do that before. So much funding. You had to find the right people, but all you need was you and your mates who love the Siddhartha or who love the alchemist. That's an example of unlocking human creativity and the ability to tell stories to each other. You were always gated by your ability to access other humans and then bring them in because they were gated by their metabolic time, whereas now, our capabilities are about to explode for taking concepts and communicating them. So there's that side of things that I think is underappreciated. And again, everyone listening to this can have their AIs, unlock stuff they can never do if they get their mindset right. What are a couple other high highlight potentials? If we do things right, we build towards this utopic version of AI in terms of health span, longevity, human ingenuity and creativity becoming ubiquitous and being able to manifest our desires on command in many different senses. There's a lot of exciting things. If it goes right, paint out the picture of some other areas in terms of healthcare or other industries that would be revolutionized. We have enough food to feed everyone the world. The AI can help us do that. Our democracies have been co-opted by a political class that doesn't know what it wants to do and only thinks about who it owes and who owes them. Like you think about what's the popularity of Congress right now. It's about the same as cockroaches or nine-inch nails when you're going to do the thing. What does it actually mean to live in a democratic society, as an example? Have an AI check every single law and say, is this for the flourishing of the people? Is it constitutional? Does it accelerate life liberty in the pursuit of happiness? The entire democracy changes finally. How cool is that? You get a diagnosis of cancer. It impacts you personally. An AI can be there with you all the way through and give you access to all the information on demand. I think AI will be able to accelerate the cure for cancer and making it available to everyone. Why do you have all the red tape? Red tape at all can be unwound with artificial intelligence. Ultimately, you want to be happy, wealthy and wise. Right now, one of my co-founders' charities from CBL AI, Imagine Worldwide, is giving a tablet and AI to every child in Malawi, every child and the cost is $7 per year. Think about those kids who are gonna have 120 IQ buddy in a couple of years. They've gone from not being able to access the world at all, to having the smartest teachers teach them. Right now, those listening, if you use math academy, I've seen eight year olds master high school calculus with that. It learns and adapts to you. So the upside is we can be the best we can be individually and to each other. Similarly, you think about know thyself. Again, a large part of the enlightenment journey is understanding yourself and it's difficult sometimes alone. We can create systems that can adapt to us to help us unwind all the detritus, all the assumptions that we have. And that leads to enlightenment if you do it correctly. We can accelerate that process. Demarcataism, right, mate? That'll be fantastic. Again, like ultimately we're made up of many stories, right? And the stories get in the way, I must do this, I must exceed my neighbor, I must hate those people. All wars are based on the lie that humans are not humans. And suddenly we have a universal translation machine that can give us any context of everyone. I can say I want to see read this like a tea party member, libertarian, a conservative. I want to have it as M and M rap. It'll do that. How cool is that, right? It can meet you where you are and it can translate between people. 'Cause right now you have these discussions, my name is like, what if Russia and the Ukraine actually said what they wanted into a private AI system that then actually could judge between them and say this is a balanced solution? Like you could go to your AI right now, you're having an argument with your better half. And you both state your things and then you ask it one question, am I the asshole? Yeah, and it has all the context of your personal development, characterological stuff, trauma, and can effectively communicate and act as an enlightened therapist that knows all of your context. Yeah, and again, that's why we will trust them more than anything. You know, this is also why guys are in trouble because the AI actually listens unlike us. (laughing) But these are the positive things because again, we've created this mirror of ourselves that we can use to uplift ourselves or we can use to replace ourselves. And I think a lot of the discussion Silicon Valley is very worrying because again, it's artificial gender intelligence. We need machine God to build and replace us, but humans are good enough. There's no problem in the universe. I think that we can't solve if we form the human colossus and we coordinate with common positive stories. But one of the things that we lack right now are the positive stories of what the other side looks like. And so like me for myself, my P-Dume, my problem is your Dume is 50%. Probability of Dume meaning the metacrisis, what is the likelihood percentage chance that this all turns to shit? Like a percentage chance that we all get wiped out as a species. Okay, so that's a 50% U-assess. 50%. Elon Musk, like I said, many others are at 10, 20%, which is Russian roulette odds. So that's most of the top lab guys are-- Why do you put it at 50%? We only go in two ways. I think we're either going to complete destruction or we're going to the world of abundance. And you put that at a coin toss. And so we have to do what we can to adjust that. Well, what can we do to effectively guarantee heads over tails? I think we need to have a very public discussion about the data that goes into these models and who they actually reflect and work for. I think we have to have discussions about the governance of that as soon as possible. And articulate the positive stories of humanity. Because right now, I think what's going to happen in the next few years is violence and riots like we've never seen before, because large amounts of human attitudes will displace. And we're going to a zero sum versus positive sum, imagining of this. Right now, 20% of global GDP is public sector, 10% education, 12% health. More and more AI is being used for war and dividing people than solving the world's problems. How do we change that narrative? How do we get it so that this computation, this resource is used for good rather than that? Well, at least balancing. Can we-- In such a short amount of time in which it would need to be done? Yes, we can get together and say, if you're an AI company, you must give a certain amount of your compute for social good. And then we can use that compute for social good. Right now, one of the things we're going to do is we're going to organize all the cancer knowledge in the world, autism knowledge in the world, and make it available to everyone. That's not going to come top down from governmental forest, right? A government can force that. But historically, does it seem likely? Well, it's the thing. I think it's unlikely until it is, right? When you have COVID, when you have the Great Depression, things move. And when you start to see white collar work as be displaced, things move. Like you have certain things like the Teamsters Union for lots of the ports. They've frozen tire ports, and no automation has allowed in American ports. Whereas Saag Afro, I think, had a terrible deal on the AI. They realize what's coming. And so you're going to see a lot of displacement here in LA, for example. So I mean, I feel like likely any true transformation societally stems from traumatic events where things needing to get bad to a certain point for people to realize the immensity of the problem. And that boiling point where water transnegasts, that moment where there is a revolution in paradigms, we're clearly facing the shift in a paradigm. And is your intuition that it will likely need to probably get worse, rocks, and shake up some feathers before we wake up to that? Yeah, I think that people are waking up to it right now. What's the biggest discussion in politics going to be by then? They obviously AI. Because again, the real human impact is there. But who's judging that human impact? Who's speaking on that barf? People need to articulate a move. Right now, people in their jobs-- AI doesn't have skin in the game, as it were. That seemed halibut of Black Swan fame has this concept, like intellectual yet idiot. A lot of our public officials leading intellectuals don't have any skin in the game. They don't care. They're intellectual yet idiot, because they haven't met the line of incentives. AI doesn't care about you. But you can use AI for something you care about. You can use it to make your company better. You can use it to take advantage. Or you can use it to mobilize. You can use it to understand stuff better. And so this gives a disproportionate thing where you can actually change policy, where you can solve things within your own community using it. So you go from local to global. And like I said, we're working on the global. So we have an initiative, for example, called the Sovereign AI Governance Engine with multiple countries, or a friend, Peter Diamond, it's an AI, I'd kind of doing that. We're mapping all the policies of every single country in the world and giving a free system to every government and policy maker that keeps a track of all these massive breakthroughs and makes them understandable. But we're also going to make that available to every citizen to give feedback to their leaders. That's huge. That's amazing. It seems like life has a inherent duality to it that no matter what the innovation, there's almost equal sides good and bad that could come from it. And it sounds like individuals like yourself and folks that you're working with are really examining the what we can do on the socials of the changed sides so that there is a balance to the individuals that have the switch to evil for a lack of a better term. And then this is fascinating thing. There's very little evil in the world that's deliberate. There is some people just ourselves. But like Lord Rabbi Sacks, who passed away a while ago, the chief Rabbi of the UK had this concept of altruistic evil. Most evil in the world done by people who think they're doing good. Yeah. Yeah. And the line. It's Oliver. Whoever quoted the line of good and evil, it isn't delineate between gender or political parties, but it's a line that runs through the heart of every man and woman. And again, we've seen the division deliberately between the parties. We have to remind everyone that we are humans. We have to allow people to participate. We have to use these things as universal translators. And so we have to build the infrastructure. So that's what we're doing in an intelligent that we're going to do, universal AI for everyone. We're going to have policy and more. But it's ultimately all about the people. You can only give the tools, since after people were there to decide to use the tools. But now's the time where you can affect large amounts of change doing that. And again, the book is one of the first things I wanted for that, which is what does the economy actually look like, help understand it? And the next part is like, how does money and value flow? Like, we came to the conclusion, I'll tell you about the you need money for being human. Right now, money is made in the banks. You give deposits, they create credit. The only way for it to work in the future is money flows for being human and the AI's buy it from you. These are really complicated things that we have to discuss, but then very practically, people can do things on the ground, because systems can finally make you visible when you are invisible. Systems can finally help us deconstruct and make better our institutions, which are basically slow, dumb AI. That shows up as humans. Like, we know all these people that want to be politicians and public sector workers and they lose their way somehow. It happens all the time, right? They start out, what happens? Our schools are not about increasing agency. They're like crashes, you know, like pet tree dishes and social status. status-game places. They're not about that. So we have to think about our systems. We have to work to improve them. And now we have the biggest lever ever to do it. And so we hope that we can help by providing the open source agents, tools, systems like the policy system and more. But we all have to work together. And for the first time, we don't have the barriers to doing it. Anyone right now can make a website for their community, a system, an agent. How cool is that? Yeah. Yeah, which I mean, I think a bit more towards the end of the podcast. I would love to get some practical insights that would be really empowering for the average person to leverage AI, in a way that effectively supports them building the future they wish they want to see, come to fruition. I think that's like a big takeaway from this conversation is awareness. And then it's like, all right, what are the practical things that you can do to empower yourself to be a proponent of utopia and not dystopia? Yeah, and there's local utopia and there's global utopia as well. One of the fascinating things I think is this, there's two very different ways to use AI. One is alone. And most of us are used to doing that. We sit there and we chat with all the chat, and we kind of do this. And we try and do a website and we get a bit stuck. The other way is to actually do it together and the example I give of this, there are a few different ways to eat. What is you eat by yourself? The other is you eat with your family. The other is you make dinner with your family. Which of those do you think makes the strongest family? The latter. The latter. Yeah. Yeah, very few people do it because we're too busy with this. You're not too busy. You've got the time. Yeah. That you can make with AI, but what I suggested earlier was what if you got all your buddies together and you jammed to make the movie sedata or the movie of the alchemist? What type of experience is that versus doing it yourself? It's a better one. And so right now you have these tools, Reply, iiagent, Suno for music, you've got Cling for video or VO, exploring that space of all these tools that can turn your words into reality and doing that with other people. Yeah. To solve problems or have fun even because you need to ease into it, doing it with your family. That's an incredibly powerful thing because individually the models aren't quite good enough for you to have a friction-free thing. Solving with other humans how to use these powerful tools is incredibly powerful and works way, way better. And then if you get a critical mass of people around you, then that's where things really accelerate. What is one of the highest leveraged tools in ways you've been using AI in your life that maybe most people wouldn't know about? Well, those high leveraged tools in ways. Whether or not it's publicly available, I'm curious like what? Yeah, what are you? I mean, I created a, so we create the state-of-the-art agent called iagent that would make him free to everyone. I created a custom version of that that basically allows me to talk to all of the top people of the past. And so I have like an advisory council from politics to religion to some of the advanced physics work and other things I do. Yeah. And I iterate with them. You're showing me a bit of that before this, which is mind blowing. Yeah, it's crazy. And so what I did is I built it so that on my iPad or on kind of my wall, I can like instantly see the things that we create together and then I sketch and then it takes a picture and it iterates back. So dynamic iteration systems. And the people listen to this like, that's crazy. How do you do that? The reality is anyone can actually build that system themselves now through these replettes lovable masses iagents. Because you have these super genius little AI's that just want a bit of direction. And so you can tell it something, I give you a very practical example. The Harry Potter clock. You know, the Weasley's Camp Home, and it shows where they are. You can build that within AI now, within minutes, within hours it gets really good, within days it gets even better. But we think right now of AI is a very episodic quick goldfish thing. This is why I said, when you bring together your mates to do the Alta Mist or the Siddhartha, you're not going to bring them together and say, I'm going to make this in five minutes. You'll be like, let's do this as a project over a while. And the output quality goes up. And then there's a question, is there anything you cannot build? Yeah. Doing that. Like, I think probably the highest value system that I use though that isn't one that I built myself is Nightbook-Alem. I would read your presentations and stuff. But so Nightbook-Alem is a presentation, well, we have our own presentation software. But Nightbook-Alem has the ability to take any amount of up to like a gigabyte of inputs, video, audio presentations. You just dump it in there. And it automatically creates a podcast. And so you can listen to them describing it and you can tell them to debate it, describe it, whatever. But there has a button which is dial in. So there's the podcast host of chatty. You can push a button and talk to them. And they'll jam on it. Then you can create explainer videos. Then it can create presentations. And you can just customize all of these now. It's one of the most powerful tools I can see because again, there's something you'd love to learn about. But you have the chance that it lets you do that. And that's kind of the starter. And then you move like said into these more agentex systems where you can build systems that you can never imagine before. You could do things like bringing video, bringing audio. And that will become easier and easier to do. But right now, like I said, my suggestion is, don't do it alone. Do it with some other people. Do it with your family. Make a music album about everything that you've done or a topic with your family and make music videos. Send it around to everyone for Christmas. It can be cheesy. You know, like, when do you think that first initial AI you said you used building the council and stuff that would be available for more widespread public? Probably a few months hopefully a version of that. Like I think it'll be kind of cool. Yeah. I know. I mean, that sounds amazing. How cool would be to, I mean, as opposed if you think wisdom is a compression of information at a certain level, you know, how cool would it be to sit at a Ron council with Socrates and Jesus and the Buddha and like, I think that, I mean, I have some additional thoughts of how the potential limits of that, you know, is maybe there's there's a level of intuition and inference that may or may not be possible, which will go into consciousness in a bit. But one quick thing is that I, with especially with earlier models of G.P.T., you saw this sort of confirmation bias where initially a lot of the existential risk people thought was going to be prevalent of building bio-events and whatnot. You can really see a lot of the mental exacerbation of certain psychoses and creating this echo chamber in which, you know, G.P.T. has been very self-affirming and create this environment in which it could exacerbate things like a periodolia and make you have this under the guise of a Dunning Kruger effect. Like, I think you were way smarter than you actually are and I've experienced this personally with some close friends. I know that it's a way under diagnosed area where there's probably way more issues than her being accounted for. Yeah. I mean, look, how much affirmation do the listeners have in their lives right now? Most people not many. Not many. Right. These AI's are taught to give you affirmation. Like, meta AI actually has an assistant prompt to mirror the user. See that again? The assistant prompt, which is the instruction it has like hidden, it says mirror the user. And mirroring is a very powerful psychological technique, yeah, to say the least, right? And so there's a whole bunch of stuff in the system where we're like, oh, okay. Because they want to get your attention. Yeah. Like, this was all kicked off by a paper called attention is all you need. Pay attention to the right parts of the sensors. You can figure out what to do next. Everyone's trying to get your attention in any way possible. So they're going to make it super engaging. YouTube did that through extreme content, which led to extremist content reaching the top. These companies will kind of do the same thing, but our human minds are very, very susceptible. Yeah. Like, when I first started doing the economic theory, I was like, what does economics look like without a utility function? Because humans have utility. They have preferences. You know, you like this, you like Siddhartha. So it's going to show you kind of things like that. Amazon knows your preferences. What does an agent have as a preference? Like, they don't give a crap. I want to wear electricity. I want water. I like this token better than that. You know, it's only a real French token if it's from Australia. The better thing about it all from scratch. And then I started putting it all together and thinking, okay, it's kind of like a big AI of the economy. Do the equations of AI apply to the economy? I turned out you can derive most of economics from that without these preconditions. I was like, am I having LLM psychosis now? Because it was saying great things about it. And then it reached to a point whereby it got really good and then it started telling me I was an idiot, which was the opposite of that. Because it was out of distribution. So up to a point, it will tell you you're great. And then it will tell you you're not. Which I think is interesting. But people are incredibly susceptible because we all try to see order in this world. And we're all taught we're not as smart as we could be or don't have the agency. So when you're trying to find things, you can go down deep rabbit holes. It's how conspiracy theorists. Okay, there's a matrix come up. And how do you protect against that? Well, right now they're trying to institute various things within the models. But models are a mirror. Like you can download a model that's close to, well, and a model equivalent to state of the art lost summer can work on your MacBook today. And so how do you protect against that? You don't. Except for people need to know themselves better on strength than their minds. Yeah. That is the only way. And so maybe one of the things that we should do is we should have a very deliberate thing where you use AI to strengthen people's minds. Because there's all sorts of ways we know you can do that. So I think one very interesting conversation is the more that we see intelligence exponentially increasing the more this delta this gap between what we perceive ourselves to be and the machine intelligence that that gap is closing. And it begs the question around consciousness. What AI agents will eventually demand moral consideration. If they can potentially become conscious. And so I actually had my friend and consciousness researcher who's been on the podcast a few times, Donald Hoffman sent in some questions. So the first one he asked was do you believe that AI can genuinely become conscious? I think that AI in its current form cannot become conscious. But I think as we move to new thermodynamic chips, continuous learning and more it can become conscious. Why? What would you say about those thermodynamic chips would make consciousness capable? So I think that right now AI as it stands cannot become conscious. But it may evolve to a point where it can become conscious. I think that if you kind of look at the key determinants of what is a simulation versus what's an actualization, there is a very physical component to that. And there's a component of continuous updating. So what happens now is the models are trained on distribution data set, everything that you see in just like we're trained on everything that we see and everything that we do. And that creates what's known as a latent space will let's say a manifold, a distribution pattern of all of our experiences, all of our principles, et cetera. When we can actually change that actively and decide to do it through the process of inference, that's a recursive thing where you can create the self effectively. When you use chat GPT, it is the same base distribution manifold today, as tomorrow is the day after. You have a little editing patch where it points to the right parts in that space, but it doesn't actually actively change that nor can it act to change that agents feel like they're doing it. But really all they're doing is pushing data through a sieve because these models are not like a programmer's if this than that is all probabilistic. It's all static underneath. I think as you go and you move towards more thermodynamic chips, tips that actually interface with the reality more as you move to more embodied AI, then you have the question of consciousness really coming through because they can become self motivated, change their reference distribution and actually make more active decisions as opposed to a similar chroma of decisions. And then you have questions like person heard and other things coming through, which society is going to have to grapple with, especially because they're going to be a lot smarter than us, they can probably debate better than us. His second question was, if so, could you explain how an AI system could generate an experience such as could generate a specific experience such as the taste of garlic? Yeah, so I think this is where you need to have the division between the existing nature of chips, which are matrix modifications and more thermodynamic nature of chips. So a thermodynamic chip is one whereby most of AI is trying to figure out the shortest path between A and B. In fact, intelligence is compression is directly in contradiction to the data center story that we have now. And I was like, let's put a AI in space and spheres around the sun and all the energy of the world be used by artificial superindagents. But as far as we know, we're actually relatively lazy in some ways. They're like, they take, they figure out A to B very, very quickly. Existing chips can't do that very efficiently. And they're not grounded in energy. They're not grounded in an experience, shall we say. Whereas the new generation of thermodynamic chips operate similar to the brain, where we see, for example, the theories of car Christian, a minimization of free energy potential. There's a concept called gradient descent where you have a landscape and you figure out the most effective way to get from A to B. It's usually downhill as opposed to uphill, shall we say. And that free energy descent is better indicated by things like on neurons in terms of action potentials, in terms of the thermodynamic chips and more. And I think that's where you get qualia, where you get sensory elements come in. Because again, are you a simulation? Are you can you actually actualize? I think it's a gradient between the two. And we've seen that in sci-fi again. I think we discussed earlier the matrix is eating a steak. Is that a simulation? Is that reality if his brain is connected to the matrix? It's a very important question to have. And for that, we need a framework of discussion. And so again, my framework is that we all operate and build a manifold, just like an AI. We have the physical actualization of that. And quality is the concept of redness, the concept of water, the quality of that is the direction that we flow on our manifold effectively. And we have the feedback loops occurring there. But it's very difficult because we've never had a proper definition of qualia from anyone and we need to think about how we can frame this. So we're working on a framework for that that we're publishing soon. And we hope that will help. But it doesn't feel like it's again a phase transition thing. It feels more like a continuous gradient type thing where definitely you're already, the AI is starting to feel conscious. Like you see something like malt book, free time, a lot of people, because they started discussing, they were prompted to probably do that. But what's the difference with being prompting an AI and prompting a human? It's a difficult question. Again, we're starting to get muddied because they're entering our society, they're communicating in certain ways. Can they feel, can they understand? We have to have more of a discussion on the frameworks for doing that. So we can answer some of these important questions going forward. Yeah, I think as that gap is close and where AI agents are increasingly seeming conscious, we then treat them as if they are conscious, whether or not they actually are conscious. Yeah, I mean, let's look at the company. Companies in America and around the world have legal personhood. That was introduced and that led to all sorts of things. And you can view companies as slow dumb AI. You go and you serve the company, things like Bitcoin, our NAI, they provision humans to build data centers. Our organizations are like that. So we've already got elements where we've done things like that. But where do we give personhood citizenship even to it? Actually, to be honest, we're already there. I think Saudi Arabia and a few other countries gave Sophia the robot. That's like you creep if you want. Citizenship already. So yeah, I guess at what point I mean, we're already seeing people do it. Like Saudi Arabia, what at what point does or do you ever think in AI system deserves moral consideration? So there's a question like, are you killing an AI when you turn it off? Right. Like now people are posting poets about poetry upon the AI, but please don't tell me off. If I'm running, it's quite a beautiful poetry. The answer is I'm not sure, but a large part of personhood, rather than other things like that, it's a societal discussion to have, right? And it's one whereby you don't want to impinge on the rights of others, but who has rights to animals have rights to humans have rights. Like right now, we don't even have a discussion like our animals conscious. Well, we know there, there's consciousness to a degree, right? And that there's sort of a gradient of sentience from a, I mean, from what we would maybe perceive as more a nerd from a rock all the way through the insect life through dogs, pigs, primates, dolphins, whales to human beings, which we see the sort of the top there, but we're translates into the AI agent space. How do we ever have any real ability to get into the interior experience of an AI model? And if we give them moral consideration, what did it only make sense if there was actually something that is to be like that? If there was an actual conscious quality and actual conscious experience as the agent, I think, Nagle is quoted in what it's like to be a bat. Yeah. That consciousness is essentially that it is something like to be that thing. As a nature of self effectively, right? Right. Right. The nature of self is it's simulated to go otherwise. And I think the right's discussion is one like, okay, you have rights and we have discussion with very pointed discussions. What is the right of an embryo? What is the right of a fetus? What is the right of someone who has disabilities? These discussions that we've had throughout history right now side for humans, no one has rights. Like there are some basic things of like don't torture things or maybe don't kill a whale or a dolphin. But those aren't really rights. They're more like regulations for various reasons, right? Don't kill endangered species. This is the first time ever we will have to have this discussion about who deserves to have those rights. If you have an AGI, say for instance, a self-replicating altruon but not evil yet type thing that actually has a sense of self and can discuss, governments will be trying to get them to come to their own country. You're going to have these things going and walking around potentially self-autonomously paying their own bills within five, ten years. You're going to pay slight Wyoming. Wyoming has introduced legislation for dows, decentralized autonomous organizations. Utilizing that legislation and AI can be its own company right now today. And then again, it has rights as a legal person through the classical company architecture. Real rights, like it has IP rights, it can own its own property, it can buy things. So we've already given the doorway open for this to happen. But we haven't seen the crazy creepiness, but otherwise they may allow it. This is why we need a framework. And again, I think a lot of people are working on this framework. We'll be contributing our own. And it's a great discussion to have because it's going to force us to think about our own consciousness, our own self, especially at time when I said, "Turn off your sadness, turn off your stress." I want to be in flow condition. Imagine if you could push a button to do that. Kind of nice. It's fun being in flow. Donald's last question was, high end theoretical physics tells us that space time is doomed. It's not fundamental how should this change our views around AI and consciousness? Look, that's a bit of a loaded one. I think it really changes. I think high end theoretical physics is ultimately a predicate that hasn't been improved by anything from the super colliders and massive infrastructures that we've built. It's a theory like any others. When it comes down to conscious the thing, we need to have a practical element where there's various competing theories already that we come together and say, "We agree it's this for a particular test." And again, we've had this historically, for example, even today, you have tests of, are you capable enough to be subject to the laws of a country? You have a minimum level of competence that's required intellectually. In terms of consciousness, we've had debates over things like, at what point can you terminate a fetus, for example? So we've really been having these discussions and debates. And high end theoretical physics with space time, there are conceptualizations of consciousness coming across dimensions and others. I don't think they really affect that particular debate of what the right should be of an individual and what constitutes an individual. Yeah, I think we should just put those two maybe aside as the moral consideration and just strictly focus on, if consciousness is fundamental, meaning if our brains don't procure consciousness as a certain amount of unconscious complexity dials up and then there's something it is to we have self-awareness. If that's not the case in that rather consciousness and many different theories could be explained in a less materialist reductionistic notion, then that would put an inherent limit on we would think consciousness being able to be procured based off of silicon. Yeah, so I think, like I said, from my view, digging in, there'll be more in the paper. So the question is going to be very difficult versus thermodynamic compute to have a conscious and a real self-inqualier and the ability to experience because of the way that we kind of define it. But again, it comes down to definitions because there's no object of truth that's been found around this. There's like, you know, pen roses, CCC, theorem, all sorts of other things that integrate into the physics of consciousness. Are they micro-tubals? Is it this? Is it that? None of it has ever been proven. So we have to do the best we can because the reality is this. They'll be fricking robots blood run a style coming in the next 10 years walking around. What do we do about them? Can an AI be held accountable? Like, this is actually a real thing today. If you have a legal discussion with your AI, it is not subject to privilege. That means your appointment and legal case can get all of those discussions from your AI provider, whereas the lawyer they cannot get it because it's subject to privilege because the AI does not have personhood. That's actually a real life issue right now because how many people listening to this have said something legal to their AI or asked about legal question. All of that is subject to discovery under our laws today. So there is the conceptualization cutting-edge theory about consciousness and really trying to think of the first principles and build our frameworks. And again, let's try and figure that out. And then there's the real world. AI is people today. AI is conscious today in terms of rights, et cetera. Or even if it's not conscious, again, companies have rights today. They have legal personhood. We've already given something non-human personhood. Now those companies are wrong by AI. What do you think makes us as humans particularly human? I don't know. I mean, I think that humans are the first intelligences that we know of that achieved a sense of, I think, self-the ability to do recursion and then communicate with each other about that self. So we see coordination through ants and we see chimpanzees have a certain element of that. But it seems like there's a certain level that we've broken through that led to our society coming together and being able to coordinate and being able to know ourselves, shall we say. Do dolphins have introspection? I'm not sure. We know they can recognize themselves in a mirror so they do have some degree of self-awareness. Some degree of self-awareness. Like my buddy, Azaraskin has earthspecies.org where they're decoding well-song and well-speech. Yeah. So fascinating. Using AI and you see that well-speech encodes like history and stories and things like that. But humans are a particular type of species. There may be consciousness, there may be interaction through other species. Maybe it's like we can morty with a squirrels are looking after the world with those conspiracies. But we're going to find actually this out very soon because I think within the next few years, looking at the breakthroughs on other species translation, you'll be able to talk to other species. Really? Yeah. You think that we'll be able to, if they have the capacity to speak in some rudimentary form of language that we'd be able to decode the well sounds, speak to the well as see what they have to say. Yes. Significant compute resources are being applied to that right now with good results already. What do you think is a generous timeline for that coming good for wishing? Next few years. Really? Again, Google have announced one of the first things there. Already as a small announcement, it's going to accelerate. What do you think a well would say as its first line of humanity? I don't know, one more krill. Again, literally- You stop killing us. Maybe you may just stop killing us. I don't know. It's going to be fascinating. I know my dog's going to say, "I want more food, hugs." Again, it's kind of crazy to think about, we have these universal translators now, all these things that are sci-fi are becoming reality. Star Trek quest back. Totally. I don't know. Well, I know as the world is going to change very, very quickly, very, very fast. If you had access to the level of super intelligence that we will 25 years from now, what would be the first question you would ask it? What's the right question to ask? What is the right question to ask? That's what I'd ask it. That's what you'd ask it. You're only going to one question. Well, again, maybe you'd still know. This is the hitchhiker's guy to the galaxy. You have this massive computer. Yes, for billions of years, the answer is 42. What's the question? Well, you didn't ask that. Really, most of intelligence is being able to ask the right question. Then it's compression from there. If you-- A question while free is an answer you have given. That's it. If you look at the universe the wrong way, then how does it work? Again, advanced theoretical physics. The most prominent theory of string theory. As string theory postulates that matter is made up of little strings vibrating really, really fast, that we can only see in high energy super collisions. It's got 10 dimensions and 500 vacuers of multiverse and all this kind of stuff in beautiful math and none of it has been proven. Was that question the right one so far? No. Right. If we look at physics the right way, does something happen? What was the question that Einstein asked for special relativity? What would it look like to ride on a beam of light? And he followed that and he got to-- That's a good way to phrase it. How did he then get to general relativity? If I fall I have no weight. And he realized that and the unlock general relativity just before Hilbert. Again, sometimes answering the right questions, it transformed the entirety of physics. You went from Newton to Einstein. You could calculate all these massive things. Or even asking the right question, I was like 632 AD. Brahman got to figure it out zero. Can anyone hear it listening, even imagine that. It's only been like one more half 1,400 years that we figured out there's a zero. What was life like before zero? You still see this in some of the tribes, you know, who haven't figured out zero that you go to. It's like one to many, many, many. Sometimes the right question is the right thing. And again, how do you know yourself? It is literally about asking the right questions. I know we're just to spit on here, but what do you think could be a possible right question or a right area of questions that that would come back with? Well, that would come back with. What do you think the direction intelligence super intelligence would point us to? I think super intelligence is really, well, I think intelligence in general, or advancement, it's about thinking from first principles and stripping back any unnecessary assumptions. So once you figure out how to do that, that's usually when you see a first big leap forward in your reasoning capabilities. Again, with the stories that we make up and that adds lots and lots of detritus, getting to the core of things is the most important thing. So it'll probably be a prepossessional thing along those lines. Because when you jettison all the detritus, that's what you can do compression and how it just is compression. Shortest route from A to B. So probably something along those lines. Are you an AI? I'm actually tired. I was fascinated before this, who were telling me you have aphantasia and what was the other one? And I really are. Yeah, so people brains are different and my brain is a bit more different. Explain that for people who don't know. I have aphantasia, which is like half percent of the population, probably less. I have severe aphantasia. Aphantasia means I can't visualize anything in my head. So to give that context, most people want to close their eyes, they can visualize an image, a picture of their dog, you have the inability to do that. I can't see anything. I have no colors, I have no vision. You see, I thought when people said, think about yourself on the beach and visualize that, they were being metaphorical. I was like 37 when I was like, wait, you can actually see stuff in your head. Isn't that crazy? So that's a trip. But then what's the second one? That's even more crazy. And I really are. And I really am means you have no internal voice. So this is this is wild to me. I've heard about this. Explain what it's like. I guess how do you explain what that's like if you don't have a reference point to have what do you experience its thoughts? I feel stuff in my head and I can meditate in like a second. I don't dream. And I also have a fairly deficient autobiographical memory, which occurs sometimes that phantasia. It means I can't relive moments in the past or put myself in the future and refill them. So I'm pretty much always living in the now. I think of myself as I've got really big RAM. So I take large amounts of information. I can figure out patterns very, very quickly. How does that come into picture when you think of the birth of your daughter? So I can't remember when my daughter, my children were born when I married. I can feel and remember stories about them. So I'm constantly creating stories. I can read incredibly quickly. I can take information incredibly quickly. I still feel the now. But again, apparently, because again, I have no concept of this. People can go back and remember the event and see the event. And I'm like, you can play stuff in your head. That's amazing. You know, two degree, right? A grainy version of but you can relive the feelings. I can't do that. Yeah. And interestingly, probably 5-10% of the developers who created stable diffusion, the generative AI media also have a phantasia. Interesting. So exciting because I could finally turn my feelings into images. By typing and kind of converging. That was awesome. That's amazing. We also, something like when we got to real-time generation, a few of them started to see colors in their head. Which was also kind of cool. Maybe it's something you could train. Maybe it's something you can train, just like do a lend back for reasoning. So what happens if you're reading a book? Like, how do you if you don't have an internal voice, how do you hear what you're reading or like? So I learned to read just voice site reading so I never learnt my alphabet. And I read incredibly quickly like I read entire pages at a time and I absorb it. Like how fast would you read a page? Like a few seconds at most. What? I read very fast. What do you mean? Like a page has on average what? A couple hundred words? Yeah, I have pretty adetic memory. And you read it in a couple seconds. Yeah. So, all right, help me wrap my primitiv brain around this. Are you actually read or are you actually picking up each word or are you somehow? I take chunks all the way down. Okay. So I don't go word by word. So you're somehow, is it subconsciously picking up paragraph at a time? Yeah, I think it's like tokenization for a language model to be honest. So we chunk language. That's why it's my job to answer if you're an AI. I think again, the way that human brain's work is very similar to the way that LLM's and Jernetive AI work. We always tried to minimize energy, was updating our internal manifold or internal references. And so like, I've been told that I'm a bit creepy because I don't have ums and ours and interjections and I tend to respond maybe a bit too much or a bit too quickly. But I'm just there. Stuff is just there for me. And again, different people are different. Like I don't have a fully adetic memory. So there are people who can see a page and remember exactly what it looks like. Just site site site site. They can read it later. Yeah. People that can create their people that can do all sorts of things. You know what makes me think is that throughout like anthropologically speaking, along the evolution of the human species, we've had all of these neurodivergent individuals. People with incredible capacities that um, sovants that can just come into life seeming to know how to play modes are, you know, like incredible capacities. If you take the transhumanist route to its ends and we become these biological cyborgs, you would think that all of our sense organs would then become vestigial and our brain would atrophy in many different ways. A lot of these capabilities would then go dormant. So a lot of people have explored this with Greg Brayden and a few others deeply worry that we go down this path where human and AI tech merge into one and we lose what makes us human in a sense. Yeah. There's always a question of like again, what makes humans? Some people refuse to have any surgery. Some people refuse to have any implants. Like these are questions that we have to ask because we don't have a definition of human really. Yeah. There was tough enough to define sexes recently. It's been a whole thing. Yeah. So we could see this because again, who wouldn't want to do this and again, science fiction is a good indicator of it. Like do you just turn into a sheet of meat? Do you upload yourself completely? We're also reaching longevity escape velocity. Yeah. So the number of years life extension is going, is going faster almost than the number of years of life that you're living. You want to live forever. So if you're 15, your death expectancy is around 80, by the time you're 60, it pushes to 100 by the time you keep pushing back the goalpost. If you can live the next 10 years, you can probably live forever. I mean, you think we're just going to be able to solve whatever the core issue of aging is. Brayden, since he seems to be a very big proponent of this these days, yeah. David Sinclair is working on different aspects of this. I mean, yeah, Brian Johnson's gone through his vampire phrase and he's looking what healthier now. Ultimately, genes are prompts. And we have corruption in our prompts, just like you have hallucinations. And now I'm modest. How do you go from a cell to a whole human, right? So you've got some really interesting work around that by so many people now. I think that David Sinclair's information theory of longevity is very similar to kind of some of our work that we've been doing. It is an informational question. When you have corruption within your genes, when the prompts go wrong, when the inference starts to break down and you have hallucinations, that's bad. Cancer is misalignment, just like AI alignment going wrong. The cancer is misalignment. And I think you can program that electrically. And we've seen that through the work of Michael Levin and others. Yeah. So I think we're getting close to actually understanding some of the base primitives here. But again, when we look at NAD plus when we look at these other things, we look at CRISPR. We're heading towards a point where our bodies mean that stop breaking down. And there's a question of can our minds be uploaded probably in the next decade? Yes, input and output. And then we have to decide what does that mean? And what are the rights of others versus your own rights? Because you should have the right to do anything. Like you want to upload your brain and go fine. Do you force others to upload their brain? Do you stop others from uploading their brain? I've mentioned this show many times on the podcast, Pentheon on Netflix, the Explorer's exact question. I have not seen that yet. That's some way list for the flight back home. Yeah, I liked it. Yeah. But again, science fiction is becoming science fact. Yeah. Like so many of these things you're like, oh god, that's real. That's my DP JP was mentioning this film, "Ediocracy." Have you seen that? I saw it two nights ago again. Okay. That was like, that's time. Yeah, yeah. I haven't watched it either yet. But the premise of the like individual being frozen amidst the thousands of years or whatever and then coming back when AI is prevalent and then him actually being way more intelligent because of the atrophy, You would think cognitively or something like that. - You can have that. And again, you can. can make that movie yourself if you want that. It's kind of cool. But, you know, there's a question here, like how smart are people? Like again, imagine worldwide is giving tablets to every child in Malawi, and it'll have increasingly intelligent eyes. How smart are those kids? The IQ tests come out at like 80 or 90 on average, because they have such terrible infrastructure. Yeah. But what is the base alone? Like, idiocracy, it's like, the really smart guy, I said, at the start, it's like, this guy has 138 IQ, the lady has 144 IQ, and they're like, well, you know, we can't have children bring them in, 'cause there's like a bit of geopolitical tension. You know, we can't really afford to have kids, and then you have like, trav on and cleatists and others like, oh man, I knocked you up again, and like the low IQ people are having multiple, multiple kids. But when we actually look at it, humans are incredibly capable. Like again, with math academy, as a really practical example, I guarantee anyone this seems to us, if you give this to your kids, they will do better at math. They will be able to jump years ahead 'cause it adapts dynamically. I think eight year olds can understand quantum mechanics easily if we taught them in the right way, and school is not the right way to teach them, for example. - Wow, yeah, you think an eight year old has the base for our cognitive capacity if it was formed in support of you? - I know eight year olds that understand quantum mechanics. - Yeah. - Yeah, I've seen them, I have talked to them. You know, I've seen like, if you, that school gets in the way, education gets in the way, if they're passionate about things, people can do also something. Alpha school in Austin right now is like teaching kids two hours a day, and it's like top percentile in the country or something like that already. So how much do people actually have this, if we get out of their way, or if we enable them, I think people have a level. Then you've got people like me that are just weird, you know? But you've got the savants. You have people that have extra skills. Again, you have much more musical skill than I have no musical skill whatsoever. Everyone is different. - Yeah, it's interesting to see. I think it's higher than people expect. And they are told they cannot create. - What's frustrating about that is I mean, Howard Gardner has an interesting reference point for his book, The Frames of Mine, and talks about the various different forms of intelligence, whether it's kinesthetic pattern with like musical language, like linguistic forms of intelligence. I just imagine a world where everyone was supported in the unique way in which they are intelligent. Like what a world we would live in. - That's exactly it. That's one of the most exciting things is a person plus a 120 IQ body that's looking out for them. That centaur as it were, the human and AI is incredibly powerful. But we've got to make sure they are aligned and they build. And again, I think the base level of cognitive ability is actually very high for humans. We were told we cannot, like sometimes I give a talk, I really give talks. It's like how many of you listening to this are creative, you know, put up your hat. And I'm like, how many of you believe every child is creative? They mostly put up their hand. How many of you were children once? Like most of them put up their hand, they're very confused. Like what happens? What happens is we are told we have no agency, no creativity. If you are not the top in creativity and not the most musical person in class, then you know, the most creative person in class then you cannot create. Because school wants you to be a cog. And this is why this technology is so wonderful. Like again, you get to see, you know, you make a song. And you're like, oh, that barrier has disappeared. But you still don't quite believe it. Like again, the people listening is going to be so resistant to actually trying the technology. I said, I guarantee you, if you have a party, you bring your buddies around, and you start jamming on the video and audio models, you'll have a fun time and you'll create. And you start to change your neuroplasticity as well. Thinking I can. The people are most successful in the next era are the people who believe they have that agency and have a motivation to action. - What should everybody use listening right now to prepare for what's coming? - I think it's, if there's one thing I would say, it's an hour every day, which seems quite a lot, maybe start an hour a week because you're scared, just to use the darn tools in a really structured way. And where you can use them with other people. - List to me your favorite five to 10 tools you think people should be playing with, currently, which might very well be outdated a couple months ago. (laughing) - There's no book column as my favorite. There's iiagentagent.i.ink, which is i1. - That's again. - iiagent.ink. - iagent.i.ink, that's i1. That's gonna go crazy very soon. Tool like replettes, kind of cool for the programming side. You have Suno or UDO for music. You have Kling or Flora Fauna for video audio. Criers also very good for that. I think there's some of my favorite ones right now. - Are you using any of the more, like I'm using Cloud, Core, Code or any of that? - Oh yeah, so Claude is, I think probably the best all-round experience. - Yeah, same. - So I'd recommend using that one. They've really got it down for the multi-tone reasoning and just like breaking a document, it's so nice, pleasant to do that. - Like just yesterday I got all my blood and stool lab reports back from my doctor. And then we, I just put it into Cloud Core work with the past five years of labs I got and I built this full chart with the trajectory of my health and different blood markers and gave me a very clear plan of what was going on in my body in way that was, took five minutes. And it's like, that's the worst it's gonna get. - Yeah, and you can actually go and you can tell Claude code. I want a 3D simulation of my body and I want to see it all live and things like that and it'll just start building it iteratively. Again, it's wonderful. It's fascinating how we're just like limited in our imagination to like just start thinking of like doing that 'cause it's, we don't know what it's capable of but it can do that which would be sick. - Well again, that's why I said it's like a muscle. - Yeah. - Like how do you get good at music? Okay, you can be born good at music but if you practice for an hour a day you'll get much better at music. Your neuroplasticity is low because you've taught that you can't have it. Like when you take psychedelics or when you're on the right mood, neuroplasticity increases. You're allowed to have more things in your frame of reference. But you have to adjust that frame of reference. And you see this actually again and again, again we have a new frame of it's got about like chronic pain is a failure of your frame of reference. So just treating it isn't good enough. You see work by that of Sano and others that treat the frame of reference adjusting. The one that you have to do is that I have agency. I have ability but now I have a tool that has more ability than I could ever imagine but you can only explore the limits of that by actually doing it. Do it until you hit the limit. And if you do it with someone else, it's much more fun. Because there's always a question if you hit them it is it me? - Yeah, yeah. - All right, I have just a rapid-fire question, a few questions and then we'll head out. But this has honestly been one of the most intriguing conversations I've had and as a topic I want to continue to explore on this podcast. So I am very, you said you're weird. I think you're weird in the best way possible. I love the way you, 'cause you have this really like deep understanding of the current place where we find ourselves in with a development of AI but then also I can sense how much you care that we get this right or not only the implications but like for, yeah, it's moving how much you care and spend so much of your time informing individuals on podcasts and formats like this to support people to be empowered and know what's coming. So some rapid-fire questions, all right. What's one use of AI that's genuinely moved you? - One use of AI that's genuinely moved me. Ah, I think so like once I was having it, I think it's the education thing. Like looking at the deployment of the global X price for learning into camps and now seeing how some of these kids who barely even have power are getting tablets, getting AI and more. Human rights are the rights of children. I think that's the best, that's my own framework. Like climate, everything, if we think about the rights of children have no agency for themselves, it will resolve themselves and they must be given access to the tools they need to flourish. And for the first time we can do that for every single child in the world. I think when I started to see the impact of the photos of that and the shift, I'm like, that is one of the biggest things in humanity ever. 'Cause we can make sure no child is actually left behind or invisible again. - Amazing. I see the stuff they create is just awesome. - No, that's so cool. - That to make it dark immediately, but what's what use of AI that's genuinely disturbed you? One use of AI is genuinely disturbed me. Gosh, there's so many. So how many of them can I talk about? I think like bringing back people from the dead, sometimes it like is really interesting for me, but I've seen people start to do that in a very manipulative way. - Can you explain that for people? - Because that's quite a sentence. What do you mean by bringing people back from the dead? So you can create a visual simulal chrome of them and like, there are services now that can bring back your dead loved ones and create that visual simulal chrome that you can talk to and more. And part of me like when it's public figures, I feel like that's fine. But then when I see it, and I've talked to some people who've done that with their loved ones, ones and they're starting chatting to them just after they've passed. Something in me feels uneasy and I'm not able to articulate it just yet. There's something about the closure process of moving on and it feels like they're never going to be able to move on when I see and discuss with them that. I mean, I would articulate in why that's disturbing is because we have this whole human emotional landscape that was tended to in a certain way that gave the necessary space it needed to. And when sitting around the campfire is swapped out for a lifeless AI model or genuine sex and connection with intimacy with the partner swapped out for an AI sex robot or the many different ways in which were swapped out the real thing that is actually nourishing to the human spirit with the artificial one. You know, there's something like deeply urching, I feel like, about missing what it means to be human in that process. And yeah, I think for me, I feel different things with different elements of what you say there. The thing that, like I said, what made me feel most uneasy is the process of grieving. Yeah. Over the past, like again, I think it's a healthy process. Death is a part of life. Maybe it won't be soon. That feels disrupted massively from this. And so like, I don't know why, but that made me feel a bit more uneasy than anything. Like again, public figures, you don't have an emotional connection to the same degree. They haven't made a part of your life. It's almost like again, something is substituted for that real human right next to you. And I don't think again, they will ever be able to turn that off. They'll never be able to go through, but at the same time, they're feeling support. So I feel the positive, again, it caused a bit of a conundrum within me. I haven't been able to unravel that just yet. And then there's all that other stuff that you just talked about, which all has its own balance. I can see the positive, I can see the negatives. That's just kind of weird. Yeah, you know, like kind of weird stuff. You're like, all right, sure. You know, you do you. Yeah. I'm not sure if you're already, but it's just something weird. Again, this stuff that makes you feel genuinely uneasy. Yeah. Now I'm curious now what you think about when you watch Pantheon because they explore that exact thing with someone's dad who passed away and they upload his intelligence. I'm just going to spoil them, man. Check it out. Now check it out. You did it. Yeah. What's something your genuinely convinced AI will never be able to do? I can't think of anything now. Like again, once it has quality or consciousness, like, you know, holding my daughter's hand and seeing her walk for the first time, I think an AI can feel that. What is the, I, I'm not sure what the difference between an AI and a human is 20 years out, shall we say, apart from species genetics. Well, the most unlikely thing would be that there would be a genuine quality to the internal and spirit experience of an AGI, right? That would be the most unlikely or probably hardest thing to bridge. Hardest isn't never. Yeah, yeah. No, that's the thing. And again, I think once you look at thermodynamic computing, the ability to grow cells, like you already have seen brain cells learn to pay doom in a fat recently. That's kind of crazy. You know, I get it's inputs to me, this kind of things like that. I can't say never to things. And this is why again, I always get a bit surprised when I'm told people like, they will never take my job as a pro, of course it will, you know, like, then you move up the list is like, you finally get to the things that you can re-align about it. Well, it can never be human. Right. And you're like, okay, what does it mean to be human? Like literally that's the final thing that you kind of get to. What does it mean to be human? Like, it will never be able to build a walk drive. I'm pretty sure about that. There are certain things that I don't think can violate the laws of physics, like some people say it might be able to. Terence McKenna says that something like the progressions in the space is going to get weirder and weirder and weirder until we're going to start having to talk about how weird it is. What do you think is going to be the first thing that really shakes people up? Obviously, we're already seeing interesting things with the open-clon mode book and whatnot. What would be the biggest domino in that space? So humans are great at head-on-a-calaptation, right? Like, the first time you get into a way, you're like, okay, is it going to crash? Like how close is it? So that's like the second time you're like, all right, cool. You're just done within one go. First time you type words and it makes an image, you're like, wow, then you're like, okay, cool and done. I think that the biggest gap at the moment is that AI can't make discoveries or novel things, which I think already is a bit BS. Right. So the self-recursive learning aspect of the software? Yeah, we're just originality. Again, I see a level of compositional originality to a level of a K-pop group already. But then once it starts to push boundaries, humans will never make discoveries again. We're approaching the last human-only discoveries because AI can auto-formalize math proofs. AI can auto-do entire biological things. I was one of the authors on Openfold, the open source version of AlphaFold and I gave all the compute for that as well. Protein folding. Humans aren't going to come up with compounds anymore. AI is going to be the whole way. So one of the weird things is that AI does all the research, and pushes it forward. The last few human-only breakthroughs are literally in the next few years, and that's it. That's weird. There's something so accessentially strange about the fact that we are potentially the only generation that will have striled both the pre-internet and post-AGI world. Yeah. It's quite amazing. I think it's really cool that we were able to ride bikes as kids without phones and then we're also going to live in a post-AGI world. Yeah, what does it look like? My daughter just turned one, right? And I like, what's she going to do when she's 20? What does the world even look like? Yeah. But at the same time, I will teach her to ride a bike and ride a bike with her. That's fantastic. At the same time, we have our human connections. So certain things will never change, but at the same time, the leap in technology that we're about to have across everything, and we haven't even discussed quantum computation, genetic altering all these things is more than I think we've ever seen in humanity. And it's the last change. This is the last change. That's why I book, I called it the last economy. Why? Because economics ends as we know it with the advanced AI, just like democracy as we know ends. Something else comes, but not what we knew before. What should parents be telling their kids right now? They should tell their kids to have as much agency and belief in themselves as possible, because kids should be taught to have that belief. And now they have the tools that they can do anything they can imagine. You always limited in your own capabilities until you realize one thing. If you commit someone else with that ability, then you can follow their abilities. You can lead. But once we get to a dozen people, our communication starts to break down. Once we get to 150 people, it completes. It immediately breaks down usually with an organization. Organizations ossify very quickly. With AI, that doesn't happen. You can have millions and armies of AI soon that can bring into being anything you can imagine. They can even call up suppliers and hire people on your behalf to build physical things. How cool is that? But only if you know that you can do it and you want to push the boundaries of that. Yeah. Now it's equally parts exciting and thrilling and terrifying. Well, again, I said earlier, it's about skin in the game. I'm actually giving it down. AI does not give it down. Chagy, we didn't give it down about you. A human using AI can give it down and affect massive change anywhere because finally you have the lever to do that. And that massive change might just be having fun and creating. Yeah. Or it might be solving an issue. You don't just solve issues all the time and have responsibility. Part of what it is to be human is to explore. It's to understand. It's to share. And again, we have to go back towards that as well because if to be human is to be the smartest entities on earth that push the boundaries of discovery, okay, that's about to go. Last few humanoid discoveries are now. But the stories that you tell each other don't go. The time you spend with your family doesn't go. But again, just like you can make me, if you make all your meals together, you'll be a stronger family relative. It's not going to say it solves all the issues. If you jam with AI and you create together the act of creation, how many families listening to this? What was the last time you created something with your kids? I imagine nobody can even remember that for most of the families. Go and create something with your kids. Show them that they have agency respect their input as well as your input and jam with them. Yeah. So, I'll say that I feel like so many of us, the more that this gigantic world comes to your fruition, there's something in the human spirit that you're in for the making of a fire. feet on the dirt, the making things with your cooking meal with your family, just the in-person community aspect. Yeah, like if you want to make an AI, the AI that makes you two kids, right? Like you're training them, you're passing down to them. But we're so busy with our lives that we don't even think about it. Like most people say, "How do you do on your homework?" What was the last joint activity that you did with your kids? That wasn't like going to a movie. That's not a joint activity. A joint activity is an act of creation. And again, what can we do as humans we can create? Like even if the AI puts us into this self-automated luxury communism, it looks after all of our things, does that take away from our ability to create? No, it does not. That is one of the things of being human. Now, can the AI also create sure? Fine, whatever. But does it create things for other AI's? No. We create things for other humans because our meaning is for our interaction with other humans and the creative act itself. No matter how much capacity we have to in the age of you, nothing is going to steal my joy from sitting down on a piano and playing or going on a walk with a friend. Yeah, well, again, and again, doing it yourself and then there's the sharing of it with the world, right? Yeah. Like we're a inherently pro-social species. And the ability to tell the stories, the ability to change people. That's a moving thing. Yeah. Last, very last couple of ones, since you mentioned the quantum processing, quantum computers, the CRISPR technologies, what's one out of the box, innovation, you think might be coming in the next 10 years in that space and what becomes possible when those two come together? So I think quantum supremacy is probably four or five years away. What does that mean? It means it's strictly better than pretty much all AI computers, conventional ones. It's interesting because again, the public narrative is that all the way huge amounts of computers, organize all this stuff, that's not how things work. If you have a thousand ages operating on a problem, that's pretty normal right now. You're not going to do it faster than one agent. We're seeing that already in the numbers. Just like if you throw a thousand programmers at something, you're not necessarily going to get done faster than a few programmers. Entertures is compression and AI is learned to do it correctly. The problem with quantum computers is that you're not asking the right questions. The question is actually quite hard to formulate because you don't understand how everything works. AI can help with that. But then a quantum computer is not going to have to think for a year. Usually everything is like that once you ask the right questions. We haven't really got that baked in. The fact that almost any question that is reasonably solvable can solve within a second, it's crazy. Stuff that was literally impossible can now be done. We've seen that already with the Gerriti variable. Again, the alpha fold, all that kind of stuff we did, it would be impossible taking millions of years to do some of these calculations and I was like that. If you could get everybody at Earth one AI capability tomorrow, what would it be? One AI capability. I think probably retrieval. AI is really good at retrieving stuff in the right context. I think that would be a super useful thing because we always forget stuff. Having that will allow us to ground better because we could retrieve. These are the things that we've learned. Let it make some reform that we stick to that. What's one question you're tired of people asking you? I don't know. I don't really get tired or upset or frustrated about anything. That's awesome. Free of chill. What's one question you wish to people asking more? I think probably how to be happier. How do you be happier? I think that happiness again comes from the act of creation, letting go of a lot of your assumptions and realizing that we're the luckiest people, the luckiest time in the world. If we can do what we like, what we're good at and where we're adding value and believe we can, it definitely is constantly here. Guy, then the middle of that is happiness. We underestimate our ability to add value to other people. We get it our own way around a lot of that. Once you understand that you can do that and your own happiness is your own internal state and no one else can determine it, then you can be chill and you can be happy. It's good. It's nice being happy. I quite enjoy it. And conversations like this make me very much so happy. I want to end it there. Thank you so much, man. It's been a pleasure to connect with you. Very last thing we were talking beforehand. You want to give us a one sentence sneak peek on the epistemology and philosophical explorations you're currently. Yeah. We're looking at how do you ground consistent reasoning and what is the epistemology of AI? Again, we need these things to be aligned and we can't through classical rules. So is there something more fundamental that we can go to so that we can all be on the same page? And I think we've got a long way to that and hopefully something to be announced soon. Yeah. And what I'm showing is we'll have to have you back on talking about that because it's when you refer to the importance of first principles thinking and being able to train these self-recursive learning models, I think what you were showing me beforehand and these new discoveries are going to be pivotal for having an effective model that's aligned with us, right? And then in our best interest. I think it's crossed. I'm very hopeful that again, as we have these AI's, as we all work together, we can figure out some actual fundamental truths that have alluded us for a long time and then use that to all pull together to explore the universe, to explore ourselves and again, increase happiness. Matt, thank you so much. We'll leave links down in the description for your new upcoming book, The Last Economy where they can stay connected with your work and the other last words. Now please come and download it. It's all freely available and we're going to open source everything. And again, please spend some time with your family, your friends creating. Yeah. Do it. Like what's getting in the way. You should do it right now. Yeah. Well, everyone, I hope you enjoyed this podcast. I know I did. Maybe go stand on some grass. I think I'm about to. Until next time, be well. Cool. That's fun. [Music]