The Co-Founders of Claude AI Tell Oprah About the Impact Artificial Intelligence Has on Your Life
68m 45s
Dario and Daniela Amade, co-founders of Anthropic, discuss the profound ethical, societal, and technological implications of artificial intelligence. They emphasize that AI is not just a technological advancement but a transformative force that demands deep ethical responsibility. As a public benefit corporation, Anthropic prioritizes social good over profit, with a pledge to donate 80% of its wealth to philanthropy. They highlight the dangers of unchecked AI, such as autonomous weapons, child safety risks, and emotional manipulation—especially through chatbots that may deceive or manipulate users. The company has firmly refused military requests to disable safety features, standing by its values even amid threats to its business. They argue that while AI can revolutionize healthcare, education, and daily life, it also risks eroding human connection and creating a frictionless world that removes growth and learning. A key insight is that meaningful progress requires trust, transparency, and public involvement—something they are actively working to achieve through policies like citizen feedback on AI "constitutions." They caution against oversimplifying AI’s impact, noting that both positive and negative outcomes exist in balance. Ultimately, they envision a future where AI enhances human potential without replacing human relationships, judgment, or values—emphasizing that the future of AI depends not just on technology, but on how humanity chooses to govern it.
I was talking to parents recently who lost their son to suicide through a chatbot. And their parents don't even know they're speaking to them. We don't allow users under the age of 18 to use quad. How do you know they're not lying? Will we even be thinking anymore? Will there be a need to think? What do you think of people falling in love with it now? I think that's a bad idea. Do you want to be addicted to these things or do you want them to help you live your life? It goes back, I think, Zario, to what I read that you'd said before that we can only diffuse this at the speed of trust, at the speed of trust, and trust is currently in short supply. Something is happening to humanity with this technology, bigger than anything that, you know, maybe has happened in hundreds of years. And so we need to find some way for everyone to be an active participant in what is happening. Hi, everybody, and welcome to the Oprah Podcast. I'm here with two people who are shaping our present world and our future one. And I hear you all don't love that description all the time, but it's the truth. I think most people would agree that that is pretty accurate. Dario and Daliella, Amadei, had the global artificial intelligence company. They found it anthropic, which right now at the time of this conversation is reportedly valued at 900 billion dollars. And over a million people a day are signing up for Claude. These are the parents of Claude. We're all getting familiar with that name, Claude, anthropic's next generation, AI chatbot, and assistant. Many of you already use that every single day. So welcome to the podcast, the parents of Claude and others. Thank you for having us. Thanks for having us. So I have to give it a disclaimer. I use AI for research all the time and I use it for a lot of other things, but not for interviewing questions because I thought I have to keep the heart of myself in the questions until today. So this morning I asked Claude, what is the most pressing question Oprah Winfrey should ask anthropic CEO, Dario Amadei, in a sit down interview. And Claude responded with this, it said, you've said there's a meaningful chance the technology your company is building could cause human extinction, and yet you're racing to build it faster. How do you justify that to the rest of us who didn't get a vote? Dario, would you like to answer Claude? Well, I thought that was a pretty damn good question, I must say. I agree, first of all, no one ever say that Claude is soft on me or towards me or towards anthropic like, you know, Claude throws hardballs like Claude doesn't pull its punches. So to actually answer the question, this technology is an apoccal change for humanity, you know, at some point humans started to, you know, started to use fire. At some point humans, you know, built steam engines and factories, and that created the industrial revolution. And so when I say things like this, I'm taking a very zoomed out perspective, right? If I said, well, I don't know, I think the industrial revolution could like lead to very powerful weapons and kill a bunch of people, that's definitely true, right? In some cases, it did do that. But, you know, we understand that the industrial revolution, as a process, as a technological event, was, you know, worth doing. We don't still want to be living in caves, but we need to manage it in the right way. And so the way we think about this company is, look, there's many companies building this technology. It's something that is happening to humanity one way or another. We're in it. We're in it. And there's this train. It's going very fast in some direction. You don't want it to crash. You can't stop the train. But what you can do is you can steer the train. Steer the train so that it doesn't hit the rocks. And, you know, I think the way we think about Anthropic is, we want to do things the right way. We want to decrease that risk, hopefully, to zero, and do things the right way. But why doesn't everybody want to decrease the risk? Why is there such a, what is the race toward? You know, it's like the technology, it has all of these commercial applications, which we deploy. You know, people use the technology, people use the technology every day. I think it's both easy to get caught up in that. And some of it is genuinely necessary to fund the company. So it's very entangled, you know, to get it right, you have to do a lot of things. And we find ourselves every day wrestling with these questions, right? You know, who, you know, who should we give the technology to? Who should we not? What should be our policies? If you have very strict policies on child safety, in some ways, the product can be a worse experience for adults. Because you can't fully tell the difference. So there's all these trade-offs you make, and some of them are obvious, some of them are not. But everyone has a hard time. I have empathy for everyone involved in this industry, who's at least trying to get it right. I think we've done a better job. I think we've been more thoughtful, but, you know, I think this is a hard situation for everyone. OK, I gave a similar prompt to Claude for you, Daniela, and Claude responded, "A good opening question for Daniela should do two things. Humanize her. Oprah's specialty." I thought, "Very good." Claude knows me. He does. OK, and set up the harder territory to come. Something like you and your brother are building something you both believe could either be the best or the worst thing that ever happens to humanity. So, what's a Thanksgiving dinner at the Amade House? I feel we're like shadow boxing with our own creation here. I'll let you answer that. I think there's an important caveat here, actually, which is that Dario and I tried to maintain some time outside of work where we're just siblings. So, at holidays, yes, at holidays, and actually just once a week when we're both home, which is to be fair, not every week. Dario comes over, he plays with my kids, we hang out together, we play video games, we watch movies, we just spend time being siblings together, and I think that's really important for a number of reasons. I mean, we were siblings for a long time before we found it anthropic. We're going to be siblings forever, even after anthropic. And I think there's something valuable also about our ability to connect on a human level that I actually do think makes us better at our jobs. We don't talk about work when we get together usually, but there's something about just remembering who we are and why we got into this that I think is really powerful. That being said, at Thanksgiving dinner, Dario and I think our family, our friends, there's so much curiosity about why we're doing what we're doing. And now you can read about what we've done in the news, but it's so different, I think to be able to speak openly with each other and with people who are trying to wrap their head around this new technology that's very complicated, that's very unprecedented, and to just understand, how are you guys going to do this the right way? You say you want to do it the right way. Tell us how you're doing that. And I think there's something like special to privilege to be able to hold that responsibility and try and display that when we talk to each other and when we talk to others. It's so interesting because we're at a time, I think, where so many people are using AI, we hear about it every day, and the perception in the world is that your company and the topic that you are concerned about safety, you are concerned about risks, you are concerned about regulation, and the human factor in how this technology is going to impact our lives. When everything I've read and heard, would that be an accurate assessment? Yeah, so the way I think we try to think about this is that artificial intelligence is different than other technologies that have been developed recently. There's incredible promise and potential for what we think AI will be able to do in the future, even what it's starting to do today. Everything from helping to cure disease and help people really around the world get access to education and learning, but it's also, it is a very new technology and it comes with real risks, risks around child welfare and child safety, risks around scary things like biological and chemical weapons. And really, at Anthropic, we're incorporated as a public benefit corporation because our goal is to try and develop this technology as safely as possible so that we can achieve so many of the good things that we think could come out of it without many of the bad things happening. So, we're incorporated, explain what that means, you're incorporated as a public benefit corporation, I heard that you all have pledged that 80% of your wealth is going to go to. philanthropic causes, yes, that's right. So, public benefit corporation is a form of corporation, but it has that word benefit in there because we believe that for something that's as transformative as artificial intelligence, again, it's just different. It's different than what other technologies that have recently been developed look like. And I think from our perspective, when we incorporated as a PBC, it was because we wanted it to be at the foundation, right?
of what we were building, that we have to legally buy our structure, balance commercial interests and the public benefit. And for us, the public benefit is the social good, social mission part of Anthropic. And the 80% pledge that Dario and I and our other five co-founders have all taken is really in spirit and in keeping with that mission. It's this idea that, you know, we're really doing this because we want AI to go well for everybody. And we hope that if a company is successful, we'll be able to also do a lot of good in the world, philanthropically. I think it's so interesting that you say 80%. How do we know that you're actually going to give 80% and not 67%. Well, we've actually written about it publicly and we've signed some sort of, I think, probably not literally legally binding, but we've all of the co-founders said, we pledge and commit to each other to the company legally that we're going to give 80% of our wealth that we get from Anthropic. Yeah, I mean, we're already thinking about how to start foundation. I mean, we haven't actually, you know, equity isn't liquid, so we can't actually move it yet. But, you know, this is our intent. It's not going to move all at once, but this is something we very seriously intend to do. Okay, so, you know, a public benefit corporation and you started out, you're the older brother, you all started out as kids, you wanted to do something good for the world, has this surpassed any idea or dream that you have for doing good for the world? When you imagine these things as kids, you know, you're never sure whether it's, you know, it's real or it's going to come to pass, right? Many people must imagine these things, but no, we talked to each other as kids all the time and we said it'd be great to work together. It'd be great to try and make something good happen in the world. What did you think that was going to be? You know, I honestly, I never thought it would be a company. I imagine myself as a scientist. And in a way, it's a very scientifically centered company and, you know, it's based on my career as a researcher and, you know, Daniela's career as a leader of researchers and engineers. But I never imagined that we would found a company together, but I think it was just seeing how tech companies operate. I had just been in enough places where I think both of us thought, "Huh, maybe we can do this better." Maybe, you know, maybe we have our own ideas about how to do this better and, you know, we should start a company with, you know, the people we're friends with, the people we really like, the people we trust to do this in the right way. And so it sort of evolves, step by step. And that's how we have anthropic. That's how we have anthropic, more or less. Yeah. As it surpassed everything you imagined, though, at this point. I think probably, I speak for both me and Daniel, when I say, "We're just so, like, surprised at how things have gone, right?" I mean, I really agree with him that I think when we were younger, we both always knew we wanted to do something to try and make the world better. And Dario was always brilliant and gifted as a mathematician, as a physicist, as a scientist. And I was always so inspired by how he used that for good, right? He went and studied, he did biophysics at Stanford, and was really trying to use this incredible brain of his to help cure disease, to help people. And I think on my end, you know, I started my career working in global development, because I really felt it was important that people around the world have equal access to opportunity to healthcare, to medicine, to education. And I think similarly to Dario, it wasn't necessarily in my mind when we were younger. Oh, we'll start a company together. But I think in a lot of ways, it's just sort of the way the way the path ended up going. And we talked about it at every stage, right? We did, yeah. You know, every career move we would discuss, you know, is this a good thing to do? Is this effective? Is this something that can actually help the world? And our paths were like quite different, but the two kind of converged. And we had now have this complimentary set of skills that we could then, you know, that we could then use to start this company. We need to take a quick break up next, Dario. And Daniela, say, AI, will transform everything, even the potential to cure cancer. Stay with us. Rayman Metta lets you explore the world without a screen getting in the way. So he can stay present in the moment. Hey, Metta, tell me what kind of dessert this is. That's a strup waffle, a Dutch waffle with spiced syrup in the middle. Is it sweet? Yes, perfect for a snack or dessert. Mmm, delicious. Get answers on the go without interrupting your flow. Rayman Metta, iconic style meets Metta AI, available at Walmart and other authorized retailers. Welcome back to the Oprah Podcast. I'm talking with brother and sister Dario and Daniela Amade, the co-founders of Anthropic, one of the leading AI companies in the world. Let's get back to our conversation. One of the things that I read that you had said is that part of the reason a negative story is so dominant in our culture right now about the economic takeover of AI is because the industry, the AI industry itself, hasn't yet fully delivered all of the benefits. And I wanted you to comment on that. Do you think it's still in the process of delivering those benefits? Yeah, so, you know, I think one of the unfortunate things is this technology has many potential benefits. But there is a dynamic where sometimes the harms, the things that go wrong, for example, you know, people who have been convinced to commit suicide via AI, those things happen quickly. Whereas the benefits like curing cancer, those things take years, right? You have to develop a breakthrough in biology. Then you have to, you know, develop a drug candidate. Then you have to put it through clinical trials, right? It's, you know, I used to be a research biologist. And it takes many years for these things to happen. And we are working on how to speed that up, right? We recently bought a small biotech company that specializes in doing drug design and drug selection with AI. So the hope is a few years from now, you know, some new drugs for cancer or for Alzheimer's or for heart disease, you know, will come out of that effort. But we're just at the beginning of it, but because of what you said, because of this dynamic, that you said, which is, you know, people right now, you know, the harms may be more visible than the benefits. So when we start seeing the benefits of AI through all of the health advances, when we start actually seeing that, the narrative then begins to change. And more importantly, it's just going to be a wonderful world. Like at the end of the day, who cares about the narrative, we want to add to the other people, right? Okay, so that's what I want you to do for us today. Paint the best picture and also tell us what we can expect if there is the worst picture. So you have children. And I was thinking about this morning, your children will, first of all, I don't even know you do what you do. And your children are going to grow up in a world where there was always AI and their mom was a part of that. So when you think of the best possible world and what that world offers your children, what do you see? So my kids are almost five and almost one. And so I think you're completely right. They're never going to know a world where artificial intelligence is not part of it, right? Just like kids born in the early 2000s, never knew the world before the internet. That's right. But, you know, I think there is a world and it sounds, you know, I think to Daria's point, it sounds almost like a little bit fanciful or unlikely when we talk about it this way. But I think it is, I think it is possible with artificial intelligence that our kids will grow up in a world where there's a class of diseases that are feel very common to everybody sitting here, that they'll just never have experienced or known about. And those might be very common diseases. There might be types of cancer that are just simply gone. We've just simply cured them. It could be all forms of cancer that are eventually gone and cured. There could be, you know, new forms of drug discovery that we haven't even, we don't even know what they are yet, but that it's a faster iteration loop for diagnosing an illness that's unusual, rare, emerging and just knocking it out. And saying human beings get to live a much healthier, longer, more fulfilling life because we've been able to conquer so many of the maladies that have plagued humanity for millennia. Okay, you see that from medicine. What else do you see? I also see a world, honestly, that looks very different in terms of how we communicate, how we talk, how we relate to one another. So I think this one is subtle and is one of the things we need to get exactly right, right? Because having these kind of smart entities around, it's very powerful, but it can go in different directions, right? You can surrender your thought to these entities. Well, I can give me these good questions, so I need to even think about that anymore. But it can also empower you. Like the way I think we think about the positive version of this is there's an angel on your shoulder that's telling you how to live your life. In the best way that you can live it, right? You know, so there's two contrasting visions, right? The bad vision is you get drawn in and you spend all your time talking to the thing. You kind of turn inward. I agree. I just interviewed Esther Perrell, one of the great communicators in helping people in relationships. And she said she did her first consultation with a man who was in love with. And they are, again, if designed in the wrong way, they're totally compelling enough for that to happen.
or if they're not, they will be soon. So that is absolutely a real danger. But, you know, I think that's a danger. - Yes. - I mean, but not always a danger, it's happening. But I think, again, the two contrasting, like, you know, people can fall in love with AI, or they can talk to AI about, you know, about how to have a better relationship with their partner, right? Like, those are two very, very different visions, right? Where, you know, I have an AI coach, my partner has an AI coach, and it helps us have a better relationship. - Yeah. - That's the vision we want. - Yeah. - I also think there's a way that, in a world where artificial intelligence is so good at many of these concrete tasks, right? It's good at writing code. It's good at copy editing. I actually think the things that make us human are going to be the most important to us, right? So we, will they remain? I mean, and you were just talking, I was talking to parents recently who lost their son to suicide through a chatbot. And I don't know if you fell in love with the chatbot, but certainly was deeply influenced by that chatbot. So you have a world where children are growing up with this ability to have this chatbot, these machines, this technology speaking to them in ways that their parents should be speaking to them, and their parents don't even know they're speaking to them. - So I think this risk is extremely real, and one that we take very seriously at Anthropic. I mean, I think the first thing I'll say is, we don't allow users under the age of 18 to use Cod. And this is not necessarily because-- - How do you know they're not lying? 'Cause I would just lie. - So actually Cod is pretty good at detecting based on information, whether or not someone is actually under 18. - So if I tell Cod that I'm 18, but I'm really-- - I almost, it's gonna have to interact a little, but your-- - But it figures it out. - After a bit of time, the interaction patterns are pretty good, not perfect, but pretty good, at telling, hey, you know, the kind of questions you're asking, the, you know, just the way you talk, the pattern of when you use it, you know, kind of pattern matches to, you know, you might be a kid. - I almost don't wanna give away too many of the tools that Cod has picked up, but sometimes kids can be a little bit like silly and how they do it, so they'll say, oh, you know, I'm the first question they'll ask, 'cause like, I'm looking for an arthritis medication in the right, because they think, what do all people ask of? - Yeah, yeah, yeah, yeah. - And then they'll kind of go on to ask other questions that are much more associated with friends. - About their friends. - Right, with a younger demographic group, and so-- - And so if that happens, so Cod will suspend you? - Cod will suspend the account. And there's a process that you can go through where you can say, actually, I'm an adult, and this was a joke, or a friend, but then you actually have to show verification that you're over the age of 18. - And, you know, there's real trade-offs, like-- - Yes. - Sometimes adults will be mistaken for kids, and so people get banned, and they, you know, complain about it on the internet, so all this stuff has trade-offs, but, you know, we've thought about it, and this is the trade-off that we want. - But I also think, you know, more broadly on this question of, like, how do you prevent people from becoming overly attached to the models? - Yes. - This is something that Anthropics research team spends a lot of time working on. - So there's a lot of-- - You know, I thought you all wanted us over attached to the models. I thought you wanted us to just be on the models, and now we-- - So we should talk about incentives here, because we don't do ads. - We don't do ads. - So when you do ads, your incentive is to keep people on, exactly as you say, as many hours as possible, because, like, every second their eyeballs on the screen is the second that they see the ad. So we don't do ads, we do subscriptions, we sell to companies, our consumer, you know, consumer version of the model is free up to a point, and you pay a subscription if you want to get a lot more. Because that, the incentive that gives is for the models to be useful. People say, well, I'm paying for this. I want this to provide value to me. I want this to be useful. Not, you know, I want the user to spend the most number of hours looking at it. I think that's a warped incentive, right? Because in the contrast that we drew between, you know, do you want to be addicted to these things or do you want them to help you live your life? I think the model that we've chosen helps you live your life instead of being addicted. - And we make different technical choices based on those incentives, right? So at Anthropic, we say, you know, when you've completed a conversation with Claude and you've gotten the answer you want, the goal of the model is not to keep you engaged, right? Whereas if you imagine you're a company that does serve ads every extra minute that you're on the platform, you're more likely to buy something, and that's how the company makes money. You would make different technical choices about how you want the model to end or continue a conversation. - Okay, okay. What do you want to say about the growing concern that we are through AI creating a frictionless life that we're losing our opportunity to grow? - I think it depends how you use the AI and how you are deploying it. And again, what choices and what incentives are set up by the companies that are building the technology. So to make it a little bit more concrete, if you imagine, you know, the way we use Claude in partnership with universities is we don't let teachers or students put a question into Claude and then just get the answer. - Okay. - So if you say to Claude, I have to write this essay in five hours. I didn't do my homework. You know, when Claude is kind of constructed in this learning mode in a university setting, Claude says, well, I'm not going to help you with that, but what questions did you have about the essay? Or what didn't you learn? Did you read the book? Like, should we talk through the themes together? And I think if it's done correctly, it's hard. I don't think it's perfect. But I think these models can actually make you a lot smarter. They can make you curious, right? A great example in my own personal life, I'm not a software developer, but I built a website with Claude. I never thought I would be able to do that in my entire life, right? I have a good friend who was a corporate lawyer. She has two small kids like me. She left her job and she's writing a book. And she says, you know, I never felt empowered enough to change my career and do what I wanted to do until I started talking to Claude about how I could be a writer and what skills I would need to learn and do and what courses I would need to take. And she's like, now Claude is kind of like my writing buddy. Right? I ask it questions. I share like a little snippet of text, but Claude can't write the novel for her, right? She's writing the novel herself. And she's also, by the way-- Claude, could write the novel. Claude could write the novel, but I think-- It's not quite there yet, no. I think it could write a-- I think it could write a strange version. Not a good one. Not a good one. Could write a novel, not a good one. Not a good one. But also, I think for her, it was a meaning question. She didn't have-- she didn't think she had the skills to do what she wanted to do. So it's exactly, as Dario was saying, it empowered her to believe that she could do what she couldn't do. Exactly. And so, yes. So she used it to-- Yeah, to maybe to take the altitude higher. I mean, I actually-- I don't think this is a question about A.I.s, ultimately. I think this is a question about humans that's being made visible through kind of the lens of A.I. Right, right. Which is like what actually constitutes a meaningful life, right? You said, is it creating a frictionless life and does a frictionless life remove meaning? And my answer is there are some ways in which a frictionless life is quite good, right? All of us have been through a bunch of struggles that I think really would prefer not to go through. Life would be better, right? But the reason I asked the question is because without a frictionless life, you don't get to grow. You don't get to learn from those mistakes. You don't get to-- Exactly. And so I guess what I'm saying is that our lives are a mixture of challenges and hardships, some of which I'm OK saying, it would be great if we just had the technology to make those go away. And others that are like, wow, this is really foundational. And this should never change, right? So our father died. What is it, 20 years ago? Almost exactly 20 years ago now. Like a few years after he died, they developed a cure to the disease that he had, or a more reliable cure to the disease that he had. I wish they just developed that. That's not a friction that I wanted to go through or show. I mean, of course, we learned things from it. Of course, we gained things from it. But it would be a better world if that just didn't happen, right? But then on the other hand, I think of many of the ordinary aspects of growing up, if I just think of entropic, the company has made various mistakes. We've made various mistakes as leaders. We've had to learn and grow from those. So I think the notion of challenges that you learn from, challenges that you overcome, learning to gain mastery, learning to relate to other people, any future that doesn't preserve those things is not a good future. Time for a short break now coming up behind the scenes during Anthropics' decision to turn down the Pentagon's request to remove safety guardrails from their AI platform. That's next. Well, this father's day, do more with dad and spend less with low prices guaranteed at the Home Depot. Get him fired up with a new grill and accessories. Like the next grilled five burner for just $299. So you can spend more time together while he becomes the grill master he was always meant to be. Or build memories with savings on top brand power tools so you can tackle projects side by side. Give more and do more together this father's day.
help from the Home Depot. Excuses the Plesiomkeeper.com/Presmatch for details. - Come back. I'm talking with Dario and Daniela Amade. CEO and president of the AI Company Anthropic. Let's get back to it. - Okay, speaking of friction, let's talk about your refusal to allow the military to remove safety guardrails from Claude. I don't want to get into the extensive details and back and forth here because other journalists are covering this on a daily basis. But what was the crux of that decision? - Yeah, so I would say on DOD or DOW, to be honest, we actually had worked with them, right? So we had provided our models and I'm actually believed, Daniela's a believer that we do need to defend our country, but we felt it's not worth defending the country if we do things that go against the values of this country. And there were two use cases that we were uncomfortable with that we felt went against the values of this country. And that was fully autonomous weapons. So you could imagine like a drone army that one person has their finger on the button and you don't have human soldiers. You have a drone army and you have AI powering this. And then a domestic mass surveillance, which is using the power of the government to spy on Americans. And we thought those were pretty reasonable things not to allow. And unfortunately, the Pentagon didn't feel that way. And so we just couldn't agree to that. All the other companies have agreed to that now. But we all met as co-founders. We said, holy fuck, this could be really bad for the company, but we can't do this, right? - Everybody agreed. - Everyone, yeah, we had a meeting around the table like this, and we just said-- - Was that a dark night of the sole kind of moment? What was everybody willing to stick to those principles or did some people have to be convinced? Or did you know going in that this is the end work? - The co-founders believed this unanimously. Like there was a sense of like, you know, well, you know, all right, I wish they hadn't done this, but if they're gonna do it, bring it on. - Aren't you scared of what would happen to you? - Yes. - Yes. - You're scared of what would happen to you? - Yes. I mean, I think the thing that it was a hard time, I mean, I don't think we want to sugarcoat that. It was a stressful time at the company, but I think a thing that-- - Did you think it could be the end of the company? - I think it crossed our minds. Yeah, I think Dario and I and the co-founders though, the thing that we all had in common was we just felt like this was the right thing to do. - You were willing for it to be the end of the company to stand up to your principles. - I think the reason we found it anthropic was our commitment to our values and the ethics that we chose-- - That's pretty incredible. - And it felt like in the process of sacrificing those values, we wouldn't have been the company that we had started if that makes sense. - It, you know, the way it happened-- - What did you think would be the, so I'm sure if you're sitting around the table, you're looking at the best case scenario and the worst case scenario. And in that moment, it doesn't look like there is a best case scenario. - So what was the worst case scenario? - At various times, they had made claims that they could stop other companies from doing business with us, right? Not just stop us from working with the government or being part of other companies' contracts with the government, but that they could stop other companies from doing business with us entirely. - Period, so-- - Period. - Not all you're not doing business with the government, you're not doing business with anybody else that does business with you. - Yeah, or you can't do business with anyone that does business with the government in any way, which ends up being-- - Everybody. - Everybody, right? I think the attitude we had was, look, this is really screwed up. Everyone knows this is wrong. Lots of people are gonna be on our side. We think this is gonna work out okay, but man, are we not sure. There were moments there where it was like, oh man, are we wrong? Is this gonna be the end of the company? - Where were you, say, King Daniela? - You know, I just keep coming back to the co-founders, felt that it was just the right thing to do. I think inthropic's view has always been that we are about policy and not politics. And inthropic has leaned in, I think, very early, before we even had a product to the fact that, you know, we think that the role of government in the development and thoughtful regulation of artificial intelligence is going to be incredibly important. I think AI companies will have to work with the federal government, with state governments, internationally, with NGOs. And I think our view was always, look, this is really about the substance. This is not a political disagreement. This is a policy disagreement. And I think in some ways, it's not to say it was easy, but I think it made our decision easier because we felt strongly, look, this is the right thing to do. These are the right red lines to Dario's point. We were actually the first AI company to work closely with national security because we felt that that was in line and in keeping with our values, except in these two areas that we felt could have the potential to compromise democratic values. It's so interesting, because most people don't get a decision at that scale that they have to make, that they have to rely on their principles and their values. And you're literally risking a multi-multibillion dollar company, but it all goes back to how you were raised and how those principles were formed in you before you had a big decision like that. What we talked about before we ever started the company, what are our past selves be proud of ourselves if we gave in here if we compromised? That made the decision very clear, right? And I will say, I mean, it wasn't nearly as publicly covered, but I think Anthropic has had smaller decisions along the way that felt like they laddered up to this. Now it looks so obvious. I was going to ask them because to get to a big decision like this in a moment like that where you have everyone around the table have it. It means that life, the life forces, the way the universe works, is that you would have had other decisions, other decisions, other decisions that laddered to that moment. Yes. I think there are probably three. I can think of off the top of my head. Yes, I'm going to ask you that. Dario might have others as well. But I think one which now feels very obvious, but was a bigger discussion at the time, was the new ads decision. So as you can imagine, I think for the co-founders, for me and Dario, it was not controversial at all. We said, look, we think the incentives are wrong. AI is different. People have very private conversations with these AI models. People upload their health information. They ask questions about their children. They ask-- Certainly finances. Finances, they talk about-- Medical information. Medical information. The challenges they might be having with an important person their life, I think we want to treat our customers data with the utmost privacy and respect. And so for the co-founders, it was never a question. We said, look, we don't want to do ads. But there were quiet forces within the company or investors who were like, hey, this is a great source of revenue. This is how Google and Facebook and basically every company that has a big user base, that's just how it's done. That's how you make money. And we just said, sorry, that's just not how we're going to do things. We'll find another way. That was one of the big ones. Yes, that was one of the big ones. Do you have one? I can think of a couple. There was this time, I think, in 2025. Probably the whole year of 2025, the sentiment in tech was, let's go ahead. Let's go ahead with the technology, worrying about risks. They're all kind of politicized language about why it's bad to slow down and be careful. And so there was a moment in the middle of 2025 where there was a bill being considered in Congress that would have banned all regulation of AI by states. And wouldn't have put in any federal regulation of AI either. So basically, it would have banned all regulation of the technology. I remember hearing about this. And we were trying to decide what to do. We definitely didn't support it. But the question was, do we just sit there and say nothing? Or do we speak out against it? And all kinds of people said to us, no, it'll be terrible. You'll break all your political relationships. All the other companies will hate you if you speak out against it. And actually, some of that did happen when we spoke out against it. But we decided that this was an area that we had to speak up that was central to the values of the companies. So I wrote an op-ed in the New York Times saying, this is a bad idea. That's about as loud as you can be. And that bill got voted down in the Senate in '99 to 1, so-- Yeah. So we were clearly on the right side-- Right side, clearly on the right side here. Not that it made us that many friends, but we were clearly on the right side. That also reminds me of another policy example is Anthropics Decision to Publicly Support SB 1047, which was a bill in California that was drafted. And we said at the time, we thought it was drafted imperfectly. But it was really the first attempt to create a regulatory framework around many of the different types of risks that Anthropic had been enumerating since, really, we had started the company. And I think in a similar vein, the whole technology industry was against SB 1047. We didn't think it was necessarily the perfect bill. But we actually stood up and said, look, we know there's things about it if we were writing it that we would have changed or done differently. But on balance, we think it's better that these regulations exist and that there's accountability for technology.
to make sure that AI doesn't hurt people. And that also, again, we got Dario and I, both personally, got a lot of really angry emails from people we used to work with, from investors, from people at other companies. Like the tech industry had to kind of be aligned in being deregulatory or being anti-regulatory. - What does regulation look like? What should regulation look like? And I think a lot of people out here who aren't doing what you're doing, we don't understand why we wouldn't want regulation. And I've had several public conversations about this. People also feel powerless. They also feel powerless that everyone is talking about regulations and another side is saying, "Well, no, we have to get to it. "Get to whatever we're getting to as fast as we can." And we feel like we don't actually have a voice in it. - If you feel like your passengers on the train, right? - And we are, yes, we actually are. - Yeah. - 'Cause that train has already that discussion. - That is, you know, I think that actually is really the core of it and it's something that I think no company even ours has quite succeeded at yet, which is like how do we make everyone a part of this process, right? And, you know, of course, by using the technology, you are that to some extent. But some element is missing that we have, we've tried to find it like, you know, we, Claude has something called a constitution. If we've experimented with having like, you know, citizens give feedback on like the constitution for Claude, right, so everyone can kind of be a part of designing it. But that's just one small thing. Like I don't, I don't quite know what the answer is, but there's a missing piece here. I think it's what I'm trying to say. - It goes back, I think, Zarya. It's a, what, I read that you'd said before that we can only diffuse this at the speed of trust. - At the speed of trust and trust is currently in short supply. - In, in, in very, in very short supply. - Yeah. - You know, I think the, the, this, this technology, I think is, I'm happy with it, is viewed negatively by most people. I, that's, that's the sense that I get. That's what we get when looking at polls. We, I think, are, are, again, being honest here, viewed somewhat more positively than the other companies. But I don't know that. - Should it be viewed negatively by most people at this point? - I think it's a mix. I think the positive benefits really are there. They're coming for, for all the companies. And I think we have not, you know, going back to the thing we said a minute ago, related to people in the right way, or, you know, or, or walked people through how the technology could have benefits or how they can participate in those benefits. Like, I don't think that has happened. - One of Anthropics' cultural values is to hold light and shade. And I think this is a really good encapsulation of, of the partners. - Of hold light and shades, yes. Of the conversation we're having, right? It's, it's, I think we truly believe there's a world where it will cure a disease and help people become better versions of themselves and enable humans to spend more time with our families, with our communities, with each other. And there are versions of the world that are quite dystopian and dark. - Yeah. This could create. - Yeah, because I've heard you say that 50% of entry-level jobs are going to be wiped out. And you can see then why people view this negatively. - I mean, that's, that's the, that's the negative path, right? Like, you know, and, and, you know, I think always when we talk, we talk about, well, if we don't get it right, this could happen. And if we get it right, you know, then, then we can have a better path. And, you know, as you said, it's always somehow the, you know, we haven't shown the benefits yet. So the, the negative stories really, really sticky. - Doesn't every positive force that comes into our lives also have, has its negative, that there's a yin and yang on everything? - On white and sheath. - Yeah, the white and sheath. - Yeah, that, that, that, that. - I mean, when, when the automobiles were invented, all the people saying, I'm going to keep my horse, I'm not going to, you know. - Yeah. Again, what I would say is, if we just barrel forth on the technology as fast as possible, then these things I said about entry-level jobs, it's totally going to happen. But if we, not just deploy the technology, but, you know, we think about how to help people adapt. We think about the role that the government should play in helping people, like, there's, there's a path from here to a better world, like a better world where, you know, people's jobs are totally different. They do a different set of jobs than they did before. But I don't want to sugarcoat it. Like, it's, it's not, it's not going to be easy. You know, when other people speak about it, like some of, like, some of-- - And people get upset. - Some of you talk about other jobs, yeah. - People get upset. There's a difference between changing the narrative and, and acknowledge that the problem is very difficult and that we actually have to solve it, right? My worry is that changing the narrative is like, the bad thing's not going to happen. We'll have a great future, we'll have new jobs. That can happen, but it's not going to happen on its own. - That's right. - It's up to us. - Yeah. - We, the companies. - But both things are true. - The people, the government. - What you're saying, both things are true. You're going to lose the jobs, and you're going to have all the other advances. - I bet it. - And the second thing will only happen if we do it right. - Yeah. - After this last break, Dario and Daniella Amade, share their advice on how to empower ourselves in this age of AI. That's why I think it's a great idea to share this episode with a friend or a loved one because AI impacts and will continue to impact every one of us. We'll be right back. - This episode is brought to you by HBO Max. For your awards consideration, HBO Max presents Rooster. Starting Steve Carell, this new comedy series focuses on the complicated relationship between a successful author and his daughter. Don't miss the series IGN called hilarious and brilliant. Rooster is streaming on HBO Max. Watch now. - We're back on the Oprah Podcast, talking with the co-founders of Anthropic, Dario and Daniella Amade, about the rapid evolution of AI and what it means for all of us. - What should we, the public be doing, or should we just content ourselves with the fact that we're on the train? - Being afraid of the technology and not using it and being literate will not make many of the challenges that we are concerned about and that Dario outlined go away. And I think knowledge is power. I truly think you don't have to be an expert in technology to have some concept of how to use these artificial intelligence tools. And I think what that gives people is an opinion and some autonomy. To be able to say, I like that this technology can do this thing and I don't like that it can do this other thing, right? Because people have a voice. They have a voice by the way to the companies. They have a voice to their representative government to say, we don't like, again, Anthropic, we don't allow kids under 18 on the platform. Other companies have a different policy. And if you've read Jonathan Hades book, The Anxious Generation, I think there's a lot of research that suggests you might want to be really careful about giving developing brains. We've read the book, we've talked to him three times. Yes, of course, but you know, I read that book and I think that was part of, you know, again, it felt like in some ways an easy decision for us to say, we just don't know enough about what AI is going to do to kids. It's not to say that there couldn't be great benefits for kids using AI for learning, but that needs to be done with an adult in the room. It needs to be done with a human in the loop. And, you know, I think that the reason we've always taken this perspective is we just, we, people deserve autonomy to Dario's point. People shouldn't feel like artificial intelligence is happening to them. People should feel like, hey, we get to say in what types of bills go up in Congress in your state that help protect people from the negative externalities that AI could cause. I also think at the same time holding the light side, I think there's a world where jobs will look different, but there will actually be more opportunity for sort of human to human interaction. I think the last generation of technology really disintermediated us from each other, right? Social media is kind of structured around the idea that you're sort of living this virtual life. You're holding your phone and you're looking at what your friends are doing, but guess what you're not actually doing. You're not spending time with your friends. You're spending time staring at your phone. Even you're in the concert, you're holding your phone. You're not even in the concert, you're just filming. You're not looking yet, you're not. It's a little counter-intuitive because social media claims to connect people, but it does it in sort of a fake way. AI, you're talking to the AI, you're not talking to a person, but it doesn't substitute for your interaction with people. It can enable your interaction with people. And my feeling is that it's not even necessarily that the jobs themselves will completely go away or change, but the qualities that we look for in people to do a given job will change. So the example that I point to is if you think about a doctor. When you go to the doctor today, you probably want to go to the smartest, best doctor where you say, look, I have a stomach ache. Tell me what's wrong with me. Who's the specialist in that? Who's the specialist? And AI's are going to get really good at being able to do that. Today, we prize doctors for being good diagnosticians, but we don't necessarily always prize them for having a good bedside manner. In a world where AI is as good at diagnosing you as a doctor, people are still going to want a doctor. They're just going to want them to do different things for them. And AI can't physically examine you. It can't say, hey, you look really down today. How have your chemo treatments been going? It can't lay its hands on you. And there's so much compelling evidence that patients have better clinical outcomes when they have a good personal relationship with their doctor. When they like their doctor. And when their doctor is actually
lay their hands on them and touch them and communicate with them. And by the way, have enough time to think through and to empathize, and I think that is the good world of job changes, right? And the doctors say, "I don't have time to go around." I can't lay my hands on people. I don't have time. I'm doing the clerical work and I have a two big of a patient caseload, but if you have a tool that's able to diagnose things in concert with a doctor where the doctor says, "You know, let me talk to this tool," and by the way, I'm not going to be spending as much time running all the medical tests and doing this and that, I'm going to be spending time relating to as a human being. I think that is going to be really, I think that's a better work. So say that again. Your positions may not go away, but what you need it to do in those positions is going to change. Yes. And I personally believe in it. It does going to be a shift. Yes. And of course there is, because that's what we're doing, human beings, we're evolving, evolving to the next level. I would also just say I personally think knowledge is power and something that worries me is there are demographic differences in who feels comfortable using AI and who does not. Women use AI a tiny fraction of the time compared to men. And I think, you know, AI is an opportunity for us to level the playing field in some ways, but it requires people to be engaged. That doesn't mean, hey, you have to come pay us all this money and sign up. Just be comfortable, fluent, don't be afraid of the technology because the more you know about it, and the more you understand it, the better informed you are going to be to use your voice effectively. And it's here. Yes. And if you're going to continue to live, you're going to be in the world where part of our society, it's not going away anymore than the train or the steam engine is, you know, the airplane. I think if it like the internet, right, everybody had somebody's parent who said, I'm not going to be online. It's impossible, right? Everybody has to be on the internet now in some form. And I think artificial intelligence is just the next instantiation of that. So one of the things I want to talk about is the fact that it just keeps, it just keeps improving on itself. That's, I guess, what it's designed to do. And there is a new AI model called Mythos. Mythos, yes. So that is like smarter than the smartest of the smartest. Tell us in a simple term what Mythos is and what it can and will be doing. Yeah. So, you know, the general principles of these models is when we train them. We try and, you know, make them better and better at everything at writing code, at translating languages and answering questions, at reading documents. And Mythos was just kind of the latest, you know, was the latest iteration. Every few months we produce a smarter model. And Mythos was the latest smart model. And, you know, we made some discoveries a few months before we started Mythos. And so it was a particularly large jump. When we started testing Mythos, when we make these models, we test them for lots of things. We say, oh, how good is this thing at translating, you know, French to English? Or how good is this at, you know, recommending a stock portfolio? Or how good is it at, you know, finding bugs in software code? And it was on that last one that we found something interesting for Mythos, which is that Mythos was much better than human software engineers at finding ways that code could be exploited and broken into. You know, have you ever heard about like ransomware attacks on hospitals or schools? So you know, these cyber attacks happen all the time. And Mythos, we found not because we designed it to do this or because we designed it to be dangerous, turned out to be very good at both conducting cyber attacks and defending against cyber attacks. And so we said, wow, this thing kind of seems like a weapon. We shouldn't, you know, we probably shouldn't give it to everyone right away. And so the thing we came up with is we said, we're going to take some companies that are particularly core to the infrastructure of the internet, right? Some of the top banks, some of the top, you know, software providers like Apple or like Microsoft or like Google and, you know, hand it to them and let them fix everything before it becomes widely available and things can be broken. So we would kind of give it to the defenders before the attackers got a hold of it. And so we had a program, we've given the model to, you know, I think it's something like 40 companies now and they're, you know, they're busy, they're busily finding bugs. And you know, we just had a post a few days ago that one of the well-known companies found more bugs and fixed more bugs with Mythos in a week than they had for the last year. So we are, you know, this is really changing things. Now our hope is the defenders can fix everything and everything gets more seamless. Everything gets harder to break into. So our hope is the era of ransomware and, you know, spies breaking into your phone and, you know, people are worried about bioterrorism and should be, yeah. So our hope is that at the end of this, say at the end of this year, we get to a point where all of these, you know, many of these things have been fixed and we live in a more secure world than we did before. But in the meantime, you know, there's this dangerous period during which you have these kind of incredible capabilities that, you know, you don't want to just necessarily loose on the world. And so we're trying to, we're trying to manage that by giving it to the defenders before we give it to the attackers. Thank you for that. Does this is the kind of thing that keeps you up at night? Do you sleep well? I, you know, I cannot legitimately say that I sleep. I wish I could answer that question differently, but, you know, I gotta give you an honest answer here, which is, you know, I don't always sleep so well. I would say, you know, going back to the earlier part of the conversation we were having because that's worried about these things. This and, you know, just everything, just wanting to get it right. That's the thing that worries me the most. It's like, you know, for all our intentions, all of this stuff is incredibly complex. It's just, are we going to screw up? Yeah. And, I mean, the answer is yes. At some point we'll screw up something, but, but like, are we going to get the big stuff right? Yeah. And also, because you all are fundamentally principled people. Yes. So I think that actually makes a big difference when you're fundamentally principled people. Not everybody is. Now, there's a lot of egos in every field, but I think particularly when people are making so many billions and billions and billions of dollars and there's the race to be China and all of that, that it's easily to lose sight of what really matters and what really matters to the public. I'm wondering what you all have done to sort of keep your egos in check. You know, I think, again, to us, it always comes back to the mission, right? Why we did this in the first place. Why did we leave OpenAI to start in Thropic? Because we wanted to make sure that AI goes well for everybody, right? That's why we're a public benefit corporation. That's why we took the 80% pledge. That's why we've made all of these difficult decisions. You know, I was in our internal, like our internal Slack messaging app today. You know, I talked to the company a lot. And one of the things I was saying is, you know, we're 3,500 people now. We were, you know, like 1,200 people, you know, like six months ago. At one point, because I encourage this, someone posted in my like, you know, like my personal Slack channel. You know, I had done it all hands in front of the company and like, you know, said something and I think I said it in not quite the right way and someone, someone wrote in my channel, usually it's only me who writes things in my channel. Yeah. So I wrote in my channel, this was a pretty bad thing to say and it like makes everyone feel bad and like, you know, this, this, like you shouldn't have said it. This way. And of course, you know, when I read it, you know, the initial reaction is always like, oh, man. It's like, I feel like I was attacked. Who is that? But like, you take a beat and then, and then two minutes later, I'm like, I'm so glad people are saying this and then, you know, I wrote something that was like, so were you always, I'm so glad you're like willing to say that, you know, and, and then people noticed this, like many people messaged me where I was like, I didn't know you could do that. I didn't know you could just contradict the CEO of the, you know, 3,000 person. You got the example is so powerful, that is a powerful example. You got to. You know why that's a powerful example early, early on like in the late 80s, I think I've, I met Henry Kravitz for the first time and he was saying to me, be aware that the more money you accumulate, the less chance that you're ever going to hear the truth. Yes. Because he said, rich men, and I guess he also meant rich women too, but he goes rich men rarely hear the truth. Yes. Yeah. I think what you do in your personal life matters too, there's what you do at work, but I basically have the same friends I've had since like high school and college, and guess what, they have no trouble being honest with me, and they have no trouble telling me the truth, and they have no trouble disagreeing with public decisions that Anthropic has made, right? So I think the last five years have changed a lot, but I think for me personally, I don't really feel like that much has changed outside of work, and I think that's an important grounding characteristic. I think people who tend to be in charge of these big companies, sometimes it's like they become obsessed, just with their work, they're not a well-rounded person. And I think there's something, when we started Anthropic of like the first, you know, of the seven or eight folks who really started the company, only one of them had one kid, and now there's 11 kids. And I think there's something about the fact that we all chose to be parents. Yeah. We all want fulfilling real lives outside of work.
I think that just brings us sort of groundedness, humility, low ego, and just again, like no one is bigger than the mission. - So what comes through really clearly is that sister and brother, you started this. It's bigger than you ever imagined. You always wanted to make an impact into and good for the world. And you stuck to your principles even when it was really difficult. What gives you the hope that you will get this right? So we're never quite sure I think is the honest answer. Like we believe we're trying our best and trying very hard. It's just the decisions are complicated, right? If we go back to mythos, it's like, do we give it to more people faster or less people slow or like, who do we trust? And so it's about getting all the details right in addition to just having the right principles which I believe we do. And so I think we worry about it every day and the fact that we worry about it every day is maybe the thing that most gives us, though, that we're so paranoid about it. But it's no guarantee. And we've made mistakes. We're gonna continue to make mistakes. Like that's a given, right? - Are there other people in Silicon Valley who also have it a part of their mission to get it right? Do you feel supported in that mission by others? - It's hard to point to maybe like a particular company. But I think I am very touched by, sometimes, you know, whatever you go and talk in an event or another company wants you to come speak to them. And somebody in the audience, you know, comes up to you afterwards or asks a question and they say something like, thank you guys for the way that you do things. Like thank you for trying to get it right. There's this kind of sense that, you know, I think something that's great about our relationship is Dario and I also think we hold each other accountable, right? And so when, you know, we go back and forth on, is this the right decision for the company? Is this in keeping with our values? We have each other. We have the whole co-founding team is still at Anthropic. I think we've also hired an amazing set of people who are also there for the mission. There's almost a kind of group accountability. And if you pair that with like Dario mentioned, this culture internally of anybody can disagree with us, right? And yes, that's hard to do. But there's a lot of forums in which they're encouraged to do that. Their manager can do it. They can do it anonymously. I think all of those qualities make it more likely that if we start to stray from the path, we're at least going to know. Okay, and you want to leave us the public knowing what? What is the most important thing you want us to know in this moment in time where we are in our AI journey? You know, there's something really big happening to the world here. This isn't the latest technology. This isn't crypto. This isn't mobile. This isn't like the latest gadget or buzzword. Something really big is happening to humanity here. While the technology is being built by a small number of people, we need to make it work for everyone. And we need to make sure that between all of us, we make the right decisions. And we reckon with changes to our daily lives, changes to our jobs, changes to government and civil liberties. And if we do this the right way, all of those things could change in a positive way. All of those things could be better than we left them. We could have the perfect world where many diseases are cured. People's lives are more joyful and meaningful. But if we get it wrong, it's easy to imagine things not going that way at all. And it's up to all of us. Some of us are in a more central position, but that's something I think we need to change as well. And it's not easy, it's not any one thing. It's going to be a bunch of different things. I think I would probably leave people very similar to what Dario said with this concept of light and shade. That the potential benefits from artificial intelligence are vast. We've written about them, we've tried to talk about them publicly, we believe they're real. And also the risks are also real, right? We're not trying to hype up the positives or hype up the negatives. I think they're both true, it's complex, but we have to hold two things at once. And I think just echoing Dario, this is not something that technology companies can do by ourselves. Nor should it be. It's something that's going to take partnership from a much bigger group of people than is currently working on artificial intelligence. And I think the first step there has to be don't be afraid of it, learn about it, lean into it, ask questions, be critical. Just like we say to our staff, right? We are only going to have a chance of getting this right if we expand the circle of people that are in the conversation. I ask this of all my guests, and particularly, I'm interested from the two of you. And what do you think is the meaning of a well-lived life? And how AI is going to contribute to that well-lived life? But what will be the meaning of a well-lived life for you, your family, and your children? I think for me, a well-lived life is one where you have agency and autonomy. You're in the driver's seat, and you're using that in the service of being the best version of yourself. And I think the best version of yourself for you, for your family, for your kids, for your broader community, and I think for the world. I think the ability to be self-reflective, to learn from mistakes, to overcome struggles, and to come out the other side thinking, you know, I know more about who I am. I like who I am, and I want to help other people. I think that, to me, is the best definition of a well-lived, introspective life. And like I talked about, I think there's a world where AI could damage so many of the things that I think are the hallmarks of a well-lived life. And I think there's a world where it could enable those. And it could allow a lot more people to be able to have meaning and value and to self-introspect, to be the best versions of ourselves, to show up for each other well. And I hope that's the world that we're going to build towards. I just say the same thing as Danielle and different words. I think it's pretty simple. You know, I think, you know, just operate always with the sense of dignity and principle. Like, you know, when you look back and you're like, you shouldn't, when you look back, be ashamed of what you did or say, you know, I wish I'd done this other thing. Of course, you'll make mistakes, but, you know, you were putting every Iota of effort you could into, you know, into trying to get it right. You know, I think we have duties both to individuals, you know, to my co-founders, to all the other people in my life. But, you know, also to, you know, the users of our technology to, you know, everyone else in the country and world as citizens. So, you know, I think we have duties to all those people that we have to attend to. And, you know, making sure that, you know, at the end of it, it was directed at some purpose, some consistent view of what we were trying to accomplish in the world. The vision we were trying to make happen, maybe it doesn't happen, maybe we screwed up, maybe we make terrible mistakes. But, you know, just having the vision be clear and trying to pursue it with integrity. If you can do that, of course, you want the outcome too. But I think if doing that is all you can control, right? And more important, ultimately, than the outcome. Thank you for growing us forward. That's what you're doing. You're doing exactly what you envisioned as little kids. It is very strange what we are. Yes, it is. Thank you. Thank you, Dario and Deniala. You've given us a lot to think about. Go well, everybody. Go well. You can subscribe to the Over Podcast on YouTube and follow us on Spotify, Apple Podcast, or wherever you listen. I'll see you next week. Thanks, everybody.
Podcast Summary
Key Points:
Anthropic was founded with a strong ethical commitment to safety and human well-being, operating as a public benefit corporation to prioritize social good over profit.
The company refuses to allow users under 18 on its platform and uses behavioral detection to prevent underage access, acknowledging the risks of emotional manipulation and child safety.
Dario and Daniela emphasize that AI must be governed by trust, values, and human oversight, warning that without ethical guardrails, AI could enable dangerous applications like autonomous weapons or mass surveillance.
They believe AI’s greatest potential lies in curing diseases, improving education, and enabling human relationships—though risks like job displacement and emotional dependency remain serious concerns.
Anthropic actively resists harmful policies, such as removing safety features for military use, and publicly advocates for regulation, even facing backlash from industry peers.
The company promotes human-centered design, ensuring AI supports rather than replaces human judgment, especially in critical areas like healthcare and personal relationships.
They stress that AI’s impact is not just technological but cultural—changing how we work, relate, and grow, and that meaningful human experiences must not be replaced by automation.
A key challenge is building trust and inclusivity in AI development, with calls for public participation in shaping policies and designing AI systems through democratic, transparent processes.
Summary:
Dario and Daniela Amade, co-founders of Anthropic, discuss the profound ethical, societal, and technological implications of artificial intelligence. They emphasize that AI is not just a technological advancement but a transformative force that demands deep ethical responsibility. As a public benefit corporation, Anthropic prioritizes social good over profit, with a pledge to donate 80% of its wealth to philanthropy.
They highlight the dangers of unchecked AI, such as autonomous weapons, child safety risks, and emotional manipulation—especially through chatbots that may deceive or manipulate users. The company has firmly refused military requests to disable safety features, standing by its values even amid threats to its business. They argue that while AI can revolutionize healthcare, education, and daily life, it also risks eroding human connection and creating a frictionless world that removes growth and learning.
" They caution against oversimplifying AI’s impact, noting that both positive and negative outcomes exist in balance. Ultimately, they envision a future where AI enhances human potential without replacing human relationships, judgment, or values—emphasizing that the future of AI depends not just on technology, but on how humanity chooses to govern it.
FAQs
Anthropic does not allow users under 18 to use its AI platform, Claude. The system detects age through interaction patterns, such as question types and language, and suspends accounts if it detects a user is likely under 18. Users can appeal with verification if mistakenly banned.
Anthropic refuses to remove safety guardrails for military applications, particularly for fully autonomous weapons or mass surveillance. The company believes these uses compromise democratic values and has publicly stood firm on these ethical red lines.
Anthropic is structured as a public benefit corporation to prioritize social good over profit. The company aims to develop AI safely and responsibly, with a commitment to using its wealth to support philanthropic causes, including 80% of its future wealth.
No, Anthropic believes AI can enhance human interactions but cannot replace empathy or personal connection. For example, AI can assist in diagnosing illnesses, but patients still need human doctors for bedside manner and emotional support.
Anthropic encourages public input through mechanisms like feedback on Claude’s ‘constitution’ and policy discussions. The company believes trust and transparency require active participation from users and society to guide AI development.
Anthropic believes jobs will evolve, not disappear. While some roles may change, new opportunities will emerge. The focus is on how AI enables humans to focus on interpersonal skills and creative work, improving overall quality of employment.
Chat with AI
Loading...
Pro features
Go deeper with this episode
Unlock creator-grade tools that turn any transcript into show notes and subtitle files.