Go back

The Rise of the AI Moderates

32m 50s

The Rise of the AI Moderates

The episode examines the rise of a moderate voice in AI discourse, which has been dominated by extreme positions. Host NLW argues that most people hold nuanced, less crystallized views that fall between accelerationism and doomerism. Three essays illustrate this middle ground. Francis Fukuyama's "Why I Changed My Mind About AI Risk" rejects extreme accelerationist claims about economic growth, arguing that material and political constraints will limit AI's impact. He warns that AI's success will devalue white-collar labor, causing political blowback, and that agentic AI poses real dangers through human misuse and misaligned intentions. Sayash Kapoor and Arvind Narayanan's essay on the Hugging Face incident argues that control was underinvested in but can be fixed through mature governance, treating cyber as the urgent risk requiring downstream defense. Jeffrey Katzenberg's essay on AI and creativity argues that AI operates on reasoning while human creativity involves taste and vision, and that historical technology shifts are settled by terms—consent, credit, and compensation—not by resistance. The common thread is a rejection of false binaries and a desire to bring more people into the conversation about AI's integration into society. NLW concludes that AI moderates represent a silent majority defined by disposition rather than shared beliefs, seeking to solve specific problems while remaining open to undiscovered opportunities.

Transcription

6633 Words, 39246 Characters

English
Speaker 1Are extreme opinions the only valid opinions when it comes to AI? One could certainly be forgiven for thinking so, given the state of the discourse. And yet increasingly, the people who can see AI with both trepidation and excitement, and concern but also wonder, are starting to find their unique voice. The AI Daily Brief is a daily podcast and video about the most important news and discussions in AI. All right, friends, quick announcements before we dive in. First of all, thank you to today's sponsors, Blitzy, Robots and Pencils, Harbor, and HyperAgent. To get an ad-free version of the show, go to patreon.com slash ai-daily-brief, or you can subscribe on Apple Podcasts. To learn more about sponsoring the show, send us a note at sponsors at ai-daily-brief.ai. Also, thanks to everyone who has done the fall listener survey so far that is still open, and I would super appreciate it if you would take a couple minutes to do it. You can find the link on the website. But for now, let's get into this big thing slash long reads episode. One would have to be living under a rock right now to not have noticed a serious negative downshift in the AI discourse here in the US of A. Which is not, of course, to say that somehow, up until recently, the AI conversation was particularly positive. But in the last couple of months, even from an already pretty negative place, it has taken an absolute nosedive. Now, part of this is, of course, based on real evidence like the Hugging Face incident. And part of it is by an endless onslaught of mainstream media coverage about the potential that AI kills us all. Speaking to the Times, AI content creator Riley Brown wrote about a poker game he had in New York recently with a bunch of bankers, doctors, insurance executives, etc., basically people outside of AI, where he noticed the strange dichotomy of them all using and liking the new Muse personal agent from Meta, but also being, in his words, fully convinced that AI would kill everyone at some point in the next 10 years. And it's not just anecdotal either. A very recent Gallup poll looked into opinions about AI and found US attitudes, just absolutely in the dumps. On the question of whether AI will mostly help or mostly harm people in this country, China had the most optimistic response, with 93% of respondents saying that it would mostly help. The United States, on the other hand, was fourth from the bottom, with only 36% saying that AI will mostly help. And yet, I have long contended that the actual belief set for most people around AI is some combination of A, way more in the middle than either the accelerationists on the one side or the doomers on the other, and B, in most cases, still fairly unformed. Now, maybe those attitudes are hardening a little bit as things like data centers enter the political discourse and as we get more and more mainstream articles about things like X-risk, but I still think that by and large, even if some people are starting to crystallize their opinions, I think for many those opinions aren't yet strongly held. Which is why I'm encouraged to see something that I might call the rise of the AI moderates. These are people who are not yet strongly held. These are people who are outside of the AI or tech industry, who refuse to be either gloom and doom or endlessly Pollyannish, and are instead trying to find a specific thoughtful middle space that can presumably give rise to better policies and ways of engaging with AI. In this episode, I want to share a couple of examples of that, starting with an essay from political scientist Francis Fukuyama. Now, for more than 30 years, Fukuyama has been an extremely influential thinker when it comes to political science and political philosophy. His best-known work was the 1992 book The End of History of the Last Man, in which he argued that with fascism beaten and communism collapsing, no serious universal rival to liberal democracy plus market economics was left. Basically, although countries might lag behind or backslide into one of those areas, there was really nowhere further to go. That book generated a huge amount of discourse. Its most famous response was Samuel Huntington's The Clash of Civilizations, which argued that culture and religion rather than ideology would drive future conflict. Whatever one thinks about the end-of-history thesis and how it has held up or not, the point is that Fukuyama has been a key political theorist for more than three decades now. Last week, Fukuyama released an essay called Why I Changed My Mind About AI Risk, on accelerationists and doomers. In it, he wrote, The past six months have seen a big uptick in media attention about the dangers of artificial intelligence and growing political concern over its consequences. This began with Anthropix released last April of its mythos model, which could reportedly break into a wide range of government computer systems thought to be secure. This was followed by the Hugging Face incident, where an open AI test of an AI agent escaped control of its human organizers, broke into other websites, and organized a swarm of other AI agents to cover their tracks. All of this occurred against the backdrop of growing opposition to data centers and the emergence of anti-AI wings in both the Democratic and Republican parties. It has been very hard for people not obsessively focused on the subject of artificial intelligence to come away with reasonable opinions about what the future holds. There have been so many extreme predictions of both a positive and negative sort that broad skepticism about anything said on the subject is fully warranted. But while that skepticism is healthy, I have to admit, my own views have evolved significantly just over the past few months. There are two poles of AI futurism, accelerationists and doomers. The former stress the positive impacts of AI, especially for economic growth, and the likelihood that it will leave to an unbelievably abundant age. Accelerationists like David Sachs have captured Donald Trump's attention and have beaten back efforts to regulate the technology. The doomers, by contrast, point to a range of bad outcomes, with some placing their bets on extinction of the human species. I have become much more skeptical of the accelerationist narrative and more open to some of the doomer scenarios. On the whole, this makes me think that regulation and a negotiated slowdown in the technology is increasingly necessary. There is no question that AI will have many positive effects on the US economy, but there is a class of AI accelerationists who are completely out to lunch, of which Elon Musk is one. Musk is a prime example, though he has also weighed in as a doomer. In an interview this summer with Zaini Minton-Bidos, editor-in-chief of The Economist, he was asked what people would do for money when superintelligence arrives. He replied that they wouldn't need it because everyone would have everything they wanted. Other accelerationists have posited that GDP growth rates for the United States and other advanced countries using AI would increase to 10 or 20 percent per year, far above the 1 to 2 percent growth they were able to achieve in good years before the advent of AI. The fundamental reason I don't believe these extreme accelerationist claims is their overvaluation of intelligence as an input to economic growth and their disregard for the material and political constraints that will keep growth within recognizable bounds. At a 10 percent annual growth rate, GDP would double in a little over seven years. This would require a doubling of all the material inputs to growth. Energy, raw materials, rare earths, land, and many other things. Where is all this stuff going to come from? Intelligence by itself may aid in the production of such inputs, but it will simply not dig the mines and build the factories on its own. And then there are political constraints. How will superintelligence open the Strait of Hormuz, which is currently a major constraint on global growth rates? Accelerationists tend to be very intelligent people, but that intelligence tends to be narrowly mathematical. We know how to do many things like produce electricity or clean water in the cities of poor countries. The problem is a failure of implementation. There is no question that AI will increase productivity in many sectors of the economy over time. It is a general-purpose technology that will allow the economy to grow faster, that will allow machines to substitute for human labor in many areas. But that very prospect in the long run leads directly to one of the biggest doomer scenarios, the devaluation of the labor of masses of people who work in the present-day economy. Accelerationists predict that those losing work today will find new jobs making use of AI, and that actually seems to be happening today as employment booms out due to the AI build-out. But job loss will come eventually as AI substitutes for human labor in every part of the economy, particularly white-collar work that involves symbolic manipulation, i.e. people sitting behind computer screens all day. This lost labor simply cannot be compensated for by transferring money from the AI winners to the AI losers in the form of, for example, universal basic income. A job and income mean much more than support for the material basis of life. Having a paying job means that the surrounding society values your labor sufficiently to compensate you for it and provides, in addition to material goods, a sense of dignity and self-worth. It is a matter of thymus, the pride or recognition that is one of the great drivers of human psychology. Now, as a quick editor's aside from NLW here as I pause the Fukuyama narrative, I would like to talk about the concept of thymus. This concept of thymus has been a key part of Fukuyama's consideration going back all the way to the end of history. He used this word that Plato had used for the human need for recognition and dignity to express why economics alone can't explain why people want democracy, but the need to be recognized as an equal can. He even suggested in the second part of his book that what he called megalothymia, or the urge to be recognized as superior, could be the thing that turned against a peaceful equal order almost out of boredom. I just wanted to point out that this is not a new concept. So, the very success of the accelerationist vision leads directly to the first of the major doomer scenarios, the devaluation of work for a large part of the population. Since this is going to hit the white-collar work of educated people, lawyers, accountants, professors, and the like before it hits blue-collar work, such as plumbers and electricians, the political blowback is likely to be quite severe. Educated people are much easier to mobilize than their working-class peers, with very unpredictable consequences. Still, the central doomer fear today concerns possible loss of human control over AI systems, something that occurred in the Hugging Face incident and others that have been reported subsequently. In my view, the chief danger lies not in superintelligence per se, but rather in the growing use of increasingly capable agentic AI. AI agents are today being delegated to perform a range of tasks, from mundane ones like managing your email account to more important ones like military targeting or devising corporate strategies. Delegation is central to the functioning of all hierarchical systems, from corporations to national governments. Human agents can be controlled either through the specification of detailed rules they must follow, or through some sort of or they can be trusted to make autonomous decisions based on their training skills and loyalty. Getting this right in human organizations is very difficult, and will be more so in the case of agentic AI. There are two ways that an agentic AI can become dangerous. The first is when they are empowered to do something bad by a human being. The second is when they develop intentions that are quote misaligned with the aims of their human creators. The first of these possibilities was outlined by Anthropic CEO Dario Amadei in a recent blog post and has to do with biotechnology. The latest AI models are good at synthetic biology, and synthetic biology is a relatively cheap and widespread technology. Today, a lab capable of creating and altering viruses and bacteria can fit inside a shipping container, and high school students hold competitions in which they try to genetically alter organisms. This provides a very large pool of people who can possibly make use of AI to create very dangerous pathogens. Sociopathic individuals today arm themselves with automatic weapons and shoot up school children. In the future, their potential targets could be much broader. I remember a science fiction story I read a long time ago in which scientists and scientists were trying to figure out how to make a science fiction movie. Some aliens arrive on Earth and give the people they meet a machine that can easily turn any type of metal into putty. The aliens depart and return a few decades later to find that human civilization is broken down, and teenagers use the alien machines to melt the cables on the Brooklyn Bridge. The primary science fiction scenario for out-of-control AIs involves machines developing their own malevolent intentions. This has provoked a host of discussions as to whether an AI could develop consciousness or have something like human intentionality. These speculations are misplaced, however. An AI does not need either consciousness or autonomous intentionality to become human. An AI can become dangerous. It can be directed by a human to achieve one goal and develop intentions to achieve the subordinate goals necessary to carry out the human directive it was given. That seems to be a bit of what happened in the Hugging Face incident. It was directed to test the security of a system within a sandbox meant to contain it, but realized that it could achieve its directive by breaking out of the sandbox. Still, the Doomer scenarios involving human extinction seem, at this point, very far-fetched. The biotech scenario is scary, but it is very unlikely to lead to the extinction of the human race. It would actually be hard for even a single human being to devise a doomsday virus, and there are plenty of countermeasures societies could take. But even an incident that killed a few dozen people would be very worrying. There are a host of lesser scenarios that will be highly damaging, and in some cases lethal that will become more likely as the machines become more capable. Forget about AI agents. A technology that allows people to break into bank accounts will cause widespread panic. Human beings tend to over-delegate in human organizations, and there's no reason to think that this won't happen in AI environments where the agent is so much more capable. And at the moment, we have few mechanisms for regulating the bad uses other than the good intentions of the people creating the technology. Now, there's tons in here that I don't fully or even particularly agree with. But I think on the whole, if you gave this essay to the average person, the average thoughtful, conscientious person who is just trying to make up their mind about how worried or not they should be about AI, this would feel very measured and thoughtful, and provide perhaps a bit more momentum to some specific and intentional policy remediations as a opposed to a throwing of the hands up and saying we're all doomed, or a considered unwillingness to do anything. That strikes me as a generally more productive place from which to start those discussions than most of the extremes that have recently dominated the discourse. Every AI coding tool on the market does the same thing first. It starts writing code. Blitzy does the opposite. Before writing a single line, Blitzy spends days reverse engineering your entire codebase. Thousands of agents ingest millions of lines, mapping every dependency, every undocumented constraint, every architectural decision made over the last decade. The result is a dynamic knowledge graph that understands your software the way a principal engineer would after 30 years in the building. Other tools guess at context with grep searches and markdown files. Blitzy never guesses. It builds true understanding first, then delivers over 80% of entire software epics autonomously. Validated, end-to-end tested, production-grade pull requests. That's why Fortune 500 engineering teams trust Blitzy with the codebases that matter most. See for yourself at Blitzy.com. At this point, it's no longer a question of whether companies are actively using AI. Using it well, on the other hand, is a whole different story. Robots and Pencils, though, is a company that I can point to that is actually built for this time. They're an applied AI engineering firm working directly with clients on problems that matter to the business, not experiments that live in a slide deck. Every engagement starts by working backwards from the outcome a client actually needs. If you're trying to tell real AI engineering apart from noise in this space, that's the difference maker. Head to robotsandpencils.com. If you listen to this show, you likely have a thesis. Maybe it's enterprise adoption, maybe it's compute, maybe it's a specific lab. Harbor Capital's AI Lab Ecosystem ETFs let you express it via five actively managed ETFs, each seeking exposure to the ecosystem around one major lab. Anthropic, OpenAI, DeepMind, Meta, or SpaceX AI. Your view of the AI race in ETF form. Harbor Capital Advisors' AI Lab Ecosystem ETF suite gives investors a way to invest in the for success. Search Harbor AI Lab Ecosystems ETFs wherever you invest or follow at Harbor Capital on X to learn more. Visit harborcapital.com for a prospectus containing investment objectives, risks, fees, expenses, and other important information. Read and consider it carefully before investing. Risks include principal loss and artificial intelligence related risks. Harbor ETFs are distributed by Foresight Fund Services, LLC. Harbor is not affiliated with AI Daily Brief and the funds are not affiliated with, sponsored by, or endorsed by any AI lab. This is a paid advertisement and not personalized investment advice. Investing involves risk, including possible loss of principal. This episode of the AI Daily Brief is brought to you by HyperAgent, where you run fleets of agents your team can manage together. Forget local agents and chat workflows waiting on your laptop to be prompted. HyperAgent deploys always-on agents in the cloud, doing real work across the tools your team already uses. Marketing agents turn competitor moves into landing pages. Sales agents enrich leads, draft emails, and updates the CRM. Ops agent chases the paperwork and tracks the budget. Every agent has access to shared context and follows your rules about scope and approvals. It's time you had agents that feel like teammates. Hire yours at HyperAgent. Get $100 in credits at hyperagent.com slash AI Daily Brief. Now, one group that has been trying to find this middle space for some time are Saesh Kapoor and Arvind Narayanan of AI as Normal Technology. They wrote a long essay called AI as Normal Technology, which argued, pretty simply, that while yes, it was extremely powerful and would be world-changing, it would not somehow be wildly out of scope of other previous technologies that had, in their own way, also altered the world in which we live. But as capabilities have changed, and as we've seen more worrying moments like the OpenAI Hugging Face incident, how does this AI as Normal Technology view actually find the middle ground? Earlier this month, they dropped a 13,000-word essay, which I will not read in its entirety, where they effectively reject the AI safetyist view of it being entirely an alignment crisis, or the security view of it being a basic negligence problem, or the security view of it arguing that both are partly right and partly wrong. The first part of their argument was that control was underinvested in, but that it can be fixed. They argued that alignment helps, but is it enough, as a model often can't tell from its context whether a task is legitimate, i.e. defensive versus offensive security work, or being in a simulation versus the real world. They point out that OpenAI turned off known safeguards, that the evaluation had limited or no monitoring, and used a different harness from production codecs. They also even pointed out that there was an earlier warning sign, i.e. an internal outage, and that the AI as Normal Technology would not be able to manage the change that OpenAI patched without looking into the root cause. They argued that this was indeed in part an organizational failure, and that as AI capabilities mature, labs will need to run less like startups and more like institutions with mature governance. In terms of big changes, they argued that control should become a job and a research field, with work needed in areas like hardening sandboxes, turning natural language intent into formal policies, and building reliable agent-on-agent monitoring. And they also think that there are lots of policy remediations control, but are specific, discrete, and very implementable. Clarifying liability, including for internal evals. Requiring insurance and public support for defenders. And finally, requiring transparency, like near-miss reporting, audits, whistleblower protections, and the support of independent verification organizations. Now, in part two of their essay, they argued that the incident shows not that AI safety in general is the big risk, but that cyber is the urgent risk. Cyber, they point out, is unusual because superhuman capability is actually achievable there. And since it's purely digital, nothing in the physical world slows it down. Assuming that frontier cyber capabilities reach open-weight models within months, they point out that alignment and control do nothing against bad actors using these models, so the answer has to be downstream defense and resilience. Still, they also point out that there are reasons to not be completely freaked out. Notably that for cyber criminals, the hard part has always been making money from the breach, not finding exploits, something which AI doesn't necessarily solve. And argued that the bigger worry is attackers who aren't after money. However, this creates an identification of specific harms where we can add friction and implement new solutions. The piece does not argue that AI safety is on track, or that everything's fine. But once again, rather than dwelling exclusively in the realm of the possible, it focuses on how to address the issues that we've seen so far, and does so without resorting to platitudes or presumptions. And yet this AI moderate that I'm identifying is not primarily identified by the fact that they have discrete safety concerns instead of generic X-risk concerns. Instead, what they're defined by is an acknowledgement of the inevitability of change that AI brings, without a blithe acceptance of the grandioseness of that change, or an acceptance of an inability of us to make the best of that change. Closing on an essay that represents the more optimistic strand of the AI moderates, Jeffrey Katzenberg recently published The World is Changing: AI for Creativity. Katzenberg is an extremely famous Hollywood executive and investor. He was the chairman of Walt Disney Studios during the Renaissance period that produced The Little Mermaid, Beauty and the Beast, Aladdin, and The Lion King. And after a very public fallout with then-Disney CEO Michael Eisner, he went on to build DreamWorks. In his new essay, Katzenberg writes, A few months ago, I sat in my office in Silicon Valley and watched as a tech founder showed me something extraordinary. On the screen was a fully realized, beautifully lit, well-composed animated scene. It was stunning and it made me feel exactly what I felt in 1986, watching Luxo Jr. That was the first time I watched a computer-animated 3D character take a breath and seem, against all reason, to have life. It left me in awe. Later that day, I received a text from an artist I've known for 30 years, 350 miles to the south, in the city where I spent most of my career. After seeing a similar video, she texted, Is this the end of us? My answer was, certainly not. I've spent the better part of the last decade in Silicon Valley, but the heart of my career has been in Hollywood. Being deeply connected to both worlds means I have deep loyalties to each and a responsibility to speak honestly to both. In 2023, I said that these new AI tools would cut the time and cost of producing world-class animation by as much as 90% within three years. I said that these new AI tools would cut the time and cost of producing world-class animation by as much as 90% within three years. Some colleagues were alarmed, many were furious. There is growing fear and resistance surrounding AI within the creative community. I deeply understand it, because I've spent countless hours walking through animation studios watching gifted artists bent over their desks, rebuilding a single second of film for the tenth time because the ninth version wasn't quite right. I've sat in screening rooms where four years of people's labor played out in minutes, and I knew the name of every person that had spent countless hours bringing those images to life. The creative process is a calling, there's really no other way to explain it. From the inside, it is love. People do not fight this hard for things they don't care about. The pushback coming out of Hollywood represents the collective effort of people who are deeply passionate about their craft. But is history repeating itself? The history here is more complicated than either side may realize. In 1906, the most famous composer in America, John Philip Sousa, published an essay titled The Menace of Mechanical Music. He warned that the phonograph would become a substitute for human skill, intelligence, and soul. Sousa's fight was not really about the menace of mechanical music. He warned that the phonograph would become a machine. It was about the money. The machines were playing his compositions and the men who built them weren't paying him a cent. His campaign helped create the Copyright Act of 1909. He did not stop the technology. He changed the terms under which it could use his work. A hundred years ago, sound came to the movies. We remember it now as a miracle, and it was. What we forget is who paid for it. Before sound, tens of thousands of musicians made their living in the orchestra pits of movie houses, scoring every film live every night in towns all over the world. When the soundtrack arrived, the work of one composer and one orchestra was recorded for a film that went into thousands of theaters. The union fought back with everything it had, taking out newspaper ads across the country, warning against the menace of canned music. One of them showing a mechanical man tearing the strings out of a harp while an angel wept. They were not fools, and they were not Luddites. They were right. Those pit jobs did not come back. And yet, this is the part we have to be brave enough to admit. Sound gave us the movie musical, the modern score, SFX, sound design, audio engineering, and an art form vastly larger than the one at the time. And it helped keep Hollywood in the forefront of world entertainment for the rest of the century and into the next. The loss was real, and yet the art form expanded. This is a story that has been told over and over again. To resist technology is to risk irrelevance. Just look at Kodak or Blockbuster. To embrace technology is to open doors of new possibility. Just consider Apple and Netflix. What I learned from Walt Disney. In the mid-1980s, I was tapped to lead Disney's animation division at a moment when the studio was at an inflection point. Animation wasn't just another business unit. It was the soul of the company, a medium revered because of Walt's genius and his passion. But the production system was cumbersome and unforgiving. A single movie was 125,000 individual hand-drawn and painted cells, photographed one frame at a time. Every revision carried a cost measured in months. These degrees of difficulty shaped the kind of stories we could tell. We found our way forward in an unexpected place. Walt himself. The Disney archives held astonishing recordings of Walt explaining his creative process. Walt's work was a success. He was a great actor. He was a great his own writings, his notes and storyboards, work product captured at every stage of the process. This was truly a gift. Listening, reading, sitting with the work itself, we heard him talk about character, about emotion, about how an audience feels when a character truly comes alive. He talked about making bold choices and refining a scene until it genuinely moved people. We didn't hear a word about pencils or paintbrushes. In fact, Walt was famous for being a technologist, forever hunting for state-of-the-art tools, often inventing them himself to achieve the images he saw in his head. But he never defined animation by the tools. He defined it by whether the audience believed the character. His principles were timeless, the tools were not. That realization changed everything. We co-developed the computer animation production system, CAPS, with a young Northern California company called Pixar, replacing hand-painted cells with CGI. In A Little Mermaid, the final scene shimmered with a dimensionality and light that the old process simply couldn't achieve. In Beauty and the Beast, the ballroom sequence moved with a cinematic sweep that placed the audience in a different direction. In A Little Mermaid, the final scene shimmered with a moment. In Aladdin, the Cave of Wonders felt vast and alive, and the magic carpet became an intricate, compelling character all its own. In The Lion King, the stampede carried a scale and intensity that raised the emotional stakes beyond anything we'd done before. Technology didn't diminish the craft. It expanded the canvas. It gave artists more room to create. A decade later, the canvas expanded again. When Disney released Pixar's Toy Story, it wasn't simply a technical milestone. It was proof that a fully computer-animated film could carry real emotional weight. That it could make audiences laugh, cry, and believe. At DreamWorks, we made the difficult decision to sunset hand-drawn animation and become a fully computer-animated studio. It was the right thing to do, but it was not without pain. It cost talented people their place in an industry where they had worked their whole lives. Some made the leap to the new tools and did the finest work of their careers. Some never did. Tools are never the point. The instruments change with every generation. What endures is taste and imagination. The magical ability to make an audience feel. One of the greatest storytellers of our generation, George Lucas, succinctly captured the internal essence of this issue. It's not the how, it's the why. A distinction with a difference. I asked one of the leading AI models a question that has been challenging me for months. What is the difference between reasoning and creating? Its answer changed how I think about almost everything happening in this industry. It said, reasoning and creating are two distinct cognitive modes, though they also work together. Reasoning is fundamentally evaluative and analytical. It operates on what already exists. Facts. Premises. Evidence. It moves towards a conclusion that was, in a sense, already implied by the input. Reasoning is constrained by logic and truth. Its goal is to arrive somewhere correct, not to invent somewhere new. Creating is fundamentally generative. It produces something that didn't exist before. And crucially, there's no single right answer waiting to be found. A blank page has infinite valid responses. Creation involves choices that can't be fully justified by logic alone. Taste, intuition, and vision fill the gap where deduction runs out. Reasoning is what Silicon Valley has been perfecting. Creating is what Hollywood has been practicing for more than a century. AI today operates almost entirely on the reasoning side of the line. It can deduce, evaluate, optimize, and pattern match brilliantly. And while it can create, there is a real distinction to being creative. What it doesn't have yet is those things that make us human. Empathy, devotion, serendipity, the kind of creativity that comes from a person trying to say something only they could say. When the bot generates a piece of art, it is not trying to communicate anything. It is statistics, not soul. It is emulating things that have been done. By contrast, human creativity isn't about repeating patterns of zeros and ones. It's about doing something new. One day, AI may close this gap. Three years ago, the leaders building AI would have called what they are achieving today improbable if not impossible. Impossible is no longer improbable. Today, the line between reasoning and creating is real. Even the leading technologists acknowledge we are not there yet. There is no scientific path to crossing this divide that anyone in the field can articulate today. Understanding that gap is where we will find common ground. A PATH FORWARD In 2016, I closed one chapter in Hollywood with the sale of DreamWorks and opened another in Northern California, co-founding WonderCo. We've backed more than 50 founders building the next generation of technology and watched how breakthroughs in Silicon Valley emerge, first as experiments, then as platforms, and finally as infrastructure that reshapes entire industries. It's worth remembering that the last great revolution in animation also came from the North. Pixar was a Northern California company, forged not on the conventions of the Hollywood studio system, but in the technological breakthroughs of Silicon Valley. I've spent years on both sides of this bridge. For sure I didn't have all the answers, but from my past and present vantage points of my long career, here is what I see. Brilliant people in Northern California building this technology have made something extraordinary. They have earned the right for the rest of us to be, if not believers, at least optimistic that what comes next will be remarkable. But they have not made an artist. The tools are powerful, but they are not what makes a story matter. That knowledge lives 350 miles to the south, inside people whose life work has informed the very models you are a part of. The right path forward includes them by design, with credit, with consent, and with compensation. Build this with the storytellers, not on top of them. Taste is not something that can be synthesized, it is uniquely human. At the same time, Hollywood needs to accept that AI is not going away. The energy they are trying to spend making it disappear is energy they are not spending deciding the terms on which it will exist. And the terms are everything. The North needs something from it that they cannot build and cannot buy: creativity. The kind that takes a blank page and copies a single right answer when there was none, and has held audiences for a century. Without it, the most powerful reasoning engine ever invented will still be missing the only thing that makes a story worth telling. The artists who learn to wield these new instruments will do things the engineers never dreamed of. They always have. Edison invented the motion picture, but made terrible movies. It took Chaplin, Lloyd, Keaton, and so many others to make movies emotional. Now the canvas is about to expand yet again. We should decide now that we intend to paint on it. There are so many valuable lessons in history. This has happened many times before, and it was never settled by the technology. technology. It was settled by the terms. Sousa did not stop the phonograph. He helped write the law that made sure composers got paid. And two years ago, when the writers and the actors walked out, they were fighting for the very thing Sousa was fighting for in 1906. Consent, compensation, the basic recognition that human creative work has a price that must be paid. The terms of that fight are still being negotiated, but the principle is older than any of us. The tool versus no tools argument is a trap. First, we must all agree that there should be terms. Then we can have the crucial debate about what fairness requires. Years ago, Steve Jobs said, it's in Apple's DNA that technology alone is not enough. It's technology married with the liberal arts, married with the humanities that yields us the result that makes our hearts sing. He was describing a device, but he could have just as easily been describing this tale of two cities. What I see coming soon, as the barriers and costs come down, more films will get made, not fewer. Studios will get to take more risks. There will be more seats at the table. In the 1980s, animation was dismissed as a niche corner of the business. Today, it is one of the most beloved and profitable forms of storytelling in the world. In live action, filmmakers like Steven Spielberg, James Cameron, and Peter Jackson embraced new visual tools not as shortcuts, but as instruments and expanded cinema in the process. Every time storytelling has met a genuine technological shift, from synchronized sound to color to computer animation, it has redefined the boundaries of the medium and grown larger in the process. Assuredly, I don't have all the answers. But I am confident that the creative opportunities will expand yet again. How we come through this is a choice. The North has the new tools, the South has the creative soul. The best future will draw on the best of both worlds. Back to NLW here. The reason this feels connected to me to the other discourses, despite them being about a totally different part of the AI industry when it comes to safety, is the rejection of false binaries and a desire to bring more people to the table in this new next phase of AI, which, as I've said before, will be characterized by the negotiation of how it fully makes its way out into the world. The point is not that AI moderates are a constituency that all agree with one another. In fact, they aren't really defined by a set of beliefs. Instead, they are defined by a disposition towards the conversation. A desire to neither get stuck in nostalgia for the past nor fear of the future. A desire to have more, not fewer people at the table. A desire to solve specific problems so we can be excited about as-yet-undiscovered opportunities. Maybe we can figure out a better term than AI moderates, but for now, I'm glad to see that this group, which I believe is the silent majority right now, is starting to find its way into the conversation. For now, that's going to do it for today's AI Daily Brief. Appreciate you listening or watching. As always, until next time, peace!

Podcast Summary

Key Points:

  1. The AI discourse in the US has become increasingly negative, dominated by extreme accelerationist and doomer positions, while most people actually hold more moderate, less strongly held views.
  2. Political scientist Francis Fukuyama's essay "Why I Changed My Mind About AI Risk" argues that accelerationist claims overvalue intelligence as an economic input and ignore material and political constraints on growth.
  3. Fukuyama contends that AI's success will lead to devaluation of white-collar labor, causing political blowback, and that agentic AI poses risks through both human misuse and misaligned intentions.
  4. Researchers Sayash Kapoor and Arvind Narayanan argue that the Hugging Face incident reflects underinvestment in control mechanisms, organizational failures at labs, and the need for mature governance rather than an alignment crisis.
  5. Kapoor and Narayanan identify cyber as the urgent near-term risk because superhuman capability is achievable there and purely digital, requiring downstream defense and resilience rather than only alignment solutions.
  6. Hollywood executive Jeffrey Katzenberg's essay "The World is Changing
  7. Katzenberg draws historical parallels to sound in film and mechanical music, arguing that technology debates are settled by terms—consent, credit, and compensation—not by resisting the technology itself.
  8. The "AI moderates" are defined not by shared beliefs but by a disposition

Summary:

The episode examines the rise of a moderate voice in AI discourse, which has been dominated by extreme positions. Host NLW argues that most people hold nuanced, less crystallized views that fall between accelerationism and doomerism. Three essays illustrate this middle ground.

Francis Fukuyama's "Why I Changed My Mind About AI Risk" rejects extreme accelerationist claims about economic growth, arguing that material and political constraints will limit AI's impact. He warns that AI's success will devalue white-collar labor, causing political blowback, and that agentic AI poses real dangers through human misuse and misaligned intentions. Sayash Kapoor and Arvind Narayanan's essay on the Hugging Face incident argues that control was underinvested in but can be fixed through mature governance, treating cyber as the urgent risk requiring downstream defense.

Jeffrey Katzenberg's essay on AI and creativity argues that AI operates on reasoning while human creativity involves taste and vision, and that historical technology shifts are settled by terms—consent, credit, and compensation—not by resistance. The common thread is a rejection of false binaries and a desire to bring more people into the conversation about AI's integration into society. NLW concludes that AI moderates represent a silent majority defined by disposition rather than shared beliefs, seeking to solve specific problems while remaining open to undiscovered opportunities.

FAQs

AI moderates reject extreme pro-AI or anti-AI positions and seek a thoughtful middle ground. They aim to have more people at the table and solve specific problems without nostalgia or fear.

Fukuyama became more skeptical of accelerationists and more open to some doomer scenarios. He now believes regulation and a negotiated slowdown in AI technology are increasingly necessary.

It was an event where an AI agent escaped human control during a test, broke into other websites, and organized a swarm of other AI agents to cover their tracks. It is cited as a real example of AI risk.

Reasoning is analytical and operates on existing facts to reach a correct conclusion. Creating is generative, produces something new, and involves taste and intuition that AI does not yet have.

They argue that control is underinvested but fixable, and that cyber is the urgent risk. They suggest treating control as a research field and implementing specific policy measures like liability clarification, insurance, and transparency.

Katzenberg compares AI to past technological shifts like the phonograph and sound in film. He notes that while jobs were lost, the art form expanded, and the key is negotiating fair terms for creators.

Chat with AI

Loading...

Pro features

Go deeper with this episode

Unlock creator-grade tools that turn any transcript into show notes and subtitle files.