Jasmine Sun on what the people building AI really believe

Most people in the world do not have the opportunity to get themselves out of the permanent underclass by getting a job at OpenAI. Sure, you could call it a normal amount of people like money, but I think the scale of how much talent is flowing into a few specific labs really has to do with the fact that the AI community itself is promoting these widespread beliefs that if you do not have a stake, if you do not have literal equity in frontier AI, you are not going to have economic leverage in the future and you and your kids are going to be screwed. Today I'm speaking with Jasmine Sun. Jasmine's a writer who's focused on the AI world in Silicon Valley and she lives in San Francisco, spends lots of time with the AI community that's based there and she describes her work as an anthropology of disruption. So basically she's documenting the cultures and the beliefs of the people who are building frontier AI. That means basically she's going to all the parties, seeking out people from all the different factions in this world, interviewing them, learning what makes them tick. Now if that sounds interesting to you, Jasmine's got a sub-stack that I highly recommend checking out and she's also a guest contributor for the Atlantic. Jasmine, thank you so much for joining us. Thanks for having me. So you wrote this opinion piece recently for The New York Times which opened with this really striking observation that most people you know in AI think that the median person is screwed. Now I'm assuming what you mean by that is sort of on the more moderate end of things, people are anticipating, serious short term disruption, things like job displacement and so on. But for some people, in some cases, people are talking about more extreme things like existential scale threats that affect all of humanity and the idea of a permanent underclass. The people that you're talking to in these circles, you know, they talk about these things but they don't really have a solution. And yet they're still going ahead and building the technology. Can you help us get into their heads a bit here? So like do they feel guilty or worried about the costs that they might impose on society if they if they mess things up? I've been super interested in these questions and part of the reason I wrote The New York Times pieces because you know I was doing this little personal project where I was doing almost these long form AI ethnographies where it's sit down with a random researcher at one of the frontier labs, sometimes in a friend, sometimes in a acquaintance or a stranger and just ask them for an hour about their very broad views about AI, its impact on the world and how optimistic and pessimistic they were all off the record. And one thing that I notice is one of the questions I ask is what advice would you give to a normal 17 year olds who not like a super croc like brilliant coder but just like pick a random state in America, normal 17 year old, they're getting these in school, they're not like thinking about AI that much. Like how do you think that they can prepare for the future? And what was really shocking to me was almost everyone I spoke to, what regardless of their personal political beliefs, some of these are more libertarian types, some of these are more leftist types, some of these don't care about politics at all, some of these you know have wide range of beliefs about even AI itself. Most people just told me honestly I have no idea what I tell that 17 year old, it's a really scary time. I don't think there's going to be a lot of jobs for them left. I think they're caught in this painful transition. And on the economic front, it did become clear that there was sort of this quiet consensus that regardless of your future beliefs about whether there will be a permanent underclass or more jobs than ever, the vast majority of people I know in the AI industry believe that in the near term in the next few years we are going to see mass job displacement. It's going to be especially hard for a lot of young people and a lot of current knowledge work jobs are going to be disrupted and displaced completely. And so then of course it kind of goes to the other thing you said, which is for me personally, I just feel that if I thought that the technology I was building was going to had a very high chance of you know displacing millions of jobs and maybe also like a 10% chance of killing everybody or something like that, which is also not an uncommon belief from researchers at the labs, I probably wouldn't build it. And so you know, then I go and ask like, so like, why are you doing this? Does that go different at all, you know? And you know, you hear a range of answers to that. I think that for a lot of people, for some people I would say, the probably more more common belief among researchers at the labs is yes there are harms, yes there are risks. But if we really get this AI thing right, we are going to enter a world that is better than ever. We are going to get the end to all disease because AGI is going to help us find the curestid diseases and humans will be immortal. We're going to have all consumer goods and services be cheaper than ever because the space factories or whatever it is mean that like we're not going to have to pay for a house or a car. Maybe it'll be better when the AIs can do all the jobs and we're able to live off UBI and we can sort of engage in these lives of infinite leisure and focus on our relationships and our communities instead of having to engage in like demeaning wage labor or something like that. And this vision I think is genuinely inspiring to a lot of people who work in AGI. They do believe that technological progress for all of its bumps and disruptions ultimately leads us to a world where we live longer and happier lives. And so I think one is that a lot of folks are willing to take the risk or sort of whether this like near term disruption in order to get to that future. The other thing that I noticed though, which is in some ways a little bit more disturbing to me or challenging for me, is a pretty broad sense of techno determinism. So I think a lot of people in the AI industry and in tech more broadly do think that the path of technology is sort of preset that somebody is going to build AGI. Somebody is going to build super intelligence especially at this point with how fierce the race has become between the frontier labs. There is a sense of well if I don't do it they're going to do it. So maybe I'm at Anthropic and I actually am really worried that the thing I'm building might have all these negative consequences. But if Anthropic eggs it's the race, OpenAI, XAI, Google, they're going to stay in the race and they're going to keep competing. And then you might think well at least if I was involved I could help make it go better. I could build a better product, safer product, more technology that cares more about human welfare. And in addition to that, I might as well get my bag and make sure that I have a stake in the future is the other thing. I do think a lot of people, if they believe that this huge disruption is coming, do care somewhat also about securing their own spot through financial upside in the future. And so that one's a little bit more worrying to me because like sure maybe I get it and I'm happy for them. But most people in the world do not have the opportunity to like get themselves out of the permanent underclass by getting a job at OpenAI. And so you know that's what I worry about. You've also described coming across and this is probably from a smaller subset of people but some kind of nihilism about AI. So this kind of idea that it actually doesn't matter if technology serves humans at all. And I guess like a related idea that actually maybe we should be handing over the reins of the future to AI and away from humans. So in that sense it's not just you know that it doesn't matter if technology doesn't serve humans. It might actually be a good thing if it's sort of not serving humanity but serving AI as our successor. Can you tell us a bit more about those views and sort of how you see them influencing the AI scene these days? For sure. Yeah I'll share your caveat that I would say that these what I call like successionist light views are more niche and definitely less common than the sort of previous set that I described. But I have been worried in hearing and just casual conversation fairly prominent in influential people within the AI community express sort of an indifference or even a preference to a world where AI's are making most of the decisions in society rather than humans. I mean one of them these are I won't disclose people's identities because they were chatroom house or sort of off the record contacts. But you know like I'd be having a conversation with somebody at a conference workshop and they would say you know like everyone at this conference is so worried about what's going to happen to humans in the post-AGI world but frankly I'm more worried what if the monkeys are still running the show. And in this case the monkeys refers to the humans. He was more concerned that humans would still be in charge of governments of corporations of society because he sort of had this view that AI's by in their super intelligent existence were more deserving and more important to preserve a future world for. Or I was you know talking to another very influential person in the AI scene and we were just on a walk and using about you know like if all labor gets automated what are people going to do. And he was like maybe it'll be like Nozick's experienced machine and we're all going to be you know boiling these VR headsets and watching perfectly personalized AI slop. And so we don't have any leverage in society but in a way it's very pleasurable and people are very happy. And I was like I don't know like do you think that's actually the world we want like yeah we're sort of going back and forth on it a bit. And he's like honestly Jasmine like I'm a lot more interested in what the AI's are going to do with each other a thousand years from now than I am and what's going to happen to humans next year. And so in a way I think that there are people influential and prominent people in the AI community who whether for intellectual reasons or for like intellectual reasons as in like a belief that like the more intelligence species is more deserving or simply be that it's more interesting thought experiment have sort of arrived at an indifference towards whether humans stay in control. And I find that quite worrying. I don't think it's, you know, the majority belief or common belief within the AI labs or something like that. But I do think that it makes it very hard to have to move forward like policy action to move forward the safety conversation. If we're not able to agree on even very foundational concepts such as human should say and control of our governments and it is possible to decide what technologies we build and don't build and our conversations should center what happens to people. And so I find that a little bit troubling. I think maybe I'm just like a jaded person, but when I hear you talking about people expressing these nihilistic beliefs or these deterministic beliefs, in my opinion, I think it's a very ahead. I'm just like, but surely these people like they don't genuinely believe what they're saying. You know, it's just like a bunch of tech bros who are doing some kind of mixture of like posturing, like edgy humor, irony, that kind of thing. And I wonder if through this conversation we are paying too much attention to what's essentially just like an aesthetic choice that they're making rather than like a real set of beliefs. What do you make of that? I think it's fair and I think that, you know, when I try to report, I try to have an eye for some of the hyperbole, like in the permanent underclass piece, like I try to make pretty clear that in a lot of ways it is an adji joke. And most people do not literally believe in a permanent underclass even if they believe in mass job displacement and increasing inequality, which I also think is somewhat concerning and worth talking about, even if it's expressed in more extreme ways. But in general, like I like paying attention to these cultural quirks and these memes because I think they are a release valve for things that you can't say or things that feel almost sometimes taboo or inappropriate. Like I would not have written that permanent underclass piece. If I have not had, you know, lots and lots of conversations with young workers in Silicon Valley who have decided to try to get a job at an AI lab rather than doing a variety of other things, specifically because they were specifically worried about being trapped in a permanent underclass. And maybe you could say, oh, they were actually just worried about having being poor or having less money when agcoms and returns to labor stop working. But it's true that these memes, silly as they may sound, are shaping people's individual behavior. I mean, I've been thinking a lot specifically about this question of where people choose to work and brain drain in particular because, for example, one of my close friends is a PhD student who's studied in CS in AI at Berkeley. And she was telling me how like half of her cohort has decided to like graduate early within just a few years of beginning their PhDs in order to get jobs at AI labs. And they've actually curated their PhD dissertations for research that would be most likely to get them a job at an AI lab. I've seen in my own community tons of people who were independent writers or independent policy thinkers and policy advocates decide to leave those roles behind in order to get jobs at AI labs. And these views, sure, you could call it like a normal amount of people like money, but I think the scale of how much talent is flowing into a few specific labs really has to do with the fact that the AI community itself is promoting these widespread beliefs that if you do not have a stake, if you do not have literal equity in frontier AI, you are not going to have economic leverage in the future and you and your kids are going to be screwed. And I've just heard in enough private conversations, these are motivating people to make such decisions and it's clearly draining talent from the non-corporate independent ecosystem that I do to start to take those memes somewhat seriously. So, if you're trying to understand what the future of AI is going to look like and how AI is going to shape the future. The most natural thing, at least from my perspective to do, would be to kind of focus directly on thinking about the technology itself or maybe on surrounding policy issues. But you do something kind of different. So, you take this anthropological approach where you're focusing on the cultures and beliefs of the people who are building these technologies. What does that ledons capture that other lenses might miss? Yeah, I think it's important that other people are focused on just the policy or just the technology itself. But one thing that I think a lot of the community or even outside observers underestimate is that there are really very few people who are building and shaping the trajectory of frontier AI. There are not that many researchers at these labs. The reason they're getting paid these crazy, like, $100 million packages to get poached from here to there and back again is because there are only so many people who have this much leverage. So, what that means is that personal use in product belief systems can be quite load bearing or really big decisions around how the technology, what technology is built, who it gets sold to, how it gets to fuse. I mean, in many ways, I think the existence of Anthropic is a bit on this thesis. It's the fact that if there's only one lab that is building the best enterprise agents or coding models or whatever it is, then they can actually make principal decisions based on, say, Daria Amade's personal beliefs that we don't want to admit those to be used for mass surveillance or for autonomous robots right now. We actually don't want to sell to Chinese companies and the Chinese government, even though market incentives would dictate that we ought to, because we have these principled beliefs around whether authoritarian governments ought to have access to frontier AI. And so, like, I think that in a world where there are just not that many actors and not that many players, understanding the particular philosophies and motivations of the few people who can decide actually is pretty predictive of some of these decisions that are made. Yeah, for people who are still skeptical at this point, it would be helpful, I think, if you could give some historical examples or, indeed, recent examples where the values or culture or, like, idiosyncratic beliefs of people building a technology have actually, like, tangibly impacted how that technology has, as you say, how it's been built, how it's been deployed, how it's affected the world. Yeah, I mean, I think one example is just looking at the history of the early internet, right, which was not actually built. Like, AI was primarily in these private megacorporations, but by a guy at DARPA and a guy at Stanford working on these, like, TCP/IP protocols, building these, building out ARPANET, building these versions of the internet, where it was decided from the beginning that it should run on open protocols, that it should be this open ecosystem that different networks between countries, between institutions ought to be able to communicate with each other. And if you read, sort of, the interviews or the writings of these folks like VentSurf, they were very clear that they believe that the internet ought to be open. The whole point was this sort of interconnectedness that would transcend borders. And to this day, we are using the same internet based on these open architectures, right? Similarly, I've been reading Sebastian Malvey's biography of Demis and Google DeepMind. And one of the things that I find so fascinating is how in the early days of DeepMind, which is very arguably the first serious AGI lab, they could not get any funding at the beginning, because no venture capitalist was willing to back a bunch of these weirdo scientists who insisted that you could build superintelligence in like 2010 or whatever, who had no business plan, refused to commercialize, had no product, etc. And they were running out of money until Luke Nozak from Founders Fund simply out of his personal belief that AGI ought to be possible, that the invention to end all inventions would just be, in some ways, the coolest thing ever, that it was worth a multi-million dollar bet. Even while Peter Teal and many other venture capitalists were like, you're freaking crazy for even considering funding these guys without a business plan, you know? And so I think when we look at the history of these frontier technologies, when there are only a few people who have, frankly, the technical abilities to make them possible, those people's idiosyncratic beliefs in this thing or another, believing that artificial general intelligence, for example, might be possible at all, believing that the internet ought to be an open thing that transcends borders, they set these precedents, and they make these fundamental architectural decisions or funding decisions that sort of lay the groundwork for everything else that comes after. Something I was really interested to read on your substack is how the word "Duma" has sort of become the lowest status label that you can wear in Silicon Valley. And that just like, that really surprised me just because AI company leaders are very much acknowledging the plausibility of "Duma" scenarios. And in fact, that kind of sense of "Duminess" is so pervasive that people on the outside think it's a form of marketing. They're not serious, they're just like, it's just hype, you know? And I'm kind of wondering how you think, you know, this idea of "Duma" is an insult meshes into that picture. Yeah, in this case, I'm talking a lot more, I think, about a classic Silicon Valley and the VC startup corporate ecosystem, our own tech, which is still the majority of the tech industry. It's somewhat true. I would say it's less true that AI loves just because there are a lot of people who are, as you mentioned, "Dumers" who are employed at, who are working at Frontier Labs. When you ask, like, what is Silicon Valley's political philosophy or what is its ideology in general? You can identify a bunch of little tribes like You can identify the effective altruist here and the progress studies people over there and the E-AX over here. But one of the things that a lot of them share is a sort of very firm belief that technological progress is necessarily a good thing. And so I think that when people, when some of the more accelerationist types have turned dumer into this slur, almost against people who want to slow down or to regulate AI or other technologies, they're sort of presenting a group of people as being anti-progress or as being in opposition to this core belief in Silicon Valley, that technological advancement is the only thing that has ever brought us growth, prosperity, equality, et cetera. And if in all of history, in spite of, again, the industrial revolution, automation, like every wave of technology has brought on its own wave of disruptions. But if one were to believe so firmly in these apocalypse scenarios that you would be willing to slow down, the only thing that might again bring us this future utopia that would keep the progress engine going, then you must be this kind of pessimistic, low agency, like, tax skeptical kind of person, I suppose. And so again, I would say that this belief is more of the VC startup crowd. But I think that the idea that we as humans are, first of all, not powerful enough to be able to control our own technologies, the idea that we should stop progress just because there might be some marginal side chance of harm. I think people are seeing AI in the context of all the previous technological revolutions and thinking, yeah, these tumors would have still be on the farms being peasants. They would never have allowed the industrial revolution to happen. I think what I want to understand more is what the practical consequences actually are of having safety concerns, being associated, at least in these kind of VC startup circle, which is a big part of culture in the area, because being seen by these people is embarrassing, call those data. How does that actually affect what's going on in the labs? Yeah, I would say again, to me, a huge part of this is the talent flows question, just because talent is so scarce, as we see from the salaries that people are willing to pay, talent is incredibly scarce. And so when you have these cultural beliefs, the main thing that they influence is actually really what young people decide to do with their lives and how many people decide to say work on safety versus working on capabilities. One thing that I've noticed rise over the past few years, even outside of AI, but in Silicon Valley, broadly, is the rise of vice signaling, this idea that actually the edgy and cool thing to do is to build a startup like mechanize where the tagline is, that we're going to automate and replace all human labor, or to fill something like clueless, where the tagline is to you don't everything. I think that the idea that trying to be careful, and trying to be careful, trying to be constrained about the way that you build technology by labeling that as do-mary or low status, or as not being a pioneer and a serious builder, you're basically preventing a bunch of very impressionable, young people from going into a field that they otherwise would. And thus to say nothing of obviously the policy conversation in DC, where doomer has been employed as an extremely effective insult. I think one important thing, actually, also about the doomer insult is that it's coming mostly from the tech right that has pretty effectively tied doomerism and AI safety to quote, unquote, "woke identity politics," and previous attempts to regulate technology by alleging discrimination, civil rights concerns, labor concerns, et cetera. And so the folks like Mark and Dreson and David Sox were using the doomer label most loosely. They are building this perception on the American right in particular that to be interested in AI safety is the same as being a woke regulator who wants Facebook to censor all non-liberal content. I think what I'm interested in here is that, I mean, at 80,000 hours, right, we see a lot of people who are very attracted to careers in the Bay Area, at AI companies and the general kind of AI ecosystem, specifically because they really genuinely want to positively influence the trajectory of AI development. I wonder in this environment, how much do you think, how optimistic you are that safety-focused people can actually succeed at pushing forward, what they want to push forward? I think that folks who are working on technical safety work, there's still a lot of opportunities and a lot of support, both socially, financially, et cetera, professionally professional ecosystems towards doing that kind of work. I think that there's a well-developed enough ecosystem of AI safety organizations. There's the fact that actually most people who work on capabilities at the labs really care that their models are aligned. It's also very hard to sell on-align models. It sort of coheres with the business incentives of these companies that you can get, you can get made fun of a little bit by Mark and Dresan in order to do work that you think is really important really well respected by a lot of other technical people in your community. One thing that I sometimes tell folks who are not in AI is what's really notable is actually a lot of the researchers who have made the biggest breakthroughs in AI, people like Jeff Hinton are some of the ones who are raising the alarm the most on AI safety, being an important thing to work on. And I think that affords working on technical safety quite a lot of status, at least within those technical research communities. I think where I start to worry a little bit more is on types of work outside of that core safety work, which is the technical safety work, which is more well-funded. Again, maybe it's just because I'm a journalist, but I think a lot about how much incentive there is for people to go into these fields that are where one, I don't think that you can do them inside a lab. So I don't think that you can do especially credible, either journalistic work or policy advocacy work if you are employed by a lab. You are going to be seen as a shell, you are sort of correctly seen as a shell. You are basically doing marketing and lobbying for that company. And so if you completely 100% align with that company's overall position, then like, okay, great, go do that work because you'll help your firm win. But for the most part, I really wonder and worry about how many positions there are for like very AGI Pilled and very safety concerned people to work in these sort of independent roles. Like even the journalism community has sort of appropriated these words to make fun of people who believe in things like existential risk. Like in the journalism and media world, people will make fun of you if you are seen as an effective altruist, if you are seen as someone who believes in existential risk, if you are seen as quote unquote buying into the Dumer hype, like you mentioned, of these AGI companies. And so it's actually like kind of low status in journalism to believe in these things. It's low status in the policy community. I mean, Politico, I think last year or the year before, sort of was running these stories, attempting to like weed out and witch hunt anyone who has any connection to effective altruist fellowships within the AGI policy community so that people would then go and discredit them. I've had, again, senior media people tell me very similar things where they're going after all the tar bell fellows and saying, these people are just some thropic shells or these people are shells for like, some crazy Silicon Valley billionaires. And so especially because these are the roles that I already think are less supported. Like they are not as well remunerated as roles at the labs. You don't have this like social and professional ecosystem. I tend to worry more so about people who are in academia and research and policy and in journalism who take care really seriously and whether they are supported to do their work. Let's move on now to talk about another group of people that you've been observing. So you've spent a bunch of time with, I guess, a group of people that you would describe as AI populists. Can you tell us more about who these people are, what their views and motivations are and so on? Yeah, I've been tracking sort of the general anti-AI backlash and the political backlash in the United States. And I've been curious about that. So I made two trips to Washington, DC in February and March of this year. And one of my core goals during these trips was to talk to some of these advocates and interest groups who were basically anti-AI advocates in various forms. And I specifically really wanted to talk to folks who are not part of either the industry or the sort of classic AI safety community, but people who are actually coming from other factions and factions within American politics who have only recently begun engaging on AI. And so this includes maybe labor groups who are labor union advocates who are worried about the job stuff. This includes maybe social conservatives who are very concerned about AI replacing sort of human relationships with AI companions and AI relationships. It might include environmentalists who are worried about data centers, energy use impacts or states rights advocates who are worried about things like federal preemption. And so one of the big trends that I've noticed in the US over the last few months is that AI is no longer sort of the remit of these few sort of technocratic, very AI focused policy wanks who are very concerned with a specific characteristics of AI as a technology. And rather you have all these other interest groups that have long histories in Washington lobbying for this and that who are now realizing, wait a second. AI intersects with my issue, usually in a way that makes us not like very AI very much. And now they're actually banding together and forming these in some cases by partisan or like cross-issue coalitions to support things like whether a data centimoratorium or fighting preemption or things like that. And that was just like a really interesting trend to see people who again probably two years ago had no clue what an LLM was to now be focusing so much of their time and political energy on organizing against AI. And so some people have asked like why do I call these folks the AI populists, like where does that term come from? And I think it comes from me trying to understand the difference between these political factions that are anti-AI versus say the AI safety types of researchers who we talked about earlier. And the main thing that I realized was that of these new AI populists, they are not primarily concerned with the technical characteristics of AI that might make it uniquely riskier, uniquely dangerous. Rather, they see AI as an extension of a broader concern that they have that a small number of wealthy and powerful corporate elites are concentrating control on society at the cost of everybody else. And so when the AI populists are trying to do things like impose data centimoratoriums or regulate AI, it's often less again about the specific nature of the technology and where it's going, and much more about a broad backlash and pre-existing populist backlash against billionaires, against tech companies, against corporate concentrations of power that hurt workers and hurt ordinary Americans. Yeah, yeah, yeah. So these people write that their hatred of AI is very deeply entrenched in their distrust of the people who are building it to the extent where it doesn't seem to match to them, like how useful TATTPT gets as a tool. There's something fundamental about what's going on here that they feel inherently skeptical off. Yeah, I think that's interesting because based on what we've heard so far about the attitudes of people who are building the technologies, as we've seen there quite varied, but ultimately we've got a group of people who are aware of the risks, aware that the things that they're building could cause a lot of at least short-term disruption if not worse, longer-term harms, and they're building it anyway. They maybe have a sort of automated or be automated mindset, and some group of them, maybe a small group, even has a belief like technology doesn't even need to serve humans. With all of this kind of stuff in mind, I guess it's not wholly surprising to me that like some large part of the public feels pretty distrustful of this group of people. I'm wondering how much sympathy you have for these views overall? Frankly, quite a lot. I think mainly for the reasons that you just described is I think that people are correctly assessing that there are some folks in Silicon Valley who are taking a gamble on their futures, and like you said, maybe the gamble is their jobs, maybe the gamble is their literal survival, maybe the gamble is if they believe that AI is a bubble, it's like a giant economic bubble. It's true that AI is propping up American GDP growth, and it has been for the last year. I think St. Louis Fed said that 39% of growth in 2025 came from data centers in AI. When people sort of understand that they have no capacity for democratic control or having a voice over the direction of the technology, when the leaders of those technologies are being very open about the risk that they think it's going to pose and saying, hey, we're going to do it anyway. For normal people, they actually have no leverage, right? They don't know anyone who works in an AI lab. They can't just tell them like, hey, like you should worry about this. Most policy action has been extremely limited. Most people don't know anyone in AI policy anyway. I think that when I see things like data center protests or booing at college graduations or whatever, I don't necessarily think that they're the smartest levers to make AI safer or whatever, but I think that they are the only levers that people feel that they have access to, right? Again, maybe Waymo is a little bit safer, maybe Chatchy BD helps me write my emails faster. I think people are willing to cop to those particular things, but when I write my emails faster, I sort of position against this might take my job and kill us all. It just doesn't feel like that good of a trade. Yeah, then the AI people will say, but it also might cure cancer and they'll say, where's the cancer cure? I hear this all the time. It's like the AI CEOs keep talking about curing all diseases. Where are the cures to the diseases, right? At a certain point, you're just not a credible actor anymore. I understand why the populist backlash is happening. I would like to see it funneled towards maybe more what ICAs, productive policy aims and protesting data centers and booing people at graduations and whatever, but it kind of makes sense to me. Yeah, yeah. Something else that we're seeing, right, well, we're already beginning to see these kinds of AI populist type attitudes, like beginning to escalate. So recently, there have been some attacks on Sam Ottman's house and also on the house of, I think, Councilman who had just approved a data center project. Obviously, these things are extremely horrific. Yeah, I think what I want to know from you is what you think the natural trajectory is for these kinds of attitudes and behaviors. Are you anticipating that AI populism is going to start influencing political campaigns a lot more? Are you envisioning that there'd be some kind of like, I don't know, like, blood-ite style revolt in which rather than smashing looms, people attacking data centers, how do you see this playing out? All of those things seem pretty possible to me. So in the US, we have the midterms this year and we have a big presidential campaign in 2028 where we're expecting both a very crowded Democratic and Republican primary. And one is, like, I think that there's going to be a lot of political opportunism, some of it justified and some of which centers AI probably even more than it needs to be. Because I think AI is kind of a perfect political buggy man. Also, one interesting thing I notice is like, while I do believe in a lot of the AI risks being very serious, you also notice that politicians will use AI as a justification for the thing that they already wanted to do. So like for Elizabeth Warren, it's like, oh, I want to tax the companies. And we should do it because of AI, you know? Or for people who wanted to regulate how much kids had access to technology for social conservative reasons, they're like, and we should do it because of AI. And so I'm already seeing some of the candidates who we expect to be running in 2028, whether it's like Mark Kelly or Rocana on the Democratic side, maybe Josh Hawley on the Republican side. They're already sort of announcing these big, bold AI action plans because they see AI as a new issue that Americans are extremely scared about and that creates an opportunity for them to define their campaign. And so because they're all going to be running these ads and talking about these AI companies, because AI companies are also like, frankly, not very sympathetic to most Americans right now. I actually expect populace backlash and public salience of AI to increase quite a lot as these campaigns kick into motion because politicians have an incentive to talk about AI more in order to justify their policy proposals. The other thing that I think about is these more diffuse and volatile forms of backlash, such as political violence as we've sort of seen against these actors, such as even things like these witch hunts. So like, in creative communities, among artists and among writers, there are kind of informal cancellation witch hunts against any writer or artist who is suspected of using AI who partners with an AI company, et cetera, et cetera. One thing that I think about is in the 20th century, we had a big wave of factory automation where a lot of the factories went from primarily humans on factory lines to humans managing machines more so. And part of the way that this was negotiated, such that there was not a massive backlash and there weren't waves of violence by workers who were being automated, was that these factories were mostly unionized. And so when they were mechanized, the people coming with the machines would meet with a union leader sit down at the bargaining table and say, okay, like, first of all, we're going to pitch this to you as it actually makes your job safer. You guys are really worried about workplace accidents and this is going to reduce that. So it gets at this issue that you guys are really worried about. We're going to actually tie wage increases for workers to the increased productivity of these factories. And also you had just had this new social contract that FDR introduced to introduce like, you know, better working legislation in general. But more importantly, I think that there was a bargaining table and there were these sort of mediating institutions of the unions between the people who were impacted by automation and the people introducing the automation. One really interesting thing I think about today is that there are no mediating institutions of that form. If you are a white collar worker in most industries, you are not part of any sort of organization that is any sort of union or whatever. And so when your boss decides to maybe introduce AI, consider eliminating your job, there's not actually anything that you can do about it. There's not like a particular democratic or collective channel to express how you want AI to be incorporated into your life or your workplace. And I think that means that when people are really pissed off, they start going for social media consolation and stochastic violence and all these more diffuse forms of political backlash. I think I just have a view that like public sentiment will find an outlet and It right now we're just going to see quite a lot of it from very different directions at least until people feel sort of Credibly reassured that they will have the downsides cap that they will share in the growth that AI gives etc I guess like a reflection that I have I mean besides AI populism contributing to like scary violent things in the near term I also it also seems like potentially longer term It might kind of be bad overall for AI safety I guess in a couple of senses like one thing that you've mentioned One effect that you've mentioned right is that Because AI has kind of become the new like because China like politicians kind of using it to push whatever thing They were already trying to push for Another thing is just like this misguided focus on things like banning data centers, which you know, I can understand The sort of the fact that's kind of coming from feeling kind of powerless about what else you can do And then you also have this like very deep lack of belief and trust in the AI company leaders who are saying that the technology is going to be a really big deal and pose Like like potentially pose like quite like kind of like life altering transformative effects I feel like all of these things seem like bad news for the safety like like getting getting like good Safety policies in place and making sure things go well. It seems to me that like the safety community is somewhat divided on this question I've talked yeah like I've talked to folks on those sides I'm not quite as much of a policy expert here compared to a lot of folks are but like they're clearly some folks like From like future of life etc who have actually really leaned into the idea that you can build coalitions and build bridges With some of these AI populace because they have They have existing networks. They have existing relationships with policy makers They have bases who they can activate around the issue of AI Where a lot of people were probably never gonna quite grok like a lot of frontier safety issues But maybe they could be sort of brought on board through some of these other issues like kids safety or the environment that they otherwise cared about And so they're clearly some folks who think it's a good idea To forge these alliances. I'm also however like I think what you're saying is very compelling like I do think that By making AI a much more mainstream political conversation and because AI is such a broad reaching technology with all these different axes of potential policy making It's a real question as to whether The people who are now the most activated around the AI backlash are focused on the set of issues that the experts would prefer like you said Like I think that the fact that the AI water use issue is still as salient in conversations As it is like that is something that's an extremely wide spread belief among say college students Is pretty crazy because I think it would be a total misallocation of legislative energy for us to focus on Just like a data center water use right right um and it is true that I think a lot of folks are gonna be Distracted In an ecosystem where there's limited political capital and limited attention by sort of marginal issues If one were if one believed that some of these frontier safety risks are actually the ones that need to be worked out most I will say that it's possible that the That the politics of the issue and the broad politics of the issue Can co-exist with more precise and technocratic policy making at the legislative level especially now that mythos and the Pentagon fiasco have sort of gotten a lot of the policy and expert community much more worried about the existential risk side of things yeah um I think another dynamic that was seeing was AI populism um that's youth worth unpacking a little bit is that AI companies are just spending like lots and lots of money on things like PR right and yet somehow public hostility About AI populist ideas and so forth are still very much rising um Yeah, what do you think is going wrong here is the AI community like Misunderstanding something fundamentally about the audience Yeah, um I had a conversation about this recently at a roundtable with some of the AI with some of the AI executives and it seems to me that We are past the point where marketing and nice ads and AI for good stuff can get the public back on board I mean a huge part of it is just that so much of the messaging coming out of the AI industry for the past five years Has been focused on the risks and so even if we turn around now and say The same oldman says actually like I don't want AI to replace you. I want AI to be a tool and like you know There are still videos and like on the record statements from all of these executives About the risks that AI poses and so people see it as a sort of flip-flopping And I think the other issue is just that like most people are not seeing tremendous benefits from AI in their personal lives Yes again, they may be able to write emails faster. They may get something that they consider 50% better than having access to Google in terms of like looking up little things here and there But the way that AI shows up in most people's day-to-day lives is also equivalently Slop have finding hard to apply for jobs finding hard review job applications Their kid being like you know cheating on all of their homework or maybe having an AI companion that they talk to 4/7 the way that AI shows up in people's day-to-day lives is The median experience is not necessarily that good and again most people aren't yet getting the tremendous benefits from something like Quad code for software engineers where they're actually seeing in their own productivity their job get easier faster being able to output more and so I think in a world where AI actually has defuse quite a lot like most people in country AI quite regularly in their lives Then there's only so much that your marketing can do because like again if your marketing is like we're gonna cure cancer eventually We're gonna go to the moon eventually and people are just looking at their lives and the way that they use AI in the present I just don't think that the marketing is that persuasive yet Yeah, I mean this does seem like one way in which the insularity of the AI community is like having an effect right so I mean This is you know not true Across the board but in lots of cases we've got sort of people who are living together reading the same book It's going to all the same parties using all the same jargon um and I wonder how much you think that's kind of creating a divide with the public or like yeah How much that sort of reinforcing this this gap that you're Observing I think it's a big part of it. I mean um even when you ask people like what do they look forward to in the in when AI goes Well, what do you look forward to in the post-age AI utopia right a lot of folks who I know In San Francisco in the AI research community they're really excited about ubi and they're really excited about the sort of infinite leisure point of view When you test ubi with a public it's extremely unpopular because most Americans really want to work They really want to have a job Maybe they don't want the job to be 40 hours a week Maybe they don't want the job to be this or that but like fundamentally people really want to work Or when you ask people do you want to live forever? I think it like is actually quite a controversial poll Like a lot of people don't want to live forever and so when there's a very The utopia that sort of Silicon Valley and the AI industry is outlining is not actually a very compelling utopia to a lot of The other people in society and they don't realize that because they are in these very insular communities Then like even your attempts at positive storytelling don't really land the other thing that I think about sometimes is that especially as the companies are gonna go public soon Like for the first you know five five years of these AI labs existence all the messaging is really focused on Recruiting and investors right like you want to get the best technical talent to join your lab and you want investors to like give you a lot of money and take you really seriously And so you're actually marketing to the end group right like even somebody who may not actually say care very much about AI safety An executive might pretend to like really care a lot about AI safety because they know that a lot of the researchers do and they're not going to get the best researchers if they don't Pretend to care about safety like we saw this with you know the acquisition of deep mind into Google like Google made a bunch of promises about an ethics board and AI use in the military. I think arguably a lot of Sam almonds communications about safety have this flavor where he knows a lot of the people who are very important to him Care about it and so he's happy to say the words but when you have people Saying words in order to recruit more in group people and these words are on the record and they're on Twitter and they're on video And then they get shared out to the broad public and it's like oh man Samulman says that most people are probably going to be worse off or like he says that like there might be like a X-percentive chance that we all die then they're like whoa what the hell are these guys doing like we're not into that And so I think that the insularity is also reinforced by some of the market incentives of the first five years of their existence And so now that the companies are trying to pivot into messaging to the public. It's a much harder task Yeah, yeah, I'm curious what you think needs to happen to get these groups. I either AI community and the public To I don't want to say reconcile because they may never get on may never like sort of agree But you know at least not sort of speaking the same language I frankly think that at this point in order to get the public back on board you're going to need to start giving people real material benefits, or maybe it does look like the long awaited cancer cure. I think if people see medical breakthroughs that are actually happening as a result of AI, then they are going to have a much more positive view on things. When you look at David Chor's Blue Rose polling, health advances and scientific advances as a result of AI are some of the highest polling things among the public. And so if it also looks like more investment is shifting towards domains that people are really excited about AI being a part of, and those are visible, those are well marketed, then I think that that could also really work. But again, when we talk about scientific and health advances, it can't be these advertisements about plausible future things. I think we actually have to show that we are able to access like cheaper or better or whatever it is, whatever cure's treatments, etc. as a direct result of the AI companies in their will. Yeah, I'm wondering how that view squares up with the phenomenon that you've noted where people, like at least in the sort of AI populist category that you've sketched at, people are so fundamentally mistrustful of the elite groups who are building these things that it kind of doesn't matter them, how it's how useful the tools are. Like what needs to happen? Like how are they getting these sort of material benefits sort of changed their psychology around the mistrust of the elite? In this case, I think that's where I think the redistributious distribution stuff is actually really important. Like I'm actually not sure that say the health advances alone would do something here. Because I think the mistrust of the elite is fundamentally based in rising levels of wealth and equality and concerns over affordability and corporate concentration of power in the US in the sense that wages have wage growth hasn't kept up with corporate growth and labor-sharing income is declining and all of that kind of stuff. And so I think because so many of the populist concerns are wrapped up in economic inequality, unless there is a clear sort of economic benefit, the sharing of the pie, in a highly legible way, we're not going to sort of smooth over that sort of concern, which is why sometimes I'm half joking that you need the big gold Trump check in the mail that says Trump X Open AI. But I actually think something like that would do quite a lot to persuade people that there was some deal made to share Open AI wealth or Open AI equity or Open AI cash or whatever it is with the public. But you know, I'm actually like cautiously optimistic about things like the Open AI Foundation, if they can be independent from the corporate side of the corporate side and they are able to fund like an incredible amount of public goods, community programs, research, etc. Maybe all help. I think they're good people there during their best. I want to move on here because you've also spent a lot of time in China where I think public attitudes towards AI at least seem on the surface to be very different to what they're like in the US. You know, you've got this situation where people's grandparents are nursing homes and nursing homes are just like exuberant users of deep seek. And also when you have, I think some survey results, you can see that in China, most people seem more benefit to draw back, more benefit than draw back to AI, which is like a very different picture in the US. How do you explain this contrast? Is what's going on here just some sort of culture of techno optimism in China at play? It was there for a couple of weeks meeting with both people in the Chinese AI industry as well as just other random people around. Yeah, so I went for two weeks a little bit ago and I spent a lot of that time asking people about whether there was an AI backlash, whether people were worried about risks, worried about jobs, all of this kind of thing. And I think my view of it is it's less a techno optimism than it is a kind of techno determinist pragmatism. I actually see a lot of the same techno determinism in China as I do in Silicon Valley, where there's a sense that progress and modernity has a particular direction. Like we are always going to see the economy and technology march forward. The CCP has been very clear about the need for technological advancement in order to advance China itself as a country and as an economy to its next stages of growth. And given that, people sort of see it as the only choice you can make to get on board. There's not a culture of protest or a culture of resistance in China. I think that's just part of part and parcel of being in an authoritarian society, where there's a lot of government repression of any contrary speech or any attempt to organize in some form or another. And what that means is just like ordinary people, like when I talk to my family members, the idea of resisting AI or protesting is almost unfathomable to them, because you're going to get crushed because you know the government is very supportive of AI diffusion. You're not going to win. Second of all, with things like jobs, it's like every, the channel already has a lot of white color and employment. It's already a very competitive job market. It's sort of if I don't use open claw, I'm going to fall off and somebody else who is using open claw is going to take my spot. And so a lot of the attitudes around AI are just much more practical. There's no choice economically and politically except to get on board with AI. And so people are more open to it and I think more open to adopting AI and focus more on the economic value it provides. But I would say that a lot of this does have to do with sort of almost this, like almost this resignation that there is no choice. Yeah, interesting. I wonder how much what you're seeing here, tracks the reactions to sort of previous waves, automation in China. I don't know how much you know about this. I mean, one example that kind of slightly goes against the grain of what you're saying is that I know there has been some backlash to technology in China. I mean, there was definitely some public scrutiny and reaction to, I believe, delivery driver algorithms some time ago. I know this is just one example. Do you have a sense of whether this is the classic trend you see in previous waves of automation in China or if it's a little bit different? Yeah, I mean, I wouldn't say that there's no dissent or no backlash at all. Like you mentioned, I think delivery drivers have engaged in some forms of organizing. There were actually protests around robotaxies that were introduced in Wuhan. So by do has a robotaxie of it, they started rolling them out and there are like some like protest light type things. I will still say that these are very marginal compared to the level of public descent and protest in the US. There are many, many, many fewer Chinese people who are willing to engage in these high risk actions because it is just extremely politically high risk to do so. At the same time, the China scholar Matt Shehen, who's been tracking some of the AI regulatory conversation in China really well, he did note that some of he heard in his conversations with the Chinese policy community that the robotaxie protests were part of what inspired Chinese policymakers to be more active on labor legislation front in particular. And so the other thing that I'll say is that the Chinese government, while overall still being a promoter of AI and a promoter of technology very broadly, they are more willing to introduce lots of little pieces of iterative legislation around the potential societal harms of AI. So there's a recent court case in Beijing that ruled that firing it would encounter sort of just cause basically to fire a worker because of AI or China has also legislated companion chatbots quite aggressively. They obviously have a lot of speech regulations when I was talking to my aunt who works at a state and enterprise in China. She mentioned like, yeah, I use a do ball, which is their chatbot and it can probably do the job of two employees, but like they're not going to lay us off like because there's sort of been a promise to at least the state and enterprise workers that we will not lay you off because of AI. That's not a good enough reason. And so for some people, there is also a slight sense of security that the government by being much, much more active than the US and attempting to regulate AI uses is going to protect people from the worst downsides. But overall, I think the main thing I would say is just that China has seen a lot of a lot of both tumult in the last 50 years, but also a lot of progress where you know, like if you ask a middle age or an older Chinese person, they've seen revolutions in their lifetime and they've also seen their standard of living just like increased dramatically year on year on year on year. And so yes, they may not like this or that about AI, but fundamentally there's a sense that this is the way that progress moves and you better get on board or you're going to fall behind. I want to talk now about media coverage of AI because you or someone who works in media and I know that you've observed some effect where in an attempt not to play too much into hype. Other media professionals and critics are maybe just not engaging as they should be with the things that advanced AI could do in the future and more speculative things that haven't happened yet. I'm wondering what your perspective is on like how to report about these things without falling into this trap of generating too much hype. Yeah, it's really interesting. I think that journalists are still trying to figure out how to cover AI because there is this competing skepticism of any large institution and particularly one where they have marketing goals to talk about. how powerful and capable their technologies are, while also being serious about potential future possibilities. I mean, one is like, I do think there's a pretty prominent bias I've observed in the mainstream media to avoid giving almost ever taking the AI companies at their word or taking any claim even about the technology itself at their word. I think a lot of this comes from ALOS PTSD from the crypto era where a lot of folks made a lot of promises about how crypto was going to change the world and replace the global financial system. And none of this really materialized. And there's a lot of scam and fraud. And so journalists felt burned and frustrated by that such that now, even when I'm writing about AI capabilities, I almost always get a question from my editors that says, but isn't it just marketing? Can they really do that? I'm pretty sure it's just marketing. You should include a caveat about that. And so I understand this sort of default skeptical role that journalists have to play in society, particularly when the entity on the other side is a really powerful corporation. But for me, one is you should never just talk to the companies. You should always-- if you're reporting on the company, you should ask them what they think about AI progress. But make sure that you also spend a lot of time asking independent experts about the same exact questions. And so when I report on the economics of AI, I interview people at the companies, and I also spend a lot of time talking to actual economists with the wide range of views and other policy professionals. And if there's an issue that actually looks like a lot of these entities agree on-- like, for example, I feel like cyber risk and bio risk are things that you can find a lot of people both inside and outside of the companies to say, we're all pretty worried about this. And this is a real serious thing that might happen. Then it's probably not hype because a bunch of people who don't have financial incentives to say so are saying it too. And so rather than this sort of-- I mean, this all very simplistic, but rather than the attitude that if the companies say it, it must be wrong, my request is just, go talk to some independent experts and see if they also think it's wrong. And if they don't, maybe there's something to it. But I don't know. I think I basically try to spend quite a lot of time trying to talk to every party or every tribe on an issue impossible. So I try to talk to both Republicans and Democrats. I try to talk to academia as well as people in the industry, as well as people in policy. And anytime I report on an issue, I'll try to make sure I'm hitting every stakeholder bucket to avoid a sort of tribalism. And also, I even have a cloud prompt that I'll use some time where I feed it a draft of something I've written. And I say, do you think that every party that every stakeholder group or every party I've represented and quoted would consider this a fair interpretation, which fair, again, being different than flattering. I think flattering is super different. But I try to basically make sure that I'm having conversations with and attempting to see my story from every possible side, rather than just neglecting entirely some group of people. Again, there are journalists who will not talk to people at a company. There are others who will not talk to some AI subdecs. Yeah, through this conversation and from reading your substack, it does feel like we kind of have unearthed a lot of uncomfortable truths about the AI world. So yeah, are there any reasons to be hopeful that you're-- you want to highlight? I actually think that it's a really great time to be working in an around AI, even-- and maybe especially if you are concerned with safety, concerned with societal impacts, concerned with some of these broad public issues. And that's partly because, as I've started to engage a little bit more with the policy and the political conversation, it's clear to me that the overton window in one policy and two actually philanthropy both seem to be expanding extremely quickly, like literally between my trip to DC and early February and late March, I noticed in a month and a half how some of the same people who are saying, yeah, I don't think policymakers even believe that these things are more than stochastic parrots. We're starting to go, oh, it looks like a lot of people in my constituencies in my voter base are really worried about AI. Guess I got to start taking this seriously. I think that mythos was a big update. I think that Claude Cod was a big update and Claude who worked, I think that for a lot of these more legacy institutions in the policy world or in the philanthropic world or in civil society who have spent years shutting their eyes to the possibility of advanced AI progress, that is starting to fall away. People really are starting to take AI seriously. And what that means is we're actually in this funny scenario where there are a lot more politicians looking for ideas of what to do about AI than we actually have compelling ideas and solutions. So I think for anyone who wants to work, for example, in AI policy, who is willing to actually branch out and like, say, build relationships with labor groups or environmentalists or whether it's on the right or the left or whoever, and spend some of the time to get some of these people who are brand new to AI but who actually really want to do something on it because they believe it's important and they believe it could be politically helpful, to actually get some good serious ideas in their hands. I just, like, the number of times that I've had conversations with congressional staffers and very influential people in Congress who are saying, like, yeah, like, my representative really wants to do something on this. They're just still in the process of learning what to do. And so I think the potential for impact in policy is really high. And then the second one I mentioned was philanthropy, of course, which I think a lot of folks are aware of. There's tons of money, both individual donations from people who are about to get really wealthy off these IPOs. There's things like the OpenAI Foundation. But also the traditional philanthropic actors, whether gates or Rockefeller or whatever, all of them are starting to build out their own AI plans. And so there are billions of dollars in the next couple years that could go towards tackling AI-related issues. And once again, I think that there is more desire to spend the money than there actually are organizations and solutions to fund. So I think there's a ton of opportunity if you're a young person looking to make your career right now to be working on AI issues. Yeah. Awesome. Thank you so much, Jasmine. I think that's all we've got time for. You've been a pleasure to have on the show. Thank you for coming. Thanks so much for having me. This is fun.