Go back

Signal’s Meredith Whittaker on AI hype and the end of privacy

41m 7s

Signal’s Meredith Whittaker on AI hype and the end of privacy

The transcription features an interview with Meredith Whitaker, president of Signal Foundation, discussing various topics related to tech, AI, privacy, and policy. The conversation delves into the Signal Gate scandal involving the use of Signal by U.S. officials, Meredith's concerns about the end of privacy, and the influence of tech culture on politics. Additionally, the discussion touches on the rise of AI agents and the inherent risks they pose to privacy and security, emphasizing the need for policymakers to better understand the technology they are regulating. The interview highlights the critical importance of privacy in the age of AI, with a focus on the potential threats posed by agentic AI systems and the implications for data security and encryption. Overall, the conversation sheds light on the complex interplay between technology, privacy, policy, and societal implications in the modern digital landscape.

Transcription

6365 Words, 36420 Characters

(upbeat music) - Hey, welcome back to Politico Tech. I'm your host, Steven Overly, and on this show, I break down tech, politics, and policy with the people shaping our digital future. If you don't use Signal, you certainly heard about Signal Gate. That was the scandal back in March when senior U.S. officials used a messaging app to communicate about military strike in Yemen and inadvertently included a journalist in the chat. That event thrust Signal and Signal Foundation president, Meredith Whitaker, into the spotlight. But Meredith has been in the headlines before. As a former Google employee, who in recent years has stepped out as a vocal critic of the way Silicon Valley handles privacy, AI ethics, and more. On the show today, Meredith and I delve into the rise of AI agents, why she fears the end of privacy, and how tech culture is changing politics. Here's our conversation. Meredith, welcome to Politico Tech. - Hi, it is so great to be here, thank you. - I actually wanna start, if I can, with a prediction. I remember reading nearly a year ago now in Wired, where you had wrote that in 2025, it would be the beginning of the end for big tech. Tech giants have sort of lost their appeal with politicians and with venture capitalists alike. I wonder, looking back as we approached the end of the year, do you still believe that's the case? - Well, to be honest, two things were going on there. Wired asked me for a prediction piece, and I said, "Do you mind if I write a manifestation?" And they said, "We don't really have a headline for that." So I was like, "Snucka, kind of, let's manifest this." Under the headline of a prediction. So I wasn't completely convinced that that would happen, but I do think that's the direction of travel. I think that increasingly there is more and more awareness, not just among policymakers, politicians, business leaders, about the dangerous dependency on centralized big tech, but this awareness is creeping out into the public just yesterday, and we're recording this on Tuesday, October 21st, 2025 for listeners in the future. But just yesterday, a large part of Amazon's infrastructure went down, taking huge sections of our online services and infrastructures offline. And this is a kind of allowed reminder of what is quietly problematic at every other point, which is that we depend for so much of our daily lives, our social functions, our governmental operations, every corporation in the world, you name it, on a handful of companies that have quietly come to dominate the nervous system of our lives and institutions, and that when these companies have a massive failure, as happened yesterday with Amazon, or as happened a little over a year ago with Microsoft's Cloud Strike Outage, which similarly took down core infrastructure around the world, we are reminded of just how vulnerable we are, but every single day, we are made vulnerable in quieter ways that may not be as apparent from an update in an AI model, like GPT-4 to GPT-5 that fundamentally changes behavior or an update in pricing that means we're locked in to paying more because we don't have alternatives that we should have or determinations about which governments these companies are going to work for, and on and on and on, we have ceded control of so much of our lives to a handful of companies in a way that I think is only becoming more apparent. And that's just the first part. I think we can also look at some of the decisions that are being made by these companies as they pursue what is ultimately their key objective, which is continued growth and continued increase in profits to please their board, to please their shareholders, and that that imperative is often at odds with what would be better for society, what would be better for the social good, and that collision is becoming more and more apparent. And I do think people across the board are waking up to it, and we haven't even mentioned the kind of tenuous AI bubble we're in. So no, I don't think that is happening. Immediately, I don't see a complete turnaround, but I do see those dynamics marching forward, and I see an increasing discomfort as we see an increasingly over-leveraged market in AI that leads me to think I was on to something. - Well, I don't disagree with being honest, I think I mean, the AWS outage example is a great one, 'cause literally yesterday when that outage happened, like it started in the morning where I couldn't order my bagel, which I now do online, and then I couldn't send a work invite because the software platform runs on AWS. And at night, I couldn't log into a portal for a class I teach, 'cause that also runs on AWS. And it just sort of is illustrative of our dependence on technology, but then as you said, how so many of our, the technologies we use are powered by few companies. AI though, as you're saying, and I'm curious to get your thoughts on this idea of being in an AI bubble, from the perspective here in Washington, it has created something of a renaissance for tech, because when you talk to policymakers, whether it's about energy policy or national security or economic competitiveness, I mean, AI is inevitably part of that equation. Sometimes it's a big part of the equation. And I wonder what you make of that, that impact that AI is now having on this. - Well, look, AI is many things and it certainly has uses, but I would dare you or anyone listening who has contacts with policymakers and politicians to just sit them down and say, what do you mean by AI? Let them answer that question in clear and precise terms. And I think what you'll get at that point is a lot of hype, a lot of fog, a lot of magical thinking, where people who don't have a rigorous technical background, who don't understand the material realities of these systems, the energy, the infrastructure dependencies, the layers of open source software on which everything relies, the cost, the political economy of building these systems, give kind of hand wavy answers that sound more like they're talking about a magical genie than about actual technical systems. And that's a big problem because we are seeing a wave of hype washing over critical institutions, governments, and key decision makers that are leading to decisions being made to outsource decision making to technology to trust these technologies with key functions that those who understand the technical reality, the limitations, the fundamental threshold conditions for how these actually work would never have advised. And that does get us to discussing a bubble because the reality is however you slice it, yes, revenues are very, very high. There's a lot of money in coming to license AI models from the likes of open AI or Google or Anthropic. People are paying to do that, but the cost of training AI, the cost of building out these data centers, the cost of inference, which is the term we use for kind of using AI every time you send a prompt and it sends back a wall of text, you've done an inference, that cost is still not being recouped. There is no break even happening in this industry. So you were seeing what I've referred to as kind of a flop sweat desperation to make AI happen, not just as a cultural zeitgeist or a renaissance, as you said, but as a profit center, and that has not happened yet. And so the bubble is getting more taught, there's more and more air going into the balloon, but as yet that magical consumer market fit that can actually recoup these investments in let's be real, highly depreciable infrastructure that will need to be purchased again and again and again as chips change, we're not seeing a profit there. And I think that has some explanatory power for just how phantasmagoric the rhetoric and the promises being made are, because again, there's a bit of desperation behind this. - Well, what's the antidote to that then? Do you think we have policymakers who listen to the podcast? I mean, it is easy to get caught up in the hype around AI, all the big promises, especially of policy challenges it will fix like healthcare, climate change, or anything that the industry throws out as sort of the positives here. And you also always hear this argument that Washington or policymakers don't understand the technology well enough to regulate it or put guardrails on it. And I don't know that I've ever heard the solve for that necessarily. - Yeah, that old trope that all you need is tech brains in Washington to move aside the dusty policymakers and get things on, the rails of modernization has been around for a very long time. I remember this in the mid 2000s. It was, you know, bring tech to Washington because they're too old and crusty to understand it. Yeah, okay. - Right. - But I think, you know, they're not too old or too crusty to understand the domains in which they operate, be that education or healthcare or national security. And tech has a lot to learn on the fundamentals of those domains. So I think, you know, in some sense, there is a, it is very convenient for those building tech to say move aside, we're the only ones who are both able to build this and to instruct how it should be applied. Right? - Yeah. - Now, I'm gonna say like the antidote, there's no one weird trick here. But I do think, and this may seem a bit of a sideways answer, that just be brave enough to ask the dumb question. Because there is a culture of, you know, what I'll call a culture of shame around technical knowledge. People are deeply afraid of being humiliated for being dumb about AI. AI is the future, AI is the renaissance, it's the revolution, it's not just the industrial revolution, it's also the invention of fire to quote Sundar Pichai. It's that important. And yet people don't feel like they have a clear grasp on it. And I will hear, you know, NATO chiefs, I will hear CEOs of Fortune 100 corporations sort of repeating as received wisdom claims about AI that make absolutely no sense. And that in the context of any other technology or any other, you know, presentation to their board, they would be ripping apart because they understood that they have standing. They understood that they need to be a, you know, they need to protect their company. They need to protect their interests. They need to equip themselves honorably in their job. And yet we don't see that with AI. We see, you know, folks talking to the marketing arm or the, you know, one or another executive of a given AI company, acting as if that is ground truth for technical knowledge and then repeating it as if it's an imperative in, you know, the context of shaping policy, shaping decision making, shaping how resources are distributed. So I think, you know, step back from that. These, you know, quote unquote, stupid questions, like how does this work? So do we have control over the data? So what are the privacy implications of managing a agentic AI orchestration layer that relies on a slurry of data that is non differentiated and, you know, are there vulnerabilities there? How vulnerable is an LLM to a data extraction attack? And on and on and on, these are just basic questions that should be the floor, frankly, before entrusting critical decision making to obscure systems that are, you know, often don't, in my opinion, meet that bar for, you know, safety use in critical domains. - Right, when it's interesting, 'cause I feel like we've seen in some ways that sort of, you know, climbing that learning curve around things like social media or things like privacy where lawmakers have gotten much more sophisticated on it than where they were maybe 10 years ago. And you mentioned privacy, which I know is an issue you are primarily focused on, care a lot about. And I've covered the debate in Congress over data privacy legislation for a long time. Congress has not passed a comprehensive data privacy bill. Now we're in this AI era where our data is being used in even more kind of opaque ways. I wonder what protections you feel are needed or what Washington might be able to do when it comes to privacy in the AI era? - Yeah, I love privacy, obviously. And, you know, without privacy, we don't have the chance of a good life, right? If those with power over us have insight into every movement, every utterance, every relationship, every decision, you know, they have the power to weaponize that to oppress and manipulate and, you know, ultimately dominate. And, you know, that's not a theory, right? That's born out through history. So this is fundamentally important. And it's particularly important because we live in an age where we've seeded so much ground on that already. You know, I don't think knowingly, but I think under, you know, as the internet was being commercialized in the '90s, as key decisions were made not to put privacy restrictions in place for private companies that were commercializing network computation at that time, as the surveillance advertising business model was effectively inscribed as the economic engine of the internet in the '90s, a choice made by the Clinton administration, what you created was kind of a, you know, a surveillance flywheel in which not only were private companies that were, you know, building kind of the internet giants of the time that were commercializing the internet in the '90s and 2000s allowed to collect all of the data, they were incentivized to do it because their business model was ultimately advertising. Know your customer, collect as much data as you can to create models of people that you can then sell advertisers access to. And frankly, that is still the business model of the internet. It is still, you know, it is why open AI is looking at inserting ads. It is, you know, you become a massive platform and use that platform, you know, as a way to lure people in or conscript to them to participate and then collect data about them and sell people access to that data, monetize that data, whether it is training an AI model or creating advertising models that may or may not use AI, that remains the economic engine of the internet. And I think a key example here is Amazon sort of casting aside privacy scruples around Alexa and saying like, look, we're just sending all of your Alexa conversations back to Amazon for use because we're afraid we don't have enough data for AI. That dynamic is happening across the board and it is fundamentally threatening privacy, a threat that is now being supercharged by the introduction of so-called AI agents, which are presenting really, really potent privacy threats across our devices and across our digital lives. - I wanted to ask you about agentic AI because there are sort of unique privacy risks you've talked about there, tease that out for me a little bit. - Look, agentic AI is this sort of brand term that is being applied to a lot of different systems, but it is effectively referring to AI systems that promise to complete complex tasks on your behalf. So, you know, the example that I've given is, you know, something like a, you know, you'll hear the marketing, you know, what are the AI leaders on stage saying, you know, our new AI agent will be able to book a vacation for you and your college best friends, find a hotel, find plane tickets, find a date that works for everyone and then, you know, notify all your friends that this vacation is booked, right? And that's kind of, that's roughly the vision, whatever use case they market it with, it's kind of, you know, you can lay back and put your brain in a jar, as I've said, and the agent will do it for you. We all have robot butlers running around, attending to our every need. And that, you know, I guess that sounds fine. Like, I don't know, kind of a slug life doesn't sound very pleasant to me. I sometimes like deciding on a hotel, what's gonna be fun for me and my friends, the social process of planning together, right? Like, you know, there's more to life than laying limp while robots do things for us. But that fundamental issue aside, the reality of what is required to make a system like that work, again, at the material level of like, how TF does it actually do that is pretty chilling. Because what you're actually talking about, if you, you know, say had an agent running on your operating system, on your mobile device, and you say, hey agent, book that vacation for me, do all those things. Well, it's gonna require extraordinary permissions, root access, you know, to use a UNIX term for it. It's gonna have to be able to do a lot of things with your device. And it's gonna have to have a lot of access to data. So just like, let's go through that scenario, right? Like, book a vacation, well, it's gonna have to be able to open your web browser. It's gonna need your credit card information. It's gonna need permission to spend your money on your behalf. It's gonna need permission to, you know, make decisions about your travel, your frequent flyer number, you know, your calendar access, well, you know, access to whatever else is in your calendar in addition. And, you know, and now I'm speaking from a signals perspective, it's going to need to have access to your signal, to your contact list, to message your friends, your, you know, college friends in this case, on your behalf and tell them, hey, this is booked. - Right. - So all of that poses an existential privacy risk because what we just described in the context of signal and any other, you know, high security encrypted application running on that device is fundamentally a backdoor that is access to data through a, you know, very insecure system that has root access on your device that effectively nullifies the promise of our gold standard end-to-end encryption algorithm, which protects your signal messages, which means no one, but you and the people you're talking to, including signal, can look at and access those. And now there is a sort of a hole punched in the hole of that, you know, steamship of protection to use a little metaphor that is allowing not only agents, but anyone who wants to instrument that, you know, that backdoor, that vulnerability to access that data. And the way these are being rolled out is extraordinarily insecure. You're talking about creating just a sort of undifferentiated data slurry in which it's your calendar data, your signal data, et cetera. This is an existential threat to our collective security and privacy. And it is an existential threat to signal, you know, if this vision, which hasn't yet been fully realized, but we hear in the marketing speak of these companies, if this vision is realized, it's questionable whether signal can exist at all, whether there's a point in us existing. We do not want a world where signal can't exist. Militaries, journalists, governments, human rights workers, anyone with confidential information to share in a high-stakes situation uses signal. It's core infrastructure for the fundamental right to private communication. And if that's gone, there's no amount of autonomous agents that are gonna make up for that loss. (upbeat music) - You know, it seems like signal to me is in kind of a unique position here to be a voice in this conversation. Because even before, you know, the signal gate scandal, if you will, back in March, I mean, you must know that sort of all of Washington's covert communication happens on your app. People here know what it is and rely on it every day. - I just gotta say, we make it our business not to know. That's kind of our thing. - Fair point. - But yeah, we've heard received wisdom is literally everyone uses signal. And you meet someone, not just in Washington, but any government, any high-stakes job, and immediately they're like, let's connect on signal, right? So yeah, it's, you know, that's because it is the one thing we have to do that. And yeah, we are in a unique position where, you know, I'm really proud to be a signal. I think it's a great effort to be part of. And I'm an extremely lucky person to be able to do work that I believe in so deeply. But, you know, I think it's also, we should look around. Like why is there only one signal? Why is it so rare to be just a consistent and ethically aligned, you know, principled organization that does one thing well that protects fundamental rights? Like, you know, why is it that signal is such a core piece of, you know, let's say like military and governmental infrastructure, right? Everyone uses it, but, you know, militaries rely on it. And yet, you know, we're not able to even be a for-profit company because if we were a for-profit company in an industry where profit is made by collecting and monetizing data, then we would not be able to provide the level of rigorous privacy that we provide. So we have, you know, grifting mill tech companies that are basically white labeling, you know, Amazon API and reselling it with some janky user interface with billion-dollar valuations. And signal is, you know, raising money from good-hearted donors every year in order to survive. There is something fundamentally wrong with the model in tech. And I think signal is also the litmus for that. - Is that, I guess this is maybe predicting the future type question, but is that always the case? Is it always going to be the case that profitability is going to be at odds with privacy and security and some of these sort of core tenants of technology that people say they want, but yet we don't really have? - No, no, no, no, no, no, no. These are, you know, one, there's nothing, I don't believe in inevitability, right? This isn't just the natural order of things that, you know, we can always, rules were created, they can be recreated. That's just a Meredith ethos. But, you know, I do think we can kind of go back through the history and see key inflection points when I would say the wrong road was taken. And I referred to this obliquely at the beginning, but, you know, in the mid 1990s, when the rules of the road for commercializing the internet were being decided, you know, by the Clinton administration, there were, you know, two key decisions that were made. And I already mentioned them, you know, one was no privacy restrictions. The other was the, you know, business model of the internet would be advertising. And that ladder was pushed by the advertising industry because they didn't want to lose another platform, right? They had magazines, print media, they had TV, and they were like, well, we don't want to, you know, lose out on the internet. So, you know, let's push for that to be the business model instead of something like a public broadcasting model or a kind of community network model or, you know, any of the other many, many proposals that were on the table at that time. So, no, these were clear choices that were made that led us to this place. And, you know, any choice can be unmade then. So this is not, you know, this is not a fundamental tension. And I think going into the future, like you can always price in these things. The amount of money spent on cleaning up a data breach, the amount of money lost by IP theft, the amount of, you know, coercive control that your strategic negotiating points being leaked before you've made them enables. You know, you're knee-capped at the negotiating table at that point, right? Like privacy isn't just a nice little value that good people like, it's fucking fundamental. Sorry to swear political audience, but sometimes you need to. - You got to make the point. - Yeah, you know, the New Yorker and me just came out. So I think it's also like getting a bit real about this and sort of expanding our scope. Like quarterly returns may look good, but, you know, if in a year, we've just, you know, foreclosed on the company because, you know, our customers are fleeing because their data isn't safe, we're not doing a very good job of leading the company. We're not actually doing, you know, what is best for our profits. But, you know, I do think there needs to, you know, all of that aside, there needs to be a fundamental shift in the business model in tech. You know, this surveillance business model, which continues to be how money is made in tech, is pernicious and has led to a huge number of problems, including the kind of agentic AI threat that, you know, Signal and others have been naming. - So with these AI agent risks that you've identified, I mean, what do you see as the solution? What do you want to see happen? - Yeah, I mean, I think what I'm going to say now is what I would say is this is the floor. This is the minimum to ensure that Signal and other applications providing privacy at the application layer can survive and that we maintain, you know, some modicum of security and privacy, even as agents are being introduced. But this is certainly not everything we need. This is what we need right now as the tourniquet we apply to, you know, stop the bleeding out. So, you know, at first we need developer control. Application developers like Signal need to be able to say no, we're going to mark our application as sensitive or whatever it is. And that means it's off limits to agents. Second, we need, what I would say is radical transparency. And right now we have almost no transparency, you know, there are vague assurances, there's marketing speak, but that's about what we know about what data these agents are accessing or what level they're being implemented at. It's, you know, often very, very confusing to piece this together. So we need clear and precise documentation about what data agents are accessing, how it's used, how it's stored, where is it processed on device or off device, what security measures are in place. And really this should be, you know, a standardized rubric that every developer fills out as a matter of course, similar to a data sheet. And then we need, you know, we also need, I would say privacy by default. So, you know, off should be the default setting for agentic access. And users should be able to opt in to where they're comfortable giving these agents access, if at all. And then finally, we need much more hardened operating system designs. If we're going to proceed in any way close to this agentic rollout at the operating system level, then we need fundamental design changes to shield data from agents, to improve sandboxing and to improve security guarantees, which are simply not in place right now, given the rush to roll out. So again, that's the minimum necessary that is certainly not the full extent of remediations. But I think we urgently need those and we need policymakers, technologists, AI leaders, all of them to be pushing in the same direction to make sure we don't poison our technical infrastructure in the name of trying to make a return on investment in the middle of an AI bubble. - I wanna ask you also about tech culture, because I do think there's like a cultural component to how our technology is conceived and made that sometimes gets overlooked. - Wait, tech has culture? - Right, the tech has a culture, right? And it is sometimes it's kind of like an anthropologist. I'm like sort of studying and trying to understand this tech species. But I believe you're based in Paris now. I know you've been in Silicon Valley though for a lot of your career. And culturally speaking, Silicon Valley has always felt like a world away from Washington. Nowadays, those two worlds do seem to be more intertwined than ever and a lot of headlines have been made about this idea of like the rise of the tech right and sort of this swing towards Trumpism among some Silicon Valley elite post-Biden administration. I wonder the conversations you still have in tech and what you observed, does it feel like there has been a palpable shift to you or was this something that was already there but just kind of in the shadows? - Well, look, all cracks aside, like yeah, tech does have a culture and when I joined in the mid-2000s, yeah, it had issues, it was homogeneous, it was narrowly scoped in terms of an expertise level but it was warm and friendly and creative in a lot of ways. Some of the most intellectually generous people I met were people who were just deeply interested in math and computers and what you could do in the world with those and then it become the money industry and all the kids who would have become doctors and lawyers in the '90s and early 2000s because they wanted to get a good paying job or finance suddenly went into engineering and that did change the nature of the industry as I experienced it, right? You were bringing in all the McKinsey people, you were bringing in the money people and that sort of wooly quality of creativity and experimentation went the way it goes when that happens and then the bottom line became increasingly prominent as the objective of these companies. Now, it was always the objective but I think it was padded a little back in the day and what I will say to that is, I think tech culture from then at least has kind of followed the political winds. I was working at Google during the Obama election, I was working there through the first Trump election and at each presidential election, what you would see is something really clear. The policy shop would basically get rid of the people who were yoked to the old guy and bring in the people who are close to the new guy and rearrange their positions, get as close to power as possible, move to Versailles to be close to Louis XIV because you got to be close to power, right? It's pretty old in terms of a rule book and at that time, tech was extraordinarily close to the Obama administration. It was an osmotic layer is putting it a little strongly. It was almost no layer at all back and forth between Obama and Google and all of these companies and that was celebrated because it was seen, Google is virtuous and it's bringing virtuous tech to DC and it's generally liberal, et cetera, et cetera. So I don't see what's happening now as necessarily different in terms of the structural dynamics. They're doing what they do, which is get as close to power as possible and then bend themselves to please power to get what they want. What I do think this is showing is that that's a very dangerous archetype if what you're talking about is trusting an actor who's going to swing in the political winds from left to right to center to up to down just to get close to power and they have the most vulnerable and sensitive data on your life. They have control over decisions made by your core institutions. They are running your government's core infrastructure and yet they're bending to the winds of political whim this way and that way. And I think part of the alarm is just recognizing like, oh, shit, that doesn't seem healthy or safe. And to which I'll say, yeah, it's not healthy and safe. It's actually incredibly perilous. And that is one more pressure that sort of leads to our kind of first discussion of like, are people becoming disaffected with big tech? And I think the answer is yes, increasingly. - The other aspect of tech culture that honestly is always fascinated me and you know this better than most is the kind of resistance culture, outspoken culture that for a long time existed at tech companies. And for those who don't know, you worked at Google for 13 years, you left back in 2019 after leading a number of walkouts and protests around some of the company's policies on things like AI ethics and military contracts. And it wasn't just Google, but during the first Trump administration, I covered a lot of pushback in Silicon Valley to Trump's policies on things like immigration or climate and defense. I don't see any of that this time around. And I guess I wonder, you know, if Silicon Valley's kind of resistance culture is dead. - I can only speak to my own experience, which was, you know, I joined Google in 2006, right out of college. And what I found was, frankly, one of the smartest environments I've ever been in, where there was just a tacit understanding that if you want really, really, really smart people working on your behalf, you got to let them think, you got to let them cook, you got to let them talk. You got to encourage a culture of sharing ideas. If you are at the table and you aren't raising key points and you aren't pushing back to make sure you understand an issue or a question, you aren't raising a problem that you see with that, then you're going to be kicked off the table. That was the culture that I joined. And it manifested in, you know, very rowdy mailing lists where people would debate any old topic. It manifested in a willingness to, you know, frankly question leadership at weekly meetings where Larry and Sergey and others would stand on stage and it was celebrated. And now, you know, obviously that didn't, you know, power plays and dynamics and hierarchies and, you know, sycophancy all plays a part in structures like that. But I would say that was, you know, it was much more like that than most environments I'd ever been in. And that was part of its success. And so, you know, in a sense, the sort of work that was pushing back on, you know, some of these business decisions was an extension of a culture that had existed for a very long time and that had, you know, I would say made Google dominant in many ways because it was selecting for people who were, you know, staunch about their analysis, who were demanded citations and demanded rigorous thinking. And that manifested also in demanding that from leadership and saying, you know, what are you doing? Building drone targeting programs, you know, using AI that we know doesn't work. What are you doing? You know, yoking the fortunes of a massive surveillance company with so much intimate information to one nation's military in a way that historically we know could be very, very dangerous for the people whose information you're stewarding, you know, questioning these decisions at a structural level. You know, again, that was a kind of core Google thing for a long time. But, you know, as you begin to hire the McKinsey types, as you begin to be more and more focused on that bottom line as the, you know, horizon of trade-offs, as I put it, grows nearer, right? And you have to decide between trading, you know, leaving billions of dollars on the table or, you know, and sticking to your kind of moral compass or bending your moral compass, increasingly the latter dominated. And I think that is just, you know, part of the cultural shift that I saw at Google. And, you know, again, that's, you know, I think that is one of the key problems with entrusting such serious, you know, entrusting such serious functions, you know, decision-making, you know, infrastructural control, the platforms that support our shared information ecosystem that are sort of eating up the media industry, all of this, two companies that are ultimately primarily invested in ensuring that their bottom line grows, that revenues increase, that, you know, profits are made, that growth is persistent. And, you know, again, I think we're facing this head-on and I do think people are becoming more and more disaffected. - Listen, Meredith, fascinating conversation. Thank you so much for being here on Politico Tech. - Thank you, this has been great. - That's all for this week's Politico Tech. If you liked the show, be sure to subscribe. And for more tech news, subscribe to our newsletters. Digital Future Daily and Morning Tech. Our producer is Normo Malikul. Pan Bandy made our theme music. I'm Stephen Overlay. See you back here next week.

Podcast Summary

Key Points:

  1. Signal Gate scandal involved senior U.S. officials using the messaging app for communication regarding military actions.
  2. Meredith Whitaker, president of Signal Foundation, discusses AI, privacy concerns, and tech culture.
  3. The discussion covers the risks of agentic AI, privacy threats, and the impact of AI on society and decision-making.

Summary:

The transcription features an interview with Meredith Whitaker, president of Signal Foundation, discussing various topics related to tech, AI, privacy, and policy. S. officials, Meredith's concerns about the end of privacy, and the influence of tech culture on politics.

Additionally, the discussion touches on the rise of AI agents and the inherent risks they pose to privacy and security, emphasizing the need for policymakers to better understand the technology they are regulating. The interview highlights the critical importance of privacy in the age of AI, with a focus on the potential threats posed by agentic AI systems and the implications for data security and encryption. Overall, the conversation sheds light on the complex interplay between technology, privacy, policy, and societal implications in the modern digital landscape.

FAQs

Senior U.S. officials used a messaging app to discuss a military strike in Yemen and unintentionally included a journalist in the chat.

Meredith Whitaker is the president of Signal Foundation and a former Google employee known for criticizing Silicon Valley on privacy and AI ethics.

There are worries about vulnerability when key services go down, the dominance of a few tech companies in daily life, and conflicts between profit-driven decisions and societal interests.

Policymakers lack clear understanding of AI, leading to decisions based on hype and magical thinking, without considering technical realities and implications.

Privacy is crucial to prevent misuse of power, oppression, and manipulation by those with access to personal data, especially in a digital age with extensive data collection and AI technologies.

Agentic AI systems with extensive permissions pose privacy risks by potentially accessing sensitive data, creating backdoors, and threatening encrypted communication like in the case of Signal.

Chat with AI

Loading...

Pro features

Go deeper with this episode

Unlock creator-grade tools that turn any transcript into show notes and subtitle files.