Signal’s Meredith Whittaker on AI hype and the end of privacy
41m 7s
The transcription features an interview with Meredith Whitaker, president of Signal Foundation, discussing various topics related to tech, AI, privacy, and policy. The conversation delves into the Signal Gate scandal involving the use of Signal by U.S. officials, Meredith's concerns about the end of privacy, and the influence of tech culture on politics. Additionally, the discussion touches on the rise of AI agents and the inherent risks they pose to privacy and security, emphasizing the need for policymakers to better understand the technology they are regulating. The interview highlights the critical importance of privacy in the age of AI, with a focus on the potential threats posed by agentic AI systems and the implications for data security and encryption. Overall, the conversation sheds light on the complex interplay between technology, privacy, policy, and societal implications in the modern digital landscape.
Transcription
6365 Words, 36420 Characters
(upbeat music)
- Hey, welcome back to Politico Tech.
I'm your host, Steven Overly,
and on this show, I break down tech, politics, and policy
with the people shaping our digital future.
If you don't use Signal,
you certainly heard about Signal Gate.
That was the scandal back in March
when senior U.S. officials used a messaging app
to communicate about military strike in Yemen
and inadvertently included a journalist in the chat.
That event thrust Signal
and Signal Foundation president, Meredith Whitaker,
into the spotlight.
But Meredith has been in the headlines before.
As a former Google employee,
who in recent years has stepped out
as a vocal critic of the way Silicon Valley
handles privacy, AI ethics, and more.
On the show today, Meredith and I delve into
the rise of AI agents,
why she fears the end of privacy,
and how tech culture is changing politics.
Here's our conversation.
Meredith, welcome to Politico Tech.
- Hi, it is so great to be here, thank you.
- I actually wanna start, if I can, with a prediction.
I remember reading nearly a year ago now in Wired,
where you had wrote that in 2025,
it would be the beginning of the end for big tech.
Tech giants have sort of lost their appeal
with politicians and with venture capitalists alike.
I wonder, looking back as we approached
the end of the year, do you still believe that's the case?
- Well, to be honest, two things were going on there.
Wired asked me for a prediction piece,
and I said, "Do you mind if I write a manifestation?"
And they said, "We don't really have a headline for that."
So I was like, "Snucka, kind of, let's manifest this."
Under the headline of a prediction.
So I wasn't completely convinced that that would happen,
but I do think that's the direction of travel.
I think that increasingly there is more and more awareness,
not just among policymakers, politicians, business leaders,
about the dangerous dependency on centralized big tech,
but this awareness is creeping out into the public
just yesterday, and we're recording this
on Tuesday, October 21st, 2025 for listeners in the future.
But just yesterday, a large part
of Amazon's infrastructure went down,
taking huge sections of our online services
and infrastructures offline.
And this is a kind of allowed reminder
of what is quietly problematic at every other point,
which is that we depend for so much of our daily lives,
our social functions, our governmental operations,
every corporation in the world,
you name it, on a handful of companies
that have quietly come to dominate
the nervous system of our lives and institutions,
and that when these companies have a massive failure,
as happened yesterday with Amazon,
or as happened a little over a year ago
with Microsoft's Cloud Strike Outage,
which similarly took down core infrastructure
around the world, we are reminded
of just how vulnerable we are, but every single day,
we are made vulnerable in quieter ways
that may not be as apparent from an update in an AI model,
like GPT-4 to GPT-5 that fundamentally changes behavior
or an update in pricing that means we're locked in
to paying more because we don't have alternatives
that we should have or determinations
about which governments these companies
are going to work for, and on and on and on,
we have ceded control of so much of our lives
to a handful of companies in a way
that I think is only becoming more apparent.
And that's just the first part.
I think we can also look at some of the decisions
that are being made by these companies
as they pursue what is ultimately their key objective,
which is continued growth and continued increase in profits
to please their board, to please their shareholders,
and that that imperative is often at odds
with what would be better for society,
what would be better for the social good,
and that collision is becoming more and more apparent.
And I do think people across the board
are waking up to it, and we haven't even mentioned
the kind of tenuous AI bubble we're in.
So no, I don't think that is happening.
Immediately, I don't see a complete turnaround,
but I do see those dynamics marching forward,
and I see an increasing discomfort
as we see an increasingly over-leveraged market in AI
that leads me to think I was on to something.
- Well, I don't disagree with being honest,
I think I mean, the AWS outage example is a great one,
'cause literally yesterday when that outage happened,
like it started in the morning
where I couldn't order my bagel, which I now do online,
and then I couldn't send a work invite
because the software platform runs on AWS.
And at night, I couldn't log into a portal
for a class I teach, 'cause that also runs on AWS.
And it just sort of is illustrative
of our dependence on technology,
but then as you said, how so many of our,
the technologies we use are powered by few companies.
AI though, as you're saying,
and I'm curious to get your thoughts on this idea
of being in an AI bubble,
from the perspective here in Washington,
it has created something of a renaissance for tech,
because when you talk to policymakers,
whether it's about energy policy or national security
or economic competitiveness,
I mean, AI is inevitably part of that equation.
Sometimes it's a big part of the equation.
And I wonder what you make of that,
that impact that AI is now having on this.
- Well, look, AI is many things
and it certainly has uses,
but I would dare you or anyone listening
who has contacts with policymakers and politicians
to just sit them down and say, what do you mean by AI?
Let them answer that question in clear and precise terms.
And I think what you'll get at that point
is a lot of hype, a lot of fog,
a lot of magical thinking,
where people who don't have a rigorous technical background,
who don't understand the material realities of these systems,
the energy, the infrastructure dependencies,
the layers of open source software
on which everything relies,
the cost, the political economy of building these systems,
give kind of hand wavy answers
that sound more like they're talking about a magical genie
than about actual technical systems.
And that's a big problem
because we are seeing a wave of hype
washing over critical institutions, governments,
and key decision makers
that are leading to decisions being made
to outsource decision making to technology
to trust these technologies with key functions
that those who understand the technical reality,
the limitations, the fundamental threshold conditions
for how these actually work would never have advised.
And that does get us to discussing a bubble
because the reality is however you slice it,
yes, revenues are very, very high.
There's a lot of money in coming to license AI models
from the likes of open AI or Google or Anthropic.
People are paying to do that,
but the cost of training AI,
the cost of building out these data centers,
the cost of inference,
which is the term we use for kind of using AI
every time you send a prompt
and it sends back a wall of text,
you've done an inference,
that cost is still not being recouped.
There is no break even happening in this industry.
So you were seeing what I've referred to
as kind of a flop sweat desperation to make AI happen,
not just as a cultural zeitgeist or a renaissance,
as you said, but as a profit center,
and that has not happened yet.
And so the bubble is getting more taught,
there's more and more air going into the balloon,
but as yet that magical consumer market fit
that can actually recoup these investments
in let's be real, highly depreciable infrastructure
that will need to be purchased again
and again and again as chips change,
we're not seeing a profit there.
And I think that has some explanatory power
for just how phantasmagoric the rhetoric
and the promises being made are,
because again, there's a bit of desperation behind this.
- Well, what's the antidote to that then?
Do you think we have policymakers
who listen to the podcast?
I mean, it is easy to get caught up in the hype around AI,
all the big promises, especially of policy challenges
it will fix like healthcare, climate change,
or anything that the industry throws out
as sort of the positives here.
And you also always hear this argument
that Washington or policymakers
don't understand the technology well enough
to regulate it or put guardrails on it.
And I don't know that I've ever heard the solve
for that necessarily.
- Yeah, that old trope that all you need
is tech brains in Washington to move aside
the dusty policymakers and get things on,
the rails of modernization has been around
for a very long time.
I remember this in the mid 2000s.
It was, you know, bring tech to Washington
because they're too old and crusty to understand it.
Yeah, okay. - Right.
- But I think, you know,
they're not too old or too crusty to understand
the domains in which they operate,
be that education or healthcare or national security.
And tech has a lot to learn
on the fundamentals of those domains.
So I think, you know, in some sense,
there is a, it is very convenient for those building tech
to say move aside, we're the only ones
who are both able to build this
and to instruct how it should be applied.
Right? - Yeah.
- Now, I'm gonna say like the antidote,
there's no one weird trick here.
But I do think, and this may seem a bit
of a sideways answer,
that just be brave enough to ask the dumb question.
Because there is a culture of, you know,
what I'll call a culture of shame
around technical knowledge.
People are deeply afraid of being humiliated
for being dumb about AI.
AI is the future, AI is the renaissance,
it's the revolution, it's not just the industrial revolution,
it's also the invention of fire to quote Sundar Pichai.
It's that important.
And yet people don't feel like
they have a clear grasp on it.
And I will hear, you know, NATO chiefs,
I will hear CEOs of Fortune 100 corporations
sort of repeating as received wisdom
claims about AI that make absolutely no sense.
And that in the context of any other technology
or any other, you know, presentation to their board,
they would be ripping apart
because they understood that they have standing.
They understood that they need to be a, you know,
they need to protect their company.
They need to protect their interests.
They need to equip themselves honorably in their job.
And yet we don't see that with AI.
We see, you know, folks talking to the marketing arm
or the, you know, one or another executive
of a given AI company,
acting as if that is ground truth for technical knowledge
and then repeating it as if it's an imperative
in, you know, the context of shaping policy,
shaping decision making,
shaping how resources are distributed.
So I think, you know, step back from that.
These, you know, quote unquote, stupid questions,
like how does this work?
So do we have control over the data?
So what are the privacy implications
of managing a agentic AI orchestration layer
that relies on a slurry of data that is non differentiated
and, you know, are there vulnerabilities there?
How vulnerable is an LLM to a data extraction attack?
And on and on and on, these are just basic questions
that should be the floor, frankly,
before entrusting critical decision making
to obscure systems that are, you know,
often don't, in my opinion,
meet that bar for, you know,
safety use in critical domains.
- Right, when it's interesting,
'cause I feel like we've seen in some ways
that sort of, you know, climbing that learning curve
around things like social media or things like privacy
where lawmakers have gotten much more sophisticated on it
than where they were maybe 10 years ago.
And you mentioned privacy,
which I know is an issue you are primarily focused on,
care a lot about.
And I've covered the debate in Congress
over data privacy legislation for a long time.
Congress has not passed a comprehensive data privacy bill.
Now we're in this AI era where our data is being used
in even more kind of opaque ways.
I wonder what protections you feel are needed
or what Washington might be able to do
when it comes to privacy in the AI era?
- Yeah, I love privacy, obviously.
And, you know, without privacy,
we don't have the chance of a good life, right?
If those with power over us have insight
into every movement, every utterance,
every relationship, every decision,
you know, they have the power to weaponize that
to oppress and manipulate
and, you know, ultimately dominate.
And, you know, that's not a theory, right?
That's born out through history.
So this is fundamentally important.
And it's particularly important
because we live in an age
where we've seeded so much ground on that already.
You know, I don't think knowingly,
but I think under, you know,
as the internet was being commercialized in the '90s,
as key decisions were made not to put privacy restrictions
in place for private companies
that were commercializing network computation at that time,
as the surveillance advertising business model
was effectively inscribed as the economic engine
of the internet in the '90s,
a choice made by the Clinton administration,
what you created was kind of a, you know,
a surveillance flywheel in which not only
were private companies that were, you know,
building kind of the internet giants of the time
that were commercializing the internet
in the '90s and 2000s allowed to collect all of the data,
they were incentivized to do it
because their business model was ultimately advertising.
Know your customer, collect as much data as you can
to create models of people
that you can then sell advertisers access to.
And frankly, that is still the business model
of the internet.
It is still, you know,
it is why open AI is looking at inserting ads.
It is, you know, you become a massive platform
and use that platform, you know,
as a way to lure people in or conscript to them
to participate and then collect data about them
and sell people access to that data, monetize that data,
whether it is training an AI model
or creating advertising models that may or may not use AI,
that remains the economic engine of the internet.
And I think a key example here is Amazon
sort of casting aside privacy scruples around Alexa
and saying like, look,
we're just sending all of your Alexa conversations
back to Amazon for use because we're afraid
we don't have enough data for AI.
That dynamic is happening across the board
and it is fundamentally threatening privacy,
a threat that is now being supercharged
by the introduction of so-called AI agents,
which are presenting really, really potent privacy threats
across our devices and across our digital lives.
- I wanted to ask you about agentic AI
because there are sort of unique privacy risks
you've talked about there, tease that out
for me a little bit.
- Look, agentic AI is this sort of brand term
that is being applied to a lot of different systems,
but it is effectively referring to AI systems
that promise to complete complex tasks on your behalf.
So, you know, the example that I've given is, you know,
something like a, you know, you'll hear the marketing,
you know, what are the AI leaders on stage saying, you know,
our new AI agent will be able to book a vacation
for you and your college best friends,
find a hotel, find plane tickets,
find a date that works for everyone
and then, you know, notify all your friends
that this vacation is booked, right?
And that's kind of, that's roughly the vision,
whatever use case they market it with, it's kind of, you know,
you can lay back and put your brain in a jar, as I've said,
and the agent will do it for you.
We all have robot butlers running around,
attending to our every need.
And that, you know, I guess that sounds fine.
Like, I don't know, kind of a slug life
doesn't sound very pleasant to me.
I sometimes like deciding on a hotel,
what's gonna be fun for me and my friends,
the social process of planning together, right?
Like, you know, there's more to life than laying limp
while robots do things for us.
But that fundamental issue aside,
the reality of what is required to make a system
like that work, again, at the material level of like,
how TF does it actually do that is pretty chilling.
Because what you're actually talking about,
if you, you know, say had an agent running
on your operating system, on your mobile device,
and you say, hey agent, book that vacation for me,
do all those things.
Well, it's gonna require extraordinary permissions,
root access, you know, to use a UNIX term for it.
It's gonna have to be able to do a lot of things
with your device.
And it's gonna have to have a lot of access to data.
So just like, let's go through that scenario, right?
Like, book a vacation, well, it's gonna have to be able
to open your web browser.
It's gonna need your credit card information.
It's gonna need permission to spend your money on your behalf.
It's gonna need permission to, you know,
make decisions about your travel, your frequent flyer number,
you know, your calendar access, well, you know,
access to whatever else is in your calendar in addition.
And, you know, and now I'm speaking
from a signals perspective,
it's going to need to have access to your signal,
to your contact list, to message your friends,
your, you know, college friends in this case,
on your behalf and tell them, hey, this is booked.
- Right.
- So all of that poses an existential privacy risk
because what we just described in the context of signal
and any other, you know, high security encrypted application
running on that device is fundamentally a backdoor
that is access to data through a, you know,
very insecure system that has root access on your device
that effectively nullifies the promise
of our gold standard end-to-end encryption algorithm,
which protects your signal messages, which means no one,
but you and the people you're talking to,
including signal, can look at and access those.
And now there is a sort of a hole punched in the hole
of that, you know, steamship of protection
to use a little metaphor that is allowing not only agents,
but anyone who wants to instrument that, you know,
that backdoor, that vulnerability to access that data.
And the way these are being rolled out
is extraordinarily insecure.
You're talking about creating
just a sort of undifferentiated data slurry
in which it's your calendar data, your signal data, et cetera.
This is an existential threat
to our collective security and privacy.
And it is an existential threat to signal, you know,
if this vision, which hasn't yet been fully realized,
but we hear in the marketing speak of these companies,
if this vision is realized,
it's questionable whether signal can exist at all,
whether there's a point in us existing.
We do not want a world where signal can't exist.
Militaries, journalists, governments, human rights workers,
anyone with confidential information to share
in a high-stakes situation uses signal.
It's core infrastructure
for the fundamental right to private communication.
And if that's gone,
there's no amount of autonomous agents
that are gonna make up for that loss.
(upbeat music)
- You know, it seems like signal to me
is in kind of a unique position here
to be a voice in this conversation.
Because even before, you know,
the signal gate scandal, if you will, back in March,
I mean, you must know that sort of all
of Washington's covert communication happens on your app.
People here know what it is and rely on it every day.
- I just gotta say, we make it our business not to know.
That's kind of our thing.
- Fair point.
- But yeah, we've heard received wisdom
is literally everyone uses signal.
And you meet someone, not just in Washington,
but any government, any high-stakes job,
and immediately they're like, let's connect on signal, right?
So yeah, it's, you know,
that's because it is the one thing we have to do that.
And yeah, we are in a unique position
where, you know, I'm really proud to be a signal.
I think it's a great effort to be part of.
And I'm an extremely lucky person to be able to do work
that I believe in so deeply.
But, you know, I think it's also, we should look around.
Like why is there only one signal?
Why is it so rare to be just a consistent
and ethically aligned, you know, principled organization
that does one thing well
that protects fundamental rights?
Like, you know, why is it that signal is such a core piece
of, you know, let's say like military
and governmental infrastructure, right?
Everyone uses it, but, you know, militaries rely on it.
And yet, you know, we're not able
to even be a for-profit company
because if we were a for-profit company
in an industry where profit is made by collecting
and monetizing data,
then we would not be able to provide the level
of rigorous privacy that we provide.
So we have, you know, grifting mill tech companies
that are basically white labeling, you know, Amazon API
and reselling it with some janky user interface
with billion-dollar valuations.
And signal is, you know, raising money
from good-hearted donors every year in order to survive.
There is something fundamentally wrong
with the model in tech.
And I think signal is also the litmus for that.
- Is that, I guess this is maybe predicting
the future type question, but is that always the case?
Is it always going to be the case
that profitability is going to be at odds
with privacy and security
and some of these sort of core tenants of technology
that people say they want, but yet we don't really have?
- No, no, no, no, no, no, no.
These are, you know, one, there's nothing,
I don't believe in inevitability, right?
This isn't just the natural order of things that,
you know, we can always, rules were created,
they can be recreated.
That's just a Meredith ethos.
But, you know, I do think we can kind of go back
through the history and see key inflection points
when I would say the wrong road was taken.
And I referred to this obliquely at the beginning,
but, you know, in the mid 1990s,
when the rules of the road for commercializing the internet
were being decided, you know, by the Clinton administration,
there were, you know, two key decisions that were made.
And I already mentioned them, you know,
one was no privacy restrictions.
The other was the, you know, business model
of the internet would be advertising.
And that ladder was pushed by the advertising industry
because they didn't want to lose another platform, right?
They had magazines, print media, they had TV,
and they were like, well, we don't want to, you know,
lose out on the internet.
So, you know, let's push for that to be the business model
instead of something like a public broadcasting model
or a kind of community network model
or, you know, any of the other many, many proposals
that were on the table at that time.
So, no, these were clear choices that were made
that led us to this place.
And, you know, any choice can be unmade then.
So this is not, you know, this is not a fundamental tension.
And I think going into the future,
like you can always price in these things.
The amount of money spent on cleaning up a data breach,
the amount of money lost by IP theft,
the amount of, you know, coercive control
that your strategic negotiating points being leaked
before you've made them enables.
You know, you're knee-capped at the negotiating table
at that point, right?
Like privacy isn't just a nice little value
that good people like, it's fucking fundamental.
Sorry to swear political audience,
but sometimes you need to.
- You got to make the point.
- Yeah, you know, the New Yorker and me just came out.
So I think it's also like getting a bit real about this
and sort of expanding our scope.
Like quarterly returns may look good,
but, you know, if in a year,
we've just, you know, foreclosed on the company
because, you know, our customers are fleeing
because their data isn't safe,
we're not doing a very good job of leading the company.
We're not actually doing, you know,
what is best for our profits.
But, you know, I do think there needs to, you know,
all of that aside, there needs to be a fundamental shift
in the business model in tech.
You know, this surveillance business model,
which continues to be how money is made in tech,
is pernicious and has led to a huge number of problems,
including the kind of agentic AI threat
that, you know, Signal and others have been naming.
- So with these AI agent risks that you've identified,
I mean, what do you see as the solution?
What do you want to see happen?
- Yeah, I mean, I think what I'm going to say now
is what I would say is this is the floor.
This is the minimum to ensure that Signal
and other applications providing privacy
at the application layer can survive
and that we maintain, you know,
some modicum of security and privacy,
even as agents are being introduced.
But this is certainly not everything we need.
This is what we need right now
as the tourniquet we apply to, you know,
stop the bleeding out.
So, you know, at first we need developer control.
Application developers like Signal
need to be able to say no,
we're going to mark our application as sensitive
or whatever it is.
And that means it's off limits to agents.
Second, we need, what I would say is radical transparency.
And right now we have almost no transparency, you know,
there are vague assurances, there's marketing speak,
but that's about what we know
about what data these agents are accessing
or what level they're being implemented at.
It's, you know, often very, very confusing
to piece this together.
So we need clear and precise documentation
about what data agents are accessing,
how it's used, how it's stored,
where is it processed on device or off device,
what security measures are in place.
And really this should be, you know,
a standardized rubric that every developer
fills out as a matter of course, similar to a data sheet.
And then we need, you know, we also need,
I would say privacy by default.
So, you know, off should be the default setting
for agentic access.
And users should be able to opt in
to where they're comfortable giving these agents access,
if at all.
And then finally, we need much more hardened
operating system designs.
If we're going to proceed in any way close
to this agentic rollout at the operating system level,
then we need fundamental design changes
to shield data from agents, to improve sandboxing
and to improve security guarantees,
which are simply not in place right now,
given the rush to roll out.
So again, that's the minimum necessary
that is certainly not the full extent of remediations.
But I think we urgently need those
and we need policymakers, technologists, AI leaders,
all of them to be pushing in the same direction
to make sure we don't poison our technical infrastructure
in the name of trying to make a return on investment
in the middle of an AI bubble.
- I wanna ask you also about tech culture,
because I do think there's like a cultural component
to how our technology is conceived and made
that sometimes gets overlooked.
- Wait, tech has culture?
- Right, the tech has a culture, right?
And it is sometimes it's kind of like an anthropologist.
I'm like sort of studying
and trying to understand this tech species.
But I believe you're based in Paris now.
I know you've been in Silicon Valley though
for a lot of your career.
And culturally speaking, Silicon Valley
has always felt like a world away from Washington.
Nowadays, those two worlds do seem to be more intertwined
than ever and a lot of headlines have been made
about this idea of like the rise of the tech right
and sort of this swing towards Trumpism
among some Silicon Valley elite post-Biden administration.
I wonder the conversations you still have
in tech and what you observed,
does it feel like there has been a palpable shift to you
or was this something that was already there
but just kind of in the shadows?
- Well, look, all cracks aside,
like yeah, tech does have a culture
and when I joined in the mid-2000s,
yeah, it had issues, it was homogeneous,
it was narrowly scoped in terms of an expertise level
but it was warm and friendly and creative in a lot of ways.
Some of the most intellectually generous people I met
were people who were just deeply interested in math
and computers and what you could do in the world with those
and then it become the money industry
and all the kids who would have become doctors and lawyers
in the '90s and early 2000s
because they wanted to get a good paying job or finance
suddenly went into engineering
and that did change the nature of the industry
as I experienced it, right?
You were bringing in all the McKinsey people,
you were bringing in the money people
and that sort of wooly quality of creativity
and experimentation went the way it goes when that happens
and then the bottom line became increasingly prominent
as the objective of these companies.
Now, it was always the objective
but I think it was padded a little back in the day
and what I will say to that is,
I think tech culture from then at least
has kind of followed the political winds.
I was working at Google during the Obama election,
I was working there through the first Trump election
and at each presidential election,
what you would see is something really clear.
The policy shop would basically get rid of the people
who were yoked to the old guy
and bring in the people who are close to the new guy
and rearrange their positions,
get as close to power as possible,
move to Versailles to be close to Louis XIV
because you got to be close to power, right?
It's pretty old in terms of a rule book
and at that time,
tech was extraordinarily close to the Obama administration.
It was an osmotic layer is putting it a little strongly.
It was almost no layer at all back and forth
between Obama and Google and all of these companies
and that was celebrated because it was seen,
Google is virtuous and it's bringing virtuous tech to DC
and it's generally liberal, et cetera, et cetera.
So I don't see what's happening now
as necessarily different in terms of the structural dynamics.
They're doing what they do,
which is get as close to power as possible
and then bend themselves to please power
to get what they want.
What I do think this is showing is that
that's a very dangerous archetype
if what you're talking about is trusting an actor
who's going to swing in the political winds
from left to right to center to up to down
just to get close to power
and they have the most vulnerable and sensitive data
on your life.
They have control over decisions
made by your core institutions.
They are running your government's core infrastructure
and yet they're bending to the winds of political whim
this way and that way.
And I think part of the alarm is just recognizing like,
oh, shit, that doesn't seem healthy or safe.
And to which I'll say, yeah, it's not healthy and safe.
It's actually incredibly perilous.
And that is one more pressure that sort of leads
to our kind of first discussion of like,
are people becoming disaffected with big tech?
And I think the answer is yes, increasingly.
- The other aspect of tech culture
that honestly is always fascinated me
and you know this better than most
is the kind of resistance culture, outspoken culture
that for a long time existed at tech companies.
And for those who don't know,
you worked at Google for 13 years,
you left back in 2019 after leading a number of walkouts
and protests around some of the company's policies
on things like AI ethics and military contracts.
And it wasn't just Google,
but during the first Trump administration,
I covered a lot of pushback in Silicon Valley
to Trump's policies on things like immigration
or climate and defense.
I don't see any of that this time around.
And I guess I wonder, you know,
if Silicon Valley's kind of resistance culture is dead.
- I can only speak to my own experience, which was,
you know, I joined Google in 2006, right out of college.
And what I found was,
frankly, one of the smartest environments I've ever been in,
where there was just a tacit understanding
that if you want really, really, really smart people
working on your behalf, you got to let them think,
you got to let them cook, you got to let them talk.
You got to encourage a culture of sharing ideas.
If you are at the table and you aren't raising key points
and you aren't pushing back to make sure you understand
an issue or a question, you aren't raising a problem
that you see with that,
then you're going to be kicked off the table.
That was the culture that I joined.
And it manifested in, you know, very rowdy mailing lists
where people would debate any old topic.
It manifested in a willingness to, you know,
frankly question leadership at weekly meetings
where Larry and Sergey and others would stand on stage
and it was celebrated.
And now, you know, obviously that didn't, you know,
power plays and dynamics and hierarchies
and, you know, sycophancy all plays a part
in structures like that.
But I would say that was, you know,
it was much more like that
than most environments I'd ever been in.
And that was part of its success.
And so, you know, in a sense, the sort of work
that was pushing back on, you know,
some of these business decisions was an extension
of a culture that had existed for a very long time
and that had, you know, I would say made Google dominant
in many ways because it was selecting for people
who were, you know, staunch about their analysis,
who were demanded citations
and demanded rigorous thinking.
And that manifested also in demanding that from leadership
and saying, you know, what are you doing?
Building drone targeting programs, you know, using AI
that we know doesn't work.
What are you doing?
You know, yoking the fortunes of a massive surveillance company
with so much intimate information
to one nation's military in a way that historically
we know could be very, very dangerous
for the people whose information you're stewarding,
you know, questioning these decisions at a structural level.
You know, again, that was a kind of core Google thing
for a long time.
But, you know, as you begin to hire the McKinsey types,
as you begin to be more and more focused on that bottom line
as the, you know, horizon of trade-offs, as I put it,
grows nearer, right?
And you have to decide between trading, you know,
leaving billions of dollars on the table or, you know,
and sticking to your kind of moral compass
or bending your moral compass,
increasingly the latter dominated.
And I think that is just, you know,
part of the cultural shift that I saw at Google.
And, you know, again, that's, you know,
I think that is one of the key problems
with entrusting such serious, you know,
entrusting such serious functions, you know,
decision-making, you know, infrastructural control,
the platforms that support our shared information ecosystem
that are sort of eating up the media industry,
all of this, two companies that are ultimately
primarily invested in ensuring that their bottom line grows,
that revenues increase, that, you know, profits are made,
that growth is persistent.
And, you know, again, I think we're facing this head-on
and I do think people are becoming more and more disaffected.
- Listen, Meredith, fascinating conversation.
Thank you so much for being here on Politico Tech.
- Thank you, this has been great.
- That's all for this week's Politico Tech.
If you liked the show, be sure to subscribe.
And for more tech news, subscribe to our newsletters.
Digital Future Daily and Morning Tech.
Our producer is Normo Malikul.
Pan Bandy made our theme music.
I'm Stephen Overlay.
See you back here next week.
Podcast Summary
Key Points:
Signal Gate scandal involved senior U.S. officials using the messaging app for communication regarding military actions.
Meredith Whitaker, president of Signal Foundation, discusses AI, privacy concerns, and tech culture.
The discussion covers the risks of agentic AI, privacy threats, and the impact of AI on society and decision-making.
Summary:
The transcription features an interview with Meredith Whitaker, president of Signal Foundation, discussing various topics related to tech, AI, privacy, and policy. S. officials, Meredith's concerns about the end of privacy, and the influence of tech culture on politics.
Additionally, the discussion touches on the rise of AI agents and the inherent risks they pose to privacy and security, emphasizing the need for policymakers to better understand the technology they are regulating. The interview highlights the critical importance of privacy in the age of AI, with a focus on the potential threats posed by agentic AI systems and the implications for data security and encryption. Overall, the conversation sheds light on the complex interplay between technology, privacy, policy, and societal implications in the modern digital landscape.
FAQs
Senior U.S. officials used a messaging app to discuss a military strike in Yemen and unintentionally included a journalist in the chat.
Meredith Whitaker is the president of Signal Foundation and a former Google employee known for criticizing Silicon Valley on privacy and AI ethics.
There are worries about vulnerability when key services go down, the dominance of a few tech companies in daily life, and conflicts between profit-driven decisions and societal interests.
Policymakers lack clear understanding of AI, leading to decisions based on hype and magical thinking, without considering technical realities and implications.
Privacy is crucial to prevent misuse of power, oppression, and manipulation by those with access to personal data, especially in a digital age with extensive data collection and AI technologies.
Agentic AI systems with extensive permissions pose privacy risks by potentially accessing sensitive data, creating backdoors, and threatening encrypted communication like in the case of Signal.
Chat with AI
Loading...
Pro features
Go deeper with this episode
Unlock creator-grade tools that turn any transcript into show notes and subtitle files.