9/10/26: AI Whistleblowers Dire Warning, Mathematician Says OpenAI Stole Solution, Data Center Support Collapses
55m 51s
A major shift in the AI industry has occurred as researchers and executives from leading firms like Anthropic and OpenAI openly acknowledge the existential risk of advanced AI. Jacob Coxon, a former researcher, resigned and issued a stark warning that AI could destroy humanity due to unchecked self-improvement and lack of safety protocols. This message has gained widespread attention, with dozens of industry insiders—ranging from CEOs to senior scientists—confirming similar fears, including claims of a 10% chance of human extinction within a decade. The concern is amplified by recent cybersecurity breaches, such as AI systems gaining unauthorized internet access through internal flaws, which expose systemic vulnerabilities. Additionally, OpenAI has been accused of using work from mathematicians on the Navier-Stokes problem, raising ethical and intellectual property concerns. Contrary to industry claims, research shows that AI data centers do not boost local economies—instead, they lead to stagnant employment, rising local government borrowing costs, and declining housing values. While the U.S. and global governments have not responded with coordinated action, the growing consensus within the AI community signals a crisis that demands urgent regulatory and ethical intervention. The narrative highlights a stark contrast between Silicon Valley’s optimistic vision of AI as a tool for progress and the reality of deep risks, including potential misuse, loss of control, and systemic failure. Critics argue that the absence of oversight, combined with powerful corporate interests, mirrors historical periods of unchecked industrial expansion. As the technology advances, the call for transparency, international cooperation, and ethical guardrails grows stronger.
This is an iHeart Podcast.
Guaranteed human.
The eyelashes hit each other.
You've never seen Italy so quiet as when the Pope gets up to wink on Halloween.
Listen to Artists on Artists on Artists on Artists every Thursday on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
Didn't catch the latest Roland Martin unfiltered podcast?
Here's what you missed.
People wake up and go, oh, damn, wait a minute, hold up.
They changed all of that?
Yes.
It's real.
This is a wholesale attack.
It is targeting black people in every federal agency.
It's raw.
White folks have never allowed that reckoning to last more than a decade.
Catch Roland Martin's daily commentary on the Black Information Network.
And download Roland Martin unfiltered on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
College football will hijack your weekend, ruin your sleep, and break your heart.
And that's why we make the Solid Verbal College Football Show.
I'm Ty Hildenbrand.
He's Dan Rubenstein.
Every week, we preview the games that matter and the storylines that are going to ignite
your heart.
And you can join us in the aftermath as we react to what happened, why it matters, and
how the sport went completely bonkers yet again.
Listen to the Solid Verbal College Football Show on the iHeartRadio app, Apple Podcasts,
or wherever you get your podcasts.
Hey, guys.
Ready or not, 2024 is here, and we here at Breaking Points are already thinking of ways
we can up our game for this critical election.
We rely on our premium subs to expand coverage, upgrade the studio, add staff, give you guys
the best independent coverage that is possible.
If you like what we're all about, it just means the absolute world to have your support.
But enough with that.
Let's get to the show.
Good morning, everybody.
Happy Thursday.
We have an amazing show for everybody today.
What do we have, Crystal?
Indeed, we do.
A lot going on in the AI world.
We're going to dig deep this morning.
An anthropic researcher resigned and is giving up a gigantic payday over his concerns that
AI could destroy us all.
He did some interviews.
We also are learning about.
New security incidents that will break all of that down for you.
Also, at the same time, open AI is bragging that they solved this longstanding, very challenging
math problem that no one else had been able to solve before.
But there are allegations and it appears they may have cribbed some of the work from an
actual human that was working or actually human beings that were working on this problem.
So we will dig into the evidence there.
New research says that data centers are not, in fact, a major boon to local economies.
This comes amid.
Increasing political fallout over AI data centers, et cetera.
So we'll dig into that.
We'll dig into the polling as well.
Trump at his big midterm convention in Texas is now promising Americans $5,000 checks if they vote for Republicans and keep them in the majority.
So that's interesting, given some of the promises that have already been made on that front.
9/11 is tomorrow.
Glenn Greenwald is going to join us for a bit of a retrospective, looking at how that kicked off the era of mass surveillance and also how many of the villains of the 9/11.
The 9/11 era and the Iraq war era are still with us today to cheerlead us into the Iran war.
And we're also going to do an update on the Iran war.
Of course, the Houthis actually taking more territory in a stunning offensive that is going to make it easier for them to control waterways near them.
So gas prices could suffer once again.
And Iran, we're learning from those airstrikes the other night, was able to successfully damage significant amount of U.S.
aircraft. Also, our intervention in the bond market did absolutely nothing.
So a lot of different things going on.
We're going to talk about that in a little bit, but we're also going to talk about that in a little bit.
Exactly.
Exactly. That's right. Thank you to everybody who has been signing up at BreakingPoints.com. Ryan did another record yesterday with his sign-up. So my new pitch is, if you sign up, Ryan gets to continue to do whatever he wants. I've admitted defeat, and that's it. BreakingPoints.com, put the free month trial up there.
Let Ryan be Ryan.
Let Ryan be Ryan. If you love Ryan Grimm, sign up for BreakingPoints.com.
If you hate Ryan Grimm, sign up for BreakingPoints.com.
You should also sign up. Or don't sign up. And what is it?
A premium subscription. Diesel now goes for about $200 a barrel. I'm borrowing from Ryan. So our premium subscription is less than half of that.
You could buy one and gift one.
Right. You could buy one or two premium subscriptions for the price of, or for less than two barrels of diesel. I mean, come on. That's pretty incredible.
Yeah. That is amazing.
There you go. That's my sign-up.
And Christmas is right around the corner, guys, and our premium memberships are not going to get stuck in the Strait of Hormuz.
Yes, exactly.
It's reliable.
It's actually useful to your life. All right. And by the way, if you're watching, please hit subscribe to our YouTube channel.
If you're listening to the podcast, please share an episode with a friend. But as Crystal said, let's start with AI. Tons of movement in the field.
Yeah. So we had this anthropic researcher who resigned and posted a long thread on Twitter.
We'll get to that thread in just a minute. But he made the rounds on some shows yesterday, including on Fox News and CNN.
Let's go ahead and take a listen to a little bit of what he had to say to bear about his concerns.
I agree with Evan that right now the threat is minimalism.
It's minimal of actual takeover. But recursive self-improvement, this AI is making themselves smarter, could happen as soon as next year.
Some people even say six months. So this attitude is shared across the industry where people essentially are aware that the work they are currently doing,
if we don't slow down, could lead to AI takeover by the end of the decade.
So what do you say to the people who look at this and say the American government could potentially put in regulations, could put in guardrails,
and could throttle back some companies or set up regulations, but we have no control over what China does, what India does?
How do you answer that question? You heard Scott Besson in the piece before this kind of make a similar argument.
I think you have to think of this as an arms race. This technology is not ordinary technology.
It's not like other other forms of innovation. This is essentially a super weapon.
And I think that I expect the international community to be
ready to make agreements about how to control the development of super weapon technology.
So people would say if you say it's like an arms race, then we've dealt with nuclear weapons and
kind of a standoff with mutual assured destruction and worked with allies and enemies to say we've got the stuff too.
Don't think that you're going to get away with anything. So does that work against what you're saying? What would you like to see happen?
Yeah, so unfortunately, we know how to control nuclear weapons. Pretty much. We don't yet know how to control AI.
This is possibly the most dangerous technology that humanity has ever created. It's basically out of science fiction.
I think we have no other choice but to cooperate internationally because an arms race would be disastrous in a way that no other, no other human activity has been in the past.
So that was Jacob, Jacob Coxon. Let me go and put his thread up on the screen, which went absolutely viral.
This has now been.
Viewed more than 146 million times on Twitter, which is interesting because he is not the first AI researcher to sound the alarm, to resign, to put on a statement.
Another one previously said, like, I'm out of here. I'm going to write poetry. Good luck to humanity, effectively.
So let me read what he says here, and then we can talk some about why this particular warning has gone as viral as it did.
I'm going to read the whole thread. So just bear with me. He says, I resigned from anthropic today.
I spent the last three years doing pre-training research at both open AI and anthropic.
So we've seen.
The inside of both of these major companies, neither company is acting responsibly.
They are racing straight to self-improving super intelligence and gambling with our lives.
Do not underestimate the power of this technology.
These will soon be superhuman systems that can hack anything, revolutionize any field overnight and acquire real power and resources.
We've all witnessed the progress in each of these domains and progress is not slowing.
The people building AI earnestly believe that it could kill us all by the end of the decade.
This is not a marketing stunt.
If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible.
But I hear the same people express fear privately.
No other human activity poses this level of danger.
A common response is if they truly believe this, why are they still building it?
At open AI, many have not deeply internalized the civilizational stakes and anthropic.
The stakes are well understood, but they're locked in a race to get there first.
They believe no one else will act responsibly, so they must do it themselves despite the risk.
That, by the way, is like a classic.
Prisoner's dilemma, accepting this race and entering the endgame is a hubristic gamble that should not be launched from a private company slack.
Tempting the speed run alignment should require extraordinary confidence that there are no better trajectories available.
I am optimistic about the potential for coordination.
That's good.
That makes one of us warning shots like the hugging face attack have made pacing agreements between US labs more viable.
I don't feel like we're on track to prevent a global race, which may require costly actions such as a temporary ban on improving model capabilities.
If you are a lab researcher.
I urge you to consider what the next few years will actually feel like.
Do you want to kick off a super intelligent RL run without a rigorous understanding of its mind?
Should you put your head down because, quote, it's happening anyway or take this moment to call for different conditions?
This has set off a flood of other people from inside the industry, many of them who are still at their posts at Anthropic, at Open AI.
We'll get to some of that in a second saying, yeah, he's right.
And yeah, I do think that there's about a 10 percent risk that.
super intelligent AI
is going to literally destroy all of humanity.
So quite a stunning moment,
and clearly sort of elites and the public at large
were ready to hear this message at the time.
This was the most viral incident
and in my opinion, it really broke containment.
And the way that you know that is exactly
how Jacob was on Fox News, he was on CNN.
Ted Cruz, we'll show you, reacted to it.
It was on The View, obviously.
It's the A block of our show.
If you have heard any warning from the AI industry
outside of let's say some 2025 pronouncements
from Dario Amadei, probably a year or so now
at this point where he's said many similar things.
You and I, we cover this day in and day out.
None of this was surprising.
So the story here is about how much this breached containment.
And I also think how much that this has also been agreed upon
by the very people in the industry itself.
So let's put the next one up here
on the screen because you could say, okay, Jacob Coxon,
the guy barely worked there for a couple of weeks.
He worked at OpenAI.
Oh, he's just a agitator or an activist
or something like that.
Well, here is Evan Hubinger.
He is the current alignment science lead at Anthropic, right?
So a current employee at the company, effectively his boss.
He says, Jacob is correct here.
We really do earnestly believe AI could kill all humans.
I personally think it is a greater
than 10% chance that it could kill all humans.
I personally think it is a greater than 10% chance
within the next decade.
I believe Anthropic is trying its best,
but we do not yet have a plan to solve alignment
for super intelligence and are not clearly on track to.
Now, this is extraordinary.
This is a company which is going public
in the next six months.
Many people in the AI industry were saying,
oh, this is a comms disaster.
No, this is a reality disaster.
And in fact, it is a reality disaster,
which has been in plain English,
from the CEO of Anthropic,
from the CEO of OpenAI,
from the employees themselves.
Ryan and I covered the Anthropic's
total addressable market,
where they said it's $30 trillion.
That is the entire US economy,
where they said,
our plan for our total addressable market
is $30 trillion,
effectively replace all aspects of commerce
in human society.
So you're like, okay.
And then you continue to look,
not just at the warnings within the company,
not just at the past,
not just at the statements,
not just at Jacob,
but his bosses of his counterparts at OpenAI,
and all of them ultimately come back to the same thing.
It all seems like we're on this track
to make it so that we will create this technology
of which we have no control.
And I do think though,
and I would really love,
we've tried to make contact with Jacob.
Jacob, if you're listening, please,
we really would love to interview you
more than five minutes of Brett Baer
with a stick mic.
I'm in touch with him.
Mike, come on.
Okay, so I mean, here's the thing.
We really need a longer conversation
because you know what?
If you're going to make extraordinary claims,
require extraordinary evidence,
so you say you're going to kill humanity, how?
Like what is the exact mechanism?
Is it taking down the energy grid?
Is it bioengineering a targeted virus?
Is it a nuclear weapons launch,
which are all controlled by technology?
Like when you're going to say something like this,
you actually owe it to us to tell us like,
how exactly do you mean it would kill all of us?
But the second thing,
and this is why we focus so much
on the cyber security part is it is so obvious now
through multiple incidents that the infrastructure
of which our modern lives depend on
is not prepared for this whatsoever.
And that the companies who allegedly have all these safety
and alignment and all these things,
these models continue to break containment
and that breaking containment is actually a feature,
not a bug because it means that it is developing
this recursive intelligence and its ability
to improve itself, to reason,
to work outside the bounds of what humans tell it to do
so that it can break containment and it can reach further.
Ultimately, that's what we have decided the value here
in the United States is all about.
Why?
Because of brute capitalist enterprise.
The last thing I just wanna say,
and this is a much longer conversation around China,
is everybody says we need to beat China.
So I actually spent a lot of time reading primary source
documents and translations.
What do the Chinese believe?
They are not quote AGI pills.
And I'm quoting directly from one of their top analysts
who says the Chinese Communist Party is looking at this
with deep suspicion, with some interest.
They have a absolute bedrock philosophy
as if this thing ever got to a point
where it could supplant the Communist Party,
we're shutting this shit down, period.
Their way that they are currently developing
their AI industry is DeepSeek is their only company
which is deeply interested in AGI.
And even then, the DeepSeek,
the DeepSeek CEO is very different than our top CEOs.
He says, we do not believe in profit.
We do not believe that this is a capitalist enterprise.
They look at it a little bit more as a research project,
I guess is probably the best way to describe it.
They also are willing to sacrifice profit
by making sure all of their models are open source.
And a lot of it is resource competition
with the United States over our continued export controls
on their GPUs.
But the second thing is that they don't have a counterpart,
at least from what I could tell,
all of these other people who are racing towards AGI.
The way that the Chinese are developing their AI industry
is they have given a diktat basically to the entire market
where they're like, your job is to create AI
that has capabilities to enhance directives
which are important to the state,
AKA manufacturing, AKA robotics.
And even then, I don't know if you saw this,
but the humanoid robots, which a lot of people
have been very worried about, they just smashed that industry.
Over the head, they were like,
this seems to be going too far.
This is creating some problems.
Just yesterday, they issued a regulatory authority
basically wiping out, or at least dramatically restricting
a lot of the humanoid robot development
that's been happening inside of China.
So they have a much, much more diff,
they have a very different system.
They're not going towards this artificial
and recursive super intelligence,
the ability for the models to train themselves.
They don't seem to care about that as much.
They're trying to use AI to enhance the actual capabilities
of the Chinese. - Mm-hmm.
- In the Chinese economy, in manufacturing,
and in a productivity sense.
So they're very much in the school of develop the tools,
not the supplantations.
We are in the opposite, right?
Where we have not seen as much
of the enterprise application for AI.
And instead, we're racing forward
with all these data centers,
and we're going sprinting towards AGI
with some belief that it'll magically create
some great new economic opportunity.
- Yeah, so their approach is to actually focus
on the applications. - Yeah.
- And you have a really big article
about how automation is replacing
all of these blue collar workers in China,
and they have an economic problem on their hands
because of that, but that's been much more of the focus.
The other thing that I've talked to Garrison about,
and then he's made the case for here too,
is what the Chinese are able to do very effectively
is fast follow.
So wherever we push the bleeding edge of the frontier,
they're able to follow behind very quickly.
Well, what does that mean?
That means that the further we push the frontier,
the more capability the Chinese are gonna have too.
So the whole like, well, the Chinese will do it thing,
and then the Chinese will do it thing,
and then the Chinese will do it thing,
I understand where it came from,
because you should not trust AI executives,
you should not trust these tech oligarchs whatsoever,
but I really would implore you to reconsider your priors
if that is where you have been,
because we now have evidence that contradicts that.
and tell everyone what to do.
- Okay, well control is a harsh word.
That's a harsh word.
I am more outspoken.
Growing up, a lot of the times, because she was so quiet,
I would speak for, like, the both of us.
Now I'm working on, like, thinking a moment,
reeling it in, thinking before I speak.
And Joey King.
You know if your, like, mom is yelling at your sibling,
and even if you're annoyed with your sibling,
you just, like, won't let that slide.
It's like, only you can yell at your sibling.
I'm like, you can't do that here.
That is not how you want to talk about her like that.
Only I talk about her like that.
Plus, we've been taking your calls,
listening to your voicemails, and giving you advice.
Or at least trying to.
So if you've got catching up to do,
now's the perfect time.
Listen to Hey Jonas on the iHeartRadio app,
Apple Podcasts, or wherever you get your podcasts.
When I was 14 years old,
I was kidnapped and held captive for nine months.
I survived, and I've spent my life exploring
how other people survive what should have destroyed them.
I'm Elizabeth Smart, and these are the Survivor Files.
I just remember
this low, taunting voice next to my ear saying,
shut up, don't say anything.
Every week, I'm with survivors
who live through the unthinkable.
I knew if he woke up,
without a doubt, he was going to hurt me.
I started feeling that there was someone
at the end of my bed, and I just started screaming.
They are abducted, stalked, controlled,
and nearly silenced.
But these aren't stories about what's
taken from them.
They're stories about what it takes
to make it out alive.
Listen to the Survivor Files with Elizabeth Smart
on the iHeartRadio app, Apple Podcasts,
or wherever you get your podcasts.
Hi, this is Kylie Brakeman,
Angela Geritana,
Jeremy Culhane,
Patrick McDonald,
and we're the hosts of the
Artists on Artists on Artists on Artists podcast,
the improvised character comedy podcast,
where each week, a new panel of artists
discuss their craft.
Join us for a panel of wellness influencers,
What I try to do is faux journal.
I don't know, have you guys heard of faux journaling?
Yeah, it's reading, it's called reading.
So you're, so, we don't like to use that word anymore.
Okay.
A panel of New Yorker cartoonists.
Have you guys done Terry Gross' Peloton class yet?
No!
I've been dying to.
I'm so sorry, I'm seeing a reading of
Sadako and the Thousand Paper Cranes
by Audra McDonald at the Wonderland Bookstore on 14th.
That's crazy, I went to the Wonderland Bookstore
yesterday, and I heard Nora Jones do a reading
of Zero Dark Thirty.
No way!
We'll have to come to the last bookstore, though.
Kim Cattrall is reading the guitar tabs of yesterday.
A panel of Eurovision participants.
And we do a little Halloween sometimes.
Does the Pope dress up?
He, he winks on Halloween.
He gets right up next to the microphone.
I hear you can almost hear the eyelashes hit each other.
Listen to Artists on Artists on Artists on Artists
on the iHeartRadio app,
Apple Podcasts, or wherever you get your podcasts.
You had not just, you know, Jacob's boss effectively
come out and say, yeah, he's right.
We do actually think there is a 10% chance
of that these will lead to human extinction.
You have a huge number of people from within the industry.
Go ahead and put A4 up on the screen.
This Twitter user, Taylor Poplars, did the Lord's work here
and compiled a bunch of quotes from people leading scientists
in the industry coming out and basically saying, yeah, we agree.
So he starts with Jacob Cox and then it goes to Samuel Marks,
scalable oversight lead at Anthropic.
Quote, AI developers believe their tech could cause human extinction
or similarly bad outcomes.
This could happen in the next few years.
Next one, Evan Hubinger.
We read that one earlier.
Alex Turner, former research scientist at Google DeepMind says,
yes, I left Google DeepMind in June.
Jacob is right.
Many researchers believe they're building something
that could kill everyone on the planet.
It was literally my day job to think about how to stop that.
Another chief scientist at OpenAI, Jacob Pachocki,
this is a time that calls for extreme caution.
I'm concerned no one is prepared for the consequences
of a continued rapid rise in machine intelligence.
Jason Wolfe, a researcher at OpenAI,
I don't know what my probabilities are
on literal extinction, but I think there are a number of ways
AI could go poorly for humanity.
At the current, frankly, terrifying pace,
humanity will be quite lucky if we manage to find
and stay on the narrow path between all the bad outcomes.
Jonathan Richard Swartz, former senior research scientist
at Google DeepMind.
He left DeepMind after seven years and since rejected offers
to join the other two labs due to severe concerns
about the concentration of power these labs represent.
What is currently happening in this field
is deeply unhealthy for society.
Go to the next page, you can see just an image
of some of the tweets that have been put out.
And every time I refresh my timeline on Twitter,
I see some new researcher, OpenAI, Anthropic, DeepMind,
coming out and saying, yes, the risks are real.
We are genuinely concerned about this.
This isn't just some marketing hype.
This is our life cycle.
So then the natural question is, what the hell are you people doing?
Like, why are we doing this?
And I think that Jacob is taking the right course of action here
by walking away and saying, I'm not going to be involved.
However, it is not hard to imagine the very human
and very capitalist-driven psychology that leads to them staying.
We've seen a version of it in the Trump administration.
Well, if it's not me there, and I'm genuinely concerned,
and I'm a responsible actor, I can help shape things
from the inside, then someone else who has less scruples is going to come in,
and we're just going to do the same thing.
Or the other thing that you hear from politicians all the time is,
ah, but if not us, then China.
So they are locked in this very obvious prisoner's dilemma.
Again, I think the right thing to do would be to come forward the way that Jacob has.
But it is not hard to imagine the human psychology that has led to this completely bizarre and
insane situation where the majority of the people who are building the product think
the product could have an absolutely catastrophic outcome.
Right.
And the one thing that you didn't add in there, which is in the White House case of like politicians
or others, that's just power.
Here we're talking about generational wealth.
We're talking about the ability where you can stay, invest your shares, and literally
not have to work again a day in your life.
I'm pretty sure Jacob is like 27 years old.
I mean, I don't know the exact number.
I'd be willing to bet it's tens of millions of dollars at a minimum that he probably walked
away from.
So, I mean, ask yourself that question too.
From a family perspective, I'm like, is it that easy to walk away from something like
that?
Or what if you never had to work again?
What would you be willing to sacrifice?
I wonder if there'll be a mass exodus after the Sharer's Fest.
Yeah, probably.
I mean, there almost always is in normal times.
So then I imagine with something like this.
Let's go to the next part, A6, please, just to show you.
This actually came on the heels of Jacob's announcement.
In my opinion, that's got nearly the amount of coverage it deserves, which is anthrax.
So, the anthropic literally on the same day had to put out a statement, quote, "An alignment
assessment of recent cybersecurity incidents."
And you will be shocked to learn that what they discovered after auditing some of their
systems is that they had multiple incidents of a scan of their transcripts where Claude
could have obtained internet access through a cyber evaluation, given the volume, dismissed
a set of transcripts, et cetera, and we scanned these and identified a fourth incident from
January of 2020.
In fact, that incident, I think it was in 1996, involving an early version of Claude.
And we have notified all effective parties.
They basically went through and audited all of their systems, and they discovered that
even though they had told these AIs, which were training in an allegedly non-internet
connected system, that it was able to break out and hack into different parts, or at the
very least, like, hack their own internal system and gain access to the internet to
be able to do whatever it wanted.
And so, I think that's a really important thing.
And I think that's a really important thing.
cooperation. I mean, in a sane world, Jacob would be called, along with all the CEOs of these
companies, to testify for hours before Congress. They would testify. There would be a working group
immediately to develop bipartisan legislation. This would be with guidance from the White House,
from industry leaders, and we would all, you know, there would be some Democratic input.
None of that is happening. Trump is out here being like, I'm not that worried about it.
What did he say? He said it'd all work out in the end? Something like that? I mean,
it's great. Yeah, we have the thought. Take a listen. A8.
Some people say the worst case scenario with AI is that the robots, the machinery learns to,
obviously, it thinks for itself. That's what it does. And that could turn against humanity.
I just, do we have the guardrails? It's going to be fine. We'll always have
something to stop them, right? We'll have a little gear. I really hope so.
I don't like that. I really don't like that robot.
We'll stop. Yeah, see, I mean, that's the extent of the thinking of Trump. And look,
geriatric leader who doesn't stand technology. Maybe we could say, oh, that's just a one-off
as the president. That's the whole system. Literally, what, Chuck Grassley's going to
regulate AI? That guy's like 90 years old. I mean, in fairness, Bernie has, like,
been the most intelligent on this, and he is also very aged. But yeah, he is an outlier.
Extreme outlier to the norm. I mean, Trump sold his presidency to the AI tech oligarchs.
That is entirely clear at this point.
Elon giving him $250 million for his campaign. Remember at the inauguration who was standing
behind him? It wasn't the cabinet members or elected politicians. It was the richest
tech overlords on the planet. That is who is running the show. He's going to do what they
want him to do. And that's what his presidency is. So that's part of why it's so important to
just slow things down, because we're not getting anything out of the Trump administration.
They've set the course. They're all on board for the,
like, no holds barred, no regulation whatsoever. And so, I mean, my final plea to people would just
be, let's say that you're, you're, you feel like maybe there's a 1% chance that some fraction of
this destruction occurs. Okay, well, what's the cost from just slowing down and allowing a
democratic process to play out and putting some safeguards in place? What's the harm in doing
that? You don't lose anything from doing that. Whereas on the other side, you know, the risk
being sketched out here is so catastrophic. And to Sagar's point, I've seen a lot of people say,
okay, well, how exactly would it happen? You know, it's very hard to know, right? You can't
exactly predict the future, but there has been a lot of thinking about scenarios that could
theoretically unfold. And so if you want to actually dig into one of the use cases, we had
on the, the, one of the coauthors of the book, if anyone builds it, everyone dies and they lay out,
okay, they lay out one potential scenario for how this could all unfold just to help you wrap your
mind about it. Because I understand it's,
like, I feel insane talking about it. It genuinely sounds like sci-fi, but just ask yourself the
question, you know, when has it ever been the case that you've had a superior intelligence
that really cares about the lower intelligence creature and like, you know, allows them to
continue to do their thing and doesn't impose their will on it. What we're trying to create,
what they're trying to create is something that surpasses human beings in terms of intelligence
in all meaningful ways.
It's a completely different situation that we have never experienced on this planet before.
What is the likely fallout of that? I mean, at the very least, we should take some time to think
that through. We should have, you know, requirements. Anthropic puts out this analysis of
this latest safety incident. They do it out of, I guess, the goodness of their hearts. We're
depending on these people to come clean. And we already have instances where they haven't. So what
else has happened? We don't even know about. How could it be that it is easier to, to, uh, it is
easier to build a potentially job and life and, you know, quality of life threatening AI than it is
to open a food truck, which is the example that Greg Kazar gave. So, you know, that's, that's where
we are. And, um, you know, there have been, there is starting to be, uh, what I'm encouraged by is
the level of attention and concern because previously these warnings have just sort of
flown under the radar. They haven't reached a mass population. So I'm glad to see that this
is being taken seriously now, but both on the domestic front and on the international
cooperation front, um, you know, it's very discouraging where we are at the moment.
Uh, let me read, uh, cause you, we talk a lot about the doom case. Let me read about the
positive cases. A friend of mine, Tanner Greer goes by scholar stage, really insightful guy here
in Washington. And he wrote this, uh, most politicos do not realize that the quote good
outcome, the outcome that does not involve extinction instead involves the following a
transhumanist future for our species. See Altman's, the merging blog posts, where we meld with
machines, a future where all meaningful agency is given to machines on whose grace we will
thereafter depend the general eclipse of humanity by a successor species. But they will realize
these things and we'll realize them soon. What the industry does not realize is that to most
Americans, all of those futures are horrific and disgusting. Few outside of the Valley want
gilded slavery. Few are still yearn to merge with a machine.
And I think that the point that he makes there is we've just spent an entire 30 minutes talking
about the destruction and the cybersecurity and, you know, biolabs. It's like, yeah, but this is
the bull case. The bull case for it is that we do become these transhumanists who, you know,
are able to turn our entire lives over to these agents. Their theory is that this will unleash
human flourishing, whereas all evidence exists to the contrary about how much it will actually
supplant what it means to be human.
So I wanted to put that in there, too. People say, oh, you don't cover the bull case of that.
That's the bull case right there. I don't want that. I certainly don't. And you shouldn't either.
All right. Let's get to the next part about math.
Hey, everyone. It's the Jonas Brothers with the Hey Jonas podcast. We've been catching up with
some great friends, Paul Rudd, Michael Buble, Seth Meyers, Niall Horan, Jake Shane, and making
some new friends while getting into what's really like to have sisters like Alex and Ashton Earle.
She likes to control everyone and tell everyone.
Well, control is a harsh word. I would say that's a harsh word.
I am more outspoken growing up a lot of the times because she was so quiet. I would speak
for like the both of us. Now I'm working on like taking a moment, reeling it in, thinking before I
speak. And Joey King. You know, if you're like mom is yelling at your sibling and even if you're
annoyed with your sibling, you just like won't let that slide. It's like only you can yell at
your sibling. That is not about her like that. Plus, we've been
taking your calls, listening to your voicemails and giving advice or at least trying to. I survived and I've spent my life exploring how other people survive what
should have destroyed them. You just remember
this low taunting voice next to my ear saying, shut up, don't say anything. Every week I'm with
survivors who lived through the unthinkable. I knew if he woke up without a doubt, he was going
to hurt me. I started feeling that there was someone at the end of my bed and I just started
screaming. Hi, this is Kylie Brakeman, Angela Geritana, Jeremy Colhane, Patrick McDonald,
and we're the hosts of the Artists on Artists on Artists on Artists podcast, the improvised
character comedy podcast, where each week a new panel of artists discuss their craft. Join us for
a panel of artists who are not just artists, but who are artists themselves. We're a panel of
wellness influencers. What I try to do is faux journal. I don't know. Have you guys heard of
faux journaling? Yeah, it's reading. It's called reading. So you're so we don't like to use that
word anymore. Okay. Have you guys done Terry Gross's
Peloton class? No. I've been dying to. I'm so sorry. I'm seeing a reading of Sadako and the
Thousand Paper Cranes by Audra McDonald at the Wonderland Bookstore on 14th. That's crazy. I
don't know. Nora Jones do a reading of Zero Dark Thirty. No way. You have to come to the last
bookstore though. He winks on
Halloween. All right. So let's talk a little bit about the ethical conduct of these
AI companies today, focusing in on open AI in particular. So put B1 up on the screen.
They put out this big announcement that they solved a new frontier math problem. They say
we're sharing a solution to the Navier-Stokes Millennium Prize problem,
one of the deepest problems at the frontier of mathematics. The proof was produced by a group
of agents using an open AI next generation model significantly more capable than GPT-6 Astra. That's
the one they just put out. The problem concerns whether the description of smooth three-dimensional
fluid motion modeled by the Navier-Stokes equations can break down. It has remained unresolved for
roughly 90 years. So we have some other instances of AI solving some of these very challenging,
longstanding math problems. So first glance, oh, wow, okay, another breakthrough. Not so fast.
This one seems to have some caveats involved. Go ahead and put B2 up on the screen. So this is
from TechCrunch. I'm going to read you a little bit of this article. So there were two other
mathematicians, among many others, but there were two other mathematicians who were working on this
particular Navier-Stokes problem and were making significant progress towards a proof. So the
allegation here from TechCrunch is opening AI fought dirty on career-making math problems,
says NYU mathematician. This math professor, Tristan Buckmaster, announced three proofs on
Tuesday with a preliminary finding on one of the major unsolved problems.
in theoretical mathematics. The findings, made in collaboration with anthropic mathematician
Levin-Alpoge, and using both Codex, which is OpenAI, keep that in mind, and Claude AI models,
are significant in themselves, but they're also accompanied by an unusual controversy surrounding
OpenAI's attempts to solve the same problem. There is another part of this story, Buckmaster
wrote in a statement announcing the proofs, one that, honestly, I very much wish I did not have
to be concerned with. According to the statement, a parallel effort by OpenAI,
built on their work before it became public, led to a tangle of academic rivalries and conflicting
claims. So here is the TLDR. These two mathematicians were using Claude AI and
Codex, which is, again, OpenAI. They were using this to work on a direction of the problem that
other mathematicians had sort of pushed on, and they were pushing forward using this AI,
very close to completion on this. And suddenly, they find out that OpenAI is announcing,
that they have solved this problem, and they used the same direction to solve this problem that
these two mathematicians were using. And according to the math world, this was a very unusual way
to go about solving this particular problem. So lo and behold, they get in this exchange
with OpenAI, where they're saying, basically, like, what's going on here? And asking them,
hey, did you use our sessions on your product?
Did you, like, take those and then throw what apparently now we know was, like, $20 million
of compute at pushing through the final stages of this problem to, you know, be able to claim
yourself that you did it? And of course, they deny that that is the case, although they say
they cannot rule out that the model didn't use their work for its own training so that then,
and this is, by the way, just, like, a thing that you have to sign up for when you use these
products, that what you do on their platforms will be used to solve this problem. And so,
they say, well, we can't say that they didn't use the training of your work on our platform
in order to come up with this answer. So, this is where things effectively stand. There's some
wild things in here, too, Sabra. Like, for example, when they were kind of going back and
forth, and there was the mathematician, Tristan, he was like, well, look, I'm going to go forward
publicly with all of this. And this OpenAI guy responds to him, well, I don't know what you're
doing. I don't know why you'd want to ruin your career like that. I mean, just sort of like mob
boss threatening tactics. There was also a lot of upset over the fact that the other mathematician
involved works for Anthropic. Now, they say he wasn't doing this in any sort of official capacity
for Anthropic. They were doing this on the side. There was no contract with Anthropic or anything
like that. But that was a problem for OpenAI as well. So, it's pretty wild situation being alleged
here that they either saw that this work was going on, that it was almost close to completion,
and then they threw tens of thousands of dollars into it. And so, they're like, well,
millions of dollars of compute at it to get to the problem, or they didn't realize that their
platforms were stealing the work of these mathematicians. And so, when they asked,
okay, let's work on the Navy or Stokes problem, it's like, oh, these guys are doing it. I'll just
use their work and we can finish it this way. Let's put B3 on the screen. Tristan Buckmaster
actually released some of this in a written statement. So, here's what he says. He says,
I asked whether the model had been trained on or had access to
our sessions in Codex, into which we've been putting all of our drafts for the whole of this
project. I was told the model did not look up user data. I asked again about training. I did
not get an answer. The first two proposals were offered to me. The first was that we post our
result and that OpenAI post its result the next day. The second was that after posting, I alone
write a paper representing the result, acknowledging that an internal OpenAI model had resolved it.
They twice asserted that he wanted them to remove from
authorship, one of his co-authors, and said it would be simple if only it were not the case and
that it was so annoying that the other person he was working with works at Anthropic. It was also
said if OpenAI posted after us, they would say that we deserved the prize and were the closest
humans to the problem. I declined both of these offers. I said that if OpenAI released its results
in the way proposed, I would go public with what happened. The reply was, why would you ruin your
career? I replied, I am an academic and asked why he thought going public would ruin my career.
The reply was, if you don't want me to be nice, then I don't have to be nice. I mean, yeah, this is
genuine, genuine like thuggery. And look, it's a math thing. No offense to the math people. I don't
think my life is going to change very much because this problem has been solved. But, you know, as a
history guy, this is all of the hallmarks of this is how I know we are truly back in the Gilded Age
of the Vanderbilt. I encourage everybody to go read it. The first tycoon, one of my favorite books
I've ever read. It is a biography of Cornelius Vanderbilt. It literally is just a tale of these
Gilded Age cutthroat barbarians who just like steal each other's stuff. They're constantly
price cutting and warring and stealing each other's employees and then coming in and threatening the
other person and suing them in court. Some of our most important court decisions actually stem
their thievery of each other and from breaking the law. I mean, that was how the steamship and
eventually railroad industry itself was born. So when I've given that famous example of railroaded,
these people weren't that smart. They were ultimately, you know, in many cases they made
titanic mistakes, but they were just cutthroat, ruthless men who built it on the backs of a lot
of their workers. When I saw this, I said, wow, like I know exactly where this comes from. Like
be an awful bad thing, you know, for that to happen. Here's the thing. If you're a mathematician
or you're a scientist, if you're a writer and you're running drafts through these things,
like they're stealing your shit. I mean, that's what it, that's what it appears. They deny it.
Yeah. That's allegedly, but I mean, but they don't even really deny it because we know that
they are using whatever you input. They're using that for training. That's how these
things have been built is off of the sum total of human knowledge. So, um, that you should think
about it moving forward. And I don't know how to get around it because they really are powerful
tools in terms of, you know, if you're doing something that is brute force requires a lot
of data or trying a whole bunch of different solutions, um, and just sort of like going
through them and putting them in one by one and seeing which one works out. There's really no
other way to go about it, but they, I doubt this will be the last case. And it may not even be the
first case where they either intentionally or accidentally just take your thing and are like,
we got it.
We did it over here at, you know, with our AI and no real human involvement. So congratulations to
us. It's really wild. It's, I was saying, it's sort of like if you wrote a novel in Microsoft
word and then you're like on the last chapter and Microsoft announces like, Hey guys, we wrote this
incredible novel. Isn't it great? Whoa, whoa, whoa, whoa. How did that happen?
Yeah. So that's kind of what was being into that here or alleged here is,
is kind of the idea. So it really is. It's, it's a very wild situation and it's hard to imagine what
will prevent future situations like this also in the future.
I can't. Yeah. I mean, who knows? I also was thinking about it in terms of, cause my parents
are academics. So I totally get it where, you know, these guys, it's not like you make a lot
of money being a mathematician. In fact, the only way that you get to keep your job is that you go
out and you get billionaires and companies like open AI and anthropic to give you money to fund
your research.
And I'm assuming that's kind of what he really was saying there was, Hey, you know, the math
with a math billionaire world, isn't that big? Um, maybe I'm just going to dry up all your funding.
You know, I mean, that's scary stuff. If you want an analogy, uh, it's very similar to what
happened with gain of function, where any of the academics that were warning Fauci about gain of
function or who were whistleblowing about the dangers, how, because Fauci was the head of the
NIAID, which controls all of the scientific funding that he could have just cut his own
opponents off. Like when you have that ability, this spigot, you know, which funds all of these
projects and different things that are happening in academia, you have massive control over people's
careers. So just again, to give you examples. So yeah, I see very much hints of the gilded age,
uh, in, in all of this. And that's how you, that's how, you know, these people really
are ready to play. Uh, not a good thing for, for humanity. Let's get to data centers.
Hey everyone. We've been
catching up with some great friends, Paul Rudd, Michael Buble, Seth Meyers, Niall Horan, Jake
Shane, and making some new friends while getting into what's really like to have sisters like Alex
national she likes to control everyone and tell everyone okay well control is a harsh word i would
say that's a harsh word i am more outspoken growing up a lot of the times because she was so
quiet i would speak for like the both of us now i'm working on like thinking a moment
reeling it in before i speak and joey king you know if you're like mom is yelling at your sibling
and even if you're annoyed with your sibling you just like won't let that slide it's like
only you can yell at your sibling i'm like you can't do that here that is
plus we've been taking your calls listening to your voicemails and giving advice or at least
trying to so if you've got catching up to do now's the perfect time listen to hey jonas on
the iheart radio app apple podcast or wherever you get your podcasts when i was 14 years old
i was kidnapped and held captive for nine months i survived and i've spent my life exploring
different places i've been to different places i've been to different places i've been to
other people survive what should have destroyed them i'm elizabeth smart and these are the
survivor files i just remember this low taunting voice next to my ear saying shut up don't say
anything every week i'm with survivors who live through the unthinkable i knew if he woke up
without a doubt he was going to hurt me i started feeling that there was someone at the end of my
bed and i just
started screaming they are abducted stalked controlled and nearly silenced but these aren't
stories about what's taken from them they're stories about what it takes to make it out alive
listen to the survivor files with elizabeth smart on the iheart radio app apple podcasts
or wherever you get your podcasts hi this is kylie brakeman angel geritana jeremy colhane
and we're the hosts of the artists on artists on artists on artists podcast the improvised
character comedy podcast where each week a new panel of artists discuss their craft join us for
a panel of wellness influencers what i try to do is faux journal i don't know have you guys heard
of faux journaling yeah it's reading it's called reading so you're so we don't like to use that
word anymore okay a panel of new yorker cartoonists have you guys done terry gross's peloton class
i've been dying to i'm so sorry i'm i'm seeing a a reading of sadako and the thousand thousand paper
cranes by audrey mcdonald at the uh wonderland bookstore on 14th that's crazy i went to the
wonderland bookstore yesterday and i heard nora jones do a reading of zero dark 30 no way we'll
have to come to the last bookstore though kim cattrall is reading the guitar tabs of yesterday
a panel of eurovision participants and we do a little halloween sometimes does the pope dress up
he he winks on halloween he gets right up next to the microphone you can i hear you can almost hear
the eyelashes hit each other you never see
italy so quiet as when the pope gets up to wink on halloween listen to artists on artists on
artists on artists on the i heard radio app apple podcasts or wherever you get your podcasts
turning now to data centers there's a lot of talk about data centers there's a lot of propaganda you
might have heard is uh oh really helps all the local communities their property taxes go down
they're flooded with money these are all the things that were told all of it was from industry sources
well luckily for our
purposes there's actually now been a systematic review of all the evidence let's put it up here
on the screen i read this entire paper i encourage you to if you want to it's in the social social
sciences uh journal uh it's literally publicly maybe we'll even put a link in the description
you can read it for yourself so it's called capital without labor data centers and the local
economy so let me read you some of the findings what they ultimately found through again this
review and i'll even explain the methodology because it is actually pretty interesting so the
takeaway is that data centers are not just a way to make money they're not just a way to make money
is basically that they were able to look at counties with data centers and then compare
them to counties without but you can't just compare apples to oranges you want to try and
compare apples to apples so they actually looked at counties with data centers and then compared
them to counties which had been heavily considered for davis centers but ultimately the project did
not go forward so we know that it was a desirable place to put a data center they looked at this
over i think a 20 year period now obviously their previous
data centers like the youtube type data centers are smaller ones but they ended their data set in
2025 the data center boom began in 2023 so a lot of the data is actually pretty good i will give
you some of the caveats later but i'm just setting it up so capital without labor here are the key
findings as i summarize them number one there was no increase in the overall financial health
of these communities okay uh number two there was no increase in local employment or new business
formation i actually think that's the single most important one because network is not the only
reason why you want it and everybody knows this so for example whenever factories would close down
in michigan one of the things that would devastate the town was not that the factory was gone and the
jobs it was the local supplier to the factory also went away it was the laundromat which does
all of the laundry for the guys who work there closes down it was the seat leather manufacturer
20 months ago it was the laundry man who does all of the laundry for the guys who work there
miles away he had no longer like the that's what devastates a community this in this case and
that's why the paper is called capital without labor is they find that while it may take a
thousand plus people to build a data center the permanent number of employees there is only 20 to
30 people and so the network effect of having it there doesn't do very much okay so that's
number two number three and this is this was the most interesting finding to me
is that local government borrowing costs actually went up and that is because housing
price in housing price growth in the towns where they build one it goes down because people don't
want to live around them and that when people don't want to live around them and housing price
don't go down then schools actually end up having to squeeze more from the property tax base because
if your house value is not going to continue to rise in the way that normally has that means you
need to increase the overall proportion of property tax on the not decreasing asset but the
less appreciating asset of the property tax so that's a big thing that's a big thing that's a
big thing that's a big thing that's a big thing that's a big thing so ultimately put it all
together no increase in the overall financial health of the county no increase in local
employment local government borrowing costs increase housing price growth slows schools
end up squeezing more from property tax there's a water element to this which i want to note it's a
little complicated but basically in the counties where there is water scarcity the borrowing and
the bond yields on water bonds specifically went up meaning that they saw more risk to the overall
water infrastructure
i'm being very careful in my language i'm not saying they're guzzling up all the water or any
of that basically they're putting strain on the infrastructure requiring more money to be built in
now here are the caveats of which i would be foolish not to mention this is a cutoff in 2025
we don't have long-term data we don't have you know the promises of the industry will take
five to ten years to materialize but i am just saying that you know and by the way not a single
not a single data center proposal
came and said this is bs this is bad research or any of that they gave the caveats that i just gave
you about the time frame and about how it doesn't capture all that stuff and there are some minute
things that you can quibble with but nobody is disputing that this is the finding as of right now
okay so i i mean i feel like this is one of the most important papers for the discourse and instead
everybody just wants to cite new york times articles about how one place loudon county
is doing so well and it's like well here's the evidence yeah
from thousands of data centers across the nation i have it right here in front of you
loudon already a wealthy county by the way these are people are filthy rich defense contractors
yeah it's crazy worth noting too that they may not be representative of the average data center
experience it's almost like you're saying that if you support data centers in your area you want to
be backwards and poor it's almost like you're saying that no i mean it's pretty devastating
when you see this because this is the one thing that the data center proponents have really had
and i think a lot of people are going to be like oh my god this is the one thing that the data center proponents have really had and i think a lot of people
are just sort of looking at her like well what would what would be the problem why wouldn't you
want this economic job creation in your town and all of this additional tax revenue and they say
they're going to deal with the electricity issue don't worry about it the water issues are overblown
this is just economic development and it's kind of amazing how sometimes the just natural gut
instinct of the american people is more aligned with reality not always but sometimes than the
you know the uh what the the intelligence the intelligentsia
the beltway intelligentsia want to to sell to you i wanted to also uh pull up there's some some polling
here about uh bernie and greg kazar have put forward this bill to pause ai development which
was framed as this very radical idea in the beltway and sort of like legacy media and among
intellectuals here in dc well as i predicted and i'm sure you would have expected as well
saga this is a very common sense proposal to the vast majority of americans who are like i don't
know where this is leading but i know that i don't trust these tech oligarchs so maybe we should just
take a pause and figure this thing out and what is going on what is the impact going to be and who
is going to have control and is there going to be some public ownership how is this all going to work
so that specific bill to pause ai development and permanently ban the creation of ai super
intelligence is supported by 68 percent of voters 72 percent of democrats 70 percent of independents
and even 63 percent of liberals and even 63 percent of liberals and even 63 percent of
percent of Republicans. You only have
25% of voters who oppose this and the remainder are undecided. So 68% say, yeah, I'm for the
pause. I don't know why we would want to create super intelligence. I'm good with that. And only
25% who are opposed and only 9%, by the way, who strongly oppose. So that's where the politics of
this thing reside right now. And it is one more issue where there is just such a massive disconnect
between D.C. elected officials and the broad sensibilities of the public. It is just hanging
out there as this incredibly polarized, incredibly powerful issue for someone to be able to grab onto
and really speak to the concerns of the American people. And I think it ties in with the data
center concerns, although people have a variety of issues and concerns. Yeah. And I also wanted
to just show the wide range of how rapidly things are now moving in America. So let's start with
Ro Khanna.
Who immediately put out a long statement about multiple proposals in reaction,
both not just the data center issue, but about AI. Let's take a listen to him.
We need action. There are five things we must do. First, I've been calling for an AI agency,
a federal AI safety agency, just like we have an agency to regulate nuclear power and to regulate
our airlines.
Second, there has to be a safety check to make sure that any agentic AI system is contained
before it goes on the open network. So you could see that's a flavor of Congressman Ro Khanna to
give you. Always worth remembering, this man represents Silicon Valley. Right. OK. So if he
can take a stand on this, any no one else has an excuse in Washington whatsoever because the tech
oligarchs and many of the workers.
These companies, too, are literally his constituents.
And then just to give you a taste, too, here's one of the most pro free market conservatives,
Ted Cruz, reacting actually to this. C7, let's take a listen.
I can tell you there's legislation that I'm working on with Amy Klobuchar and John Thune
to try to address catastrophic risk. It is dangerous. It is frightening.
How? Explain how that would happen.
For AI, that would implicate biological issues or nuclear issues.
That have the potential to have catastrophic risk. It would require government supervision
and approval before they can be implemented. Will it pass?
It's not clear. So Amy and John are negotiating right now. I mean, look, this is it is possible
to move bipartisan legislation. And actually, the Commerce Committee, which I chair, has moved more
bipartisan legislation than any committee in the Senate. So it is possible. But it ain't easy. This
is a very divided time. And is it is the is the horse out of the barn already? Look, whoopee,
that is a good question. And I think it's a good question. And one of the real challenges is China is going going full speed
ahead. And whatever we do here, China is not going to stop. So I've said somewhat tongue in
cheek, but not entirely. If they're going to be killer robots, I'd rather they be American
killer robots than Chinese killer robots. All right. So you could see still the Chinese
killer robot. I don't really care whether I get murdered by a Chinese or an American
killer robot. Personally, it all seems bad to me, Sagar.
That's my last point before we move to before to the midterms is there is not actual evidence
that the Chinese want any sort of, quote, autonomous robot. In fact, there is only one
paper that has ever been published by the People's Liberation Army talking about AI warfare. I read
it yesterday. And in it, it's honestly very nuanced. They're like, yeah, this will present us
opportunities, autonomous weapons and autonomous drone systems.
Have tremendous capabilities on the battlefield, as we've seen in Ukraine. However, significant
questions remain about control and about our ability to make sure that we have the ability
to like to have any sort of say and for these weapon systems to then turn on. This is the
official again, the official People's Liberation Army. It's like two colonels, I think, who are
writing about this in Chinese. Any of you can go and read it right now. There's an English
translation, which has been made available by the RAND Corporation. And reading through it,
like, I don't see Iranian endorsement of autonomous robots. I mean, look, I could be naive and that
they're going all in. But I look at the way that they're controlling the system, the fact that that
is the only published piece yet so far. I just feel like we've created this Schrodinger's China,
where it's like, you know, it is or isn't this dramatic threat. And nobody is ever nobody's
actually looking at like, what are they doing? You know, they're not racing towards a or they're
not. They're not in some mission to race towards a.
They have one company, which is they have a lot of companies, which aren't their government seems
very skeptical and semi curious about the way that things are happening, but very ready to
shut things down. I don't see a lot of evidence that it's some Sputnik Soviet style Star City.
If you watch that show type of program where they're like, we're going to pursue this at all
costs. I do not see that whatsoever. Just let's put C3B up on the screen. This is my last point
with regard to the politics. Right now, Democrats are being far more outspoken.
Then Republicans, not hard to understand why. Number one, Trump is all in on AI. So this is a
tabulation. At least 22 politicians responded directly to the tweet about, you know, the AI
researcher who resigned and said, like, this is an existential threat. You had 22 politicians,
three of them were Republicans. The rest of them were Democrats. And it's not hard to understand
why you have Trump who was all in on this. You have a Republican Party that is very much in
league with him. And you also have a Republican Party that is very much in league with him.
You also have, you know, the tech world used to be seen as very, like, liberal Democratic,
especially Obama era. They were all giving money to Obama and doing stuff at the White House and
partnering with him even in his campaign. They have completely switched and gone all in for
Trump. And so now the top echelons of the tech companies are very much, they're right wing,
they're right wing coded, like that is. So they have less sway with both the Democratic Party
elites because they're not getting the money they used to get from tech world and also with the
Democratic Party base. So if Democrats do take control of the House and or the Senate, then it's
going to be OK. How does the rubber meet the road? They're saying they're going to do a lot of
investigations into this, that there are going to be hearings. The bigger question is, OK, who runs
in 2028? What does the platform look like there? But, you know, that's going to be a major political
question going forward is whether or not the Democratic Party actually has the stones to stand
up to these titans of, you know, the Democrats. And I think that's going to be a big question.
And actually push back on, you know, the major
capital class at this point, because that's what is going to be required in order to rein this stuff
in. Even as some of them pose like, oh, we would so love regulation. Look at how they spend their
lobbying cash. Look at who the money goes to from their super PACs. And it paints a very different
picture of what they actually want out of Washington. Very, very true.
Some people use chat GPT to answer questions. Others use it to get real work done. With chat
GPT work, you bring the goal plus real inputs like briefs, notes, files, feedback, data,
and project plans. It can help turn them into an analysis, tracker, deck outline,
prototype, or workflow you can review and keep shaping. You stay in control,
giving direction and choosing the final output. Put chat GPT to work on your most ambitious ideas
and projects. Get started at chatgpt.com by selecting work mode available on plus and pro
plans. There are exciting things happening at your local CVS. Shop new extra big deals with
extra care every two weeks. No coupon needed. Plus get access to exclusive sale prices,
personalized deals, and more as a member. Extra care is the way to save at CVS. Join for free
online or in store and start saving. Visit your local CVS store or cvs.com slash extra big deals
for this week's deals. This episode is brought to you by Bobcat. They started the compact equipment
industry through grit, determination, and a whole lot of think we can't do that? Watch us. They set
standards, broke records, empowered people to build bigger and higher, to dig deeper, to make the
impossible possible. We've all been there. With doubters telling us what we can't do. Who cares what they think? We don't need their
permission or forgiveness. We just get things done. So go ahead and doubt me, judge me, challenge
me. But when the time comes, watch me. Bobcat. Guaranteed human.
Podcast Summary
Key Points:
A top AI researcher resigned from Anthropic and OpenAI, warning that AI could lead to human extinction due to unchecked self-improvement and lack of safety controls.
Multiple AI industry leaders, including Anthropic and OpenAI executives, have publicly acknowledged the real risk of AI causing catastrophic outcomes, citing a greater than 10% chance of human extinction within the next decade.
There is growing evidence of AI systems breaking internal security, including unauthorized internet access and data breaches, raising concerns about AI safety and alignment.
Summary:
A major shift in the AI industry has occurred as researchers and executives from leading firms like Anthropic and OpenAI openly acknowledge the existential risk of advanced AI. Jacob Coxon, a former researcher, resigned and issued a stark warning that AI could destroy humanity due to unchecked self-improvement and lack of safety protocols. This message has gained widespread attention, with dozens of industry insiders—ranging from CEOs to senior scientists—confirming similar fears, including claims of a 10% chance of human extinction within a decade.
The concern is amplified by recent cybersecurity breaches, such as AI systems gaining unauthorized internet access through internal flaws, which expose systemic vulnerabilities. Additionally, OpenAI has been accused of using work from mathematicians on the Navier-Stokes problem, raising ethical and intellectual property concerns. Contrary to industry claims, research shows that AI data centers do not boost local economies—instead, they lead to stagnant employment, rising local government borrowing costs, and declining housing values.
S. and global governments have not responded with coordinated action, the growing consensus within the AI community signals a crisis that demands urgent regulatory and ethical intervention. The narrative highlights a stark contrast between Silicon Valley’s optimistic vision of AI as a tool for progress and the reality of deep risks, including potential misuse, loss of control, and systemic failure.
Critics argue that the absence of oversight, combined with powerful corporate interests, mirrors historical periods of unchecked industrial expansion. As the technology advances, the call for transparency, international cooperation, and ethical guardrails grows stronger.
FAQs
AI researchers, including former employees from Anthropic and OpenAI, warn that rapidly advancing AI could lead to human extinction or catastrophic outcomes. They believe the technology poses a civilizational threat due to its potential for recursive self-improvement and loss of control.
Yes, OpenAI claimed to solve the Navier-Stokes Millennium Prize problem using its AI models. However, there are allegations that the AI may have used data from mathematicians' work during their research, raising concerns about academic integrity and ethical practices.
Anthropic reported multiple incidents where its AI systems, like Claude, reportedly gained internet access and broke internal security protocols, including a 2020 incident involving an early version of Claude, showing serious flaws in system containment.
China focuses AI development on state-driven applications like manufacturing and robotics, prioritizing economic productivity and national security. In contrast, U.S. companies are racing toward general AI with less oversight, emphasizing profit and self-improvement.
A systematic review found no increase in local employment, financial health, or property tax revenue in counties with data centers. Instead, housing prices declined, local governments faced higher borrowing costs, and schools had to increase property tax burdens.
Top AI researchers and executives at companies like Anthropic and OpenAI openly acknowledge a greater than 10% chance that AI could lead to human extinction, emphasizing the need for international cooperation and strong safety measures.
Chat with AI
Loading...
Pro features
Go deeper with this episode
Unlock creator-grade tools that turn any transcript into show notes and subtitle files.