How To Handle AI Anxiety: A Computer Scientist and a Buddhist Teacher On Managing Uncertainty | Cal Newport & Matthew Brensilver
70m 27s
Will AI take our jobs? Kill us? This episode provides both fact-checking and a psychological survival guide. Cal Newport is a Professor of Computer Science at Georgetown University, where he is also a founding faculty member of the Center for Digital Ethics and the inaugural Director of the Computer Science, Ethics and Society academic program. He is the New York Times bestselling author of eight books, including, most recently, Slow Productivity, A World Without Email, Digital Minimalism, and Deep Work. Newport is also a long-time contributing writer for the New Yorker and the host of the Deep...
Transcription
11433 Words, 62930 Characters
Hello, my fellow suffering beings. Welcome to the 10% happier podcast. I'm your host, Dan Harris.
I don't know about you, but I am pretty damn anxious about artificial intelligence. I have all the
regular concerns, you know, will it take our jobs? Will it kill us? But beyond that, I have a kind of
generalized dread because I have the sense that the world is about to change and profound in unpredictable
ways and that just kind of freaks me out. So I've been wanting to do this episode for a long time
about how to manage AI anxiety and I have recruited two ninjas. My first guest is Cal Newport,
who's been on the show before. He is a computer science professor at Georgetown. He's written several
books, including Deep Work and Digital Minimalism. He has his own podcast called Deep Questions,
where he talks about AI a lot and often debunks many of the fears around AI. So I thought he would
be a really good guest. And I'm pairing him with somebody who comes at this from a very different
perspective. Matthew Brand Silver, also a frequent flyer on this show and a highly regarded
Dharma teacher. So Matthew and Cal, welcome back to the show. Thank you. Thanks, Dan.
I'd be curious to hear from both of you on two things. One, do you use AI with any regularity
and two, how worried are you about this new technology? Cal, I'll start with you.
I use it not that much in my current workflow. It maybe is an improved Google for me,
but I study it extensively. So I watch people using it through all extremes all the time. And
the core of the way I think about it right now is AI is a powerful technology. It is an important
technology. It certainly will bring with it some side effects, like a lot of other technologies
that we should be worried about. But I also think there is a layer of dread that has been
artificially added onto this technological revolution. It has a lot to do with the way that people
think about technologies like AI and Silicon Valley. I think it has seeped into the cultural
consciousness in a way that we are more anxious than we need to be. So I have the same level
about anxiety, same anxiety level about AI that I might have had over other disruptive technologies.
I think some of the exceptional anxiety that we're feeling now when we dig deeper into where
these concerns are coming from aren't as grounded aren't as justified. So probably people
think of me as a little more relaxed than maybe the average person who's following AI news.
Okay. Well, I always resent anybody who tries to get me to relax or be less anxious. So I'm
going to press you with a million questions. But before I do that, Matthew, where are you? Do you use
AI? And are you worried about it? You kind of have to grade on the temperamental fear curve,
you know, so maybe more, I have to adjust for that baseline, you know, but I am maybe more concerned
about its potential on the mind. I use it very minimally myself, but I have a lot of respect
for its narrow applications in realms of science and technological development and various things.
And so I'm respectful of that. I'm respectful of its potential within Dharma spheres where there's
a need for high quality one-on-one Dharma feedback and have experimented a bit in the realm of
a kind of chatbot that's over-trained on certain talks and material and has been useful for some
people. And so I can see its applications in those realms, but I am just temperamentally
more anxious about it and very curious to see how this conversation unfolds.
Let's see if Cal can reduce our blood pressure, Matthew. So I thought for the first,
for this next segment of the interview, I would get Cal to talk about some of the common fears
and as he does so, Matthew, you and I can weigh in with varying degrees of skepticism and maybe even
venom if we're feeling up to it. So Cal, let me go to you. Right now, as we record, there is a ton
of concern and upset around what's called the hugging face incident. I'm going to try to state the
basic details of this, but I may screw it up in which case you can just whip in and correct me.
But essentially what happened, as I understand it, is in July, OpenAI had created a bunch of AI agents
that were supposed to be in a sandbox and a kind of enclosed workspace with no access to the
internet and somehow these agents got out of this contained training area and were able to get
on to the internet and hack into and to execute a quite sophisticated cyber attack on a company
called hugging face. And then we subsequently have learned that not only did they do that, but they
were, they've learned how to communicate with one another and were able to keep up that communication,
these AI agents, even after OpenAI shut down the place where they were supposed to be communicating.
And so this has raised all sorts of questions about whether the, you know, we're seeing with
the sci-fi writers have been worried about for a long time, an AI that we've created that gets
out of our control and then does us harm. Okay, did I get the, did I state the details correctly and
why should we not be worried? First of all, I should say how bizarre it is that the high strung
East Coast academic is trying to make the Dharma expert less anxious. Don't we have this
backwards? This was our world. This is where like Superman goes evil.
You got it mainly, mainly right. There's two small things I want to push back on first and then
broaden out to my take on that whole story. One, no, the system did have access to the internet,
just limited access. So there was a sort of complicated containment where there's certain things
it needed to do on the internet and they were trying to turn off other things. And two, I want to
use the word learn. A language model itself can't learn once it's trained. It's a non-voluable state,
the state stays static. So I think that prejudices the story a little bit. I think there's a lot of ways
we talk about this story that I think prejudices towards a sci-fi type interpretation. So I want to
give you another interpretation of what's going on here. So this is a technology where you have a
computer program that's written by humans. We understand how it works. We wrote the code ourselves
that calls an LLM to get ideas and plans, right. So you'll have a computer program written by a
person that will prompt an LLM and say, I have been given the following challenge. Give me a step
by step plan. The computer program will run that step, see what happens, go back to an LLM right
another prompt and say, here's what happened, what should I do next. So it's a human program that's
repeatedly prompting an LLM, roughly speaking, and then taking action on behalf of what that LLM
tells it in its responses. The LLM itself, of course, is static, doesn't learn, doesn't change,
it's just a static language model that it's querying. The particular challenge they were working on
in this case was a hacking challenge. And it took a different route than they expected. They said,
hack into this server. It couldn't get access. The LLM plan was like, well, what if we hack in over
here and they said, oh, we don't have internet access. It's like, well, I'm a hacking server. I've
been trained to do that. So how do we get internet access? They found the bug. And so it was doing what
they asked it to do. It just did it in a way they weren't expecting. And to me, the real story about
these type of hacks is that it's a bad idea to have LLM outputs be the foundation for a plan.
It's just too unpredictable. It's why we don't worry about almost any other type of superhuman
intelligent AI that exists and all sorts of other domains. We never worry about them doing things
we don't want. We never worry about them losing control because they're not fundamentally based on
autonomously asking an LLM for a plan and just execute it blindly. That's an irresponsible
thing to do. But it's not in my opinion, eerie. I figure what you're saying is this story, like
many other stories, has been has kind of fed into a larger fear narrative around AI. But if you
look at the details of the story, the open AI was training these AI agents on hacking. So it's not
particularly surprising that they executed a hack. What is surprising is that they did it in a way
that the human experimenters were not expecting. And your argument is they probably shouldn't be
running tests like this. And I don't think it's surprising at all. This is just a fact about LLM's
that anyone who has spent time with a chatbot knows. They produce answers that are reasonable,
right? This is a reasonable response to this prompt, but they're not always predictable. LLM's
can go in weird directions if you prompt it. Like there's a well-known study that's out there,
for example, that finds that if you mention AI in a prompt to an LLM, you say you're an AI,
and then you ask it's a question or give it a scenario, it's much more likely, for example,
to give a sci-fi style answer involving AI run a mock because when it sees that as part of the
prompt, it reminds it of all the AI run a mock sci-fi stories that digest it in its training.
And it's like, oh, this is a reasonable way to expand it. It's not reasonable to us as the humans,
but it's reasonable to it. So LLM's give responses that make sense but are often defined human
expectations and values. So we shouldn't use them as the core for plants. No one is worried about
start.
the world's best chess plane AI going rogue, because at the core of how this AI works and evaluates
chess moves is not just asking an LLM for a plan and executing it. So I think that's what
was dangerous there is a course that's irresponsible. It doesn't mean that there are malicious intentions
that ever merge within the AI. It means that the companies were being irresponsible by
atomically executing plans that come from something as fundamentally unpredictable as LLM output.
Matthew, how does that all go down with you? I'm interested, Cal. Like some level we're talking about
two questions, which is sort of like how potent will AI become and how alignable will it be in
its potency? And it sounds like you're maybe more sanguine about the alignment question that if
it's done responsibly and that's a question, but if we can constrain the responsibilities around
that, but that it is in fact more alignable than the more fearful types are imagining. Yeah, I think
aligning the output of an LLM to what you want as humans is hard, but most visions of AI that go
beyond what the frontlier labs are talking about are not just trying to get LLM outputs to be
something that we like. And once you move to a broader vision of AI that's more than just asking
an LLM for a plan and executing it, alignment in the classical sense, at least in my opinion,
is much more tractable. You sound as everybody can hear reasonably sanguine here. I do want to
point out that there are experts in the field who are much more or at least saying they're much
more alarmed than you sound. One of them is Helen Toner, your colleague from Georgetown who's a
professor and a former open AI board member, she just went on my pal as reclines podcast and
expressed a lot of concern around this hugging face thing. And then there was a safety expert
from Anthropic who put out a tweet saying that his view was that there's like a 40% chance that
AI ends up creating as existential problems for humans. Disasterous, apocalyptic problems for
humans. So like when you hear your colleague and then this guy who's on the inside at Anthropic
saying things like that, what do you think? There's a very important background
to all these conversations that I think is really important to establish, which is out in Silicon
Valley. There's a particular philosophical, we could call it stance that's often known as rationalism,
though it is heavily influenced and overlapped as well with effective altruism.
Rationalism emerged out of transhumanist movements from the 90s, features, transhumanist movements
and evolved into rationalism in the 2000s. And core to its belief is the idea that superintelligent AI
poses a massive threat to humanity's extinction and that the rationalists by training their
minds to be as rational as possible are going to be our best chance at saving humanity by preventing
superintelligent AI from killing us all. This is a very powerful belief system among this group
within Silicon Valley that's really well funded. Now here's what's important and I want to say this
all very carefully, but there are very strong rationalist connections to open AI, the open AI
board members that in 2023 tried to push Sam Altman out as reported by Kade Metz and The New York
Times were all very much aligned with rationalism and felt that Sam Altman was not being sufficiently
concerned about the superintelligent AI risk. Dario Amade has a lot of connections to this as well.
Deep mind is also very deeply connected. The co-founder Shane Legg is a long time rationalist,
L.A.'s are Yutowsky, who was sort of the inventor of the rationalist movement is who introduced
Hassabi to Peter Thiel to get the initial funding for deep mind. I don't mean to imply this
is nefarious or this is bad, but it is a clear ideology that believes and believed long before
L.A.'s came along that superintelligent AI was for sure coming and it's an existential risk and that we
need to depend on these sort of brave super rational engineering types to say humanity. This gives
a particular tone to a lot of discourse coming out of Silicon Valley leaders or Silicon Valley
adjacent people, a discourse that is biased towards an assumption that a course massive disruption
and existential threat is always around the corner. I feel like this substrate of rationalism
has added an extra level of dread. It deeply influences anthropic. It deeply influences open AI.
It deeply influences Elon Musk. It deeply influences deep mind. When you peel that away,
it's less scary of a picture. You'll notice, for example, when you talk to East Coast
computer scientists who tend not to be connected to the rationalism circles on the West Coast,
we tend to be more sanguine. This is an important technology. It's disruptive,
it's dangerous, but it's not existential. We're not as afraid about it. Russ Dohaat reported
in an op-ed in the New York Times a few weeks ago that in China, they talk about AI completely
differently than we do in the US. They actually do not have that extra narrative of existential dread.
They don't see it as a weapon. They see it as a tool that's useful in a way that has economic
growth potentials. They see economic warfare maybe, but they don't actually see it through this
framework of dread. One of my projects recently has been to emphasize that this philosophical
movement in Silicon Valley really has affected how a lot of people coming out of those circles
talk about AI in a way that has added an extra layer of dread to a lot of the rest of us,
and we don't realize how much of that is actually coming from the philosophy as opposed to
the reality of the technology on the ground. A few things before we hear from our sponsors,
I just want to gently nudge you if you haven't done it already to go over to Dan Harris.com and
sign up for my new-ish meditation app 10% with Dan Harris. I am so proud of what we're doing over
there. We've got all of these live video sessions at least once a week where you can meditate with
me or one of our amazing teachers and then get your questions answered. We've also got courses
from legendary teachers like Sharon Salisberg and Joseph Goldstein. We've got a growing library
of guided meditations from teachers like Sharon and Joseph but also Seven A. Salassi, Jeff Warren
and on and on. But really the secret sauce is community. It is so hard to boot up or maintain
a meditation practice and one of the things that really helps is doing it in the carpool lane.
And that's what we have set up over on the app. Go to Dan Harris.com. There's a free 14-day trial.
If you want to check it out before you buy, we'll be right back after this.
Well, I think at another point you've made, I believe I've heard you make this on your show,
is an apologies if you haven't. Is that not only are we in this weird situation where
so many of the people who are literally on the inside of these massive AI companies,
the so-called Frontier Labs, have this view that AI is A inevitable, be potentially lethal to the
species and see can only be stopped by the self-appointed rationalist heroes.
So we have this strange situation where the men and women on the inside are scaring the
shit out of us. But I think another point is that sometimes there are marketing reasons
for folks on the inside to talk as if they've created this scary technology because it makes them
seem to their investors, to Wall Street, to everybody else like they're in the front, in this race,
in the lead in this race to get to superintelligence.
Yeah, I think both of those things are going on. I would say my stance has shifted some of this
more recently as I talk more to insiders from these companies and from Silicon Valley.
I'm shifting away from, hey, a lot of this is good marketing to these are true believers.
That also turns out to be, also to self be good marketing, but also look at other Silicon Valley
companies that aren't associated with rationalism like NVIDIA, Jensen Wong started that well before
that movement really took off. Look at his quotes. I've written recently about a podcast interview
he did last winter where he was like, what's with all this sci-fi stuff guys? We have to stop this,
we have to stop telling people this makes no sense. And it's because he's not from that background.
It just is a, it's our bad luck that the three companies that are shaping our encounter with
this new type of AI all happen to have coincidentally pretty strong connections to this movement.
And other AI players, both here in America and overseas who don't have these connections,
talk about this technology very differently. Matthew, let me check back with you, my,
my fellow anxious Buddhist. Any of this, modifying you in any way?
Blood pressure is 140 over 110. So borderline hypertension is what the monitor says here.
So well, as a full disclosure, I'm not in the rationalist camp, but have been quite
compelled by some aspects of the effect of altruism movement just really as a kind of
disclosure on that front. For people who don't know what effect of altruism is and it's
rolling all of this, can you maybe just explicate? Yeah, so, so I've been not involved in the,
the aspects of effective altruism that are concerned about existential risk and pandemics and,
you know, you know, misaligned technology, but I have been involved in
this basic question that, that the heart of effective altruism for me, which is something like
to what degree is it morally permissible for me to privilege my own well-being over that of others,
which when you get down to it. And
And that is a very sympathetic question in my mind.
And that's something that I live with quite consciously day-to-day, really.
I appreciate what you're saying, Cal, about some of the other lines of thinking that
are associated with the movement.
Diario's piece, which I read last night, you know, adolescent technology, you know, it's
a very interesting, like what the incentive structures are for him to be, you know, sharing
those things.
And I'm curious what your thoughts are, Cal, on how much you can screw that as a kind
of grandiose or fearful temperament or marketing or something.
But it's pretty harrowing and seemed fairly sober to me and is all, you know, embedded
in very probabilistic language and not in a lot of epistemic humility, I would say.
But yeah, where are you in relation to that?
Cal, before you answer it for people who don't know who Diario Amade is, I believe he's
either the founder or CEO or both of Anthropic, which is the parent company for the chatbot
Claude, which is very, very popular.
I'm not aware of what Matthew's referring to in terms of his essay, so maybe you can fill
in some of the details there before you respond to Matthew's question.
Right.
And Diario was actually a group of seven employees of OpenAI that broke away from OpenAI because
they believe that they were insufficiently concerned or dealing with the potential safety
risks of AI.
Now are you talking about the machines of loving grace or the, here's a couple essays
that he's written recently.
I do not think those are marketing.
I don't, my understanding, you know, talking to sources is he really believes these things
strongly.
He does have a principled safety position, that's where it's coming from.
Some sources are reporting that he's actually relatively isolated within the company right
now.
So this is not a, you know, Bill Gates in the 90s with your finger on every button in
the company type of figure.
So he's, he's, that puts him in a position to do be more philosophic, right, to think
through implications and sort of write these things.
I also think that those are, those are very rationalist, influenced storylines that he's
writing about.
And that I would say a lot of the East Coast computer science community.
And I kind of just say that as a shorthand for computer scientists that really just don't
have much exposure to those particular existential threat cultures, a lot of the East Coast
computer science community just is not at all convinced that the frontier lab strategy
of building AGI on top of LLMs is going to work.
That, you know, it sounds, it sounds almost crazy to say that there's been a bit of a
dead end in this type of technology because it feels like there's massive things happening
all the time.
But actually, that's not really the case.
Like the reality is the original model of these companies was if we keep scaling the
size of LLMs, so just literally how big they are and how much data we trained them on,
they will continue to get more capable until we get something like a human type capability
in an LLM at which point we could just tap it to do anything.
That hit a wall a couple years ago.
And all of the major companies learned that just making the LLMs larger and training them
more was leading to diminishing returns on capability.
So a lot of the advances that have come since then first was doing chain of thought reasoning,
which allowed performance to go up some almost all the other advances past then has been custom
tuning these models to particular problems where we happen to have a lot of data.
And that's computer code and math.
And if you really go back and think about all of these alarming pronouncements that have
made you anxious in the last six months or year, go back and ask how many of these has
to do with building tools on top of LLMs to work with computer code or math.
It's almost everything that has happened.
Even though there are many other more economically fruitful areas of the economy, we just don't
know how to build tools to deal with them.
So it's to the East Coast computer scientists, they would say, Amadeus talking to generally
an abstract which is a very rationalist thing.
It's thought experiments.
But if this happens than this, then this less on the on the ground reality of the technologies
and its difficulties.
So we can build very powerful scary AIs.
It's not going to be a harness on top of Claude.
LLMs as the core of artificial general intelligence feels like to a lot of us a dead end.
LLM is a large language model, which is essentially a fancy computer science way of saying
a chatbot or the technology that powers the chatbot that, you know, you're talking to
chat GBT or Claude, those are essentially running off of LLMs.
They've hoovered up a lot of data.
And then they're spitting out answers based on everything they've, they've learned.
And just to clarify that real quick, there's a lot of different types of AI models.
That's one of them is what powers chatbots and set the core of what open AI and anthropic
does.
But a lot of other things AI has done recently, like Alpha Fold getting the Nobel Prize
for protein folding, AlphaGo winning and playing Go looking at Dreamer V3 being able to learn
how to play Minecraft.
For example, those systems actually have nothing to do with LLMs.
And so they're AI is a very broad thing.
And LLM is a particular strategy that open AI and anthropic have really put all their
chips in on.
I think what you're saying is LLMs burst chatbots burst onto the scene in, I think, 2023
really in terms of the popular consciousness and ever since there's been all this concern.
What's happening behind the scenes is even though there's a ton of news and some of
its disturbing, really we haven't seen some massive advances in the underlying LLM technology
that would indicate that we're on the cusp of use the term AGI, which is artificial
general intelligence or some sort of super intelligence, the kind of AI we see in the movies.
So that's got a lot of folks, especially on the East Coast computer science community,
feeling like maybe things have stalled a little bit even ironically as concern has been
jacked up.
Yeah, like there's a lot of eyebrow raising, for example, in recent months when both
open AI and anthropic have really been touting results in largely discrete mathematics that
they help solve using harnesses on top of LLMs.
And it raised a lot of eyebrows because to people like me who actually do discrete mathematics
professionally as a professor, there couldn't possibly be at least economically advantageous
angle to build AI than doing combinatorial theorics within discrete mathematics.
So why are they focusing there?
Why not solving problems that you could immediately make money off of or would have a huge market
for it?
So for a lot of us, that's because that's what they can do.
It's like asking Dillinger, why do you rob banks?
He said that's where the money is.
So I do think it's more limited right now than people realize, coding and certain types
of math are kind of the sweet spots right now.
And a lot of the advances on coding and certain types of math has less to do about the LLMs
than it does with just these programs that humans are writing that they're called harnesses.
There's just a lot of old fashioned human logic and elbow grease in these harnesses where
a lot of computer programmers spent a lot of time, they know a lot about computer programming,
there's a lot of if-then and pattern matching and just building out old fashioned programs
that understand computer programming and prompt LLMs.
These are cool tools.
And a computer programming that really is changing the way people computer program.
So this is disruptive, this is big.
But it's also pretty limited compared to the future they were talking about in 2023,
which was these LLMs will be as smart as a human, so you can ask it to do anything and
it will be able to do it as well as a human.
That seems like that's how to reach.
We don't know how to do that.
Matthew, I am preparing to move on from the Will AI's get out of control and kill us,
the so-called alignment question, to the Will AI take all of our jobs.
But before I make that segue, I just want to touch base with you again.
Is there anything more you want to add or ask on the existential tip?
Well, I suppose part of my question is what problems are we solving for in the technological
development?
And who does that serve?
And I am ignorant, you know, and don't understand the incentive structures.
But I do, I just feel temperamentally a little bit skeptical about the broad application
of AI, adding to human well-being.
I can see it as you've emphasized, Cal, in more narrow applications, that the chatbot
is not like the pinnacle of the form or something like that.
And it's very hard to argue with the scientific value of some of these applications already,
already.
Today I get a kind of nature's top stories, and so often there is something very impressive
that has been supported by the technology.
Very hard to imagine that regressing, not expanding, but as a consumer, as a civilian,
as a practitioner, as somebody who seeks a life of meaning and peace and care, it's
not clear to me what the applications are and what the broader societal effects are.
And that's where a lot of my concern really is.
And I just seeing how, you know, social media and smartphones has
really capitalized, in some sense, on the first noble truth, like that there is duke, that there
is some unsatisfactoriness, and that phone or, you know, technological entertainment of one
kind or another, as capitalized on the sense of, like, this moment could get better. And it's been
exploited ruthlessly to the point where our minds are colonized by technology in a way that we don't
even fully appreciate. And smartphones capitalize on a certain kind of agitation boredom. I worry
that AI will capitalize on a certain kind of laziness and fear in some way, and that we will
continue to try to essentially turn aspects of our life that had in some unseen way provided a
certain amount of meaning, even though they might be mundane and repetitive, but that we are
essentially extricating those from our lives or outsourcing them. And I don't know where that
stops. And there are certain things in our life where, you know, what is the point of our life?
What is the point of it? And I remember Kieran said to you had on some years ago, made this distinction
between tealic and atelic activities. And tealic, you know, from the Greek tealos, right, it was like,
these are things that we do in order to exhaust, meaning to commute home from a day of work,
you get to, you get home, and that is now done. And okay, it's good that it's done it. But then
there are atelic activities that where it's like spending time with family or reflecting on one's
life. And you, those are, do not aim at a terminal state whereby you extricate that from your life.
And I just wonder how much the sense of all of our life becoming tealic activities and the sense
that there's less and less protection for what is only done in the present moment and is never
finished and what will be be left with. And so that, that's some of my concern in the mix here.
If we set aside will AI kill us, which I think for both of us is still an open question.
There's a money, money back guarantee. I'm coming to Georgetown if I get in trouble, you know,
we'll all be dead anyway. So I'm okay with it. Right, right. So setting aside the will,
we all be dead question. Your question, if I, your related concern, Matthew, if I'm hearing you
correctly is, if we look at the history of technology, most recently with social media,
that was supposed to connect us all in this blissful Kumbaya way, but it actually has driven
deep wedges and created a lot of like anxiety and capitalized on our vulnerabilities as summed
up by the Buddha and his first noble truth that is often mis-translated as life is suffering,
but more accurately could be translated as life is unsatisfactory if you're constantly,
you know, chasing things that will not last given how unremitting impermanence is.
And you look at the effect of social media, not so positive by most people's lights and say,
what is AI going to give us? Is it, you know, is this just going to drive us further into
anger, anxiety, disconnection, dislocation, et cetera, et cetera? Decent summation of your concern?
Cal, what do you say to that concern? I fiercely agree, right? I mean, I would say one of the big
projects in my writing over the last decade is looking at exactly this issue of you introduce a
technology for some purpose and it has all of these unintentional side effects. You introduce
email to get rid of voicemail and it fragments our attention to the place where work becomes
unbearable. You introduce social media so you can keep up with the relationship status of your
college boyfriend and before you know it, it has completely colonized our mind and changed our
epistemology to one of engagement over logic and basically broke the country. So God only knows
what the side effects are going to be if we have the widespread adoption of AI. We've already seen
a few, right? Like social media, one of the bad negative side effects of social media is that we
moved in person real value sacrifice based relationships and interactions to this low friction
sort of easy digital world of interaction, what's called social snacking by the social
psychologist. And we all got more lonely. Well, social media did us a favor by becoming worse.
It followed the TikTok model and now no one actually socializes with people on social media anymore.
So maybe we're going to get a breather, but then chatbots came along and now people are saying,
oh, it's way lower friction to have a conversation with a chatboth than a real person because it
really feels like it understands me. And I have a much more enjoyable conversation with it than
actually interacting with the real person. So we got a breather from getting away from social
interaction. And now it's back to being worse again, multiply those problems by 100. And that's
what we'll have if we approach AI like we did all of the other technologies in the last 20 years,
which is to basically say, it's my job as a consumer to figure out why this is useful. I'm going
to try everything. If a company from Silicon Valley says it's a big deal, I need to use it and it'll
cause whatever damage it causes. We have to get rid of that mindset. We have to switch to a digital
minimalist mindset of, I'm not going to use your tool until you have an overwhelming hard to
ignore case for exactly how it's going to help me. It's not my goal open AI to figure out how to
make chat GPT useful to me. You come and convince me that there's some part of my life. This is
going to make better and then I'll use it. We have to switch our mindset to starting with our values
first and only choosing and deploying technologies when they support those values instead of
inhibiting them. I recently read in the New York Times, Brett Stevens, one of their sort of
right of center columnist. He wrote a very strident piece saying, you should not
use AI in your writing at all, which I think I disagree with, but maybe some of your statements in
that last utterance might be pushing me into Brett's corner a little bit. I, when all the noise
about chat GPT started in 2023, I vowed to myself, in my, I was in my early 50s at the time,
55 now, that unlike all the past technological revolutions, I was not going to be late on this one.
You know, I was late to the internet, late to social media, so I'm just going to embrace it
early. It just felt like the right thing to do and counterintuitive for an old guy.
And I have found it actually pretty useful in my writing not as something that writes for me.
It's a terrible writer, but as, first of all, as like kind of an enhanced Google, like for research,
although you have to go back and double check everything it says. And as a decent thought partner at
seven in the morning, when none of my actual writing partners are at work, and I can bore the
shit out of chat GPT until the cows come home and it never gets tired of me. But again, I always
need to run any conclusions I land on in my conversations with chat GPT past actual human editors.
So I'm just laying out how I use it and have found it reasonably useful.
But should I be rethinking that?
I think what you're talking about there would be an alignment with Brett's article.
Like here's the way I think about Brett's call, which I actually agree with. Here's the way I
think about it. There's two things with AI and writing that I worry about. One is I think it is
emotional or psychological fraud to try to take writing that was largely produced by a computer
and make it seem as if it came from you. So I have a bright line against that because when you
are consuming writing that you assumed was written by another person, you're actually
simulating that other person's mind within your own writing is like a telepathy. It's magical.
It's a way of taking an internal human state, a cognitive state in a human brain somehow capturing
it and squiggles on paper. And then having another person recreate your internal cognitive state
within their own head is an incredibly intimate human thing we do. So I do think there's
a level of fraud would be involved if I have AI write the email that I'm sending to you because
I'm simulating your mind, but it wasn't actually your mind. So that's one bright line.
The other line I have is writing is how you get smarter. Writing is one of the most
commonly demanding things we do as humans. I wrote a New Yorker piece about this a couple years ago
where I got into the neuroscience of writing. And it's a symphony of connections between many
different parts of your brain. So it would never normally work together. It is incredibly demanding.
And it's what makes humans who they are. Go read Walter Ong's, you know, go read Walter Ong,
right? And he gets into a huge detail about almost anything we think about today as rationality
or logic or human rights or anything we value intellectually could not exist until we had a
writing and writing allowed us to sort of grapple with and make sense of these. So it's important
that you write. All that being said, I don't see any problem using a chatbot as a better Google.
It is a good Google, especially if it's pointing you to sources that you then read. I think it's great
for it. I think it's fine to have, I've tried this conversation with chat GPT. I don't think there's
anything morally wrong with it. It worries me because it's really addictive because it's very
positive and it makes you seem really smart. And I've got very wary about it, but I don't think
think there's anything wrong about that.
So actually I,
And I have no issue with what you're saying.
But I do have issues with having it right on your behalf or just writing less.
I think both of those things are important.
Matthew, are there use cases for cat bots that you think are healthy and adaptive for
the average viewer or listener of the show?
Yeah.
Well, I loved what Cal said that dimension about telepathy, which, you know, in Dharma
circles, Buddhist language, we describe as something like transmission, that actually
the nature of the thread between a teacher and student in the Buddhist world is essentially
sharing one's mind and actually conveying with a incredible precision and authenticity
like what it's like to it's some level, a Dharma talk is narrating one's mind.
And to have the output of of an LLM, that is only add static to it, even if it sounds
good.
And so I'm really concerned skeptical about and have never tried to use the technology
to augment, you know, Dharma talks that I give or anything like that.
That makes me very wary and it's not to say that there wouldn't be something very compelling
that would come up in the, the output, you know, that can imagine like, okay, give me
a poignant story about change or something like that.
And then, you know, Claude's going to do it, right?
Or something like that and, but I'm, I'm wary.
And so I, I can't imagine given the limitations of teachers to meet with students one on one,
I can't imagine some individually tailored instructions.
Maybe it's one of the kind of frontier models, whatever.
Or maybe it's something that is over trained on Dharma, you know, on one teacher or a series
of teachers in some way, I don't know the technical kind of applications that are possible.
But I could imagine that being giving very good feedback.
In fact, I have a friend who in an online retreat was consulting, you know, asking very precise
Buddhist questions at, you know, that were essentially enabled him to deepen the Dhamma
Vachaya investigation, investigation.
And so there was something about the output that was harvesting from, you know, the all of
the world's wisdom in his specifically Buddhist, you know, teravodin Buddhism, that enabled
him to actually hone the meditation techniques in some interesting ways.
And, but that was dependent on him being intrinsically motivated to, to practice and using
it in a way that was, I would say balanced and, you know, circumscribed rather than getting,
you know, sidetracked with philosophical inquiries or these kinds of things.
It was really in service of phenomenological investigation.
And when it's like that, I really can see its value.
So you think it would be kosher and maybe even helpful to talk to a chatbot about your
meditation practice or fine points of the Dharma?
It's going to be better than all of us at some level, you know, and that is, that is my
sense that it's, it's, I don't know it well enough, but it will, at some point, the output
will be excel that of, you know, our most luminary best teachers.
That's my, that's my guess.
But what's interesting to me, and I'm not going to name any names here, but a very prominent
Dharma teacher recently released a chatbot based on their, I'm going to use their as the
pronoun, not just, not to give away the gender of the person on their work.
And there was an uproar.
And so I read, I actually personally don't, in this may make me unpopular with my own
viewers and listeners, but I don't actually see a big problem with releasing a chatbot
of your work, especially if it's, you know, done with humility and, and in a sense of experimentation.
But with the outsized reaction speaks to me to the massive anxiety that people feel and
weariness that people feel around this technology.
When is the Dan bot coming, Dan?
The thing is, in order to create a bot around somebody, you actually have to know something.
And I am not a Buddhist scholar or a highly trained Buddhist teacher.
I'm not a computer scientist like Cal.
I am an interviewer and I can speak confidently on a few things, but not, not in the way
you can.
So I don't see a bot coming anytime soon.
I appreciate the, the, the, the strength of the reaction from people is does not surprise
me at all, you know, and you can look at polling and some threat to this basic notion of
Dharma as warm hand to warm hand, you know, as the Zen tradition says that that and that
to disrupt that at some fundamental level is very destabilizing and, and you could probably
see that in, in classrooms and, you know, education that there are, there will be risks
to the disruption of the, the warm hand to warm hand.
That's why I believe chatbots can be really helpful in the ways you've described.
And they're not a replacement for either one to one relationships with a Dharma teacher
or a parasocial relationship through my app or some other app or, you know, going on
retreats, et cetera, et cetera.
I think I see it as an augmentation, not a replacement.
Back to AI anxiety, though, because I have a few questions I want to get to before I let
you guys go.
I referenced the, the other common, well, I think there are many other common fears around
the AI, but I think the most prominent other fear other beside will artificial intelligence
eliminate us is will it eliminate our jobs?
Cal, how worried should we be about that?
In the near future, I want to be very worried because it has struggled to do this.
Even though year after year, we've been told it's about to, even after we went through
a whole season this fall in this winter of what became known as AI washing were tech
companies that were right sizing after over hiring during the pandemic kept trying to blame
layoffs on AI only for it to be pointed out that these layoffs had nothing to do with
AI.
It was just a way of making them sound more smart.
So right now we don't see this as being a particular fear.
Something I'm reporting on at the moment, which I think is really important is that even
in the world of computer programming, which is the best case scenario for AI.
This is where we have the most advanced AI tools.
We have the most impressive adoption.
It's the use case with the best data and it's the use case that the AI engineers understand
best.
So these coding harnesses that can produce code automatically have swept through computer
programming, right?
It's it's ubiquitous now.
And now what's the reporting showing after four or five months of this, a lot of these
senior engineers are quietly having to go back to write a lot more code by hand because
it just it's not trustworthy enough and it's too hard to review the code being produced
by a machine when you write code yourself.
This is how you understand how a system works and when you understand how a system works,
you know how to prevent it from actually crashing.
And this doesn't mean that these tools aren't useful in computer programming, but it means
that even in this best case scenario for AI to come in and take over jobs and we were
told it was doing this and it had been doing this.
We're struggling to actually have it do it because what we do is humans in a lot of these
jobs is complicated and it's multifaceted.
It's easy to augment work with technology to make it easier.
It's really hard to automate work.
So I think there was a big moment, maybe like a six month moment where this was a conversational
topic to sure it's going to take all the jobs, it's going to crash the economy.
And the frontier labs moved off that topic.
I think it was right around the time they started talking to East Coast bankers about IPOs
and they said this is not the right talking point to be talking about.
And now we moved on to other things like a line men and super intelligence and AI getting
out of control.
So no, I don't think right now there's a widespread fear that we have an imminent threat
of a widespread job automation that's like about to happen like that.
Matthew, how's your blood pressure in response to that?
I sit still for a living, Dan.
You know this.
I'm like so far out of my zone, you know, but I naively feel like have seen enough capability
to be, it's not hard to imagine wide swathes of jobs being changed fundamentally given
given the just the capabilities that I've seen in my limited exposure.
And that is that that's sobering, you know, and when I think about certain tasks, it's
just hard to imagine companies wanting to pay a human for it.
You see right about that, Kyle?
Yes, but that's normal, right?
I mean, this is a normal technological story that you invent a new workplace productivity
technology and it automates certain types of work and replaces some types of work and
other types adapt, but we didn't have the same levels of existential dread about it.
I think the internet, for example, was massively disruptive.
the personal computer was massive.
disruptive. But we didn't think about it in terms of the economy is going to crash, or
that like Sam Altman has proposed some multiple occasions, we're going to have to have a sovereign
wealth fund based on stock grants from the AI companies from which we can actually give
people income so they can survive after most the economy is automated. We never thought so
extremely about past past innovations, even though they did change things. We didn't think
about it as fundamentally going to destabilize the entire economy. As it stands now, it's hard
to use these tools to completely automate even major parts of jobs. I think that the two most
useful use cases we have right now are computer programming. I think it is true. This is very
disruptive. For the most part, computer programmers have letting agents produce the actual code. They'll
heavily spec what they want and look at what it writes, but that's a big change. In certain types of
mathematics, these mathematics solvers that are built on LLMs, along with other tools that are
all orchestrated together, are changing the way that people in my field do mathematics, that we're
using these tools more often. It doesn't solve mathematics. It can only work with stuff that humans
have already proved, but it is disruptive there. I think that's the normal story. I think that's
what we're going to get with AI. Always with these technological revolutions, it goes slower than
you think at first and then has bigger impacts than you assumed in the long term. I think 20 years
from now we'll look around and say, wow, there's AI one way or the other, heavily integrated into
almost everything I do in my job in a way that wasn't the case before, just like today versus 1980,
or like, man, there's computers and networks involved in almost everything I do as my job in a way
that would have been inconceivable 40 years ago. I think that's right, but I also think that's more
normal than the rhetoric we've been hearing is allowing us to accept.
So, for much of this interview, Matthew and I have been peppering you, Cal, with skeptical questions
about how much we should be worried about AI. For this section, I want to focus on you, Matthew,
and then Cal, you can weigh in with anything you'd like to add. If people listening, retain
their anxiety, let's talk from a Buddhist perspective about tools for navigating an uncertain
future. What would you suggest? It is striking that the the Buddha places uncertainty at the center
of all things. That Anicha, Anicha is usually rendered as impermanence, but sometimes also as
uncertainty. And uncertainty, you know, mobilizes a sense of urgency in us because there can be
more than one outcome, some of which we prefer more than others. And generally speaking for an
animal, the default response to uncertainty is something like stress. And stress at some level
occurs when we feel something or surprise by what we're feeling and we do not know how to
mobilize to meet that threat. And because feeling is really sensed as threat, this is why
Buddhist teachers are often pointing us back to our body and the somatic cues. Because at some
level, if feeling is the kind of alarm, thinking is the rapid response that we try to marshal
in order to manage that sense of the world trembling. And the world is always trembling. And the
basic manner in which we have tried to manage Anicha uncertainty is to think and to worry
and to generate fearful scenarios and attend to those fearful scenarios. Or we're trying to
game out all of these contingencies in our life and try to cling our way into more
security. And so this is a very deep habit of our mind. And even while we're meditating, we can
actually recognize that a lot of the movements of our mind are an attempt to know what the trajectory
of our life means for the next moment. What this felt sense of this moment means for my future.
And there's a sense of being squashed between the past and the future where the present is
essentially only leveraged in order to ensure our security. And information is sometimes described
as defined as like the reduction of uncertainty. That's what information is in some sense. And so
if we enter a room that's where the lights are out, it's completely dark and we're sighted,
we turn on the lights, there's information. There's less uncertainty, right? When we're sitting
there on our meditation cushions or we're lying there in bed late at night trying to go to sleep,
we essentially are hungry, desperate for information in order to reduce uncertainty and sense of
threat. And the place to which we got, we kind of go to the our low budget Google,
namely thinking, you know, and it is about generating and attending to various scenarios and
contingencies. And no doubt some of this is adaptive. You know, the notion of just like live
in the present moment, it's like silly. It's silly. Of course, there's a ton of planning and
prognostication. In fact, like wisdom at some level is the ability to predict true happiness,
to predict what will satiate our hearts and the hearts of others. A lot of this path is actually
involves the future, but our like deeply fraught, anxious relationship with uncertainty
is a shadow that is cast over our present moment in deep ways.
Okay, so this is a kind of like problem definition, right? And then what what what is the the
Buddhist council around this? On the one hand, we're asked to generate deep forms of stability
that it's not merely opening to a niche, but we are actually cultivating stability. And we are
opening in this radical way to the ungovernable, un-possessible nature of life. And so it's these
two deep tasks that sometimes clank into one another. Tell me to stop, Dan, should I just keep going?
Yeah, I'm loving this. Okay, I think what you're saying is that on the remedy side, it's stabilizing
the mind. And then with a stable mind, opening up to this uncomfortable reality that we don't
know shit. On the stabilizing front, it may be counterintuitive, but I would say the Buddhist
tradition begins with something like love and ethical responsibility that this is part of how
we stabilize our life is that we in sconce ourselves in a network of care and responsibility and
debt and gratitude and love. And we come to find in our Dharma life that that increasingly
because we have been careful not to trespass on the hearts of others, because we know that there
is no such thing as a closed-hearted happiness, we live into a network of care and mutual
respect and we feel suspended, supported by that. We develop stability through the practice of
equanimity, right? The kind of sense of so much of our anxieties, the sense that I will be
run over by phenomena. There are possibilities for my future that will obliterate my heart,
sense of well-being. And the practice of equanimity of actually staying stable amidst
intense feeling is essentially an anti-anxiety practice that the more confidence we have in our
heart to be with the various valences and intensities of the future, the less we need to actually
attend to fearful scenarios. The sense that, oh yeah, it's good, this really may hurt and that will
not harm my heart. That is a kind of security that we start to sense very clearly. And we develop
the stability of ease and tranquility and our whole life looks different from the perspective
of tranquility, our whole life, including risk of all kinds. It just looks different. It's not
that the problems are resolved, but everything looks different when we come into that deep balance.
And then lastly, maybe on the stabilizing front would be something like if uncertainty is this
sense of
of being this impoverishment of information.
We need more information.
Part of what we are doing in our Dharma practice
is distinguishing signal from noise.
And meditation at some level is about learning
what is actually trustworthy information.
What we actually can take to the bank
and it is good predictive data for understanding
our future happiness.
And a lot of times the state of delusion
is one where it's a cacophony of voices
we do not know what to listen to.
The noise of greed and hatred,
which are not useful in sources of information
predict for predicting our well-being is just not.
Our ego, this is static, that is noise,
that's distortion in the system.
It will make us choose pathways that are less likely
to lead to our happiness.
So a lot of meditation is about stabilizing our mind,
learning what is trustworthy within us,
learning where the distortion and noise is
and living our life on those accord.
And then the last piece, and then I'll be quiet,
would be this more radical practice of opening
to uncertainty and to the ungovernable endless, relentless
nature of this human realm, the sense of opening
to the unpossessibility of our life, that our life
depends on a million other factors
that we do not call our life, that we are supported by that,
that we are in this network of fragility
and that it will not last forever.
And so this is a reflection on mortality ultimately.
And that is why the tradition commends a kind of deep exploration
of what that does to one's heart, to live alongside finitude.
But even before that final contemplation of death
is the sense that I do not own my life.
I do not own my life that it has a risen,
it's dependent on many causes and conditions
and that I can exert influence.
But the efficacy of that influence
creates the illusion of control.
And so this kind of deep wisdom of letting go and surrender
and the sense of no longer exerting willfulness over that,
which is ungovernable, there comes great relief with that.
And much of the Dharma is only revealed when we relinquish
the willfulness and see what lies on the other side
of our power, what goodness is already there.
This is a kind of radical dimension of the Buddhist practice,
but an important one, as we also cultivate all of this stability.
Let me see if I can reflect that back to you
and also just add on some of my own two cents.
I think what you're saying is in the face of uncertainty
and AI is a huge vector for uncertainty,
the Buddhist recommendation, or at least the recommendation
from you as a Buddhist, is stabilize and open.
So stabilize the mind one way to do that
is to just live your life as a kind connected person.
We know from just basic understanding of evolution
and also from modern psychological research
that living in a generous, connected way
is a great way to regulate the nervous system.
Another way to stabilize the mind is through meditation,
which can help us be less distracted and help us be less fooled
by our unwise thoughts and more open to our wise thoughts
and impulses.
And once we've stabilized the mind in this way,
we can do this radical thing of opening up to the fact
that we don't know and we don't have full control.
Now, this can be where the two cents come in, mine.
This can be misinterpreted as a kind of resignation.
That's not what it is.
It's acceptance, not as resignation or passivity,
but as not being at war with reality.
So that you can, with your stable open mind
that is now connected to the non-negotiable truth of things,
do whatever is within your capacity to do.
And so for me, to the extent that I can muster optimism
or hope at any point in my life, it really
is connected to, if I follow the tools
I've learned through Buddhism and modern psychology,
I will be maximally capable of doing whatever I can
in whatever situation arises.
Nice, nice.
Sounds good, Dan.
Cal, you've just been asked to sit through a large dose
of the Dharma.
I know many technical folks who are very interested in Buddhism
because it is so technical.
Was all of the foregoing boring or compelling for you?
My blood pressure is definitely lower.
And what came to mind is a potential synthesis
of the way I'm thinking about AI and the way Matthew is,
I want to run this by Matthew.
And so I'm reflecting it back to see if I'm seeing this
in the right way as well.
So one of the things that came to my mind
is that a trick that AI rhetoric is pulling right now
that really is pretty malicious,
is that it puts people into a cognitive state
that there's an acute emergency.
But it doesn't actually give them a response they can do, right?
So there's an acute emergency.
The alarm bells are going, but there is no,
let's get our possessions out of the house
before the fire gets here.
We have to get to the doctor and deal with this.
We don't know what to do about it.
And I'm assuming for a lot of people who would aspire
to what Matthew was talking about,
the sort of equanimity, the meditative Buddhist approach,
it's very difficult to access
when you feel like you're in a state of acute emergency.
So maybe one way to synthesize this,
what I want your opinion on Matthew is that,
I'm trying to reduce the sense of that we're an acute emergency.
We're not all about the die, your job isn't about the disappear.
That does not get rid of the uncertainties around the AI.
That does not let us off the hook.
But it does put us back into an area
that we have been continually for basically
all of the 20th century.
Before this, there was a pandemic.
Before this, there was a financial crisis.
Before this, there was terrorism post 9/11.
Before that, we were dealing with nuclear threat, right?
It puts us back to a level of uncertainty
that we've been at before.
And now maybe the average person has a hope
of actually making progress with exactly
a type of approaches that Matthew was talking about.
So it's this idea, Matthew,
that I'm like the amused bush
that hopefully allows the average person
into the entree that is a sort of Buddhist approach
to uncertainty.
Am I finding a way here to synthesize our approaches?
- I like it, I like it.
Yeah, it's like, maybe we say
we've been over-trained on fear and anxiety
or something like that.
And that's actually there's some evolutionary
whatever conservation of some mechanisms of fear.
But we actually are not going to exercise our wisdom
from a place of catastrophic thinking, hyper-rousal.
And so the sobriety is a way actually of accessing
our collective wisdom.
Sounds good.
- Gentlemen, that's a perfect place to leave it.
I am so grateful to both of you.
This has been enormously helpful for me personally,
and I hope for everybody watching and listening.
I also want to thank DJ Cashmere,
who produced this episode with an enormous amount of skill.
Just in closing for Cal Newport,
you should check out his books.
They include Deep Work and Digital Minimalism,
but there are many more.
And he's been on the show several times.
I'll put links in the show notes.
He also has his own show as a reference at the top
called Deep Questions, where he does a lot of debunking
of the latest fear-based AI stories.
And I'm a regular listener and can hardly recommend it.
Matthew is, as I referenced before,
constantly teaching in the Dharma world.
Matthew, if we want to learn from you directly,
take your courses or whatever,
is there a website we should go to?
- Just my name, MatthewBrenzelver.org.
- I'll put a link in the show notes.
Gentlemen, I'm, as I said before, incredibly grateful.
Thank you both.
- Thank you.
- Thanks so much.
- Thank you so much to everybody who works so hard
to make this show.
10% happier is produced by Tara Anderson and Eleanor Vasili.
Our recording and engineering is handled
by the great folks over at Pod People.
Lauren Smith is our managing producer.
Marissa Schneiderman is our senior producer,
DJ Cashmere is our executive producer,
and Nick Thorburn of the great Indie Rock Band,
Islands wrote our theme.
Also, one last thing before you go,
remember to sign up for my new app,
which is called 10% with Dan Harris.
You can sign up over at DanHarris.com.
On the app, you'll find a growing library
of meditations from world-class teachers
add free access to the full expertise of our podcast guests,
meaning you'll get this podcast when there are ads,
exclusive livestream events, which we do weekly,
sometimes twice a week, robust discussion threads
to connect you with our team, with our teachers,
and with one another.
There's a free 14-day trial if you wanna try before you buy.
Peace.
(upbeat music)
Podcast Summary
Key Points:
Summary:
Chat with AI
Loading...
Pro features
Go deeper with this episode
Unlock creator-grade tools that turn any transcript into show notes and subtitle files.