DARPA Scientist UNLOADS on AI Doomers, DNA Gene Editing & CERN | Lee Cronin
3h 1m 53s
Lee Cronin reflects on his work with DARPA, highlighting how the agency has funded key research in chemistry, molecular computing, and AI-driven discovery. He describes building a chemical computer using a reaction that mimics neural activity, demonstrating how chemistry can process data without silicon. Cronin emphasizes that while AI tools are powerful, they are not intelligent in the biological sense—they only retrieve and process data already in their training sets, lacking true creativity or the ability to solve novel problems. He contrasts AI’s role with human cognition, arguing that humans generate original, unpredictable ideas—something AI cannot replicate. He warns against AI doom narratives, stressing that real risks stem from human misuse, poor regulation, or biased systems like social media, rather than sentient AIs. Cronin sees AI as a powerful tool for augmentation, not replacement, and calls for greater ethical oversight, transparency, and critical thinking in how these technologies are developed and deployed. He concludes that genuine scientific breakthroughs—like new laws of physics or novel chemistry—still require human creativity, intuition, and biological insight, which current AI systems fundamentally lack.
Lee it's great to have you back man last time you were here episode 289 was like a year and a half
ago you closed up like we literally stopped the cameras and then you're like yeah I was doing
some work for DARPA as well and you just lay that one on us and I'm like well that I mean you're
supposed to say that at the beginning of the podcast but now you're telling me like ah it's
not that big a deal how's DARPA not a big deal I mean I'm like a big DARPA fan yeah I don't so
um I will I've had maybe let me get this right so how many grants have I had from DARPA
so DARPA is a funder right they're a funder they're a they're a grant funder they give people
money um I think they're them the reason they were established you know why they were established
I think you can you can check this so their mandate was like to not when Sputnik
went up into space the US were not expecting that satellite the Soviets launched a satellite
I believe it was in the 50s I think that's right and and it basically DARPA was then established to
to to eliminate strategic surprise so they were so basically that wanted a load of money
fund people do crazy things and also to have a mandate to do stuff so
arguably DARPA might have had something to do with say the internet right self-driving cars
um and um a few years ago DARPA started looking at um chemistry and AI like many years ago way
not way before way before the hype now and they there was a program they started called make it
actually um and I and the the person who started it you know they kind of used um
uh some terminology from one of my papers and I was kind of a bit grumpy they didn't offer me
any funding right because they had they gave money to MIT to Stanford Research Institute
DARPA plagiarized Lee Cronin I didn't you used the p-word I did they were inspired I said anyway
they I remember they got on a call with me and I was like complaining bitterly um the bet that they
used this paragraph of you know what I was trying to do and they're like Dr. Cronin we're phoning
you up because we want to talk to you about that and I was like okay and basically what it turned
out is they wanted me to put in a white paper and I said okay I want this you
know a zillion dollars and they said well why not ask for a little bit less and do this thing
that fits into our program you know it's U.S. taxpayers and you're one of the uh you know few
groups overseas doing this thing and we think it would be valuable for us and what was the
thing specifically so it was to it was to um it was part of their make it program can you make
molecules on demand right in theater or you know on the moon in Antarctica whatever right how do
we do chemistry robotically
and then when they asked me about that and I've been building chemical robots for years
hey guys if you're not following me on Spotify please hit that follow button and leave a five
star review they're both a huge huge help thank you you've been building chemical robots for years
yeah yeah yeah yeah that's a dense statement for for since 2012 right 20 so about yeah about 14
years how would you define a chemical robot for people out there who are unfamiliar a robot that
you give instructions to and it will
do chemistry so yeah I mean it's a it's fit it's out so I made I can tell you about it but let me
answer the DARPA question because you asked so that was the first grant they gave me make it and
they and that they carried on giving money there and then they were they had a one-on computation
using molecules to make molecular computers and I I got money from DARPA there and that was in a U.S.
consortium so there was a couple other groups in the U.S. right and then there was another uh grant
that gave me uh for a couple other groups in the U.S. right and then there was another uh grant that gave me uh for
kind of advanced using AI for discovery so they were the three DARPA grant I think there's three
DARPA grants what year did they give you the AI grant I can't remember I mean ballpark 2019 2018
2019 and then it carried on through the pandemic it was a bit tougher in the pandemic but DARPA
a brilliant organization right they go where the experts are they don't give grants to people
in countries that are probably anti-america I would say right so don't just say
they're not they didn't fund bin laden so they're and and also they they want to start new fields
and they want to start fields that are going to obviously be of strategic importance right
and the U.K. and the U.S. have done a lot of um hookups in different scientific disciplines for
a long while so I thought that was quite good um the molecular I made a molecular computer
chemicals to do computation as well because I what does that mean yeah I don't know yeah I mean so
so well I know what it means now so what does a computer do so a computer we're around going
everywhere but anyway let's start with what is a chemical computer a chemical computer is a
chemistry set where you could put in inputs the the the data you input the data and into the
chemistry somehow and the chemistry would then take that data and process it using chemical
reactions rather than transistors on silicon and then you'd read it out using it some method and I
was like I built a chemical computer um using a thing called the bluzov-zabaskinsky reaction which
is a chemical clock and all it does goes tick tock tick tock or red blue red blue red blue
okay so basically pour a lot of chemicals in the pot you could just take uh you know
maybe a just a beaker which is like a like a glass put in half fill it up halfway put in
some chemicals and without doing anything just leaving look watching it it would flash red blue
red blue red blue whilst you're stirring it when you stop stirring it it would basically stop
but then spontaneously flash one color or another what's called an excitable media it's a bit like
how think about how neurons flash so that's a cool idea why don't I just basically make a grid
of stirrers so I 3d printed a grid basically about the size of a small book and in that grid
there was it was seven by seven grid so 49
um little wells and I put a stirrer bar in each one and had put a little motor under it
and stirred them and put the chemical reaction in and all the colors went across the grid and
I used a web camera to basically read out the colors and so when the stirrers were on I could
that that was a one when a stirrer was off that was a zero and I basically then uh put uh basically
printed in ones and zeros to represent some input and then just read it out and then worked out
what it was doing we kind of just made it up to start with yeah what does that tell us when you're
done well that's hey it's a DARPA project it's supposed to be crazy bad no so what it was
supposed to do is is could I could I somehow use the because remember the bz is a clock
tick tock tick tock tick tock if you put a load of clocks together and you allow them to synchronize
as they desynchronize you could process some information so we actually used it to classify
and we used it to make a primitive neural net and the idea was a neural net you literally used no
power and was quite good at error correction and could like refine images so the same way
you'd use chat GPT or you'd use a kind of Nvidia's architecture to do gradient descent
um and what is gradient descent well it's basically that it changes the weightings in
the in the neural network and to basically you know kind of maximize um its training capability
so you have the weights and the and the activations two different things but basically this was a
chemical neural net it was the idea it was the first step I'm now making brain gels but that's
another you're making brain gels now because we put that and put it in a gel because it was all
liquid it's sloppy and it the memory wasn't that good but if you put it in a gel then maybe you
could then basically use the polymer gel to flip to switch in such a way you could teach
the system to learn for a longer period of time how does that work scientifically no idea
that's why I did it so you're trying to figure it out it basically yeah I mean look we're again
we're all over the place but why not that's good I was inspired by the episode of pickle Rick and
Rick and Morty and I was like well I and so so so so it's like I took a gherkin right
and attached the gherkin to the mains to 240 volts and then put in load low you know my
workshop I have at home um and used a bunch of electrodes and I tried to program the gherkin to
recognize the difference between a circle and a square but it kept exploding kept exploding
because it kept heating up with them so I had so long so I took the gherkin I thought the gherkin
could be a good um it seemed like a good idea it's like it always does a gherkin computer like
literally you could just be making this up right it's like yeah just anyway so gherkin heat it up
to put it in there it sounds ridiculous you heat it up by putting it in the 240 volts what would happen
to the ions potassium ions because it's in salt so you've got this gherkin you soak it in the salt so
it has this salt in it it's conducting when you put power when you put electricity into it when
you put alternating current at high voltage it heats up and basically the ions can move around
so it literally makes an excitable media a bit like the BZ reaction like flashing on or phone
off but here with a gherkin and then when I put in little electrodes I put in a little grid and I was
then trying to basically train the gherkin to tell the difference between a square and a circle
because it was made malleable it's a bit like taking some uh taking a some
and making it liquid again and then you make it liquid again and it'll learn something and you'll
set it but the thing is the gherkin kept exploding before i could actually train it and this is in
your lab at your house i did at home yeah i mean i don't think the university would be too happy
so now fast forward to the brain gel i was like well look if i could take a gel and then make the
gel conduct right so it conducts electricity a bit like a um um yeah like a wire but and then put in
electrodes on one face and the other and program one surface using a camera so i could just take a
visual feed and plug it into the jet into the gel and then basically read out as i show the
camera to different objects can the gel tell the difference between the edges on the objects and
train it in the same way you'd use open cv or some kind of um silicon based um system for
edge detection right it's a bit like you use a jetson nano or something right
and that and i was just playing around if i could use material to compute turns out you can but the
now you're like when you said well how's that work and i laughed well it's not because i'm making it
up but because the way you program material is the material responds in time um according to
its stimuli so it's very much trial and error so it's a bit like how the brain has evolved like
the brain has evolved over billions of years and so the brain has a number of different kind of
programming periods it was programmed by evolution so your brain let's say it's 3.8 billion years old
so that's time that's time number one then um you are created by your parents so over a period of
nine months your brain is growing in the womb as you as you and so your brain is starting to program
when you're then born obviously between you go through massive developmental surges so you know
age 21 22 your brain may be fully almost completely gone and you're able to program your brain in a
so then your brain is then able to process data in real time so there's all these different
developmental stages so the brain is able to evolve grow be programmed activate and then
continue to work and we have no idea how brains work and what are unique to brains well sentience
consciousness the purpose the the and a living system that will tell you that they are an
individual you talk to all humans most humans can communicate with will communicate with you
we'll claim they're an individual do you desperately need a nicotine pouch every 15
minutes just to feel normal so does joey deep he's a complete addict which is why deep started using
ultra's new energy pouches they've been an elite upgrade for this fiend ultra pouches are instant
energy in one pouch ain't that right thief oh yeah he's been using them obsessively for about
a month now and they've been giving him a huge intense energy boost when he needs that extra
kick in the morning during work or before working out these are 100 nicotine free pouches
and they give you energy in a way that's completely different from nicotine coffee or
other pouches ultra energy pouches still contain some caffeine to give you that little lift the
real difference comes from their other ingredients including l-theanine to smooth out the energy and
curb the crash vitamin b3 to turn carbs fat and protein into brain fuel vitamins b6 and b12 for
balanced mood and recovery so unlike nicotine that might only help for 10 to 15 minutes ultra pouches
deliver instant energy that lasts for 30 to 60 minutes that's why you see me passing so many of
them under the table during the day
the best part about them is these are clean truly good for you pouches zero nicotine zero calories
zero sugar zero sketchy gas station chemicals ultra is the ultimate guilt-free pouch delivering
instant energy mental clarity and boosted mood without nicotine sugar or calories ultra is
trusted by pro athletes entrepreneurs and engineers around the world it's for everybody and today our
listeners can get the ultimate guilt-free pouch for 15 off using code julian at takeultra.com that link
is in my description below. That's TakeUltra.com, link in my description below, for 15% off with
code JULIAN. After you purchase, they're going to ask you where you heard about them. Please
support our show and tell them I sent you. So you think the brain is the thing that is
strictly just programming that in and it might not necessarily mean that that's the case?
No, no. I think there is something very interesting. I don't think it stops at the
brain. I think biological systems are very complicated, but I think humans are unique
in that they will claim to be an individual with words if we teach them language. And I think
that's something that we don't understand how chemistry gives rise to consciousness and how
chemistry gives rise to the fact that I will claim to be me and I have my own particular
personality and do stuff. This is very important in this time because we're viewing that AIs are
entities that are sentient and they are indeed they are not. Yeah, you've made a lot of arguments
on this because you think that, for example, a lot of AI doomers are making leaps that the AI can
exist without human beings, I guess, in the future. And you don't agree that that's the case.
Yeah, clearly, clearly not. It's fantastical. Why do you say it's fantastical?
Well, we've not seen any evidence of that. So if we think about the origin of AI,
right, if you go all the way back, origin of life, the AI is produced by, well, let's say the
origin of the term AI was at the DARPA, sorry. Wait a minute. Don't do that.
The Dartmouth meeting, which you know, you can fact check it.
It's a little Freudian slip right there.
Sure. Whatever. Let's build as many conspiracies as we can. Go. But I think DARPA have funded
some AI work, right? Right at the beginning. So at Dartmouth College, the term AI was kind of coined.
When was that again?
In the 50s? I mean, I don't know, 56?
I don't know. But a long time ago, maybe a bit later. And so, but if you think about what a
computer is, a computer is a deterministically built system. It's switches, right? And the way
those switches work is we build, a computer is built out of switches. Those switches have high
and low. You put those together to make logic gates. Those logic gates, the universal logic
gate in a computer is enormous.
And NAND gate.
And NAND gate.
Yeah. And NOTAND, right? You can build everything with NOTANDs, right? You can, so NOTANDs are
literally, you can build memories, you can build everything. The way you architect those together,
you build the silicon, the silicon infrastructure for everything we have today is based on that.
There may be some differences that I'm, you know, electrical engineers watching this,
listening to this might be shouting, go, no, that's wrong. There are other things called ASICs,
which are basically that you might be able to do.
What we would call neuromorphic computing, where basically you could have an analog voltage. So
in a transistor, you basically, typically you would have a voltage between zero and five,
five is high, one, zero is low, zero, and something in between. And if it's on the zero side,
you call it a low, and if it's on the five volt side, you call it a one. But I'm not a qualified electrical engineer, so I don't know
how the ASICs are built today. I've designed some ASICs for fun, but yeah, well, I want to build a
brain. So if I want to build a device, a chemical brain, I have to design a, I need to have an
analog kind of electrical system for addressing the chemical brain. But we'll get there later.
Yeah, we'll come back to that.
So the most important thing with a computer is like, it's fairly deterministic in some regard,
and what, sorry, let's not say that, it's digital.
And so that means I can put in the inputs in there and go on. So with AIs today, they're based upon
digital computers, and they use all this digital infrastructure. We take massive amounts of data
and train a model, and the model can do splendid things. But the doomers say that these models could
run away. And I agree the models could run away with bad humans running them, right? There's
always a human in the loop. The human is turning on the power station. The AIs, although they are,
they use terms like recursively self-programming. I mean, it's a bit like you and I could build an AI
now that we can have a loop in a program, like, you know, do this thing. And if this thing occurs,
then do that thing and carry on until it either hits the objective or someone turns off the
computer. Now, that's always been the case, right? Those loops have always existed. So the AI doomers
are kind of stuck in this like,
this kind of fantastical reality whereby they say that AI could overtake the world and cause a
nuclear explosion or something else. What I think is more likely is that bad humans using the AI to
do bad things will happen. And I do worry about that. So I'm not dismissing AI doomers. I'm
dismissing AI doomers who are saying, this thing will happen because magic.
On its own.
Yeah.
Got it.
And I think that is actually a major,
a major worry because they're talking about magic. And actually, there's just some doomer going,
some bad actor going, I'm going to use AI to crack into this system and do some damage. Or I'm going
to use an AI to bot system that will basically do some social engineering on social media to cause
some kind of effect, right? So I think that I haven't seen any evidence of sentience in any AI,
right?
No, no, no. Sentience comes from humans exclusively. Any evidence of sentience you get from the internet,
If you say to Claude, are you alive? Claude will probably say, no, I'm not alive. And they'll use
I. And this anthropomorphization is just to hook you to be addicted to talking to the entity.
What if it's a format? What if it's a technicality though? And it doesn't get to sentience,
but because, and I'm going to way oversimplify this for a minute, we're able to eventually
or create technology that isn't quite simply plugged in and unplugged to be able to do that.
Because of that, a non-sentient, but extremely intelligent artificial intelligence who has no
ability to empathize, obviously feel any sort of emotion or level of humanity, took actions that
it doesn't understand the grave consequences of. Do they have an argument for something like that
to possibly happen? So I don't quite understand the
statement, but I know what you mean, so I'm not going to be too obtuse, but
AIs, are they intelligent?
They are intelligent. We have to define intelligence. What really makes me very
confused is there are people out there that say, in next years, the AI will be more intelligent
than any human. And what does that mean? What is intelligence? If you can't measure something,
so could the AI cause something to happen on its own? No. Could humans not understanding how to set
up a system cause something bad to happen? Think about social engineering. I don't know,
take any system like
this is kind of hard because I'm not a qualified, I'm not qualified. But let's say we're going to,
I don't know, create a type of bylaw in the city that says, right, we have to have trees every,
for you to get planning permission in the city, every time you build a building, you have to have
a tree on every corner or something. So suddenly, before you know it, there's just random trees
everywhere.
Yeah.
And I was going to say, bless you people, but bless you twice.
There's dying over here.
So what happens is when humans make decisions and policies, they get propagated
and they get propagated by systems, whether it's in a corporation or in an institution or in a
software algorithm, right? So those things get propagated and there are unforeseen consequences
of them. And I totally buy that AI is object. Trying to build, to achieve an objective could do bad things. But those bad things,
humans are in the loop all the time. And I guess what I'm trying to say is the,
the AI is not bad. The human is bad or the training data is bad.
Yeah. So don't, so, and that would, if I agreed with that point and you might be right,
you know, I, I, I honestly hope you're right. And it is in control of humanity,
by the way, selfishly speaking here, but like, let's assume though, there are some sociopaths
who have their hands on the trigger with these things, which I think it's fair to say some of
the technocrats we have in the world, not all of them, but some of them may fit that bill. What's
to stop people like, you know, to put a name on it, like a Sam Altman who jokes about humanity
ending. What's to stop him from being like, ah, you know, today I want to play fucking
World of Warcraft, but with AI and let it go wild.
So look, um,
I have a lot of sympathy for people who are building companies and building technologies.
I'm building one myself right now, which we can talk about. I think we have to kind of,
we have to take a step back and say, what are we built? How are we building our technologies? How
are we regulating those technologies? And, and how are, how do we then get feedback from the
regulation of those technologies to make sure that the human good things are happening to humanity.
That's right.
So if we,
if let's take an example where this has already happened, right? We got the internet and then
we've got social media. So what was the critical failure in social media has given us arguably,
I don't think anyone would argue that social media is particularly nice right now, right?
What's the failure? Yeah, I think there's a bunch of them.
So there's one critical thing that people should have done, uh, which was the policymaker should
have said to social media, they should be treated like publishers.
Mmm. Section 230.
Something like that. I don't know what the US version is. So if you're treated like a publisher,
that is anything you put on your, on your, on your platform, you have to basically be held
accountable for. And so that you, that you don't, when you start putting nonsense out there, um,
it can be taken, you have to say, no, it's clearly a lie. Put it down.
Right.
So basically Facebook and.
You're good. You're good.
So Facebook and X and, um, Instagram and all the, and all these entities are not
accountable for the stuff they put out. Now that's, for me, that's a real problem because
basically that, that entire decision, although, you know, they're, they're a medium, it's a bit
like you can't hold the type, the person who built the type, the printing press liable for the bad
books printed. Right. I get that the same way we might argue when you talk about my chemical robots,
am I going to be liable for anyone making any bad chemistry on them?
But I, I do think there's something we can learn from the social media and the fact we didn't,
we didn't regulate that. We didn't hold them accountable. And so, um, it's very hard to know
how it's going to evolve. However, having said that, that if someone invents the social media,
there's quite good as in, you know, a nice place to be and not a hellscape. Right. And if we can
work out why humans are very good at being, you know, you, you get a anger for attention, right?
Sorry.
If you create anger, you get the attention the system wants. So, you know, if there was a social
media system whereby, I'm not saying it should be like, you know, some kind of Mary Poppins world
where everyone's like, you know, it's all flying around and all happy, but, but there, I guess we
have to understand the psychology of social media and the negative effects it has, particularly on
teenagers. When I grew up, there was no social media. And I've seen that social media has been
probably an
net negative for a lot of teenagers, but some might argue is like, well, in, in, in environments
where they don't have access to social centers or youth clubs and things, there's people can work,
play online, play games, interact one another, support one another. And we don't see all those
positive things because only the negative things are amplified. So when it comes to AI,
we have a similar quandary, which is how do we, how do we let the free market and free humans
dictate what's happening? Because there is one argument. If you look at the difference between,
say,
anthropic and maybe open AI, anthropic basically won't let you do anything on the models because
it's got some kind of higher purpose wired in. Whereas open AI is like, no, no, I'm going to
serve you as the entity. And actually if I'm a, I want to, and if I choose to use the object
to do bad things and I'm breaking the law, then I should be held accountable.
Sure.
Whereas like, and I think, so I, I'm not sure if I'm getting that correct, but it seems
to me that there is a kind of a split right in this right now, but, but that's kind of obscured
by the doom is saying AI could run away. And I don't understand the mechanism for running away.
I do understand the mechanism for tinkering. I do understand the mechanism for, but may put
disinformation out there or for doing some kind of now the conspiracy theories that don't aren't yet
possible. Here's one crazy thing. Look, there's no real conspiracy theories in history. Not many,
because humans.
Humans couldn't keep them secret, but if we had good AIs and we could just pump,
you could play around with the future with the AIs pretty well. And that might be one
thing to be worried about. Now, you know, is there one big con if we say that, you know,
one particular political movement or post second world war, when the winners talk about what
happened, could that be one big glorified conspiracy theory? Because obviously the
winners write the history books. Okay.
Yeah. There's always a percentage that's written by victors for sure. As far as like,
when you look at a story, it's never 100% what was said. I take issue with when you then try to say,
well, if 5% wasn't what we were told, therefore a hundred percent's not, you know, you gotta be
careful with where you go with that stuff. Absolutely. And I think that's really
important. And in terms of nowadays, I think, um, I, that critical reasoning to what can I verify
and what, what do I find impactful to me is really important. So I think one of the things that I think
AI will accelerate the, the teaching of critical reasoning. Right now we're in this real, um, I,
I worry a lot about, um, how young people are going to be allowed to get their first job, you know,
make mistakes, get the training, the mastery is required, have the, the, the hard work emotion.
Frustration is the best trainer, right? But whereas like people don't want to get frustrated
now, just use chat GPT.
Mm.
And so, but I think this is an aberration. I think these tools are actually, a lot of them
are really good. Like the coding tools are amazing. And so I, I do wonder,
and this is me actually shifting my emphasis a bit. If AI might actually save us all.
Save us all.
Save us all because social media is such a clusterfuck, right?
If you listen to my show, you know, I take my supplements every day,
religiously. And you've also heard me talk about how the supplement industry is really
crowded with a lot of fake products too. On top of that, everybody in health disagrees
with everybody. If you've ever Googled a supplement,
you can read such a range of opinions on what the expected benefits are,
somehow you leave more confused than when you started.
But you're not going to have that problem with Blueprint's longevity mix.
Blueprint is built on scientific evidence so the guesswork is over.
Every ingredient they use earns their place through population-level research
and real-world testing, not what's trending on TikTok.
With Blueprint, instead of a whole cabinet full of pills, it's one scoop, water, mix, done.
That single scoop helps support energy, cognitive performance,
mood, focus, sleep, cellular resistance, and healthy aging.
It includes ingredients like magnesium, taurine, glycine, creatine, and more.
Blueprint is also third-party tested for purity and toxins like heavy metals,
and they publish their results on their site so you can see exactly what's in their supplements.
Blueprint doesn't just offer longevity mix either.
They also have essential capsules, high polyphenol olive oil,
omega-3 collagen peptides, and more.
This is science-backed,
precise,
precision-dosed,
no BS.
For a limited time only, new customers are going to get 20% off, plus free shipping,
at blueprint.brianjohnson.com, link in my description below,
by using code JULIAN at checkout.
That's code JULIAN at blueprint.brianjohnson.com, link in my description below, for 20% off.
After your purchase, they're going to ask you where you heard about them.
If by using AI tools we can actually allow,
but help us do critical thinking, help us verify things,
if we understand that the, you know, the current AIs as generated are not very good at actually,
as classically trained, weren't very good at being correct,
but actually they're getting better at being correct because you, you can say,
"Hey, go out and check the literature and check if this thing actually happened."
And help me, you know, straw man or steel man a particular argument,
and then also help me understand as objectively as possible how I might frame that argument.
Because if nothing else, these AIs might be able to allow you to do one-to-one teaching.
They've got infinite time, infinite patience, and if you use them correctly. If you use them correctly.
Well, we might be, yeah, if we can use anything incorrectly, like I say, you know,
so I'm kind of, I'm, as you might tell in this conversation,
where I'm just saying wildly contradictory things. Strong opinions loosely help.
Yeah, I mean, for sure.
For sure. But I do think that the doomers are kind of like, they're kind of out,
it's a bit like, you know, well, I would say that the doomers serve a very good purpose,
but I just wonder if the doomers could actually help us by shifting their doom
to the real issues that we need to deal with, such as like bad actors using the systems, right?
Well, that's the thing that I'm thinking about with your
world right there that you're painting. On paper, that would make sense, but again,
if these different platforms, because there's many of them, are going to actually be a positive and
help teach critical thinking and things like that, for a person to be able to do that themselves,
then I think a requirement for humanity for all of them across the board would then be you need to
open source all the code at all times, because you don't want to know, or you want to make sure that
there are not human beings, you know, just slightly injecting their little opinions into coding the
actual AI, I'm going to use a fake word here, but the AI organism that is going to teach us to what
we do. Well, I mean, no, you're not. AI organisms are cybernetic organisms. They are the combination
of human programmers and the model working together, right? So I'm very happy to say the
sentience in the AI comes from the humans, right? This is really the nice mystery that we can talk
about. But look, I'm uniquely unqualified, although, to say what the models do, because I
don't build, well, I mean, I build models, but I build models based on data and very basic learning
algorithms and systems, because I need a first principles to understand it. And if I can't
understand it, then I don't tend to implement it. And the reason for that is like, I need to
understand what the model is doing. And a lot of these models are kind of
they've got lots of meta levels, it's a bit like having a conversation with someone,
and you think they're understanding you, and you've got completely different images in your head. And
then you leave the conversation, they go and do something else, they're completely different to
what you thought they would do. And likewise, so you can have what you've got to be able to
do with these systems to somehow ground them and understand conceptually what's going on.
In science, that's really important. The only thing I have exception to in AI, my hard lines are,
the AIs are not intelligent, right? They're not intelligent.
How do you define intelligence?
Yeah, that is the question that makes sense. Because people talk about AI, AGI,
and superintelligence. What is superintelligence, everybody? Like, is superintelligence like some
kind of magic that I don't understand? And what is artificial general
intelligence? Let's go all the way back. And I've got very strong positions on this, which I think,
you know, will endure the time. So intelligence, I would define to be a property
of an entity to solve problems that will allow that entity to survive. So this is like a biology,
right? So now, a general intelligence would be an entity that cannot solve almost any problem to come
that's coming at it to survive.
An entity that cannot solve?
Can solve any problem. So you've got, basically, you could say your entity is really
good at mathematics, right? Now, people will say, well, the AIs are good at mathematics,
and they do solve problems. So now we're saying, right, well, I think that the AIs are very good
at taking a prompt, a problem that you give it, and say, please, when you've got this data set,
help me interrogate this data set and give me the outcomes. And so what I'm playing with right
now is trying to engage with people positively about what we mean by intelligence, right?
And intelligence is a very interesting thing. And what I will say to you is that we do not
know yet how to define or measure it. I'm working on a problem,
a shadow problem that I'm uniquely unqualified for, maybe uniquely qualified for, which will
have a go at measuring it. And I'm really inspired by going back in science and looking at problems
and discontinuities in problems. So the one that I really like is the concept of temperature.
We knew in the part all gravity, but let's take temperature. We know that things are hot and cold,
but what is that? Oh, that's hot. Oh, that's cold. So that we didn't really know how to measure
temperature. We knew some things were hot, some things were cold.
It wasn't until humans, scientists were able to, well actually technologists would say, right,
what do we need to be able to do? We need to measure temperature, right? How do you measure
temperature today? Well, the good old days, you'd have a thermometer. The thermometer could have a
number of different liquids in it. You want a liquid that would basically, as the temperature
goes up, it would expand and hopefully have kind of a linear relationship. So whether that's mercury
or alcohol. Mm-hmm.
And so if you take an alcohol and you, so for that expansion, so let's go back. So
I just want to say temperature, we knew that things are hot and cold. We didn't have a scale.
How do we get a scale? Well, we realized that liquids expand as they get hot and they contract
as they cool down. Great. So let's build a system whereby we can measure the expansion of liquid.
What technology is required? Well, we need a glass. And what property do we need that glass?
We need the glass to be uniform because if you made it fat and thin and fanning out, maybe,
you know, a triangle shape, that ain't going to work very well. So you needed to make a really
nice tube where the sides of the tube were parallel, was a perfect cylinder, was perfect as
you can get. Well, back in earlier times, there were some glass blowers in Italy that perfected
how glass blow tubes. Suddenly the glass blow the tubes and then you put the alcohol in. You
could go around and measure the temperature everywhere. Suddenly, oh, it feels cold here.
We'll go Antarctica, this temperature. Oh, we go here. And of course, the Americans,
we're going to have Fahrenheit. I don't know where you guys got Fahrenheit from.
Listen, I like Fahrenheit a lot better. It has more units.
Like a Celsius, a one degree Celsius jump is a jump. But if it goes like 82 to 83, it's, you know,
I'm wearing the same thing. Sure. Okay.
We got that right. You got that wrong. Just take the L, please.
Well, there is this temperature scale called the absolute scale and Kelvin scale. So one degree
Kelvin is the same as one degree Celsius. So it's the same as one degree Kelvin. It's the same as
one degree Kelvin. It's the same as one degree Celsius. It just goes down to minus 273 point
something or other. So that means zero Kelvin is the lowest temperature you can get. You can't get
any colder than zero K, right? In fact, you can't achieve zero K anywhere. On Earth, we've built
some really good systems that you can almost get to absolute zero. And what that would mean is the
molecules at absolute zero wouldn't do anything. They wouldn't even vibrate. They'd just be like
stationary. But anyway, so I digress. Brilliant thing about temperature.
Technology was built to measure it, right? We knew things were hot and cold before,
but we didn't know quite what it meant. Now intelligence, the problem is human cognition
and psychology and IQ tests and all this stuff. And we have people saying,
"Well, you know, this AI will be able to solve any problem from a human." They're misunderstanding
understanding what intelligence is, giving an algorithm a series of queries to solve,
a mathematics test, is not the same thing as a human solving an unseen problem. And intelligence
is actually the ability to solve an unseen problem. Now, unseen is hard, right? Because
if it's not in my training, I can't solve it. So this is the problem. But when I actually have
the problem, and I've solved it, I can train on it. Am I way oversimplifying this if I put it in
the bucket of almost what you're saying is logic versus the ability to be creative?
We'll get there. Logic is. So the way to. Computers are quite good at using logic if you
encode them properly. There's some good programming languages to do it, and they can do lots of
things. No. What I'm saying is something super concrete.
So intelligence is a thing we don't know yet how to define or measure. And I think for a little
hobby, because I'm basically bored and I haven't got enough work. You're bored.
I'm far from bored, and I'm too busy. But I think someone needs to have a go at this.
And of course, I'm uniquely unqualified. So maybe that'll make me. I've almost finished it,
so it's not that hard. So. Yeah, you're so busy, you don't change clothes.
I did wash. I have 12.
12 different. I think 12 pink shirts in play today.
All right. I'm going to need to see some evidence of that, because that looks like the same shirt
as last time.
Probably. I don't know. You can check. Maybe the other one was a wide collar one. These are
narrower collars. Evidence. I was going to wear a different pink. Anyway, it doesn't matter.
It's all right. It looks sharp.
It's fine.
But you're talking about intelligence.
So the nice thing is, I don't have a cognitive load when I dress. It's just pink.
That's good. Simple math.
It could be like Mark Zuckerberg, and he just wears, I don't know, blue.
Blue? Gray? Gray, I think.
Does he have like a. He just wears gray.
Isn't he kind of like based with fashion now? Like he's always wearing different chains and shit?
Sure. I don't know. I mean, me no billionaire.
Got it.
Me just poor person.
Hey, you just raised like 70 milli. I don't want to hear it.
Sure. I mean, but I raised it to change the world and chemistry.
That's right.
Not sort out my wardrobe.
That's right.
But fine. We can go back there. But let's go back to intelligence measuring,
because I want to linger on it.
You can measure temperature, and therefore we can have a scale, and we got there.
We don't know what intelligence is. We've got the IQ issue.
We've also got the race issue that goes along with it, right, that's out there.
And also the genetics issue, which was all kind of like crazy,
because psychologists and cognitive psychologists and so got confused.
But then we got people confusing the AI is getting good at stuff as being intelligent.
And so, you know, I think Elon keeps saying, oh, the AI,
it's going to be a PhD level in all these subjects right now, and therefore no PhDs.
And that is such a fundamental fail.
Why?
Because PhD, so let me explain how the AIs work right now.
And I'm going to convince you, and hopefully by extension, anyone listening or watching this.
So AIs today do the following thing.
You get a lot of data, you take that data and you train a model.
That's right.
And that model will be able to tell you what's in that data, right,
and find your relationships in that data.
Great.
So that data, if I say the internet, all the problems solved in the past are encoded.
Let's say all the problems solved in that past are captured in that data set.
So when you give the AI a problem that's been solved in the past, it can solve it, right?
That's not intelligence.
That is incredible retrieval.
That is incredible retrieval, right?
And retention.
Exactly, right?
And sometimes the AIs aren't that good because they hallucinate and so on.
They hallucinate.
Well, because of the way the structures of some of these models work, they hallucinate.
And so what happens is that because they have to give you back a output,
if you say, you know, it's less problematic now because the frontier labs,
I don't know what they call the frontier labs, the top AI providers,
are very good at basically having what's called a, having a checking system.
They might say, well, come out with an answer, we'll check it.
Like you would go to chat GPT and say, you know, calculate, do a GIST calculation.
It used to just retrieve it using the model.
But of course, the model would not get it right because the numbers,
the training data and the internet, well, humans kind of were put there by humans.
And so it would just give you random number back.
But now it says, oh, I recognize.
This is a calculation.
Let me bring up my calculator tool, press the buttons on the calculating at the number back, right?
So the AIs are quite good at doing things like that.
But the thing is, the AIs are trained on this huge amount of data.
And all the problems that we've solved up till now in humanity are in there.
So potentially that's awesome.
But a PhD, scientist, mathematician, is not about understanding the past.
They're trained on that.
It's about.
Using the scientific method to solve problems.
So whenever you give a new problem that's not in the data set to the AI, it can't solve it.
But what if it has enough data and enough retention from all the things in the world that it can keep at one time that a human can't,
such that it can find abnormalities or holes or something to be able to then, for lack of a better way of putting it,
plug it in a way, in a faster way than a human could.
How's that not intelligent?
I would not.
So because if we, again, we have to define intelligence.
You can call it.
I would call that very useful, right?
My calculator is very useful.
There are many tools I've built that have been built that are useful, that enable me as an entity with, you know, with human rights, right, to do stuff.
But Einstein with a pencil was much more intelligent than Einstein without a pencil.
Because he was able to use a pen and paper, pencil and paper to think.
So it's almost like a cybernetic thing.
So we get trapped in these circular arguments.
Are the AIs intelligent?
To all the AIs, do they have free will?
And are they sentient?
Right?
It's where we kind of confuse it.
So people use intelligence as a confusion.
Intelligent entities can solve problems and want to persist in time.
That's called biology.
I would say intelligence is a property absolutely reserved for biological.
Organisms, right?
Now, what are the AIs?
We can call them maybe augmented informatics.
That would be the word.
Augmented informatics?
Yeah.
That's a lot to say, Lee.
I know.
It doesn't sound as good as AI, right?
Let's get it shorter.
Artificial intelligence sounds great, right?
I'm like, wow.
Right.
So there is a culture, there's a zeitgeist associated with it.
But again, the AIs aren't magic.
They are incredible models.
In fact, they are revealing things about human language and cognition.
Yeah.
That we didn't expect.
Like what?
The AI, so again, I'm not an expert.
So if you train an AI in a certain language, and then you train it in another language,
and you look at the representations of those entities, let's say king or queen or brick
on cement, they occupy a space that is prelingual.
Right?
Which is conceptual.
In English.
What do you make of it?
Ask the AI.
Basically, there is a mathematical representation beyond the language in a space.
Right?
Okay.
Which is really interesting, but not that surprising.
Because humans use language to represent concepts.
So if I basically take the Spanish, and I distill Spanish into the English language,
then I get the idea that there is a language.
Right.
Yeah.
And then I get the idea that there is a language.
So if I basically take the Spanish, and I distill Spanish to find out, you know, love
and hate, hot and cold, up and down, and plot them in some space, and I do the same in English,
you overlay them, they're very close.
This is why AI translation tools are amazing.
Right?
Yeah.
I don't know if. I haven't tried it yet, but this is great German. I learnt German, I'm not very good at it now, but there's a great word in German
called gemütlich.
Gemütlich.
Gemütlich.
Which is like, loosely translates as "cozy".
Gemütlich?
Gemütlich.
Because they go, "Oh, das ist gemütlich."
Yeah.
Okay.
If you go into a pub in the UK, and it's a windy winter night, and it's cold outside,
and there's a nice fireplace and beer, you go and go, "Oh, that's cozy.
Nice."
Gemütlich.
Yeah.
Germans have it.
But it doesn't quite translate.
Right?
Like, it's a different kind of word.
So there are cultural representations of the word.
It's not like, "Oh, that's cozy."
"Oh, that's cozy.
Nice."
Gemütlich.
Yeah.
Right?
So there are cultural representations.
And the Inuits have a lot, right?
Because the Inuits have to live in the cold a lot.
Right?
That's right.
So there are lots of terms.
But let's go back again.
We don't know.
Can we measure it?
We don't have a measurement.
We know what temperature is.
So we've got an idea.
These AI tools are able to do very important, very interesting things.
They can automate a lot of tasks.
But I'm going to make one, again, one statement, and I'll keep coming back to it.
The AI only knows what it's trained on, and if something is embedded in that data and
you query it correctly, you can get that out.
Which is great.
Right?
And the AIs are showing there's a huge amount of knowledge that we haven't explicitly found
in the internet, in human knowledge, that we can pull out.
But it can't use the way the human brain works.
humans query and reason over time to put together patterns to be able to predict how they're going
to query in the future and potentially outrun humans before we can get there um i don't i don't
understand that statement until i understood all of it until the outrun humans till we get there
because if they can patternize everything like let's let me give an example because it's a little
bit complex if i'm talking to an ai and a hundred other people in the population are talking to an
ai and we're all trying to figure out something about paint and we're asking all these questions
about different colors and how we paint a room and whatever the way i ask questions in a series
of queries even if it's very similar to the next person the wording might be different or
a specific thing i may be interested might be different but the ai is collecting all of these
different at at volume and at scale all these different ways of querying things so they can
try to pat the ai can
you
you
you
you
all of its computational technology to be able to patternize what everyone's saying and be able to
predict what the optimal questions might actually be so in that way the way i see it is it could be
outrunning humans front running them is maybe a better way to put it so yeah this is really
interesting so no no no that's not what's happening um thanks for clearing that up well
so there i think there's a fallacy here which is super interesting
and again look i'm very happy to be wrong on this but um i want to come to it with data
so ai's are prediction machines humans are creation machines and so ai's when the creations are
kind of shallow the ai is great at finding them you take all these air dish problems all these
ways you find you've in mathematics so the ai's are solving i mean that and you find all these um
disproving certain conjectures ai's are very good at disproving things by finding a counter example
but ai's an ai has not come up with a single creative mathematical act right hasn't come up
with a single creative scientific act now people will argue about this now i want to actually stop
this argument because actually obscuring what the ai is a good at and i tell you in the last
two years last one half years the ai's have supercharged my ability
to be creative um because i don't have to spend my time doing things that that um
writing code and collecting data and processing things the ai's are splendid at it they're really
really great but what they can't do is they can't create they can appear to create right
and those creations are relatively shallow but i would say there were and this is where i'm really
interested in is that there's a lot of things that are going on that are going on that are
where intelligence is intelligence solved intelligence i would measure is by the ability
to solve problems that are unseen ai's are able to solve problems that are seen or embedded in
their data that's probably called i don't know we should call it a different word like it's not
not not a problem so ai's are very good at doing new can do new things right but they can't do
novel things and so the question is what is a
difference between novel and new and here it is right new is something that you can get from your
data set it's just a combination of things it's fairly shallow novel um so you can search for new
something new in your data set and find it in the end so when the ai does something
and you got all that's exciting you can see that it is just new and it's entirely embedded in that
data humans are able to do something which i call novel
and novelty is defined by that thing that is in principle not predictable and not embedded in the
data so but when i then do it it's a bit like fashion fashion is a music uh that's right i just
human you're not going to know when humans are going to do you know i might you might have me
back on your podcast one day i might come back wearing a color you weren't anticipating is that
new or novel well it's novel because you're in prior data i'm just wearing a new color
right right the ai is just going to make in this suit so when i come in wearing i don't know
turquoise or something or whatever else you'd be like that's novel and so and it's very interesting
that humans are kind of misunderstanding it but there is a certain amount of mis-selling here
because we're trying to sell ai's as intelligent going to replace phds replace this and human
beings are going to use the ai's to massively um flex their cognitive capabilities right not
replace them this is where everyone's going to be like oh my god i'm going to be like oh my god
what's going wrong ai is going to replace science no they're not i mean because science is about
problem solving well you actually just made a point a couple minutes ago and i can't believe
i've never looked at it this simply it's like the most obvious 30 000 foot in the air point
we've had this ai crisis now i'm putting that in air quotes being talked about extensively over i
would say the last decade but particularly the last three to where everyone's using it
on llms and god knows what they have behind the scenes at darpa maybe you know but like
they haven't created
their own e equals mc squared yet or anything like that which is make kind of making your point
for you like there's not something they have not figured out the laws of quantum or i'm just making
up things right now but these things that scientists are constantly trying to test every
day therefore not only have they not replaced the highest level guys like you they haven't replaced
science in any way at all technically to this point well i would say um people have used ai
to come up with very good new ideas for making new drugs
folding proteins solving some physics problems but these problems are already well defined by the
human that's right right for data processing so the ai's are a great tool they're a tool
i don't understand i i think there's something really interesting sociologically happening and
cult so culturally and technically happening now um now i i'm not going to geolocate it
you can all guess but we have this problem right now where people are saying ai is the ai labs need
a lot of money they need a lot of infrastructure they need a lot of energy right and we're saying
in academia there is this political um push against academia academia is full of left-wing
people who are basically you know don't critically think and all woke and so on therefore let's just
replace all academia with ai's new science right now that's just such a fail on all levels sure
academia has problems right there's but ideologies and things everywhere but given the ai
providers builders don't know what science is right you know they simply don't they're populated
by computer scientists and mathematicians now um and they don't and that's not me saying being
elitist it's just like solving scientific problems in a wet laboratory whether it's
a biological lab or chemistry lab or a physics lab or you're trying to do some mechanical
engineering problems are very visceral things right and it requires creation
like the governor in a steam engine you know someone's like oh yeah i need why do you make
sure i can the boiler doesn't explode and i need to do this thing you know build stuff we we interact
with the world now we will be able to build models and whether that we build i'm building a world
model for chemistry what does that mean well i'm just learning all the chemical reactions by doing
them and then once i've learned them i'll then be i make any molecule that's pretty cool that's
i have to collect the data i have to have a verifiable process and then i have to be able
to then run it and get it and so i think the science has never been in a more exciting place
right and it's it's just a shame that we have this culture war that's going on at the same time
because we have to make a decision do we want to spend all this money on cp on gpu cpus water
energy whatever to basically crunch the data and give back products to people
or do you want to spend the money on humans doing that as well right so it's kind of like a choice
you could spend money on how much does it cost to to produce a human that can solve a problem
that you can use chat gpt for right like it's there's not magic right you just say well if i
want to if i want to replace a human with chat gpt i can but what is the cost and i've got the
human out there who's now got not got a job to do well maybe the human will do something more
interesting but it's there are so many different things there's many layers maybe we can go back
to one fundamental thing we don't yet know what intelligence is we haven't measured it we're using
ais to do very important very interesting things at scale and at speed but it's not diminishing a
human so you said at the beginning of of when you were explaining this with the intelligence loop
you said there's three layers we often talk about intelligence general intelligence and then super
intelligence so if i'm understanding you correctly because we can't even measure the bottom layer you
were saying it's like 10 leaps and a skip to get to the next layers obviously yeah i mean
ag so i think that the the the providers of ai right and i actually like that i like the products
they're great right i don't know about your glasses though they were doing some math before
you might want to check those things yeah i'm not doing any product uh um promotion on your podcast
um so i then but they're not meta glasses yeah but meta might have actually gotten that right not that i'm trying to
show for them no no they they worked it was just okay anyway i'm a little off to me well okay
um but so let's go back so we say um ai so agi lots of people will say that an agi is um what
the term we would give to something that can automate most tasks now is that an agi an artificial
general intelligence or is it just an an artificial general i don't know um uh automator
so like you know if i it'd be great if i have an ai that can clean up my emails
but actually i mean i do use an ai to clean up my emails i use one that's about maybe eight years
old and it kind of and what i do is i'm obsessive email cleaner i answer all my emails that i want
to answer and i basically file everything and i keep them all and so i just file them and it's
a it's a filing system so i i just because then when new stuff comes in it doesn't get lost in
the noise right don't look at my emails i get so many emails every day
you
, it just i find it incredibly depressing because i lose stuff in the noise i need to answer or
you know i've only got so much cognitive bandwidth so an artificial general intelligence that the
frontier labs are discussing is literally an entity that could just solve a lot of problems
right um sorry do a load of tasks does it solve general problems no humans are good at this and
i think you know maybe there are some jobs that humans have that are filing but we our failure
maybe in um in human society right now as people go from school to university or wherever they go
into a job is maybe we need to generate jobs that have more value and meaning right we can do that
and ai provides a great chance that now let's go to super intelligence well nick boster made up this
term yeah we got off this last time we didn't go deep on this i've read that whole book i'd really
like to it means just making up right it's like it's like if look if you can't define a thing and
you say it's super i mean i could be a super chemist what does that mean i mean so a super
intelligence for me would be to say be somehow that's beyond our current understanding of
physics and mathematics like magic again it super intelligence plays on this kind of oh there could
be this entity that's way more intelligent than me knows more what does that mean right we human
beings are able to discern how the universe works we're able to understand far more than maybe
evolution has equipped us with it would seem now what the doomer says well this super intelligence
could understand how to you know do things that could basically end humanity or build a super duper
weapon or something well i i don't understand the evidence for that so what i try to do is deflate
the term super intelligence because i don't know what that means now it could mean let me let me
make a take a stab at three different things it could be it's just a faster way of thinking right
sure chess computers can do chess really fast so i could buy that but why call it super just fast
it could be that it is able to um play through some kind of chain of reasoning um how i can
basically look at um decision theory and i could if i plant these seeds and these decisions i can
basically create disruption right like i could disrupt a market by let's play plant a meme over
here over here over here everyone buys their stocks in a certain way right and i can basically
do that but the market is so noisy and and humans are so good at doing weird stuff we couldn't
predict that's going to get washed out and the other thing is maybe suddenly it can come up with
a brand new thing that doesn't have precedent well we haven't ever seen that you just said
there's no evil e equals mc squared so the problem is within with ai we've done the following um and
i i think i might have mentioned this before but let me go let's just imagine let's go back to time
einstein through and i again i'm not a trained physicist but i'm a pretend physicist so let's
go my pretend physics so with special relativity einstein basically asked the question what happens
when i sit on a light beam so he basically worked out when he sits on a light beam yeah what happens
when he sits on a light beam so he really he started to realize the speed of light if he said
the speed of light was a the fastest speed limit in the universe you can't go faster than light
what happens then in general relativity einstein said well what happens when you sit on a light beam
what if space is a time are curved right or more specifically what if mass curves space time and
things don't take a straight line they take a straight line they go through space times it's
curved right cool so suddenly when you go use general relativity you're able to go think ah
if i fire a satellite into space um the further the satellite gets away from the earth the the
the greater the
drift in time on the atomic clock on the satellite versus the atomic light clock on earth and in fact
if the satellite is putting out a pulse it's clock and i measure it and i can and i compare it with my
my clock on earth i can use that to position using gps right so suddenly we knew that before which we
understood general relativity before we put satellites into space so when we put satellites
into space we understood frame dragging and we could build gps right hold that thought we've built these
systems which can basically keep distilling um data and finding relationships that we're basically
we're assigning a property to these relationships that we don't understand because we haven't
understood the fundamental theory of intelligence in the same way that we don't have it we did just
imagine if we start for it it's like science in space satellites in space we didn't have general
relativity we're like what the hell they're losing time and we would just made all sorts of stuff up
just to basically understand that we're losing time and we were just made all sorts of stuff up
understand that so i think the the thing is the frontier labs have got to some kind of
incredibly capable um systems that that appear to reason and do things that we didn't anticipate
before and that's because we don't have a good theory for intelligence
now i like the baseline there of you actually already have something defined so that then
you can measure it once you test it with the einstein and testing satellites with gps
if i go back to what bostrom did pretty early on here all things considered with how early he wrote
that book in in our timeline of ai recent timeline the way i always looked at it was he created a
bunch of decision trees so he created possibilities and and i think you're probably i think i buy your
argument that there wasn't an underneath definition on that but his decision trees
pointed out from a scale of things could be fine all the way to we are like he did have every
thing on there it pointed out if this then that or that that that if this then that then that that
that that and it created all these different worlds to where you at least i remember i'm
reading that book it's a dense it's a dense read but you could see a world where like
code gets out of control where some things that he described i wouldn't even make the leap and
say this ai became sentient i'm just saying like it was coded to do something again with the mistake
of a human being and then i think like one example was it could over create paper clips and cover the
entire surface of earth and paper clips and drown us and i see things like that it sounds
crazy but at the same time i could see that kind of situation happening if and this would actually
go to your argument human beings are not responsible with how they create the code so do
you think it's useless if he's pointing out things where we make mistakes and then the ai does things
that end us
the ai won't do anything the ai is programmed by humans all the decisions come from the human
you know this is a thing that people don't understand and this is one of the reasons why
i think it's kind of fascinating my my research why i've built a company to make a world model for
chemistry and discover drugs and new stuff why i'm basically building engines for chemistry is i
want to understand the transition that that we go from physics to chemistry to biology to kind of
almost let's say cognition or culture what is happening there we don't really understand it
and and i think that i mean the issue i have with the super intelligence is it requires a mechanism
doesn't exist the thing i like to say is um let me think of us you know you say you can see the leap
if this thing then that thing okay let me say i'm afraid of um uh ag and that's anti-gravity
it's like what's ag what anti-gravity is a thing that happens you know when i build a new technology
and suddenly it turns off gravity and we all float away right and we all die right because we're not
stuck on the planet anymore we have no air nothing so i'm like i put it in your head what about ag
should i write a book on on super super anti-gravity that could appear one day sure i
could tell you a decision tree if anti-gravity then float right but but what is the mechanism
for the anti-gravity it's like it just made i just made some up you know and so the
problem is unless you can define something and understand the mechanism paper clips what a
nonsense if you flow if you fly on an airplane above the world the most of the world is not
covered with machines it is empty space fields trees oceans what do you mean paper clips like
he was using a ridiculous example of something yeah but it's it's entirely ridiculous
there is no scientific merit in it it is divorced from reality and it it it's just basically so
it's divorced from reality that something so powerful could just start to 3d print a bunch
of paper clips and put it everywhere it's just basically it's fantastical nonsense
and it's science fiction in a in the worst way because he's
plays it off plausibly and calmly but i think we have a duty we have a all thinkers nick all of us
have a duty to actually criticize our own ideas and think well what is it really it really you
know like literally is making shit up it's like i i'm sorry i don't know what else to say other than
um we do not understand what human consciousness senians decision making is the the fact that
people are going to start saying in a few years that ai should own its own copyright it's just
an excuse for people who basically want to take your copyright feed it to an ai jet on a model
and then you know if i'm being really really rude about it i'm saying oh yeah thanks whatever
company for reading the internet and stealing my ip and then training a model that then i can then
and then selling my ip back to other people and then you have all the kind of the kind of you
know the the ai pro is going you're just like you just can't accept that um
the ai is smart and i'm like no it just stole my ip right this literally just stole my creation
and shall i still shall i steal your house is that okay because the ai said so no and but here's the
thing we don't understand so there's three things we don't understand what intelligence is right
we don't understand what creativity is and we don't understand what novelty is now the fact
we don't understand those three things and we're using them all interchangeably right like and i
don't understand why it works right so the reason why everything appears to computable is that once
something is created right by the world i can then label it and put it in a database i can decompose
it but that doesn't mean i can't i don't understand what because i can't predict the future faithfully
but i can predict the next token um and sometimes you know if the search space is shallow enough
it's going to appear to be acceptable for some eval right but what we're going to see is that
my hope is that the way that we um explore um the developments of ais is that we'll understand
that what humans are doing are quantitatively different they're in a different universe to
what we're doing with silicon compute which is great again i'm i'm i'm not i don't think there's
something beyond the material i'm a materialist but similar to roger penrose and i think my
collaborator sarah walker many other people we don't know what that material is doing i'm a
but i don't know what it is and that's why i'm trying to make chemical brains can you expand
upon that like when you say we don't know what it's doing yeah so we i don't understand um how
matter is able to process information in space and time we have some models right but there's so much
because we don't understand how biology is created by chemistry how do how does evolution
produce biology and how does biology then produce consciousness and intelligence
and these phenomena um there that we just don't
know right there's just so many things we're a really wonderful time in in our existence where
we have all these tools we have all this data but we but ai is really good at predicting the past
i'll say that again ai is the best at predicting the past because it has the past oh let me qualify
ai is very good at predicting the past when it can train on a faithful representation of the past
what it cannot do is predict the future because the future is something different
so what happens is so the future the past is kind of like a is a probability space right what has
happened you can look at probabilities right sorry and um the future is a possibility space
so what is a possibility what is the difference between probability bayesian probabilities and
any other probabilities you want to use and possibilities and until people understand the
difference between those two things you'll keep we'll keep
confusing it how do you define the difference well a possibility space is um literally um
well it's something that hasn't happened yet a probability space is something that's happened
because i can't define a probability on something that hasn't happened yet so what i mean if i take
a die and i roll it i know that i'm gonna get one in six i know it's happened before i can train
them i can train my own model on it right i know what's happened but i could create a die in my
head or i could create a die in my head and i could create a die in my head and i could create a die
well on paper probably more likely because i don't think um that you can't anticipate and
therefore it's a possibility not a probability and until we understand the subtle difference
between those two things we're going to continually keep keeping um uh to miss to
mislabel or to misunderstand what ai is actually doing and i think that's kind of you know there's
a lot of vested interest a lot of money in saying using in in the kind of trying to basically make
this is why ai can never ever ever do science right but ai will be and does today is a tool that i can
use to do science yeah it's it's and it's not a rocket it's extra nice rocket fuel i mean yeah i
mean and everybody like 99 or even most scientists will argue with me and think that it will say that
ai does do science but i mean it's it's a tool that i can use to do science and it's a tool that i can
i'm sorry they just don't understand what science is right and it's and science is this science is
the ability to identify a problem and then to create a thesis a hypothesis an idea about what
that what is going on and then to create an experiment to test now what ai's are very good
at is running experiments but if you haven't just if you have not actually correctly assembled the
problem statement that all that phds do is a problem
is is assemble problem statements that's what we that's why phd doing a phd is so annoying
some of my phd students that work for me are like why are you making me think in this crazy way but
and it's hard but it's really hard to identify a problem it's like you can be really great student
grade a student and then you go to a phd and you find it the most destabilizing thing in the world
because i'm asking you to be creative in a space you might not be used to or to identify a problem
or an anomaly and how do you identify an anomaly and so i'm asking you to be creative in a space
i think a lot of people become really think that the ai's are able to do this they're not they're
doing the ai's are doing something really shallow they can't identify anomalies looking at large
data sets and finding a hole they absolutely can do that but that's not the same thing how's it not
the same thing so it's basically one is the inverse of the other so the ai's are really good
at you could use the ai to say take this data where i've already defined the experiment and
find an anomaly within that experiment that's great i've already but i've already defined the
experiment right what the ai can't do is actually define an entirely new set of experiments
they will always define experiments based upon what they know so the right
the ai's doing science are a big delusion people are going to go and people will argue with me
forever until i get this measurement done right because the ai's are not um are great at you know
i i just wrote an article about the ai's and i'm not going to go and say i'm not going to do that
i'm sorry i used an ai the other day to write a simulation of the origin of life using assembly
theory and i said hey here's what i want you to do here's my here's my assembly theory calculator
for molecules let's generate a load of random molecules and join them together and and basically
it does a pretty good job it uses some toolkits from from the github puts them together with a
code and generates simulate and can generate molecules right and it looks cool but but
obviously i'm having to because i was like oh no it's generating molecules and i'm like oh no it's
generating random molecules and i might use my chemical knowledge it was generating some
absolutely batshit crazy molecules that are not stable allowed and i said no no don't do that
remove that remove that adding constraints i curated it to my taste right you had to fix it
up and my taste right i was like how did you encode that i was like i could encode it but
i'll be there all day but i'm just like don't do that don't do that don't do that it's a bit like
i feel like a music producer producer actually like it's like that didn't sound too good i'll
i'll be there all day but i'll be there all day but i'll be there all day but i'll be there all day
right and we need to train people to use those and that's glorious it's a wonderful thing
but we mustn't misunderstand we mustn't use the ai just to do boring science and
do pretend science and the proof in the pudding will be in the in the cooking with the ai's right
you know when the ai start to produce new theories explain quantum gravity or come up with something
that we could never conceive of are we then oh i will be looking out for that and go oh that's
interesting and then i'll be there all day and i'll be there all day and i'll be there all day
and just why is that ai doing that well my my assertion let's make an assertion it's august
2026 as of today silicon-based computers as we know them are not able creating novelty
that doesn't mean to say we will not create a machine that is able to go beyond computation
as we know it so all right are you saying we could create something that right now is
not something we are labeling ai effectively sure okay i mean the brain is not well the brain is
mystical but just because we don't know what the hell is doing but we i mean if you want to create
a brain there's the old-fashioned way of doing it right i've got two brains i created one is 20 and
one is 18 this week right my two boys right yeah right and they were also created by darwinian
evolution going back to luca so we need to understand i'm saying and maybe this is obvious
because i'm just like i'm just a boring
origin of life chemists. I'm like, I need to create life in the lab before I can understand
consciousness.
but probably right there is no other way to get there and and i and i think it is a we're making
a massive leap to say well let's just make these ais and you know maybe we are entering in a new
dark age of science right in like the middle ages where you know witchcraft and everything was
allowed and super intelligence all this stuff we're all worrying about this thing and we're
and science will actually creative science will stall because the weaponization of science does
produce outputs and papers will just go through the roof and everyone will just use llms to write
papers they'll use llms to assess the papers we'll use llms to write the grants we use llms to assess
the grants and who's gonna have who's gonna be the taste right it's just gonna be it's just then
then actually bostrom's prediction of paper clips will come true but in the scientific world and the
paper clips will just be papers and grants well it's a stretch from what he was saying but i know
but same thing right i mean you know so i i don't think
you know i don't think there
i don't think there
is a but what happens is humans what i'm fascinated by is what happens at the printing press right
everyone said it was all over you know we never i think there are some famous examples where people
were saying that you know it's terrible writing things down it will take something away from us
but actually if it wasn't for our ability to write we wouldn't be able to create what we created
so what i'm excited about is what we'll be able to use the ais to create
help but sorry what we'll be able to use the ais to help us create right right yeah and
and this is where like i think of the common example when you look at say music that ai creates
there was a whole stir a year and a half ago or something like that where ai made a song
of drake and the weekend that actually obviously two megastars that actually sounded pretty good
and people were like oh shit like is this gonna be a problem but it didn't take off
a because people learned it was ai and there was something about that that people were like okay
the human creativity didn't make this i don't i can't feel the same way about it but the
other reason is going back to a point you've been making this whole time which is it didn't make
anything novel it took what the types of music those guys had already created and just took that
style and said okay make it again so i mean i'll give you a kind of scoop from something i'm
writing just now what i will define novelty and and um newness that ais do and try and explain
why ais can't do it in principle and where there's an interesting gap so so if you just
so if i come up with something novel right now and i say hey here's this novel thing oh that's cool
but we'll know full well that we can then label that and put it into a database and then we
understand how we got there we understand the pathway of getting there and therefore the
probability we get there because now we have a precedent right so that so what happens is that
ais can combine things together but the way the combinator the size of the space of combinations
for the ai is big but not that big so roughly speaking if a space is big but searchable
the ai can do quite good in a shallow space what humans are able to do is literally pluck something
out there that's so deep you cannot ever search it with a compute you have available so humans
are surfing on the wave of the almost the infinite right possibly
possibilities yes and that's where creativity is on that wave and then as soon as they find
something they chuck it back and suddenly they go from that infinite edge to the finite encodable
present so i would love to i love to put it in this way is that ais basically kind of predict
the past they're encoding at the present and the few the interface between the present and
the future is where the infinite is it's continue is basically a continuous kind of um
uh substrate so when something is continuous it's basically infinite and so you can't in
principle know what's going to come and that's why that's where creativity comes from now
the thing about the ai is kind of amusing you've got all these people that are pretending
to be creative and like that's pretty shallow mate you could the ai could have found that
so what's going to happen is like the ai is exposing that a lot of people were pretending
to be creative but they're just plagiarizing one another and plagiarism if something exists
and you're literally here put it again but make that thing and pass it off okay if you didn't know
right because i've done it i invent so many ideas all the time and i'm like oh someone else had that
idea it wasn't my idea oh so does that make me a plagiarist no because i didn't basically knowingly
take their stuff and pretend it was mine like most of my life i'm basically an not an accidental
plagiarist but i'm like i i have shallow ideas just a shallow thinker but occasionally just
occasionally have a thought and i'm like oh i'm not a plagiarist i'm not a plagiarist i'm not a
well that's pretty good and the depth of that thought is such that it's like oh it's quite
novel and the humans are quite good at doing that and we know them there's great artists musicians
fashion people just doing all sorts of weird stuff on that are able to surf that edge between
what is the present and the future where do you think ideas come from no idea you have no clue
well i mean i i well i have something that i'm going to
propose um but i i'm it's um well if you were gonna if you if i want to give you a recipe for
having a new a novel idea not just an idea where if you say where's another right something creative
what you want to be able to do is to make a leap into a space that's so big you could not in
principle search it and what humans are really good at is imagining in that space imagination
is non-com is not uncomputable because imagination is not uncomputable
sorry imagination is uncomputable in principle right because why because it's too big to compute
no one says but that's stupid because your brain is imagining i'm like yeah what is my brain doing
that's not computable in principle so the human brain i imagination seems to be proof the human
brain is doing stuff that is not computable as in computable by a turing machine a counting machine
a labeling machine so how are you going to build a brain
then if it's something that's not even that that performs tasks that aren't even computable how can
you compute in the real world to build that so i build it so i take a physical object i interface
it digitally interface interface with it digitally okay in english i basically have i i well i i
that's english i i plug it into a digital computer okay right there we go and then the brain is able
to come up with imagination
that the digital computer could never predict or even conjure because the chemical because the the
the size of the space is too big so there's something about the polymer brain like are they
able to collapse the interface i don't know well i do know but i can't i have an intuition of how
it might work but i'm i'm struggling to put it into um into proper mathematics
how long have you been working on this i mean like probably
quite a long time i mean and it's been in the back of my head for maybe more than
20 or 30 years oh wow um yeah so we got on this tangent a while ago on ai that was originally
coming from the brain and the way you were explaining is after you created all whatever
it was 49 tubes where you're getting zeros and ones on off with all the lights you were then
taking that and putting that into gels is that how you said that's the next step the next step is to build a
brain gel yeah okay right now can we go back to this and explain that some more um sure i mean
what i'm trying to do is make a material that um chemically responds so it's sorry make a material
where there is processes that are um can be encoded digitally but are and but then become
analog so a bit like an oscillation so on off on off tick tock tick tock okay you code it digitally
because you you nudge it with a piece of electricity right and then it
floats away on its own exactly and then you then read out what's happening later and then i want to
understand how that digital encoding and what readout are related and is there a is there a
a complex or a linear relationship between the two but um i mean i think to be honest with you right
now um the phenomena that we're looking at i don't understand and and i infuriate a lot of
molecular computing because what's that well they are using dna so dna has four base pairs
and they can then connect that those base pairs almost to a like a computation they can make a
they can make a machine a bit like a chip what's called a turing machine it's basically another
fancy way of saying a digital computer and they can make a dna computer but i'm like dna computer
yeah they've did it i mean darpa darpa funded it fucking darpa man amy jacobson said they were
talking to dolphins telepathically in 92 i'm just saying darpa is a funding agency they fund people
they give people money and the people do the crazy things have you been to like one of their secret
labs they don't have any secret labs i don't buy that that's what i would say if i were funded by
darpa i would say they don't sure all right i mean you know i'll ask them to buy me a volcano
at some point but darpa
maybe
darpa based in um in the washington area they're incredibly smart people
they have program managers that will and it was all on that it's all it's all
out in the public domain, DARPA has a series of program managers. They identify very interesting
areas and they fund them. What DARPA does that's exceptional is they have exceptionally smart
people who will then basically come up with an idea that if this could work, it would change
the world. And the internet changed the world, right? Self-driving cars. So DARPA has a self-driving
car challenge, where they had cars going through a desert and they were falling over. But it
arguably accelerated a lot of the visual way of using vision and compute together to kind of
navigate and robotics. So I mean, DARPA is great. So I don't want to burst the balloon of DARPA,
some kind of magic lamp. Will Barron:
I think it's a really fascinating place for sure. There's a lot of it that I think a lot of us don't
know about. And we just hear about some of the wild projects they work on. Obviously,
it's not like when they come to you, Lee, they're like, "Here's all the one fucking billion things
we're working on right now." Lee Ngo:
They're coming to you for a very specific thing because you have an area of expertise. And they
say, "Hey, could you try to do this?" Actually, how open-ended is it? When they approached you
with the first grant, were they saying, "We're working on this kind of thing. That's what you
work in. Do you have an idea that you can add?" Will Barron:
I mean, the way they do it is very collaborative, right? So they'll have a number of different
performers that would be funded, and we'd all get together and share and pull stuff. They're trying
to push together the boundaries of science. I mean, it's very successful. It's not mystical.
The UK has got a DARPA version as well called ARIA they've just brought out, which is the kind of
advanced research and innovation agency that they call it.
Lee Ngo: And they're cool with you working with DARPA,
even though you're a UK guy? Lee Ngo:
Sure. I mean, everyone. I mean, look, again, all these organizations, I mean,
ARIA will also fund stuff in the US. It's the same way that DARPA has funded people.
Lee Ngo: Oh, that's interesting.
Lee Ngo: They fund where the best
ideas are. I mean, obviously, there's a certain amount of political taxpayer accountability,
right? As a taxpayer, do you want to give all your money to someone elsewhere in a different
country? Well, if they're building something that's going to be of great use to you and you're
the only country that can use it, then sure, right? I think that makes sense. Same with ARIA,
based in the UK. Of course, the majority of the funds are spent in the country of origin. But going
back to the DNA computer thing, what I was trying to say is there are people out there that are
computer scientists thinking about DNA as a computer, and they reduce it to this conventional
computing paradigm. I'm suggesting that the brain is not a conventional computer. The brain is
capable of doing things that we don't understand, i.e. imagination. I mean, isn't it wild? You can
have an imagination. You can imagine a thing that doesn't exist yet, right? And that imagination,
that imagined thing has causal power, because you can imagine that thing, and you can make it work.
You can make it, yeah.
Right? And this is what entrepreneurs do all the time. Isn't it great that we have this, like,
"Oh, I want to make this widget." It might be a mobile phone, or I'll make the iPod Nano. I mean,
if Steve Jobs came up with it, whoever came up with it. Human beings are uniquely able to imagine
a thing that doesn't exist. It just exists in their head, molecules and synapses, and you can
literally grab that from the future and drag it into the present.
Grab it from the, so specifically from the future.
That's why I like to
call it, because for me, the future is unpredictable, and is a possibility space.
And imagination works in possibility space, not probability space. And then you work backwards.
I mean, whoever at SpaceX, whether it's Elon or someone else, came up and said, "You know what?
We'll just make the rocket out of steel, and we'll catch it." Because why not? Because we're
just going to make something the size of a skyscraper, pretty much, that will take off,
and it will go supersonic. And then when it lands down, we'll make it go subsonic. And by the way,
the time we catch it, we'll hear the sonic booms. I mean, what?
That's nuts, yeah.
Yeah. But it's now science fact. And this is why humans are really good at fiction,
right? Science fiction, you think about Jules Verne and all these things. It's so fascinating
that we're able to do this. And I'm not saying there's something magical. I'm just saying that
digital computing is not everything. And the fact is, we're in this fallacy where we think that the
entire world is a simulatable entity. It's another thing that Nick Bostrom said, "We're all in a
simulation." But that's just basically saying, it's unfalsifiable. And if something is unfalsifiable-
How is it. Yeah, we started to talk about this last time, but got off that as well.
How is it unfalsifiable that we're in a simulation?
Well, where does simulation exist in? You have an infinite regress.
All right. What do you mean by that, infinite regress?
Well, if I'm in a simulation, great. The simulation has to exist somewhere.
Let's imagine where. Let's say I exist in a computer somewhere. Where's that computer?
Is it another simulation, and a simulation, and a simulation? So if I can't falsify. A simulation's all the way down, right? Therefore, it's kind of like. It's the same as having a
religious commitment, a belief. So if my simulation argument is the same as a religious commitment,
a belief, I'm not saying. I'm not saying I can't falsify God, therefore God doesn't exist. I'm saying
I can't. It's not amenable to the scientific process. So if something is not amenable to the
scientific method, then we don't have to talk about it. And so the thing about the simulation
hypothesis is it requires a commitment to a thing that is not ever falsifiable, and therefore it's a
commitment of faith. And if it's a commitment of faith, we don't have to discuss about it. In fact,
David Deutsch writes about this really nicely, I think, in the beginning of infinity. The simulation
argument is a garbage argument, because it is an argument that stems from faith.
The part that I wonder if it's actually beyond faith, though, is. Well, it's a couple. It's
twofold. Number one, the galaxy, we don't even know how dense it is and how far it could go,
and we can only know what we've been able to actually physically observe.
And then number two, there are unexplainable things that happen in human patterns, in a way,
that would suggest that perhaps we are within, like you said, the layers of simulation. I'm trying
to picture in my head why that's not. Okay, no, no, no, no. Look, let's go back. Okay,
we're in the universe. Who created the universe? Who do I believe created it?
No, no, no. We can say there's a creator, right? Or it just is. But the fact we can't falsify
that, it's nice conversation. And sure, there are things that are weird in the universe. Go,
"Well, was there a designer? Was there a god?" Sure. But what can we do? What can we do? What can we
use a scientific method to explore, right? Yeah, but you said you're not like
a Lawrence Krauss guy, that something came from nothing. You believe it started from something.
No, I mean, I don't. So, a Lawrence Krauss guy, something. No, look, I mean,
I think there are some scientists who basically, again, that something from nothing is,
as an argument, is, for me, kind of similar to the simulation argument, right? So, I think
that they both have fundamental scientific flaws. And so, I prefer to, as a materialist,
to work in the material world and just basically do experiments on the stuff around me. Now, that
doesn't mean to say we do not exist in a simulation or something didn't come from nothing.
It's just I am not able to build an experiment to basically falsify that. How do we find a way to
build an experiment to falsify that? Well, it's not. I don't think it's possible. You don't think it's possible? I think, I mean, my
small brain, my small intellect, I am not able to falsify that. Right now. But like, you know, they
couldn't falsify gravity in 1400 and then an apple fell on the. Yes, they could. They could. They
started. They were throwing stuff at each other. They just didn't know how to falsify it.
You know, the principle was always. So, that seems like semantics to me. No, because we knew
there was this thing called gravity, and we understood that there was a force. No, no. Look,
I think we have to be very. This is where philosophy becomes really important, and I wish I was a properly trained philosopher.
Who would say, "Look, if we're going to basically take all the way back, we're going to. We're going to
assume there are certain things that exist, an ontology, right? Or a metaphysics, right? And then
we're going to basically then look at relationships with things within that metaphysics and ontology,
and we put out layers. And those layers are going to have to be self-consistent. And what you'll find
with both the simulation hypothesis and the something or nothing is an infinite regress.
And with an infinite regress, you can't make progress on that. And so,
what you do is you put that to the side and say, "Well, that is something that's outwith
the scientific method. Not as defined today, but as defined forever, right?" And that's why I think
the simulation argument, the fact we're still discussing it as if it's a serious argument,
is silly. Because we can spend our life discussing so many other interesting things, like how do we
cure cancer? Or why can't we live forever? Or can we go to Mars quickly using a fusion engine, right?
Well, far more interesting questions because we affect them. And also, I think the
simulation argument is. For me, simulation is super interesting because I'm building chemistry
robots, right? And if I build a robot to do something, and then I build a simulation, I want
to be able to verify. I need a thing called verification. Now, in AI world, where the AIs
are working really well, they've got very, very good AI systems. They've got very,
very good verification in certain problems, right? And so one of the things I'm inspired by actually
from AI is like building the correct verification loop for physical chemistry stuff because you know
I invented a programming language for chemistry a few years ago and everyone just said this is
nonsense you just made it up I'm like well it's not I didn't make it up but I'm not sure if it's
nonsense like the idea came to me because I wanted to program my 3d printer to do chemistry and I
want to make sure the 3d printer didn't catch fire so then I built this programming language
but that allowed me to make a digital twin of it so I can verify and test it in a sandbox and so
and so simulation that allows me to verify something in the real world is great so don't
so if I can take the real world and then make a make a model of it and then do something
that will allow me to check that when I do it in the real world doesn't catch fire
I'll do that that's why simulation is so important and that's why I think it's important for me to
push back on this whole you know again a nonsense idea of the simulate where we're a simulation
but I think it's important for me to push back on this whole you know again a nonsense idea of the
simulation but I think it's important for me to push back on this whole you know again a nonsense
now that doesn't mean to say this will mess with everyone's head that one day we can't create a
simulation where we can put digients inside where we can put what inside so um I've got a Ted Chang
I thought you'd say Terrence Howard I was like oh shit here we go Ted Chang wrote a really great
book called the life cycle it's not the nicest name not the sexiest name the life cycle software
objects I believe the name of the book is Ted Chang Ted Chang fantastic writer is he still with us
yeah okay he's a fantastic thinker
writer um he's um external faculty at Santa Fe Institute so I've met with him several times
cool um debated assembly theory with him um and um and these digients are kind of real entities
that live in the world and you can manifest them in physical robots and so on but it's not
you know I could imagine a world where I could create a sufficiently rich
um computational universe where I could create things that might appear sentient
I could do tests on um where I would actually have to think about some moral philosophy ethics
and so on you know um I can imagine that but I don't know what physics I would have to build for
that because I don't know because I don't understand what life is right what how chemistry
became biology number one and how biology generates cognition and consciousness number two
and how consciousness makes intelligence and free will number three I don't understand any of those
things until I get to the bottom of it I don't understand any of those things until I get to the
end of those things I can't build a simulation of them right I got you so I think that that's
what I'm trying to get at so it's very easy for people to loosely say I can do a thing but then
we have to apply the scientific method and real scrutiny to it you know and that's why Bostrom
like I'm I feel like I'm really I'm Bostrom hating he's a really nice guy have you ever
talked with him I haven't no no no I mean I think interesting conversation I think I've been at
several meetings when he is there but he's kind of you know um I think I would probably just be
too annoying I would just
be like
I would like I don't know I would make the the Bostrom conflabulator
conflate confabulator confabulator yeah so this it will be like a philosopher that just puts
together the bullshit things and pretends they're real the coffee cup um you know let's think one
now let's combine coffee cups in a simulation that could make black holes and destroy the world
you know so like what would happen if we simulated the wrong coffee cup in the in this in this uh you
know
in this alternative universe and it caused a singularity and the entire world disappeared
I don't know if he was doing that I don't think he went to that I think he went to where things
are coded to create or destroy just in general not like oh we're gonna have fucking floating
objects or something like that that defy physics I don't think he quite did that I'm not arguing
that maybe there is something to be said that he didn't create something that's falsifiable
it's an interesting point I just don't know if he went that far I mean I think look it has a role
and I think it got people thinking but I think it's very dangerous because it's allowed people
to think there's this thing possible called super intelligence it's a bit like saying we're going to
go fast and speed of light right you can't go fast and speed of light we know ever ever it's
the law of the universe right as you put energy into a mass and you to accelerate it it it radiates
radiation to stop you getting there we do that in proton beams all the time at CERN right there's no
like the speed of light seems to be you know I mean never say never but 99.99999 percent
so you're saying there's a chance well if I just no there is no chance but but as a scientist it's
impossible for me to say anything is absolute because you know I have to have an open mind
but right now having putting some limits on things allowed us to build a technological society
you know
when you go to a hospital and they say well we're going to do an operation on you and you say and
we're going to I don't know put a stent in your in your heart right and you can say well you know
did you make this up is there a chance well there's of course a chance that we're just making
it up you'll die but but actually look at all the statistics we did if people do die but that's part
of the but the fact is the probabilities of the past exactly the probability that you can survive
if you've got a you know some kind of constriction in your artery it's like it's a it's prevented
many deaths so sure you never say never in science you never say anything you just basically go to the
edge of the scale and say I'm 99.99999 percent sure we're not going to fasten speed of light
because all the phenomena we showed that allowed us to build all our technology it means that
when you accelerate objects towards the speed of light they they can't get there
now you said we when you referred to CERN are you involved with CERN at all
no you're not no no I mean I've been to CERN I was a TED TED talk at CERN but I mean CERN is
just like it's a it's you know it's just a very interesting place where particle physicists try
and do experiments to confirm what they already know but that's me making a standard model because
what's the latest stuff they're working on over there I'm not I'm not call it I'm not a particle
physicist right and I'm not I'm CERN is a great machine it probably CERN is a great machine in
terms of the the the media associated with CERN the way they drum up interest it's like this massive
experiment and it costs a lot of money right and so they have to keep it they want to keep the
machine wants to keep itself going you know there is an argument right now in the world in the UK
like how much do we want to spend on particle physics the particle physicists are getting a
lot of money spent on them to do stuff that basically is you know we've we've we've basically
used the the CERN to get the Higgs boson great it was was that worth five five billion euro or
dollars or whatever it was I don't know well that seems like it's such a huge part of the
these spaces in in any level of academia but especially in science how much can you drum up
buzz and hype and I don't know some sort of like for lack of better way of putting it like creative
sci-fi interest in the general public to be like oh I want people to work on that versus actually
funding the ideas that might actually have the merits of being the best to create something
that's actually groundbreaking I'm yeah I think that's a that's a legitimate question right um
and I think there's an argument to be so to
be say look at look at any any um scientific enterprise when you fund it um you get you get
um rewards coming out and then when the rewards tail off what you do you probably kill it and
start again right creative destruction so that happens a lot in science but um things you know
it's not just CERN right in in chemistry in physics in biology there's all you know was the
human genome project worth it well it wasn't worth it at the time it's gonna be worth it now because
we now know how I edit the genome
can you explain that more yeah so when the human genome project was done it was a massive
collaboration between the NIH and uh and the MRC so the UK MRC medical research council and the NIH
national institute for health they spent quite a lot of money in basically building technology to
human to sequence the human genome and then also Craig Venter um great pioneer great entrepreneur
great um a kind of engineer also basically started a company to beat them to do it right because he
um the to justify it we said well we're going to cure all disease right and the human genome was
solved and we didn't cure all disease what's beginning to happen now which is really exciting
is that there's a lot of gene therapies where we understand how to correct a diseased gene like
there are some people um but young people and old people that have had a young people have been born
blind or almost blind where they've been able to correct protein by gene therapy and they can see
that's amazing wow there's also gene therapies where we're understanding how to re reprogram
the body's immune system to cure cancer I mean there is a very strong chance that most cancers
we know about within our lifetimes well no we've on our lifetime we'll have a combination of
molecular and genomic therapies where we'll use small molecules do you think they already have
them and they're just not giving them to people no why would you possibly because that's the stupid
thing to do
why is that stupid we've had the same they've improved some levels of how they treat cancer
but we've we've utilized the same type of treatment for it for decades now and it's brutal
so yeah and the companies are getting there right it's um I think they're so no there is this is one
conspiracy that can't exist well it doesn't exist right why because there's lots of pharmaceutical
companies pharmaceutical companies classically a chemistry there's lots of chemists doing
medicinal chemistry going way back
developments in biology are moving a pace but the most critical problem is
We have to translate those developments from the lab into the clinic and people are hard
and people die.
Now there is actually quite an interesting contrast in China and the US and the UK right
now about how much regulation we have and arguably there are some clinical trials going
faster in China because of different regulation in the UK and the US and Europe.
Now is there an argument to say that there's not conspiracy in the West but we are much
more, we're much more risk averse.
Right.
Right?
Yes.
So could we go faster if we basically said, oh, okay, we'll accept a few more deaths probably.
But that actually is. So any limitation that we have in the West is a function of our regulatory environment,
which is in function of our voters and the people.
So we're not conspiracy.
We're like, no, we don't want to-
Yeah.
No, it's not always the worst thing for sure.
Like you look at the conversations happening around like the ability to clone things and
stuff like that.
And like China's moved in some ways that are like a little fast and taking risks with that
because they don't have the same guardrails on it.
I think there's something to be said for having guardrails on that for sure.
Yeah.
I mean, there was one very famous Chinese scientist who used gene therapy to edit some
embryos that became humans and caused a problem, right?
These people are not going to have such a good life as others.
So he got put to prison because he basically mis-edited the data.
The genome.
Yeah.
What did he do that they're not going to have this good enough life?
Oh, I mean, I can't remember the details and I think of something to do with the HIV.
Was it something to do with HIV?
The virus?
But there was. I'm not sure, but there was something he did that was not particularly good, smart.
Yeah.
Chinese scientists who produced genetically altered babies sentenced to three years in
jail.
He Jinghui.
And his two collaborators were found guilty.
They were found guilty of illegal medical practices.
Let's see what they did.
The Chinese researcher who stunned the world last year by announcing he had helped produce
genetically edited babies has been found guilty of conducting illegal medical practices and
sentenced to three years.
A court in Shenzhen found that he and two collaborators forged ethical review documents
and misled doctors into unknowingly implanting gene-edited embryos into two women, according
to Jinghui, China's state-run press agency.
One mother gave birth to twin girls in November 2018.
The court ruled that the three defendants had deliberately violated national regulations
on biomedical research and medical ethics and rashly applied gene-editing technology
to human reproductive medicine.
All three pleaded guilty to a two-year prison sentence.
The court heard the case in private to protect the personal privacy of the individuals involved.
The report says physical and documentary evidence of witnesses and expert testimony were presented
to the court, but it gave no details.
Sad story.
Everyone lost in this.
But the one gain is. The world is awakened to the seriousness of advancing genetic technologies.
I feel sorry for JK's little family, though.
I warned him things could end this way, and it was just too late, wrote bioethicist William
Hurlburt at Stanford University.
And then Dave's highlighting this.
In November 2018, he announced that he had modified a key gene in a number of human embryos
in a way thought to confer resistance to HIV.
The modification might be passed on to the descendants of children born with it.
He recruited couples.
The mother was not.
The father was infected with HIV and the mother was not.
His talk at the International Summit on Human Genome Editing in Hong Kong, China.
He said he wanted to spare the babies the possibility of becoming infected with HIV
later in life.
The technique could be used to reduce HIV/AIDS disease burden in much of Africa, he argued,
where those infected often face severe disruption.
But like you said, they kept it private in court, but it obviously caused other serious
drawbacks in the kids.
Yeah, yeah.
I mean, I think that was completely the stupidest thing to do, right?
Yeah.
Because HIV is pretty much now. I mean, horrible disease, but fascinating that we have now, it's possible, I mean,
I don't know if it will be completely eradicated in our lifetime, but it will be eradicated.
And the reason for that is HIV was one of those weird things where it was a leap from
animal to human, right?
And obviously, it devastated population, mainly homosexual males, right?
And then we got therapies.
to put it under control and now we've got to the point where you can actually
get it under such control there's no viral load which means like it's almost it's not impossible
to pass it on and i'm not an expert in this but basically is you could chemically control it and
you get rid of the side effects and then now you're at the point where you could actually suppress
the presence of the virus what an amazing accomplishment for human medical technology
i think he just went a step one step too far and okay are we going to edit do gene editing in the
future in ways that we have to debate it's a technology that we have to debate yeah absolutely
and you know in the uk we've we've we've done it but anyway coming back to the human genome project
compared to cern and pharmaceutical companies is that human gene the human genome project was an
incredible achievement in the same way that you know use of cern to find the exposome was the
incredible achievement now how we take those projects on in future time and how we fund them
and what we tell the public is kind of interesting right um and i think you know science is becoming
it can be expensive um we're in this illusion right now that ai labs are going to automate
all science so it'll be cheap and we'll just cure all disease and we're gonna have and that's just
not going to happen something else is going to happen the ai tools will help us cure some disease
they'll help us
can um produce new molecules and it might be that it will accelerate rapidly what we can achieve i
just don't know right i like your scenario i said this earlier but like in all seriousness i hope to
god you're like over the target on this because if it's just a huge accelerant that allows us to
solve things way quicker where human beings are still leading the way and creating that intuition
to do stuff then this is the opposite of doomsday i think so and i think that's why i can almost have
some sympathy i mean i have sympathy for both of you and i think that's why i can almost have some
sympathy for both of you and i think that's why i can almost have some sympathy for both of you and i think that's why i can almost have some
ai doomers because obviously um they're trying to communicate a scenario in a language that gets people to think and ask their politicians to basically think say hang on can we just understand what's going on and i have sympathy for the ai abundances abundant tests to say let's be optimistic and use these tools in a way that will help human flourishing what i don't like is the fact that the doom you know you can wake up i mean like if an alien visited earth they'd be like what the hell
because when you're like we're all gonna die hey is gonna kill kill us and two we're all gonna live
forever and we're gonna have infinite productivity we're gonna have infinite stuff both those things
are clearly stupid the nuance says well look there is a worry that we'll use ai systems to hack into
computer systems and all software is going to be perpetually unsafe bank accounts
encryption blah blah blah that's a problem you don't want you don't want your tesla to go nuts
on the motorway you know you just normal you want safety and you want security and you want
bad people to not do bad things you want them to also be able to stop them on the flip side
you want to use ai to accelerate thinking accelerate kind of technology and and basically
cure disease um make things cooler you know and but what i think has happened is some of the ai
people getting quite rich are saying oh money won't exist in 10 years yeah i don't understand
that argument at all that doesn't make sense it's just elon making shit up again it's like i don't
understand like i don't know what's going on i don't know what's going on i don't know what's
going on like elon is a genius but but he's not a genius at communicating what is what but what i
i listened to that a few times and i was like what the fuck is the logic here what how does money
how does money not exist to where people are all just going to be the same especially like that
i think it's so look i'm not an economist but i would say the following money today you're an
economist money is a is a representation allocation of resource right yes and um and where there are
people who are deciding on what to do money will be required now isn't it going to be great that
the resources required to build certain things will drop and drop to drop almost asymptote towards
zero right it's kind of great that i mean think about technologies now that you can just buy and
they're just basically almost free right there are some microprocessors you can buy that are just
like 15 cents when it used to be many many pounds many many dollars sorry so there's things like
that so that the cost of certain goods will get so low that the cost of certain goods will get
it's relatively abundant right but that there's always going to be a bottleneck i mean planet
earth has a finite size there's a finite amount of accessible energy today we have to be there's
a finite amount of physical resource but there's an infinite amount of possibility which is really
cool because that infinite amount of possibility we're going to recycle things we're going to find
new energy sources we're going to be able to create entirely new economies right there'll be
digital worlds where people will be trading stuff and
doing stuff and creating you know all sorts of art and stuff so i mean i can't prejudge what's
going to happen there but this idea that we've got infinite abundance in in less than 10 years it
might be a reaction because quite rightly the people creating these ai tools have been astonished
by their capability i mean think about it like you can take these you know the thing i find
fascinating is you can use claude or chat gpt to make a powerpoint it's pretty good yeah no it's
you can make apps with these things too
but the thing is if you tell if you tell claude just make a powerpoint to do x and you don't give
enough information it's garbage that's right so the fact is is it that
complicated to understand if you garbage in garbage out it's just like if i say oh i don't
want to make a powerpoint presentation myself but here are the points i want to make and here's a
fundamental data for them please make it and iterate with me i have no problem with that i
have no problem using ai tools to basically unleash my creativity right um because i spend
i think what i've had to spend some time adjusting to is um the fact that these tools have to be used
in certain ways and and you know they a lot of them give me the ick right like when it comes to
writing do i oh yeah right do i do i use the ai just to write for me it's shit i mean it's getting
better it's still but people can i talk to the average person now and like they'll be they'll
look at someone very quickly they'll be like that's ai like the human intuition on that is
pretty fucking good so i'm and i just love the way the ai is going they're so um what's the word i
think semantically uniform semantically you know i think there's basically there's a the ai is right
in such a uniform way yes you can see it so it's you know and also it's kind of this it's not it
this it's that it's not a it's b i'm just like can please not write like that right so what i do
tend to use is i i write and my writing is fairly flawed but um but you do something flawed my
writing no way i might i'm i'm not the i'm not the best trained uh uh english professional but i
and i and i try and write enthusiastically but i but i do use the ai now to collect typos but it
does try and clean up my grammar i was like no i don't want to say i'm like that i want it sound
like this this is my voice right exactly so please don't do that thank you it's very robotic but what
i have used which i found quite fascinating is i use the ais now to look at all my paper proofs
because paper proofs so when i publish a paper and i've got the proofs and i i'm really bad i i'm
really bad at reading right i i find it hard to read in a way that allows us to correct typos
so i i had this paper that came out in pns just a few weeks ago on alien detection systems
alien detection systems you can find it online if you think assembly theory for
um i don't know what it was alien detection or something or life detection um and um i put the
proofs into chat gpt and said just fight expecting it just to and it went through a
bunch of typos and i found like 10 typos i did not find like you know it's useful yeah like it was
like really typos a human a human reading it would find it annoying right and and and what i want to
do is make there we go this is the paper in pnas molecular assembly is a universal biosignature
measurable by mass spectrometry now can you bring that from japanese to english just to put
what you mean oh oh okay sorry from from english to english yeah um so that's a
kind of english and we speak here in jersey so so what this paper does it show so it's basically
latest extension of assembly theory for detection and what it just says is like hey how can i take
a molecule so if i how can i measure a molecule the presence of a molecule on another planet
and use a measuring device to tell me if that's produced by biology or not an alien biology or
meaning intelligent life not intelligent life just any life evolve any life the presence of
evolution we can tell intelligence as well actually on the same scale as we can tell
what i'm getting to i think we can measure intelligence it's just that so and then we just
if if you go down if you scroll down there's a great figure which my student made because i use
machine can i read the can i read the abstract before we scroll down yeah is that right let's
go back up to the abstract or the significant statement which one do you like better
significance or abstract um read the abstract let's read the abstract so detecting life beyond
earth requires biosignatures that do not depend on the chemistry of known organisms molecular
assembly ma derived from assembly theory which to be clear you've mentioned this today this is a
theory you have come up with you talked about it last time but we'll get deeper on it i'm sure now
quantifies how difficult it is to build a molecule from basic building blocks linking complexity
directly to selection and evolution here we show that ma can serve as a universal biosignature
that is both interpretable and experimentally measurable unlike information theoretic measures
ma can be inferred directly from mass spectrometry data
without structural elucidation we demonstrate that using a machine learning model trained on
standardized signal stage spectra which predicts ma with three-fold level error than baseline
methods simulated multi-stage data reveal that small instrumental variations can double prediction
error highlighting the importance of calibration these findings establish molecular assembly as a
physically grounded quantifiable biosignature measured by mass spectrometry whose interpretation
depends on a careful control of the instrumental effects offering a scalable route to life
detection on future planetary missions so dave let's go down to where lee wanted to expand upon
this with the with the graph i just like that i just like the picture with it so it's kind of nice
with um because obviously he says um you can use machine learning because there's a theory there
right so the the thing is people have been trying to use machine learning to look for life and they
were just making shit up and assembly theory just helps you understand the basis for it so all it to
go back to my analogy for temperature right temperature we know things are hot or cold but
how do we quantify we know things are live or dead we know something's wiggling around and moving or
it's dead it's a stone or we just killed it boom how do we measure it so all the assembly theory
does it says well look living systems uniquely this is the only assumption this is the only
assumption it is an assumption and we're trying to falsify it and it's falsifiable so you living
systems uniquely make molecules with many different parts
right and um in high copy number so we can measure that so we've made them it's equivalent to our
thermometer we have a thing called a mass spectrometer what a mass spectrometer does is
able to weigh a molecule how heavy it is so it basically fires a molecule into a vacuum
electric field and just measures how much how heavy it is and then it hits it you hit it with
energy and it falls apart and the way it falls apart yeah you just break the molecule part you
hit it and just it's a bit like taking a plate and hitting it on the ground and fragments
right and then you count the number of parts and that parts you can then um use that to measure the
actual assembly index that we can theoretically calculate and this was a leap i made a few years
ago i realized that assembly index was measurable and calibrated it and caused and that was and this
paper is the next step to say well hey not only does it work we can now put it onto mass spectrometers
a mass there's a mass spectrometer on mars right now in fact there's three on mars
uh i don't know if there's one on the moon there have been
put in in other places and we're sending a nuclear powered mass spectrometer to titan
called dragonfly it's quite cool that's a hard name i like that so basically it's a quadcopter
it's going to be powered by a plutonium slug a nuclear battery and it's going to fly around
titan and sniff the air and it's got a mass spec on it and i'm like guys use assembly theory to
see if we can find life okay so let's expand upon this could this be maybe i'm going to
go way too far with this can you do any of this to try to find life on like exoplanets and things
you can so there's a paper that's going to be coming out soon where we can use assembly theory
to um to detect to measure the probability for life on an exoplanet for sure now whether it
will work or not we don't know yet but this paper is going to come out in a few months i don't want
to say much more about it because my co-workers have been working on it
walker and her team at asu have you talked to david kipping about this yeah yeah yeah i've
mentioned it to david kipping yeah what does he say um he's excited i mean he's an enthusiast
for this type of stuff yeah um i think that the the problem is not with david kipping but just
the exoplanet world in general is they they're very used to the used about talking about one
marker for life like methane which is ch4 okay or oxygen o2
or water h2o so these are all very small molecules so these molecules themselves don't carry enough
information if to know the difference between um life and death whereas the system that we've built
using assembly theory is able to kind of print fingerprint these gases in a way but uh i'm sorry
can you explain that some more you lost me a little bit so when they're looking at those individual
so if yeah so on methane has been detected on mars does that mean it's life or not no because a
geological process could be producing methane oxygen has been detected on exo well oxygen
could conceivably be detected on the exoplanet does that mean it's a presence of life because
oxygen is made by photosynthesis on earth no because oxygen is simple you could you could
get it by just breaking water down in uv light right so the question is how can you
um for the presence of biology or evolution in using gases and the answer is going to be
assembly theory meaning maybe i'm making a leap here that's totally wrong but you can instead of
looking at individual variables like that you're combining all them along with other factors to put
it all together and determine if there's life yeah i mean you don't have to use other factors
you just combine them together so all i'll say for now because again it's you know has to be
peer-reviewed and i'm i'm what i i you know i do many things um but presenting scientific findings
before they're being peer-reviewed as if they're accepted findings is a trap one doesn't want to
fall in
to but what i can tell you is i published a paper a few years ago where i was able to show you can
measure assembly index in that in the lab using three techniques a thing called mass spec which
i just said is weighing molecules one called nmr which is called nuclear magnetic resonance a bit
like mri right that you but um for molecules and the third one's called infrared using infrared
spectroscopy and light now how would that work so that you just basically you just look at the
number of different colors so the more complex molecule the more colors it has right and so
and that and so conceivably you could imagine exoplanets having molecules lots different colors
sure so now are aliens something you thought about like as a kid just as an idea a lot like
man there's got to be life out there i wonder what it looks like or i mean as a kid i mean
was i thinking about aliens a lot i mean not obsessively um i was probably thinking about
why am i here why does life look like this and i was thinking about why am i here why does life
look like this and i was thinking about why am i here why does life look like this and i was
thinking about why am i here why does life exist how can i how can i take this thing apart i mean
but i think obviously now um understanding what life is um i think is is really critical for
understand the phenomena of life on earth is going to for sure tell us about aliens how so
well what is life as a phenomena right as a chemical phenomena and then if we understand
how how
how odd is it that is earth that has life right um and how um rare might life be in the universe
it kind of related so if we can work out the process that gives rise that gave rise to life
on earth we should be understand something about the process that could give right to
life in the universe let me let me give you an analogy um the if we let's just imagine we could
when we looked up in the sky at night we we did not see anything and we were like oh my god
anything except during the day saw our sun because there was no other light getting to us we just see
it's black um we would obsess about the sun right how did the sun get created we know the sun
is created by the collapse of hydrogen and what happens is hydrogen get collapses go its own
gravity and the point at which the gravity is dragging all the hydrogen together what happens
when gravity pulls the hydrogen together gets hotter so there's a point where it gets so hot
it's enough to overcome a strong nuclear force and then it's starting to go in fusion and then
when it gets so hot it's enough to overcome a strong nuclear force and then it's starting to
go in fusion and then it's starting to go in fusion if the gravity is enough it doesn't blow
apart it it kind of self-regulates right because some start stars could just blow apart so that
phenomena that gives rise to the sun um is um is gravity now let's look in this now let's take our
universe we can see stars everywhere in the universe we don't just know our sun you can see
stars coming into existence and exploding all the time right well not all the time i don't know what
the frequency of supernova is and i don't know what the frequency of supernova is and i don't
I think maybe one a month, one a day, I don't know.
We'll accept it.
So you can see them.
So we only have an N of 1 for life on Earth.
So if we can start to understand how lightly we think it is chemically
that life emerges on Earth, we can start to bound the probabilities.
I'm sorry, how can we do that if we don't even understand
how vast and big the full galaxy is?
We do understand how vast and big the full galaxy is.
You mentioned that earlier, and I kind of –
I mean, we can measure light from the Milky Way,
and we can estimate the size of the Milky Way.
But can we estimate what might be on the other side of that?
That's what I mean by that.
Like how much do we not know what a speck we are?
I mean, the universe is pretty big, and we do have some bounds
on what we call the light cone of the universe, right?
Yeah, the universe is the term I should be using.
I'm sorry, not galaxy.
Yeah, okay.
Universe, that's my bad.
Oh, all right.
Now I understand what you mean.
All right.
Fine.
Let's just look at the universe for a second.
When you look up at every star, every star looks like it has some planets around it,
which is pretty crazy.
And if you think about it, let's classify those planets.
Those planets are either dead and will never have life on them,
abiotic but have the possibility for life, number two.
Number three are alive.
They're just living.
There's stuff everywhere.
Living and technological, i.e. there's intelligence there, so there's technology there,
and post-biology or post-lifology, because let's say biology is unique to Earth,
and there's just technology on there, so it's kind of outgrowing it.
But arguably. Just technology on there.
It's like robots and stuff.
I don't know.
I just made that up.
So there's kind of six type of planet types.
So when you look up in the sky, each one of those planets can be one of those six.
It can't be anything else, right?
I think I've classified all the possibilities.
So wouldn't it be good if we could build a telescope?
Big enough to shine light on them.
Now, according to assembly theory and chemistry,
I think that life is probably only possible within a certain zone of temperature.
Too hot, and all the bonds fall apart, and you can't have biology.
Too cold, nothing happens, right?
Right.
But actually, I thought of an idea, actually, listening to David Kipping's podcast.
He has the Cool Worlds podcast, is that right?
So I was listening to that, and they were going on about the habitable zone,
and I realized they were wrong.
I realized that planets. Living planets can probably modify the Goldilocks zone.
Okay, can you please explain that?
Yeah, so planet Earth starts to, after the late heavy bombardment,
where there's just lots of. It starts to cool down, and the atmosphere is being filled.
There will be feedback processes whereby the planet will probably attempt to regulate its own temperature.
So it's a bit like the Gaia hypothesis from James Lovelock.
Okay.
And I realized that, actually, if life starts to form on a planet,
and within that zone of life support, if you like, for that biology,
like temperature and pressure and whatnot,
if the planet starts to drift outside of that, evolution will start to kill stuff,
and the stuff will start to respond and go,
no, I don't want to die.
I will counter that.
So like a thermostat.
Yeah, rebalance it, yep.
So I think that planets might even lock into a biological or lifeological,
I just made that word up again, framework where it self-regulates.
The planet itself.
Yeah.
So the planet is able to basically self-regulate for the emergence of life.
Okay, let me play this out.
This might be totally off-base,
but if a scenario existed where a planet was traveling around its star,
its sun in a certain way such that it was getting closer,
closer and closer to it and heating the temperature beyond where life could be,
are you suggesting that the planet could adjust?
I don't even know how that would make sense scientifically,
but could adjust not moving closer to the sun
in order to be able to survive at a lower temperature?
So I think pre-intelligence, no, post-intelligence maybe,
we'll go back to that in a moment,
brings up one of my favorite Chinese sci-fi movies, Wandering Earth.
The Wandering Earth?
It's a brilliant movie.
Okay.
They basically, the Earth is going to be engulfed by the sun,
so they're like--
Deep, you don't know that one?
Deep knows every movie I've ever made.
There's two, there's also Wandering Earth 2.
Okay.
Come on, you don't--
I'm in, I'm in.
It's a fact, like, you know, I didn't think that Chinese sci-fi would be a thing.
Oh my God, am I so wrong?
I'm just so like--
Oh, they're cooking on sci-fi.
Brilliant.
Wow.
Absolutely fantastic movie.
Good to know.
Anyway, but, and that's the excuse where Intelligent Life was like,
well, we need to get away from Earth, the sun, because the sun is getting too big,
and it's slingshots around Jupiter, but I won't give too much away.
It's a batshit movie.
It's awesome.
But no, so let's say, let's talk about, let's say the sun, so the star, sorry,
the planet is moving around the star, but it moves around such that it gets closer
and very hot, maybe not habitable, and further away it gets too cold, uninhabitable.
That's right.
I bet you it'll be able to regulate the pressure and the temperature, the atmosphere.
So wouldn't it be, wouldn't it be great if like, oh, it's getting, getting too hot.
Atmosphere becomes deflective, shields up, oh, we're moving far away, turn the
atmosphere to trap light in, shields down.
It could do that?
Why not?
It's just an oscillation.
If the chemistry can respond in, in, in, this is what the Earth does now.
So we talk about runaway climate change now.
I know, but here's what's crazy.
I just made it up a few weeks ago when I listened to his podcast.
No, but it's not, but it's not even, I think it's a good idea.
I've just never thought of it that way, thinking with Earth, like the Earth itself as like a,
has its own brain as an organism.
I mean, like the, everyone's like climate change is such a problem.
It's like not for life.
It's not like the Earth is going to get greener because there's more light, there's more heat.
It's annoying for humans because we're built, we're, we've urbanized around, you know, around
the coast and around the equator where it was, the, the, the zone was quite right for
agriculture, but Siberia is going to become really fucking habitable.
Right?
You're going to have to get some notes on that.
Get some new prisons, I guess.
I mean, and Siberia is like, but on this time scale of a few hundred years, I will
be buying real estate in Siberia.
It's going to be great.
All right.
So people don't really understand.
It's like, we're kind of like, oh, doomsday climate change.
No, annoying because people are going to die from heat, you know, from overheating, for
lack of water, having to shift and migration.
That's really bad.
We'll probably come up with some technological solution for climate change, but planet, the
planet is a pretty big organ.
organism is the wrong word, but it's a pretty big. able to kind of respond so i think again looking at these planets in the in the sky
they'll they'll have an incredible amount of dynamics will probably home in on life because
life produces more complexity more adaptability so maybe the most interesting planets i'm gonna
maybe earth is going to survive longer than it otherwise would have because it produced life
that's right wow i mean be so cool i mean i think we're looking at life all wrong
and you know and actually this is one thing elon says i mean elon says such a creative things but
look if your son needs to lose mass so it doesn't explode something bad doesn't happen to it i'm
sure a life form could say i'll just take some mass from the sun the other thing i would how
would that oh i don't know just make a vacuum cleaner how hard is that i mean look let i mean
over a billion years so look over the next five billion years the sun is going to get larger
right right now the climate change we've got now is nothing
the sun is going to get larger as its hydrogen gets depleted and it starts fusing heat more helium
and it's going to get and it's going to get more and it's going to get a bit hotter now what do we
do to solve that problem i mean the wandering earth is a bit of extreme version i would just
like hey we've got like a couple of billion years notice can't we just push the earth gently that
way how hard is that just put a few nukes boom boom and like you'll just need to shift it a few
millimeters a year that's it it's not hard just find a desert if you have two if you have two
billion years notice and you want us and you want to it's not hard i don't disagree with you
considering the technological innovation we have on very short time scales for sure i mean like
there's ways we can play with the gravity like what do we do the moon i mean look i'm not saying
that we can do everything but if we understand the mass of the earth it's finite but it's large
but finite there's all sorts of things we could do we could go and drag
another planet near us near us and just push it out a bit again given two billion years right
we can do a lot you know planning ahead i gotta get you and david in here for a podcast together
he's coming back in in november we're gonna do one but maybe next year all right he's here like
he's in town we can make that happen i didn't realize you chat with him i guess make yeah he's
he's awesome but that would be really cool to like exchange ideas i love that you were listening to
that and just i listened to it i was like yeah
no i need you to say that to him and the two of you go back and forth because he's also like
what i love about his style is he is number one incredibly open-minded but also like when he's
challenging other scientists ideas with data you know he's just looking at it by the evidence and
he's like hey here's what we're seeing could be that i feel stronger about this but if they prove
this then maybe that actually end up being right but right now we can't prove that so i'm here he's
very diplomatic about it yeah yeah
he's a worrier he's a worrier he's a worrier a warrior or a worrier not a wow i mean a war i
don't i might be a warrior okay the accent's killing me but he's a worrier and and that and
i think that yeah it's kind of he worries a lot but that's okay everyone everyone does it
differently they all i like to be more provocative than not and not worry because then you can really
i think for science to accelerate sometimes you need to annoy each other yes because if
then it just stops
because people get too comfy but maybe ai is going to solve that problem anyway because the ai is
going to say no don't be boring it's going to make us all a lot more creative well you're a no
bullshit guy that's what i respect you're like the minute you hear something that's like what
the fuck is that you're completely unafraid to bring out the fist and be like stop stop well i
mean i'm so you need three components for that or i guess you need to be um somewhat um uninhibited
by people pushing back right and be and then and all of a sudden you're like oh my god i'm not
Also, you need to be willing to be wrong.
And then the other thing is you need to – critical thinking, real-time critical thinking requires – basically, I would – I'm sure there's many things I've said today that are actually wrong.
But if someone can educate me and say, well, why that's wrong?
Like, can we make ASICs that aren't used just with zero and five volts?
Are there variations?
Can we make neuromorphic computers?
That'd be great because I'll buy one and play with it.
I won't have to make a – plug a, you know, a gherkin into the mains, right?
And so I think that having new ideas and being able to challenge those ideas almost like in a sandbox, right, or whatever in your mind, imagine them, and then create new things is kind of interesting.
And I think a lot of people – we're mysticizing, if that's a word, AI, right?
We're revering it because we've been told it's magic.
It is quite interesting.
I do think, though, going back to AI.
And it's the only thing I'll say on it before we can talk more about assembly theory is that something did happen.
Open AI did – they basically hit upon a cognitive treasure trove when they trained their model.
And suddenly these chatbots started to be really good at predicting the next token.
And as you increase the context window, it got even better.
And then when you basically built kind of guardrails or chain of thought abilities, suddenly these systems were able to daisy chain together.
Daisy chain.
Daisy chain.
Daisy chain.
Daisy chain.
Yeah, just basically say if this, then that, then this, then that, da-da-da-da.
And then you checked everything, fact-checked within, and suddenly these tools became incredibly powerful.
But for me, it's like, meh.
I wanted my computer to do that since I was nine years old.
There was no physical reason it couldn't do that.
It's just programmers were rubbish.
You have finite memory.
Or programmers were too good.
I don't know.
So I think that AI is – we've got to demysticize it.
And that means that we have to start saying –
well, what is intelligence?
What is creativity?
What is novelty?
And I'm really asking these questions and stop pretending the AIs are.
Because this is where humans will – you know, until we understand how – what life is and create new brains and things, humans still have a job.
And isn't it – and maybe there is an argument for kind of saying, well, there are some silly things we can automate.
You know, my company, I have this company that –
Chemify.
Chemify.
And Chemify's got a few –
Chemify's got a few hundred people in it now.
Oh, wow.
And I was at a meeting where a load of people were saying, well, you know, I've been able to shed all this number of people from my workforce.
And I was like, guys, what are you doing?
Like, not only you're basically – you're getting rid of people because you want to temporarily increase your profitability, but actually, look at the human race.
We have fantastic – human beings are fantastically flexible, infinite problem solvers and infinite creativity machines.
So what you want to do is you want to employ more of them, not less of them.
If you're giving them a stupid job because you're stupid, that's actually – don't be stupid.
Yeah.
Didn't you come up with assembly theory you were telling me with like your finance guy?
He was a finance guy at the time.
Yeah, yeah.
He was able to do that with you.
It's like no one would ever think something like that could ever happen, but you have to be even open in the situation of that possibility.
I mean, so I do – I find the whole –
I find the whole job displacement theory rather distasteful, but I also do find the fact that in the world, in any organization, you've got to – I'm in my company.
You want to make sure you don't break the law, and you've got to have good working practices and good regulations, and there's data protection things and all this stuff.
So you want to have all of this, but I've hired a lot of people to do incredibly creative things, and also we're building this thing as we go.
I mean, Chemify.
Chemify's aim is to build a world model for chemistry.
What is that as Ligon for AI?
I mean, it's kind of – no, and it's not a joke, but it's like the world model for chemistry.
In fact, if you go on the web, if you go to chemify.io and slash Genesis, it explains the world model.
I built this landing page myself.
Genesis?
Chemify Genesis, yeah.
Chemify Genesis.
That's some biblical shit right there.
Well, that is because – and it's called Genesis on purpose because –
It's the world model for chemistry.
If you go down, yeah, you can go down and you can see, okay, keep going down.
The molecule on the screen is only a hypothesis.
S, make, test.
So the idea is that Genesis is about the fact that people think that drug discovery is discovering a molecule.
This is actually the answer to creativity and novelty.
It is?
In AI.
Yeah.
This is why a chemist is able to come up with it.
Okay.
So in the old. In the old days, the way you did drug discovery is you would basically just look at – go and get plants and things and look at the molecules and discover molecules that look like they have some kind of interesting microbial activity or biological activity.
So you would discover the drug, right?
Okay.
Now, if you think about chemical space, chemical space typically is said that chemical space is about 10 to the power of 60, right?
Okay.
So that makes for drugs.
So that is if the average drug – the space of possible drug molecules is about 10 to the power of 60.
The number of atoms in the universe is 10 to the power of 80.
I actually redid that calculation.
It's not 10 to the power of 60.
It's 10 to the power of 117.
Now, how do you arrive at that?
It's fairly technical.
It's on the archive, actually.
Okay.
So if you – I don't know what you would put on there for it.
It's like size of chemical space, Cronin X archive or something.
You might find it.
Size of chemical space.
Yeah.
So you showed the work.
My high school math teacher would be proud.
Yeah, there we go.
Is that it?
Elucidating the size of chemical space with assembly theory?
Yeah.
Okay.
Wow.
So we looked at the number of steps you would take.
So basically, if you allowed your molecule to have, I think, 25 steps, if you click on
the PDF or go up in the right-hand corner, I think it is, yeah, there you go.
And I think if you go down to the table, there's a table.
I didn't think I'd give everyone a chem informatics thing, but keep going down.
There's a table with the numbers in, and there's some pretty big numbers in it.
Keep going.
The biggest numbers.
I was going to do a trumpet.
Right there.
No.
No.
I think you have to go up now.
Sorry.
You went too fast.
Too fast.
There's a lot of pages.
I know.
A lot of math as well.
I'm sorry.
It looks smart.
It looks. I'm trying to give you something, Lee.
Yeah.
It's just math.
I don't know where it is.
The table might be further down.
I can have a look.
Maybe go to the back of the paper and go the way to the front.
I'm at the point where I'm ready to take it.
There we go.
I was going to take your word for it.
And then zoom in there.
And then you can zoom in.
Oh, look at that.
Yeah.
There's the number.
And then you can look at the assembly index.
Yeah.
So assembly index 25.
That is if you take a random walk, and you take 25 different steps with the chemistry
that's available, there's 10 to the power 117 molecules accessible.
Right?
Now, there are some duplicates, and there may be some that are impossible because the
laws of physics, right?
And we've tried some filtering there because the referees are arguing about this just now.
But that's a really big thing.
It's a really big space.
So when your space is so big you cannot search it, you have to hop there somehow.
How do you do that?
Well, you really have to generate something new, right, or novel.
That's where genesis comes from.
If it's just searching, it'd be like a search engine.
So that's why, basically, I think on the genesis, if you go back to the genesis thing, go up,
I think if you go up, I don't know where it is.
I might have made a statement, but go back one.
Go back one.
And I think it's like. So not a catalog, not a synthesis sore, not a retrosynthesis, it's a computation.
One executable loop wired to real chemo farm capacity ideas to verified matter.
Yeah.
And so the idea is to say the space is so big you can't search it, so you have to generate
it.
You have to really make it.
But if you go back to the beginning one, sorry, the hallucination, I loved it.
I was A/B testing it with a friend.
It was like. Chemical hallucinations, that's hard.
I love it.
I like it.
I made it.
And everyone's like, "Oh, your marketers wouldn't like it."
But at least people know I didn't use an AI to create the carousel.
That's right.
That's right.
Because at the end, if you go to the end one now, the meta, right?
Because I like the meta, because computation is. We're drowning in meta molecular?
So the future of chemistry is making the meta physical, right?
People say, "Oh, that's meta."
Yeah.
They're like, "Oh, the joke isn't that highbrow.
That's metaphysical."
But now let's make the meta physical.
Okay.
You're like, "Get a new job, Lee."
Yeah.
I don't know if that was as funny as you'd. You got a good sense of humor.
I just don't know if that was your type of. Anyway, I did it.
I put it up there.
But the point is that the Genesis engine creates molecules.
It doesn't discover them.
Because you can't discover something if the space is too big to search.
You can only create.
And that's kind of weird.
And that's the same thing with AI.
Right now, all the AI's generate. So there's all these people doing drug discovery, but they're just generating random graphs
on the screen.
They can't make them.
So people go, "Oh, I've discovered a drug or a new battery molecule."
I'm like, "What do you mean?"
They say, "Well, this is what I got out of my simulation."
I'm like, "Oh, great.
Have you got it working?"
They're like, "Oh, no.
We haven't made it."
I'm like, "Well, that's just bullshit then."
So basically, I realize, because what Chemify has been doing is making molecules in the
hard world for hard chemists.
And then you've got the AI world, they're just generating just bullshit.
And Genesys connects the two together.
And now I'm excited because people are like, "Oh, so you can connect our AI to your engine
and we can have a dual AI?"
And we're just, "Yes."
And so what we're doing now is Genesys is a forward-deployed kind of Chemify engineer
that connects people who buy it so they can just use it.
They keep their IP.
But anyway, I won't sell the company on your podcast.
It's just. No, you can sell it all day.
That's why you're here.
Raised a lot of money, too.
Yeah.
Employing a lot of people, too.
I like that.
I mean, we haven't raised. I'm kind of sad that I'm such a bad fundraiser, right?
Such a bad. You raised 70 million since the last time you were here.
I feel like that's pretty fucking good.
But then look at all these AI things that have raised hundreds of millions, right?
Yeah, that's all right.
That's all right.
But then one of my friends was saying to me is that comparison is a thief of joy.
That's right.
When you were. Were you like into art when you were growing up?
Were you an artist of any kind?
No, I'm into art now, though.
You're into it a lot.
I'm into it a lot now.
Yeah, yeah.
Because when I hear you talk, and there's other scientists I've thought this about as
well who I've had a chance to talk to, you remind me of the way you look at things and
the way you're visualizing things in your mind and trying things is very similar to
how a musician describes making music or how a painter describes painting something or
how a sculptor describes sculpting from one slab of marble.
It's a very, very similar, if not the same wavelength.
Yeah, yeah.
Have you ever thought about that?
I think so.
I mean, I think there is a certain amount of. Because genuine creativity can't just emerge from you applying some rules.
Yeah.
Right?
I was. And I think there is something to be said for how to create. I'm very interested in how Genesis works.
It's going to work.
And the nice thing is I built this chemi farm in Glasgow and I just connect. I'm just going to. It's like, think of it when Nvidia built its first H100s and put them into racks is literally
what we've done.
So we're just going to set up that capacity and then we're going to use that to make the
next capacity.
And then basically every single molecule that we invent will basically be invented much
faster because of this.
So all pharma, all batteries, all catalyst companies, anyone who deals with chemistry
will need it.
You see it coming together.
Because what happens is every time we do a reaction, we get faster because our world
model gets better.
Then what I had to do is I had to figure out, because I was trying to sell this, but all
the organic chemists were great.
Partners kept giving me molecules that were too hard to make.
Because if you think about it, Chemify's library, do you want to know how big Chemify's virtual
library of molecules make?
How big?
10 to the power of 40.
That's large.
That seems big, but actually, the actual chemical space is about 10 to the 117.
So when anyone comes to me and go, "Can you make this?"
And we're like, "Shit."
"Can you make that?"
"Shit."
Baby steps.
We're like, "Can you make anything?
Can you just. Can you instead. Rather than. Rather than. Yeah.
I mean, rather than you picking molecules that you want us to make, because we can make
all of them, but it takes time.
So we've got this virtual library.
It's not a catalog.
It's not even that.
It's so big.
It's a procedurally generated process, which allows us to compute.
So compute is our verification process.
If it computes, we know we can make it for real tomorrow.
Right.
That's really awesome.
So what we do is, rather than you giving us a molecule. And hoping to get lucky, it's a bit like going, "I'm going to take a shot.
You've got 10 to the 40 possible targets.
I'm shooting in the space of 10 to the 117.
You're always going to fail."
But if you say, "Oh, is one of those 10 to the 40 possible targets good enough for my
drug idea or my catalyst idea?"
The answer is then yes.
Yeah.
And suddenly when you flip it around, but then they don't want you to own the design.
So I designed Genesis.
It's like the way the UK does its biobank.
So basically people buy Genesis and they keep all their IP.
So I'm able to federate the data.
Oh, I see.
Okay.
So basically when they bring in their question, their question is probably the
most valuable thing.
You can answer this question.
And so basically I built an AI that takes their question, encodes it, gives them physical
matter back, allows them to do it quickly.
So basically I think I've just built the. Yeah.
The most valuable engine for chemistry ever.
And that's cool because that gives them retention on their own stuff.
They keep talking.
So basically then Chemify gets faster at doing chemistry, but no one ever knows what they're
doing.
That's right.
It's completely encrypted and segregated forever.
Wow.
And that's the way the UK biobank does it.
Because what you want to be able to do, the way the biobank works in the UK is like, we
had this problem where, let's say as a patient, you go and say, "I want to know what is the
best treatment for me."
And you're like, "Great."
Yeah.
So we'll interrogate the biobank.
We're going to put your data into the biobank and you're like, "Oh no, I don't want people
to know.
I don't want my insurance company to know."
And they're like, "No, no, what we do is we basically encrypt it and strip away your
personal data and just put it into the space."
So your characteristics are in the space and queryable, but you, and all the everything
associated with you, can't be reverse engineered.
You're like a lesser version in a good way of like a Swiss bank, but for chemistry.
I'm not going to say that.
My investors are like, "I'm a launderer."
But no.
I think I'm cooking.
I think. So I will. You can. No.
But sure.
Okay.
All right.
Real quick.
I got to go to the bathroom, but we'll be right back.
Yeah.
Me too.
After you.
I'll go after you.
When you look at what you're doing, when you look at the scaling, regardless
of the argument over sentience and all that.
But when you look at the scaling of tools like AI and the abilities that humans are
able to leverage now to be able to figure things out at such an exponential rate, do
you ever worry about the. about the incoming. abilities of us to potentially start playing god on something no i want to play god in fact
i love playing god i mean look we've got we've got mobile phones we have drugs we have cars
i mean i want flying cars where's my flying car we've got robots i don't think that's playing god
i think the chinese doctor you talk about though that's where it gets to like you can be playing
god i think no i think playing god if you like is taking any scientific and what was it was it
isaac asimov that said you know any when any scientific magic yeah yeah so so when science
can do that science does it a lot imagine going back in time with a mobile with a fully working
mobile phone satellite system everyone be like what right and then here's a face here's a face
of my mate mate around the world i'm facetiming him what what um so we are playing god now
i think that what we've got to be able to be very good at is making sure that
humans are flourishing and thriving and what does that mean that you want the average human
being on planet earth to be happier to be more um content or whatever it is to be more excited
to be contributing to the flame of consciousness or whatever it is so that humans continue to kind
of do more and more things and build a technology that makes everyone's lives better and yeah and
we're doing that i mean by any measure human beings have never had a better time on planet earth than
planet earth ignore polarized social media it says we're all doomed and it's like yes there's climate
change you know what we're going to fix that it's not going to be that hard at the end of the day
we'll shut we'll shove a load of sulfate in the atmosphere and we might get it wrong and overcool
a bit of acid rain and then we'll add some base i mean some people will die well no i think that
look but less people will die right right now here's a here's a quandary we have all it we're
burning all this fossil fuel most of the fossil fuel we're burning is to create fossil height is
to create ammonia to feed the world that's creating global warming that global warming
is causing stress um but there are more people alive today because of technology than ever lived
and if you didn't say oh no we feel so guilty this is why the climate climate people are kind
of like annoying me saying we should like go and live in caves i'm like who are you gonna
who are you gonna starve to death tell me which half of the population you're gonna kill
so sure if we attempt geoengineering and we create some accidents along the way if that
saves billions of lives and we basically 50 people die of i don't know a thing unforeseen
then do the calculation but what about like the genetic engineering and where that ends
we're genetically engineering rice right now in fact if it wasn't no no that's not that's not what
i mean well maybe but that's not where i was going with that like when you look at what the guys at
i like them i've had ben and matt on the show i don't know what they are they are the bioscience
company out of texas that is recreating extinct species so they made a version of the dire wolves
so they tell you so they tell us yes but to be clear like they're they're honest about this part
they made a version of the extinct dire wolves that's based on gray wolf dna which gray wolves
still exist and share some sort of familial bond with dire wolves so they didn't create like a
perfect dire wolf but
like when they're looking at maybe creating something that is not evolutionarily but is
somewhat similar to say a woolly mammoth part of why they're doing this is because woolly mammoths
for example share dna with elephants and in modulating or creating a potential woolly mammoth
they could say solve for there's i forget what the disease is called but there's this disease that's
effectively called like elephant herpes that kills 20 of elephants around the world they could
do that by testing on what would be this woolly mammoth before they make it and therefore like
it's useful however when you get to the whole idea of maybe this technology then gets used to clone
animals and then what if they start talking about cloning humans or something like that it's a
slippery slope that potentially that's where i start no i'd love a clone i haven't i don't have
enough hours in a day as you pointed out earlier i'm just joking look i i i think that society so
one of the things that i'm so i don't know it's to me the guys might be great but it sounds like what
they're doing is a bit like i mean like george church is presumably behind this behind all these
years so george church needs to get out more i think needs it why do you say that well because
i mean that's a big statement george is lovely he's just very mischievous let's put it that way
he's very mischievous yeah what do you mean by that he he basically likes he like the same way
i like a around my chemistry he likes to around biology uh-huh and i think you know um is he bad per
person doing it no for sure not he's a great scientist but um i think he is literally trying
to test the limits of where what do we want to do ethically what do we want to do commercially
what are the driving should we you know here's a question um is this is very controversial
well it is um low iq a curable disorder right if we can measure iq in some objective way
um and then you say right you've got a choice between having someone with a high iq or low iq
and you can genetically engineer high iq humans would you do it this gets weird this is what i
mean this one's playing god i know what the answer is i mean i think i mean um well and i don't know
what the answer is the answer is society will decide i think being mischievous in general one
needs to pay attention to what is ethically acceptable
and society acceptable but let's take today what is you know cesarean section
um would we argue that cesarean section today is a fantastic tool sure so but a few hundred
years ago it probably wouldn't be an acceptable right maybe and so i think that um we have to
understand if engineering people to have a higher iq gave them better resilience
to live and was better for the human race and actually stop people i don't know voting for
nonsense parties or something not saying that low iq people vote for nonsense party i don't know
right engineering critical thinking into humanity is that a good thing i don't know actually maybe
just scrub that from the it's just it's just it's no i don't want to go there i see what you're
saying i think it's just it's it's a weird uncomfortable space to get into with the
questions because it's a slippery slope how far do you go
something that seems realistic and good you start there and then eventually you're like yeah let's
give them all 18 inch dicks too it gets weird yeah you said that not me um i would scrub this
entire section no it's good okay i don't like scrubbing stuff at all we're gonna talk these
things out why would i would i would say when it comes to so you're saying what let's discuss the
ethics of genetic engineering or technological engineering in general and how to play god
i would say it's society
society needs to decide i'm very comfortable with certain technologies we have today like
mobile phones cesarean section um if we could engineer um certain favorable attributes for
humans genetically should we do it you know i can see a world where that just becomes acceptable
over time it's very ghastly right now but why not why would you there is a good example in in the
uk where we have what say three parent babies where when what happened was that there was a
particular disorder i think passed on by the
mother into mitochondria and i think you can find this is like a disorder where
the mitochondria are so critically disabled you get a kind of muscular i'm not sure it's muscular
dystrophy basically the child is not going to live for very long now what they did is they said right
but the couple want to have children but the but the mother is never going to be able to have a
healthy child because of that so what happened is that um there was a suggestion made that you
could take healthy mitochondrial dna from another mother female donor
put it into the cell right and so and the mitochondrial dna is just in that cell but
the all the other characteristics from the mother comes from the actual mother
and so you can give birth to children with three parents if you like but completely healthy and in
the uk we did it and there's eight children and those children do not die a horrible death of
muscular dystrophy yeah that isn't completely worthwhile right surface it's hard to argue with
that yeah
well no i mean sorry if i if i came sentient and i knew that i could have been born
with i'd be pretty fucking pissed off yeah right i agree so you know so that's a good example and
the good thing about that is it's all already gone through ethics and you know i can basically not
debate the woolly mammoth and all the other people doing random stuff like that it's like fine if
there's a market and you know jurassic park that's my worry though you've seen those fucking
movies the dinosaurs eat the people well that's you know then no no no don't do that don't do that
well don't you know me i don't like that i don't want to see like a t-rex out here just like
tearing your head off if someone could actually get a resurrected t-rex i would want to pay for
that be great okay that would be awesome if it's on a leash but look the probability of it being
possible i don't know like you know we we have all sorts of things but i think that's a very good
example a very positive thing now where could that be misused right your mitochondria are vital for
energy to your cells if you supercharge that you can give rise to super athletes they could just
exactly you know
be like the russian olympic team but they have no steroids they've already got it but you know
isn't isn't that in a way kind of interesting again but then do we start having like 12 foot
giants walking we do have 12 foot giants have you tried i mean well we have six or seven foot
giants i was gonna say i was unaware of these 12 footers please please do disclose you said
that real confident yeah whatever like yeah okay no uh but but i'm saying we do have natural um
biological capabilities so what's the word a genetic there's a genetic destiny but in western
europe or whatever during you know the the i guess in the last few hundred years due to
malnourishment we didn't achieve that genetic destiny right people were short then you have
a little bit of a problem with the genetic destiny and then you have a little bit of a
problem with the genetic destiny and then you have a little bit of a problem with the
genetic destiny and then you have a little bit of a problem with the genetic destiny
in the netherlands now everyone's like six foot whatever at all it's kind of interesting um but
look um your question is am i worried that we can play god to some degree i'm worried about that
with the chemical computers sorry all the computers could people just get these robots get this
technology away from chemify and mass manufacture bad stuff well you know what i've done is i build
encryption into the system and actually um gps they will have in the end gps um geolocated licenses
do you have like a like a red button not to oversimplify it but like the button in in the
dark night where morgan freeman hit it and the whole machine turned off like can you do that
with your technology if it got in the wrong hands i i think that's um rather simplistic way of saying
is there a way of making sure that i mean right now chemify builds his own robots do stuff
internally and no one will be able to copy it right um because of the the way that we design
things and segregate it will people be able to design things and segregate it
they'll be able to design robots to do bad things for sure we have them today
right yeah um i think my job um as a as an entrepreneur is to basically use the technology
to do good things right and and the market to access that and then if you know there are people
out there um using 3d printers to do chemistry to kind of biohack or chemical hack and they're
going to be able to do more of those things so i think that's the way that we're going to be able
to do more of those things so i think that's the way that we're going to be able to do more of that
right but but well i know actually i am not so there's no one's there's nothing stopping people
taking my papers off the web and using that those papers yeah but not the stuff you're actually
creating yeah yeah yeah but is there a big road button there in the way the chemi farms are built
there's obviously a huge amount of firewalling and being able to kind of control the system
right real-time telemetry and also to make things feel that sure they feel fail to safety so for
sure but um and when we do that we're going to be able to do a lot of things and we're going to
scale i mean you know the amount of chemical flops right like you know you have cpu flops or
whatever um is going to increase you know a hundred years ago computers were people
in skyscrapers basically doing slide rules so the number of you know what were the number of
floating point operations per second a hundred years ago several hundred thousand maybe several
million because there's several million people in these places doing calculations with slide rules
today how many people doing chemistry
on the planet planet earth how many chemists are there doing reactions every day it's less than
a million and probably more than a hundred thousand that's not a lot i think one of the
ways that one of the ways why ai and physical ai is called chemify in a way will be positive for
the us in particular is like the healthcare system is a bit bit annoying just now oh yeah but but
think about like this in the future the birth rate is going down so human humans there's not that many
humans and you want to keep people healthy and you want to keep people healthy and you want to
keep people healthier for longer so people are basically able to get access to health care
subscription and they have more productive lives and then make more money and have good fun and do
whatever drive the economy suddenly you got this economy that inflates not because like
that's right it's natural it's kind of amazing right yeah yeah and that scenario could be
amazing i mean it will happen it's just a question of how we fuck it up along the way
but but it will happen and it's um i i think that you know one by one bit by bit there's
things that we're going to be able to solve and i think that that's why i you know i'm i'm a great
kind of techno evangelist i'm not quite the abundance we're all going to live forever we've
got infinite stuff we'll build a dyson sphere around the sun because why not but i do think that
you know i very enthusiastic about the intersection of technology and science and critical thinking
and also the free market but not entirely free and also well not kind of the corruption that we have
right now that
i do see where there's just like you know the only the only place where capitalism is really
work is really meant is being forced to work maybe in the arguably in the u.s and the uk is
in the middle classes like if you're really really rich you can do what you want if you're really
oh right yeah yeah maybe that's me being slightly too kind of weird right and all the rich people
say that's not right but no i think i think it's a fair point i think i think there's almost been
like a socialized capitalism yeah that that's that's formed for sure and in the upper classes
it's kind of weird yeah it's very weird but i i'm hoping that that will revert i mean the uk is like
in the is in the doldrums like everyone's miserable in the uk it's such a terrible country it's like
actually not it's great there's more entrepreneurs in the uk probably per capita than anywhere else
in the world right now although it's quite nice that in france in switzerland and germany they
were coming up not quite as good as the u.s but in but or not sorry not good is the wrong word
not quite the same number but i think there's a lot of interesting things happening because people
really are not as good as the u.s but in but or not sorry not good is the wrong word not quite the
same thing but in but or not sorry not quite the same thing but in but or not quite the same thing
realizing that you know it might be that the in 20 years time everyone everyone wants to be
rather than being i don't know being a management consultant or working in a with a bank they want
to be an entrepreneur that would be great and they're just basically identifying unmet needs
and getting funding for the unmet needs and and then so we have this new kind of knowledge
economy that evolves but i'm a relatively late entrepreneur i didn't want to be
entrepreneur i kind of became one by accident well here you are yeah well it's working out
for you it there you know the working out it's not about the money it's about the ability to
appropriate appropriate sorry yeah what's the right word appropriate's wrong word um it's about
to um allocate that thank you it's about allocating resource right i mean when chemify becomes a
trillion dollar company i will be out allocate resource to helping cure disease solve the origin
it takes on a whole new life of its own yeah i mean that's as long as dr james tour is not you know
right and you're wrong dr james tour what is he right about what were you what will he be right
about i don't know you tell me i just saw you guys going at it on pierce morgan oh what was
his argument against yours i don't i don't i mean james is a complicated person he's a
he's a he's a he's a born-again christian who is a chemistry professor but he's a kind of um
i mean what is his his argument is that um he doesn't he's very slippery in his argument he
just basically says hey the cell is so too complicated um therefore origin of life isn't
as easy as we thought right and but i do believe that we'll solve it and it's not just you know
you think we'll be able to no no he he says this is what he says right he says so he kind of makes
all these oh i'm a real scientist and i'm do this that and the other but look dr james tour is a
i wouldn't say dr james court is a scientist i what's the well i mean i'm gonna sound really
pompous if i go down that rabbit hole but i mean i would say that um oh maybe he's a chemist first
and scientist second whereas i'm a scientist first and a chemist second okay is that does
that have to do with the way you're defining following the scientific method to ask questions
versus no i mean i would say that i would say that james basically does chemistry he's very good at
and he uses that authority to exert authority over his belief system i got it i got you whereas
i'm like i'm clueless he says you know clueless clueless you're clueless everyone's clueless i'm
like but that's why i love doing science because i'm clueless and and so and i mean i wouldn't use
the word clueless because that just sounds silly but i do science why would i do experiments if i
knew the answer already so you look at him as more dogmatic and like yeah it's harder for us to change
whereas you're like we gotta yeah a lot of shit against the wall i mean i think so so i mean like
i'm i i he i'm the only person that will debate him and i don't know what the origin of life
chemists think about that and i think it is kind of complicated but also i i think i am willing to
like talk to you talk to people that want to listen and give my views as flawed as they are
but it starts a debate right i don't think right you know people come to me and say are you the
authority on this i'm like i'm not the authority on anything but i am working on this and i think
i've made a commitment to doing this and i've made some progress so from that regard i might
have some expertise you might find valuable yeah but i think there's people over credentialize all
the time and say well i'm a scientist and i get this so so i i think that you know you'd have to
ask james what he thinks and the reason i did the thing which i was like in two minds when pierce
did it though you go out there you challenge ideas you let people listen to the arguments
and decide for themselves that's how you should always be yeah yeah
went i thought what what could go wrong is he could rant at me and i could just go you know
yeah i didn't i thought it was pretty civil he i mean he's pretty ranty and i just like i'm not
going to argue i'm not going to i'm not going to descend into ad honam and i just want to say look
this is what we're doing i think it's quite important that's right and i think it's quite
interesting because i actually pierce is you know he's he he he has a religious commitment he also
thinks that aliens must exist he's like he will he he has a huge following he asks sensible
questions you know and um it was quite it was a fun debate to have looking at it i mean
a few people said you surely want to do that and and i did it and one of my kids did watched it
and was like this is the first time i've heard you ever talk about something and i understand it
and i was like oh and if that and if my kid is like that's good was inspired by that and i was
okay that's worth doing if nothing else right because right because i've talked i you know my
really smart and i talked to them all the time and the guy was like one of my sons was like
i have no clue what he talked about most of the time but on that on that discussion you made an
effort to engage in a way that i understood it and i was inspired by it i was like i was like
okay great it's worth doing always oh i honestly i hope you're always saying yes to that stuff
because like you get a chance to put your evidence to the test and there's nothing better than that
that's what we need we need to open dialogue with science but it's always great to have someone in
to be able to talk for a few hours and walk us through all the cool shit they're doing so thank
you as always lee we're gonna have to do this again let's let's go get some steak though now
all right thanks to be with you and uh yeah till next time all right everybody else you know what
it is give it a thought get back to me peace hey guys if you're not following me on spotify
please hit that follow button and leave a five-star review they're both a huge huge help thank you
Podcast Summary
Key Points:
DARPA was established in response to the Sputnik crisis to eliminate strategic surprise by funding radical, high-risk research.
DARPA has funded multiple grants to Lee Cronin, including projects on on-demand chemistry, molecular computing, and AI-driven discovery.
A key innovation was a chemical computer using the Belousov-Zhabotinsky reaction, which demonstrates how chemical systems can process information via excitable media.
The concept of "chemical robots" involves giving instructions to systems that perform chemistry autonomously, with potential applications in remote or extreme environments.
Lee argues that current AI systems are not sentient or generally intelligent—they only retrieve and process known data, lacking true creativity or problem-solving beyond training data.
Human cognition is fundamentally different from AI, as humans generate novel, unpredictable ideas, while AI solves only problems already embedded in its data.
The real danger in AI development isn’t sentience or self-replication, but misuse by bad actors or flawed systems, such as social media algorithms causing societal harm.
Lee believes AI should be seen as an "augmented informatics" tool, not a substitute for human intelligence or scientific discovery.
Summary:
Lee Cronin reflects on his work with DARPA, highlighting how the agency has funded key research in chemistry, molecular computing, and AI-driven discovery. He describes building a chemical computer using a reaction that mimics neural activity, demonstrating how chemistry can process data without silicon. Cronin emphasizes that while AI tools are powerful, they are not intelligent in the biological sense—they only retrieve and process data already in their training sets, lacking true creativity or the ability to solve novel problems.
He contrasts AI’s role with human cognition, arguing that humans generate original, unpredictable ideas—something AI cannot replicate. He warns against AI doom narratives, stressing that real risks stem from human misuse, poor regulation, or biased systems like social media, rather than sentient AIs. Cronin sees AI as a powerful tool for augmentation, not replacement, and calls for greater ethical oversight, transparency, and critical thinking in how these technologies are developed and deployed.
He concludes that genuine scientific breakthroughs—like new laws of physics or novel chemistry—still require human creativity, intuition, and biological insight, which current AI systems fundamentally lack.
FAQs
Lee has received three DARPA grants. The first was for the 'Make It' program, focusing on on-demand chemistry in remote locations. The second supported one-on-one computation using molecules to build molecular computers. The third funded advanced AI-driven discovery in chemical research.
A chemical robot is a system that receives instructions and performs chemistry tasks automatically. It uses chemical reactions to process information, similar to how a computer uses transistors, but with liquid chemicals and reactions instead of electronic components.
Yes, Lee noted that DARPA referenced a paragraph from his paper in their 'Make It' program, which he found concerning. While he didn’t receive funding directly, the program was inspired by his research on chemical robotics and on-demand chemistry.
A chemical computer uses chemical reactions, like the Belousov-Zhabotinsky (BZ) reaction, to process information. Lee built a grid of 49 stirrers with chemicals that changed color in a rhythmic pattern, and used a camera to read the output, effectively creating a simple neural network.
Lee argues there is no evidence that AI systems are sentient. He believes consciousness arises from biological systems, and AI tools are merely advanced pattern recognition and prediction machines, not entities with self-awareness or sentience.
Lee defines intelligence as the ability to solve unseen problems. Current AI systems only solve problems embedded in training data and rely on pattern recognition, not true creativity or problem-solving from first principles, which humans do through experimentation and insight.
Chat with AI
Loading...
Pro features
Go deeper with this episode
Unlock creator-grade tools that turn any transcript into show notes and subtitle files.