AI and Justice: The Neutrality Myth

[MUSIC] You've got to be working for the benefit of people. It cannot be simply about accumulating wealth or accumulating power. [MUSIC] >> Welcome to New Thinking from the Center for Justice Innovation. I'm Matt Watkins. Part of the deep appeal of artificial intelligence is it seems to stand above the messy world of human decision making. The criminal legal system has no shortage of that kind of decision making. And AI solutions are being put forward for everything from police departments and prisons, deprobation offices, and courtrooms. But how do we separate AI's real promise from the hype? And how do we ensure the technology helps rather than sets back the cause of fairness and justice? There are a few people better qualified to answer those questions than today's guest. Amongst the many highlights on his resume, Roy Austin Jr. is a former deputy assistant attorney general with the Civil Rights Division at the Department of Justice under President Obama. Then up until about a year ago, he was the vice president of Civil Rights at the tech giant meta. And beginning this year, Austin is the inaugural director of the Artificial Intelligence Initiative at Howard Law. Its writ is to bend the arc of AI toward justice. Here is my conversation with Roy Austin. On paper, you really present as kind of an institutionalist. You've had a number of prominent positions at the DOJ. You were a partner at a big law firm. You were the VP of Civil Rights at Metta. But you're also someone who seems quite skeptical of institutions and of institutional power, particularly the way that power can be wielded against the marginalized. So I'm wondering if you could square that circle for me a little bit if you agree that there's a circle to be squared. Yeah, I think it's fair if you just look at my resume. You say he worked at the Department of Justice and he worked at Metta and he worked at law firm. So yes, he believes in institutions. But if you dig a little bit deeper into what I did at each of those places, I think you would notice that really my job has always been to challenge institutions. So you take my work at DOJ and I started as a federal prosecutor prosecuting civil rights cases. So I was prosecuting hate crimes and police brutality cases. Not your average cases when I was at law firms. I was building civil rights practices where I was challenging what was happening with respect to law enforcement institutions. And then Metta had an incredibly unique role. One that didn't exist before and not sure when it's going to exist again. But this vice president of civil rights and I really saw the role as an opportunity to force the company to reflect on civil rights issues and how what it was building was impacting communities. So really every time I've been in an institution, it has been in some ways to challenge what is normally thought of of that institution. Now with this recent gig at Howard Law with the Artificial Intelligence Initiative, the institution you're taking on to some degree as Artificial Intelligence and the tech companies. I've seen where some people liken the kind of power that the tech companies have now, the sort of international reach of them to empires of the 19th century. Do you feel like what you're taking on now that sort of power is almost qualitatively different in scope? I don't know there's different in scope. I mean, I think this is an opportunity without real limitations to build something, to challenge these tech companies and what they're claiming and what they're saying and potentially even to build our own. And so really this is new to me because I'm not stepping into an institution where there are those types of guardrails and I'm building something here that I deeply believe needs to be built. I guess just to push you a little bit on the nature of the challenge. I mean, certainly in this country, the way that we've seen that the big tech companies or tech oligarchs as I've seen you refer to them are very much wedded to the power of the federal government, very much wedded to the financial sector of this country. But just seems like and I don't want to start in a disparity manner, but just to have a, you know, a sense of what we're up against or if the goal is to reign in the sector somewhat or put it at the service of people, it just seems like a difficult task. Yeah, so I wouldn't say I'm trying to rein them in. I'm trying to make them do what's right and I have very strong feelings about what's right and that is you got to be working for the benefit of people. You know, so definitely not trying to rein them in, but you know, throughout history, you know, look at like businesses who wanted child labor. Yeah, they would have been more profitable had we allowed them to have child labor. But is that the right thing to do and destroy the lives of certain children? And so what we have now is a technology that has the ability to both do amazing good, but also to destroy a lot of things. And I just don't think we're paying enough attention to what it could destroy and what it is destroying and, and, you know, the lives that it is harming. And we don't have a North Star that in my opinion makes a lot of sense. So, you know, you challenge those folks and you challenge those organizations. Well, what do we know right now about how AI is is being used in the justice system already or how it could be used? I mean, it's obviously a huge sector itself, the criminal justice sector. We know that AI is already being aggressively marketed to police departments, parole, probation, corrections departments. Do we have a sense of the landscape? So we have a sense of it, but that's maybe the first problem here is we have a sense of it, but there's there's so little transparency. And how it's being used. There's so little community involvement. You know, what we know is we're doing a ton of facial recognition work right now. An enormous amount regardless of the possibility of false positives and false negatives in the use of that technology. We've become a surveil in society. And that's I don't think that people have agreed to that. We've had this idea of predictive policing for quite some time. There's no real proof case for it other than, oh, well, we went there before. And so the data tells us we can go there again and we can find more of whatever the contraband may be. But it ignores the fact that there's always been racial and ethnic discrimination and where police have shown up. So that's my concern. And that's what we're seeing and now we're hearing more and more about them kind of trying to find ways to take shortcuts on writing reports and writing search warrant affidavits and other things like that. We still need human beings with thoughtfulness and common sense and smarts just straight smarts to be able to read these things because you know, even when I use AI, I have to read it and be like and there's never been a case where I've read it and I've been like, oh yeah, you nailed it exactly 100%. There are always mistakes. There are always things that my own judgment says are wrong. So enormous use, enormous number of vendors running in and saying, hey, we got the next greatest thing here. A enormous amount of money being spent and I would say wasted on this technology with really no proof of efficacy. Are there lessons we can learn from the earlier waves of technology that have sort of washed over the justice sector. Often with very big promises that often didn't come to pass and quite the way they were promised I'm thinking specifically of risk assessment algorithms that were meant to automate who was released or detained pre trial or electronic monitoring that was meant to be an alternative to incarceration. Are there lessons there? Yeah, I mean, Maddie, the biggest one is the risk, the risk profiles that have been created. I mean, it's not like we have removed recidivism because we have that. I mean, you don't know who's going to commit the next crime. We're not spending the time, the resources on really thinking about what do we really want here? Do we want people to spend 20 years in prison or jail and come out worse? We did a report back when I was at DOJ with Memphis where we found racial discrimination basically across the board at every level of decision making in the juvenile justice system. But that's the data because that's the only data we have that we are now using to train our artificial intelligence and we have an administration that is anti-data in a way that is, you know, if we don't know the truth, if we don't dig deep on the data, if we don't ask those hard questions, if we don't disaggregate on the basis of race and gender and ethnicity and even sexual orientation, we're not going to have the kind of data that AI could even have a chance at being able to give you good answers on. We're getting the answers that we want or we're getting answers and we're saying, oh, a computer did it so it's not discriminatory. And that's, you know, to use a technical phrase, that's bullshit. Yeah. I mean, there's a way, right, that AI, just like risk assessments before them are presented as a kind of magical. Solution almost that takes it out of the human realm, whereas for better or for worse, we can't get out of the human realm, right? None of it is magical. It's it's human basis. Look, it's cool. I will admit. I mean, that's why I've decided to spend some more time in this field. I think it's cool, it's promising, it's interesting, but it's not magical. It really and truly, it's human beings who decide what data goes in. It's human beings who decide the algorithms and how they're going to work. It's human beings who decide how much they're going to read on the output to push back when the output gets it wrong. And it's human beings who are impacted the most by this. And that's why we need more and more people who are asking the hard questions and not just simply buying what they're selling. Right, but let's sit with the cool and the interesting then maybe for a second. Do you want to make your best sort of strong case for how AI could improve the administration of justice in this country, specifically when it comes to the issues of fairness and equity that I know you've devoted your whole career to? Yeah, so one early thing that I remember we were working on and I haven't seen AI being used in this way, but a woman by the name of Lynn Overman who I worked with at the White House. She started talking about the idea of we have these people who we call it and this is a majority of kind of frequent flyers. And those are people usually low income individuals who are constantly in trouble with the law and constantly ending up both low level offenses, a lot of shoplifting, a lot of public nuisance type stuff. They're also the same people who end up in our hospitals and our emergency rooms with great frequency. Right, often people with real mental health problems, substance use disorders, unhoused. Exactly. And law enforcement spends an enormous amount of time trying to work with or just arrest and lock up and put away these people. If we can combine that data to figure out how we create early interventions so that we can really help you know you provide people with a house, you provide people with a job, you provide people with even we've seen as little as like you know a thousand dollars of income can prevent someone from slipping into a ridiculous hole. I recently saw Vicki Schultz who is the head of Maryland Legal Aid. She was showing how they're using AI in ways that are just amazing. So you know your land your average landlord tenant case is actually a pretty straightforward case. If you can input that information and come up with a complaint right away and ensure that people are not pushed out of their houses by bad landlords, that's an amazing use of it and getting for people to get their benefits. We've seen it used with intake possibly in human trafficking type situations. You're getting all these calls, you're getting them all times of night. Can you use AI to determine you know the emergency cases versus the longer term cases. So there are a lot of ways that I can imagine being used for good and for good just means for the people in a ways that make sure that more and more people benefit. Again not for the accumulation of wealth and power which unfortunately is what you're seeing more and more of. I mean maybe it feels like for jurisdictions thinking about using AI in their legal system the first question for them to ask themselves is what do we want to use it for. Yes. Right. He rather than just rushing into it. I mean you know Robert Oppenheimer famously said of the atomic bomb nobody considered should we do this. We just said well we can it's technically sweet. Let's do it. I guess I have a concern that that kind of rush can happen with the kind of quote unquote magical powers of AI out there. Yeah. No, absolutely. I mean that should be that should be everything. That should be why do we want government. Why do we want fairness and truth and justice and what are those things mean at the end of the day. And if those are our goal again it's very different from the selfish goals that one is seeing by so many and you know this is the AI optimist out there the tech optimist out there who basically ignore that middle step and just say well at the end of the day text got to be good for all of us. It's like no no no you have to build it to be good for it to in fact be good. You can't build it and then say oh well now we're going to fix it. If they even want it fixed because again they have tons of money they have tons of power. They aren't all that worried about in my humble opinion they're not all that worried about its impact on so many other people. Well let me run this idea by you when it comes to you know how we might use AI in the justice system here at the center for justice innovation you know we recently put out a paper about AI we said yes there's lots of positive uses for AI in the system that you've just been talking about but we said we think that you should draw a line in the sand when it comes to using AI to make decisions that could negatively affect people's liberty right you shouldn't have AI waning about whether somebody is incarcerated and that actually got some pushback. Well I don't and I would and I would need to dig in more because I don't know what that means because honestly if you are asking AI to help you write a arrest report. Yeah our approvation report I was thinking too yeah. Yeah I mean you just technically used AI in a way that will help you incarcerate someone. So I don't know like like the direct question of here I put your file you know Matt Watkins has just been arrested I put his file into a computer and ask the computer should Matt Watkins be held pending trial that's a bridge way too far can I put it in and say okay well Matt Watkins you know the offense at Matt Watkins has has been involved in Matt Watkins background says that he should be on electronic monitoring versus incarceration because the likelihood of recidivism is xyz you know we kind of do that already and so we can have humans do it badly or we could have computers do it badly. I'd rather we do it well and thoughtfully and transparently and have everyone in the room and crowdsource the idea of okay what do we really want to weigh and how do we want to weigh it what questions do we really want to answer and how should those questions be answered. You know I entirely take your point that it's hard to say when does an incarceration decision begin so to speak when does that get set in motion I guess just as a lay person because I feel very much like a lay person here I mean the fact that when you ask AI to write something they tend to use the word delves a lot apparently and nobody knows why you know they've got and they're penchant for the M-dash. But they you know they're known to hallucinate and go rogue and you know alignment faking and this and that and even it's the creators of the technology aren't always sure what's going on it just seems to have that machine for lack of a better word make decisions as consequential as whether somebody is incarcerated or not seems alarming I guess. Yeah well we had a room in the DC US office called C-Tet and that's where arrangements happened people who were arrested the night before they get a raid and then you have to go in front of the judge and have to read the probable cause statement. Having AI review and say well here are the elements of the offense you're missing you know this element telling someone beforehand so that you can in fact have an accurate and thoughtful probable cause statement I don't know that that's a bad way to have another we need to have a longer discussion that goes on for a very long time I'm sounding like a like a like a prosecutor here and that's assuming that I believe that our justice system is fair it is actually doing the right thing and I have real questions about it at this moment given how awful this administration is on on the rule of law and the effectiveness of any of that stuff but I'm just saying that you know having something that kind of walks through the checklist for you because we as prosecutors a police officer would come before us said at our desk and say here's my probable cause statement we'd spend time trying to figure it out and analyze it and say well you know can you say a little bit more about the time of day that this happened can you say can you actually put in the jurisdiction you just said you know I stopped I stopped Pat Jones on so it's on fifth street where you know those kinds of things and having AI kind of help and answer those questions I think is actually better again assuming that we have a justice system that it that works and then that is fair to all people and that's an incarceration decision in my opinion you know you can use AI to help you formulate a cross examination that's going to be effective in a jury that is another way that AI can be used and the right way to do that is here's another tool that's going to give me more questions ask and ways to ask them that are going to delve into the truth um M- if we want the truth you know so you know that's that's where I just don't know what the line is there yeah and then you know when you say you want a system that is you know fed only good data I mean I know from speaking to my colleagues here researchers and data people that you know criminal justice data tends to be in a pretty wofl state and that's been bemoaned for years and we're talking about 3000 local justice system it's crap it is entirely crap okay so entirely crap so how do we get entirely crap to good data that allows AI to do the stuff the good stuff that we're talking about every administration has been afraid to force police departments to audit their numbers because of the power of police and police unions you don't put out any numbers that aren't audited. And yet that's what we do and that's what we allow. And we have different definitions. We don't have a general definition of recidivism. Recidivism can be committed crime within one year, it can be commit another crime within five years, it can be unearrested within one year, can be arrested within five years. All of these things are different. Why? It's not helping us, it's not helping us get the answers, but it's this fear of questioning police officers and then they basically say, it's a, you're forcing them to do something without giving them the money to do it. And my thing was, what's more important, honestly, public safety or employment? Or after all, they're fantasy football. The best numbers are our fantasy football numbers. Our next best are our employment numbers, our worst numbers are our public safety numbers. That tells us what we think about actually getting it right on public safety. And that's a real problem. But then what's us talking about the great stuff that AI could do in the sector, are we sort of whistling in the dark then since we're seem to be agreeing that the good, clean data is an out there. Yeah, I think we are. But that's the thing. And that's the thing why you have to allow researchers in to actually start figuring this out. If it's important enough, I do think AI might be helpful in certain ways, but I don't think we can just do it relying on the data that we currently have at the White House. They came up with this thing called the police data initiative. And one thing we got a number of jurisdictions, I believe it was Lexington, Kentucky was one of the first to do this. Every single police stop was listed in real time on their database for everyone to see. And I would say what the stop was for, what the result of the stop was, give a general location of the stop, length of the stop, all this data and information that I think was incredibly important. And we were trying to encourage more and more people to do it. Because it said, what are the police actually doing in your community? What are they? What are their interactions with the community members? Is it traffic stops? Is it broken down vehicles? Is it drug interdiction? Again, the police are belong to the community, not the other way around. And so having that data out there was so important. And again, it was killed during Trump one. And so it definitely doesn't exist now. Right. And I mean, we haven't even touched on the issue of the bias, you know, the bias of the system that is of the criminal legal system that then gets reflected in the data. I was watching something put up by your Howard Law Institute. You had Jared Tanksley, an academic and invited there to a recent event who said that anti-blackness is the default setting of AI. Yeah. Well, I mean, we know that. We know it from as simple as things as like you you ask AI to evaluate an image of black men. And it sometimes comes back and says, well, those apes did such and such. You have the idea of meta wanting to actually wanting to train at say, I that if someone asked if black people were dumber than white people for it to say, yes, black people are dumber than white people. Yeah, I've heard you say that before. And that what is the thinking there that people asking that question are white people who want to be told that basically? And they want to keep them engaged. That's the nice thing. I mean, other than do we actually do people actually believe that and want that to be the answer because that's the truthful answer to those people. Or is it that, you know, this the sick of fancy behind AI and the idea that each of these companies are competing against each other. So, you know, if Matt asked me a question, I don't want to tell Matt that he's a dumbass. I want to tell Matt he's the smartest person in the world. And I agree with his answer. I mean, we have this fantasy that there is a neutral in this world. And that that's what we are aiming for. But there is no neutral. We need to just acknowledge that and tell people, you know, when I build this, I'm going to build this based on the following biases. All right, that all human beings are created equal that everyone's life is of value. That we want people to be able to succeed. That we want fairness and justice. I want to build that. So, I mean, with that story of Meta, you just told in the background and this goal of, you know, getting companies to see regulation is not just an obstacle, but it's something that will improve their product. It just feels like that would really require changing the incentives for the tech companies. And I just wonder, and you've worked inside of one, how do we go about accomplishing that? I mean, look, it's not about changing the incentives of my opinion because they're every business pretty much or the vast majority of business, let me say, they're North Star's profit and immediate profit. What is Wall Street going to say about what is done here? And so it's about creating real forced transparency, forced data collection, forced fixes, forced proof that you fix, accountability systems. It's about law and regulation. It's about saying you have to do this. And again, I don't want to limit technological advancements. But I do want to ask the question is, like, what is our goal? Because sure we can do things faster, but is that in and of itself enough and in and of enough value in this world? Just because we can do things faster. Yeah, we can pull in all this data. Okay, to what end? The builders, the tech oligarchs, they are looking for where the power sits. And they're going to build their product to benefit those in power. There's nothing out true, whistling about what they're building. And there's nothing magical about what they're building. They can engineer it to provide a particular answer in a particular way. At the other day, it's still going to be human beings who are going to make these decisions. And if you make AI, somebody that everyone relies on, then those people in power are going to use the AI to keep themselves in power, not to get to the right answer. And that to me is a huge, huge problem. Right. And that's where the role of government and regulation comes in. I mean, we're looking in this country right now, the federal government, you know, recently issued an executive order trying to prevent states from really doing any regulation of AI. And I believe specifically targeting attempts to make laws around bias and artificial intelligence. I don't know. Real attack on Colorado, which is one of the first to really do bias. They California tried it. And I believe that's one of the things Gavin Newsom had vetoed. The Colorado is the one that has one that has passed. They still haven't put it in place because of the number of threats against that. Do you feel some fatalism about all of this? I mean, that it certainly seems like AI is here. It's here to stay. We can regulate it. But it's not going anywhere. And I wonder if you feel like that. And if you do, whether it means you draw a distinction between, you know, criticisms you need to make that because where the technology is causing genuine harm and, and maybe criticisms that are just sort of counterproductive because this thing's coming down the tracks anyway. I mean, we can get into the kind of philosophical, existential conversation about why are any of us here on this planet and what should we do with our limited number of years here? That sounds like a good question for an AI bot when we're both doing this. I'm sure. So I'm sure. Bigger ton of money. Bigger ton of money while you're here. Have fun. Every fight I've been in has been bigger than me. It really has been. And this is just another one. And all I can do is hopefully make things at least a little better for whoever comes next. You know, and I look at it and I have these pictures on my wall and those are very intentional. I did a lot of work in policing and, and you know, the people who allowed me to have the incredible career that I've had so far went through much more than I am. You know, they weren't sitting there on podcasts tried to advocate their role. They were out in the streets and they faced real real danger, physical harm. I mean, I Martin Luther King being arrested and John Lewis being arrested. And, you know, they would, they'd be disappointed if, you know, if we didn't keep trying to move the the world forward in a positive direction. And that's why we say bend the arc of AI toward justice. You know, I don't, I'm not going to finish that bending, but can I do a little bit to help get it there. And so that's, that's my goal. That's my fight. Who knows where it's going to be, you know, when my fight ends, but I don't see any other real value of my being on this planet if I'm not trying to make it a better planet. Right. I mean, this is the continuity in your career as sort of a skeptical institutionalist to go back to our opening question that, and again, AI for all its wonder working claims is, you know, created by it for humans. So we can't escape the human realm. And we're still in this battle over fairness and power and truth. And that that's that's your continuity, I guess. Yeah. I mean, it's it's always been, you know, as I've said, like when you first, when I first took on my job, I was, you know, prosecuting police officers and and perpetrators of hate crimes. And you always thought, well, the impact's going to be huge. You know, you probably So the whole police department is going to say, "Oh, wow, we got to change things." And then you realize they're like, "Oh, no, no, no." Pat was just a bad apple. We don't really, we're not like Pat and move about and just go about their day. And so you realize that you have that limited impact to start doing stuff where you do whole police departments. And we worked on New Orleans, America, but County, and you have a bigger impact there to working with the folks in the Task Force and 21st Century policing, where you're touching all 18,000 police departments. To working at Meta, where you have four billion daily users of its product. So if you can impact that in a positive way, the impact that you're having, to now both working to try to make the Metas and the Googles and the Claude's better, but also maybe create your own thing that can have an enormous impact. But also, I'm at that stage with my life where I basically need to help the next generation to have these fights and someone take on the fights in all these companies or get institutions or in advocacy organizations and give them some tools that maybe they can have a huge impact. But your hope is you're always, you're touching more people as you grow older. And that's where I think I am right now. So neither an AI boomer or an AI doomer somewhere in between. Somewhere in between, somewhere in between. I mean, it's, AI is here. It's not going anywhere. Shoot anything that writes your term paper for you for school is gonna stick around for a long time. They couldn't get rid of, they couldn't get rid of cliff snouts when we were younger. I think technology has some benefits, some significant benefits. But if it puts a bunch of people out of work and doesn't give them something to do and it lies to them all the time and it's controlled by people who don't have, the interests of humanity in mind, it's not a good thing. So how do we both make it, how do we make it good and make it good at doing the things that we as a society really need? - Well, Roy on that note with no false sick of infancy. Let me just say thank you so much. I mean, first off, for a year long and impressive and I think really important career and for this not quite so long, but still quite impressive podcast interview. Just very much appreciated, thoroughly enjoyed the conversation. Hope we can talk again soon. - And Matt, just really appreciate you giving me this opportunity. This is fun and I know you in your day-to-day work are also trying to just make the world a better place and as modestly as we can do that, we push forward. - That was my conversation with Roy Austin, Jr. Roy is the inaugural director of the Howard Law Artificial Intelligence Initiative. Roy is also the senior advisor to the new AI and justice consortium, of which the Center for Justice Innovation is a founding partner. For more information about the consortium and about the center's work on AI and justice, check the links in your show notes or go to innovatingjustice.org/newthinkin. For their help with this episode, my thanks to my colleagues Katrina Ting Morton, Michaela Carmichael, Daniel Legoso, Bill Harkins, Julian Adler, and Dan Levoire. Thanks as well to Chris Edley at the AI and Justice Consortium. Today's episode was edited and produced by me. Samia Amin Mia is our director of design. Emma Dayton is our VP of Outreach and our theme music is my Michael Aaron at QuiverNYC.com. This has been New Thinking from the Center for Justice Innovation. I'm Matt Watkins. Thanks for listening.