Name: Algorithmic Injustice? Racial Bias and Facial Recognition
Uploaded: undefined
Duration: undefined

NOVA

Carlisle Companies

NOVA Science Trust Logo

Facial recognition technology can help police officers identify—and ultimately charge—criminals caught on camera. But its critics argue that it's discriminatory. Now, Detroit, Michigan is facing lawsuits for the false arrests of two Black men, both misidentified by facial recognition tech.This video was produced in collaboration with NOVA and is made possible in part by the Corporation for Public Broadcasting, a private corporation funded by the American people.

Research shows that facial recognition software often misidentifies people of color at a much higher rate than white individuals.

Research shows that facial recognition software often misidentifies people of color at a much higher rate than white individuals.

A useful tool for consumers and law enforcement alike, facial recognition technology can help police officers identify—and ultimately charge—criminals caught on camera. But its critics argue that it's discriminatory: Research shows that facial recognition software often misidentifies people of color at a much higher rate than white individuals.

A tool for law enforcement, critics argue that facial recognition tech is discriminatory

Algorithmic Injustice? Racial bias and facial recognition

Algorithmic Injustice? Racial Bias and Facial Recognition

Tech & Engineering

Algorithmic Injustice? Racial Bias and Facial RecognitionPublished: May 6, 2021Michael Oliver: They told me I had a felony outstanding felony warrant out for my arrest.I kind of figured it was a joke until I got took out the car and put in handcuffs.Narrator: In 2019, Michael Oliver was arrested during a routine traffic stop and charged with larceny for stealing a cell phone.Michael Oliver: I was charged with something that I didn't do, a crime that I didn't commit.Narrator: Oliver was misidentified when Detroit police ran a facial recognition search in the state of Michigan photo database using technology created by an outside company.Tawana Petty: We can expect those miss identification cases, using face recognition to happen all over, uh, especially when it comes to black and Brown, uh, communities, because darker skin tones have a more difficult time being recognized by this technology.Phil Mayor: We simply don't know how many people not only have been falsely accused, but have been falsely convicted, uh, because of facial recognition technology.Many people accept plea bargains, even when they're innocent, because it's, it's the safest way to make a case go away.Narrator: Facial recognition technology uses biometric algorithms to "recognize" and match images of individuals in large photo databases.Anil Jain: The word biometrics is made up of two Greek words, bios, which means life and Metron, which means measurement.And when we talk about biometric recognition ...then we are talking about recognizing a person based on his or her body measurements.Fingerprints, Iris of the eye and face.Narrator: There are two types of biometric face recognition systems. Authentication — like using your photo to log into your phone or checking in by passport at an airport kiosk. The other is search identification, which can be done using images captured on the closed circuit surveillance cameras that we see everywhere.Both methods rely on a type of machine learning called "deep learning."Anil Jain: When you want to design a deep network for face recognition, you need large amounts of data.By presenting the faces of different individuals, uh, the, the network is supposed to learnNarrator: But a growing body of research, including from the National Institute of Standards and Technology ate M.I.T., show that, currently, these "deep networks" are also "learning" bias.Phil Mayor: This is largely thought to be because the technology has been trained on predominantly white images.Anil Jain: If we don't show them enough variety of faces then the network is not learning enough to separate different demographic groups.Narrator: Critics say the use of facial recognition technology negatively impacts communities of color.Clare Garvie: Quite simply surveillance in the United States is more prevalent in black and Brown communities.A lot of the systems around the country, these are arrest databases, not conviction databases, meaning that if you're arrested and the charges are dropped or you're adjudicated and not guilty, your face still remains in this database.Black people, particularly young black men are disproportionately enrolled in these databases.Narrator: Many AI systems aren't adequately trained on enough Black and brown faces. Which leads to more frequent misidentifications of people of color from the arrest databases.In the case of Michael Oliver, he's filed a 12-million dollar lawsuit against the city of Detroit alleging there wasn't proper investigative follow through by the police to corroborate his identification.Tawana Petty: He didn't even know until he was at court and saw the image that they were using. And he said, that's not me. And the judge was like, Oh, that's not you.Michael Oliver: The guy didn't look nothing like me, so it really shocked me.I have multiple tattoos that I have for 10 years plus. And he, the guy had no tattoos at all.David Robinson: There was this overwhelming apparently reliance on this flawed facial recognition system.Clare Garvie: A human, an officer looking at those two photos should have been able to say, Hey, this is not the same person, but research shows that we are more likely to agree with what a machine tells us and override our common sense evaluation of whether two people are or are not the same person.Narrator: Detroit police won't comment on Michael Oliver's case because of the pending litigation. But his is one of two publicized false arrests of Black men by Detroit police because of incorrect identification by facial recognition software.Like Oliver, the other man was arrested for the non-violent crime of larceny. At the urging of the public and activists, Detroit police instituted a facial recognition policy in September 2019 to prevent future misidentifications.Aric Tosqui: Those cases were larceny cases. A crime that predates our policy and would not be acceptable with our current policy. What we have done in Detroit is built in safeguards to help overcome implicit bias.It's not one analyst who's deciding that this person is the one who is the candidate for the probe photo, but that analyst has to have his or her decision corroborated by another analyst. And then once that's done prior to going to the detective as lead, the supervisor has to sign off on it. So prior to policy that none of that existed.Narrator: The larceny charges against Michael Oliver were dismissed at trial.Michael Oliver: I lost a job. I couldn't pay rent. I couldn't pay my car note. I thought I was going to lose the trial and ended up incarcerated.Phil Mayor: If this technology is not good enough to identify people accused of minor crimes, why is it good enough to be used to accuse people of the most serious crimes that can result in years or decades of incarceration?Aric Tosqui: We have people that are suffering out there because they're, they're a victim of robbery. They're a victim of aggravated assault or a victim of homicide.And we have to keep up and use and leverage all the technology that we can.Narrator: Most jurisdictions around the country use some sort of facial recognition technology in policing. But many don't have standards or protocols to catch incorrect identifications and prevent wrongful arrests.Clare Garvie: The more information the public has about face recognition, the more interest there is in just banning it outright or placing a pause on the use of the technology until we put very clear controls in place, or until we have a better understanding about why it exhibits bias and whether we can remove that bias.Narrator: And some cities — including Boston and San Francisco — have banned the use of facial recognition by law enforcement. A move applauded by activists.Tawana Petty: I am not an advocate for face recognition to any degree. I think that it's a slippery slope and I think that always, it's going to be used in a way that's going to violate the civil liberties of Black and brown communities. But we're looking at a technology that is going to ramp up that deception and I think that that is a very dangerous trajectory to be moving in.

United States

Northern Mariana Islands

Puerto Rico

American Samoa

Guam

U.S. Virgin Islands

U.S. Minor Outlying Islands

US & Territories

Colossal explosions shake a remote corner of the Siberian tundra, leaving behind massive craters. In Alaska, a huge lake erupts with bubbles of inflammable gas. Scientists are discovering that these mystifying phenomena add up to a ticking time bomb, as long-frozen permafrost melts and releases vast amounts of methane, a potent greenhouse gas. What are the implications of these dramatic developments in the Arctic? Scientists and local communities alike are struggling to grasp the scale of the methane threat and what it means for our climate future. (Premiered February 2, 2022)

In the Arctic, enormous releases of methane, a potent greenhouse gas, threaten the climate.

Arctic Sinkholes

The top half of Jupiter in blue and green against a night sky

A composite image of Jupiter using images captured by the James Webb Space Telescope. Image Credit: NASA, ESA, CSA, Jupiter ERS Team; image processing by Judy Schmidt.

Explore the cosmos, delve into ancient history, and follow an extreme rescue with NOVA’s most-watched documentaries released in 2022.

NOVA’s most popular science documentaries of 2022

Four bright orange loops brand off of a dark blue blob

A transmission electron micrograph of HIV-1 virus particles (orange) replicating from the plasma membrane of an infected H9 T cell. Credit: NIAID, Flickr

Scientists have cured a handful of people of HIV by piggybacking on treatments they received for blood cancer. But does that bring a widespread cure any closer?

Algorithmic Injustice? Racial bias and facial recognition

Support Provided By

Explore More

Are You Feeding a Powerful Facial Recognition Algorithm?

Communities come face-to-face with the growing power of facial recognition technology

Ghosts in the Machine

Transcript

Credits

Support Provided By

Explore More

Are You Feeding a Powerful Facial Recognition Algorithm?

Communities come face-to-face with the growing power of facial recognition technology

Ghosts in the Machine