Name: These Smart Glasses Know Who You Are, and Much More
Uploaded: undefined
Duration: undefined

NOVA

Carlisle Companies

Viking

NOVA Science Trust Logo

The facial recognition glasses can pull personal information, like and phone number and even home address from existing online databases.

Two students created glasses that can identify people on the street, without them knowing.

The facial recognition glasses can pull personal information, like and phone number and even home address from existing online databases.

These Smart Glasses Know Who You Are, and Much More

Two students created glasses that can identify people on the street, without them knowing.

Tech & Engineering

These Smart Glasses Know Who You Are, and Much MorePublished: April 17, 2025Caine Ardayfio: Oh, hi, ma'am. Wait, are you (beep)?Person #1 at a train station: Yes.Caine Ardayfio: Oh, okay. I think I met you through like the Cambridge Community Foundation, right?Person #1 at a train station: Oh, yeah.Caine Ardayfio: Yeah, yeah, it's great...Narrator: What if you could immediately know the name and personal details of any stranger you passed on the street?Two undergraduate college students developed a tool that can pull sensitive personal information, like home addresses and phone numbers, from existing databases just by using a person's face, and without that person even knowing it's happening.AnhPhu Nguyen and Caine Ardayfio are students at Harvard University. They set out to build facial recognition glasses using these smart glasses built by Meta, the parent company of social media sites like Facebook and Instagram. Basically, they wanted to be able to put on the glasses, look at a random person, and identify who they were.After just four days of coding, they had a working prototype and were trying it on students around campus. Even on strangers at a train station.AnhPhu Nguyen: Are you the person working on like minority stuff for like Muslims in India at all, or something?Person #2 at a train station: That's me, yeah.AnhPhu Nguyen: Really?Person #1 at a train station: Yeah.AnhPhu Nguyen: Are you (beep)?Person #1 at a train station: Yes.AnhPhu Nguyen: Oh, I've read your work before, it's super cool.Narrator: Here's how it works. Once AnhPhu or Caine puts on these glasses, an LED light turns on to indicate they're recording, and they start to live stream the video feed to Instagram. Then a bot they built takes screenshots of the video and scans a facial recognition library, looking for a face.AnhPhu Nguyen: Once you look at someone, it puts the face into this database that returns links to where that person appears online.Narrator: That database is called PimEyes; a facial recognition search engine that scours the internet to find websites where that face shows up.AnhPhu Nguyen: We use some large language models to scrape those websites, all the information, and then guess who it might be on those websites.Narrator: A large language model, or LLM, is a type of artificial intelligence, like ChatGPT, that can understand and summarize data into text that's similar to how humans speak. The LLM suggests a name to match the face, and then that name is used to find more information.Caine Ardayfio: And then it would put it through a bunch of databases to try to figure out like home address, job, what they enjoy doing, that type of thing.Narrator: And then all of that information, the photos, names, address, and interest, gets sent to their phone. From beginning to end, this takes about 90 seconds. AnhPhu and Caine use the free versions of these databases, but they say if they had unlimited access, they could have gotten results in just a few seconds.The project raises a lot of ethical questions, but it's not illegal. Some states, like Massachusetts, do have stringent rules that restrict how the government can use facial recognition technology, but that is not the norm across the country.And the databases themselves can also impose limits. Once the project went public, PimEyes removed AnhPhu and Caine's access, because they say the students violated the site's terms of service by uploading photos of people without their permission. But AnhPhu and Caine's goal isn't for this to be used, it's to show that we're already vulnerable to this kind of technology.AnhPhu Nguyen: We basically exposed the fact that you can go on the street and pull all of this data. It was simply like a technical demonstration.Narrator: In a Google Doc accompanying their video, they encourage and instruct people to remove personal information from databases that contain details, like addresses and even the names of relatives.Caine Ardayfio: All of these databases that we use, they have opt-out systems where you can just go onto their website, verify your identity, and then you're completely scrubbed from those databases.Narrator: Facial recognition software already exists, like the kind used to verify your identity when you're going through a airport security, or to unlock your iPhone, and similar facial recognition technology is being used by some law enforcement agencies, both at the federal, state, and local levels to identify individuals and support criminal investigations. Though a few cities like San Francisco, Boston, and Portland, Oregon have lost specifically prohibiting city officials, like police departments, from using facial recognition systems.But AnhPhu and Caine showed private citizens can also use facial recognition software to identify strangers. They don't plan to take this project any further, instead, they started working with data privacy advocacy groups. As engineers, they say they've done their job to bring awareness and show that this is possible.As facial recognition technology continues to advance, questions about data privacy and security will continue to arise, and many may start to use this technology for more than just a demonstration.

United States

Northern Mariana Islands

Puerto Rico

American Samoa

Guam

U.S. Virgin Islands

U.S. Minor Outlying Islands

US & Territories

Colossal explosions shake a remote corner of the Siberian tundra, leaving behind massive craters. In Alaska, a huge lake erupts with bubbles of inflammable gas. Scientists are discovering that these mystifying phenomena add up to a ticking time bomb, as long-frozen permafrost melts and releases vast amounts of methane, a potent greenhouse gas. What are the implications of these dramatic developments in the Arctic? Scientists and local communities alike are struggling to grasp the scale of the methane threat and what it means for our climate future. (Premiered February 2, 2022)

In the Arctic, enormous releases of methane, a potent greenhouse gas, threaten the climate.

Arctic Sinkholes

The top half of Jupiter in blue and green against a night sky

A composite image of Jupiter using images captured by the James Webb Space Telescope. Image Credit: NASA, ESA, CSA, Jupiter ERS Team; image processing by Judy Schmidt.

Explore the cosmos, delve into ancient history, and follow an extreme rescue with NOVA’s most-watched documentaries released in 2022.

NOVA’s most popular science documentaries of 2022

Four bright orange loops brand off of a dark blue blob

A transmission electron micrograph of HIV-1 virus particles (orange) replicating from the plasma membrane of an infected H9 T cell. Credit: NIAID, Flickr

Scientists have cured a handful of people of HIV by piggybacking on treatments they received for blood cancer. But does that bring a widespread cure any closer?

These Smart Glasses Know Who You Are, and Much More

Support Provided By

Explore More

Are You Feeding a Powerful Facial Recognition Algorithm?

How Police Use Algorithms to Predict Crime

How Large Language Models Like ChatGPT Work

A.I. Revolution

Transcript

Credits