Name: How Large Language Models Like ChatGPT Work
Uploaded: undefined
Duration: undefined

NOVA

By recognizing patterns in billions of words, these models can make guesses at the next word in a sentence but to do that well, the AI also has to understand the sentence.

It’s not always easy to tell the difference between writing by a human and ChatGPT.

How Large Language Models Like ChatGPT Work

Carlisle Companies

Viking

NOVA Science Trust Logo

By recognizing patterns in billions of words, these models can make guesses at the next word in a sentence but to do that well, the AI also has to understand the sentence.

It’s not always easy to tell the difference between writing by a human and ChatGPT.

Tech & Engineering

How Large Language Models Like ChatGPT WorkPublished: August 22, 2024Narrator: ChatGPT. It allows users to engage in a dialogue with a machine that seems uncannily human. It was first released in 2018, but it was a subsequent version that became a global sensation in late 2022.Speaker 2: This promises to be the viral sensation that could completely reset how we do things.Speaker 3: Cranking out entire essays in a matter of seconds.Narrator: Not only did it wow the public, it also caught artificial intelligence innovators off guard.Speaker 4: It surprised me a lot, that they're able to do things that we didn't think they could do simply by learning to imitate how humans respond. And I thought this kind of abilities would take many more years or decades.Narrator: ChatGPT is a large language model. LLMs start by consuming massive amounts of text, books, articles, and websites, which are publicly available on the internet. By recognizing patterns in billions of words, they can make guesses at the next word in a sentence. That's how ChatGPT generates unique answers to your questions. If I ask for a haiku about the blue sky, it writes something that seems completely original.Speaker 5: If you're good at predicting this next word, it means you're understanding something about the sentence, what the style of the sentence is, what the feeling of the sentence is, and you can't tell whether this was a human or a machine.

United States

Northern Mariana Islands

Puerto Rico

American Samoa

Guam

U.S. Virgin Islands

U.S. Minor Outlying Islands

US & Territories

Colossal explosions shake a remote corner of the Siberian tundra, leaving behind massive craters. In Alaska, a huge lake erupts with bubbles of inflammable gas. Scientists are discovering that these mystifying phenomena add up to a ticking time bomb, as long-frozen permafrost melts and releases vast amounts of methane, a potent greenhouse gas. What are the implications of these dramatic developments in the Arctic? Scientists and local communities alike are struggling to grasp the scale of the methane threat and what it means for our climate future. (Premiered February 2, 2022)

In the Arctic, enormous releases of methane, a potent greenhouse gas, threaten the climate.

Arctic Sinkholes

The top half of Jupiter in blue and green against a night sky

A composite image of Jupiter using images captured by the James Webb Space Telescope. Image Credit: NASA, ESA, CSA, Jupiter ERS Team; image processing by Judy Schmidt.

Explore the cosmos, delve into ancient history, and follow an extreme rescue with NOVA’s most-watched documentaries released in 2022.

NOVA’s most popular science documentaries of 2022

Four bright orange loops brand off of a dark blue blob

A transmission electron micrograph of HIV-1 virus particles (orange) replicating from the plasma membrane of an infected H9 T cell. Credit: NIAID, Flickr

Scientists have cured a handful of people of HIV by piggybacking on treatments they received for blood cancer. But does that bring a widespread cure any closer?

How Large Language Models Like ChatGPT Work

Support Provided By

Explore More

Computers v. Crime

How A.I. is fighting wildfires

The Birth of Artificial Intelligence

A.I. Revolution

Transcript

Credits