Skip to main content

Learning as a guest. Your progress lasts until you close this tab. Save it free

Fakes Made by AI: Voices, Videos and Photos

  1. Warm-up
  2. Story
  3. Learn
  4. Play
  5. Quiz
  6. Remember
  7. Try it
  8. Finish

About this lesson

About 15 minutes · 5 quiz questions

The big idea: A computer can fake a voice, a face or a photo, so check in a second way you trust before you act, and know that fake images of you can be taken down.

This lesson mentions threats to share fake private images. It covers what to do and where to get help, and it never shows any images or plays any fake voices.

Lesson outline

The whole lesson as text: the story, the ideas, key words and more

The big idea: A computer can fake a voice, a face or a photo, so check in a second way you trust before you act, and know that fake images of you can be taken down.

The story: The voice that sounded right

Tiago gets a call in a voice that sounds like Tiago’s brother Mateus asking for gift cards. Noemi says to hang up and call back, and Mateus turns out to be fine.

  1. Narrator: Tiago is 16. A call comes in from a number Tiago does not know. The voice on the line sounds just like Tiago’s older brother, Mateus.
  2. Narrator: The voice says Mateus lost a wallet and needs $50 in gift cards right now. A gift card is a card loaded with money.
  3. Tiago: It sounds exactly like Mateus. But why would Mateus call from a number I do not know?
  4. Narrator: A computer can copy a voice from a short clip, like one in a video posted online. A computer-made copy of a voice is called a voice clone.
  5. Noemi: Hang up. Then call Mateus on the number you already have saved.
  6. Narrator: Tiago hangs up and calls Mateus’s saved number. Mateus answers from home and never called anyone.
  7. Narrator: Scammers ask for gift cards because once the card numbers are shared, the money is very hard to get back.
  8. Narrator: The Federal Bureau of Investigation, a federal police agency, suggests a secret word or phrase to check who is calling. Families call it a code word.
  9. Tiago: So I hang up, call back on a number I know, and ask for the code word.

What you’ll learn

  1. Fake voices, faces and photos

    Artificial intelligence is a computer program that learns from lots of examples. It can make a voice clone, a computer-made copy of a real person’s voice. A deepfake is a fake photo, voice or video that a computer makes to look or sound real. A short clip posted online can be enough to copy a voice.

    Penn posts a short video chatting with friends. A scammer copies Penn’s voice from it and calls Penn’s grandfather to ask for money.

  2. Check it a second way

    The Federal Trade Commission says not to trust the voice. Hang up, then call the person on a number you know is theirs. If you cannot reach them, try another family member or their friends. A family code word helps too, because a fake voice would not know it.

    Rennie’s family agreed on a code word at the dinner table. A caller who sounds like Rennie cannot say it, so the family hangs up.

  3. Threats with fake pictures

    Sextortion is threatening to share private images unless you pay or send more. The images can even be computer-made fakes. It is not your fault, and you do not have to handle it alone. The FBI says to stop all contact, do not pay, keep the messages, tell a trusted adult and report it at IC3.gov.

  4. Getting fake images taken down

    A takedown request is asking a website or app to remove an image shared without your okay. Under the Take It Down Act, they must remove it within 48 hours, and the law covers computer-made fakes. For images taken before you were 18, Take It Down from the National Center for Missing and Exploited Children helps too.

Key words

deepfake
a fake photo, voice or video that a computer makes to look or sound real
voice clone
a computer-made copy of a real person’s voice
code word
a secret word or phrase a family agrees on, to check who is really calling
takedown request
asking a website or app to remove an image that was shared without your okay

Common questions

How do I send a takedown request?
The website or app, called a platform, must offer a way to ask. The Federal Trade Commission says it must then remove the image and known identical copies within 48 hours of your request.
Is sharing these images a crime?
Yes. The Federal Trade Commission says that if someone shares an intimate image of a minor, or an image of you without your okay, that is a crime. Intimate means private and sexual. Making or sharing fakes of someone causes real harm.
What does the National Center for Missing and Exploited Children’s Take It Down do?
Its page calls it a free service that can help remove or stop the online sharing of nude, partially nude or sexually explicit images or videos taken of you when you were under 18.
What if a platform ignores my request?
The Federal Trade Commission says you can report the platform to it if the image is not removed within 48 hours, or if you cannot find the removal process or it is broken.

Remember this

Hear it? See it? Check it a second way.

Try it: Make your check-it plan

  1. Agree on a code word in person with a family member or another trusted adult.
  2. Ask someone you trust to play a rushed caller, and practice hanging up and calling back.
  3. Save two places to get help in your notes: Take It Down from the National Center for Missing and Exploited Children, and IC3.gov.

The whole mission; no account or app needed.

Live facts

Numbers that change over time, with when they were last checked and where they come from.

  • “A scammer could use AI to clone the voice of your loved one.” … “a short audio clip of your family member’s voice” … “content posted online” … “Don’t trust the voice. Call the person who supposedly contacted you and verify the story. Use a phone number you know is theirs. If you can’t reach your loved one, try to get in touch with them through another family member or their friends.” … “If the caller says to wire money, send cryptocurrency, or buy gift cards”

    Source: FTC Consumer Alert, March 2023(opens in a new tab)
  • “Create a secret word or phrase with your family to verify their identity.” “Criminals can use AI-generated audio to impersonate well-known, public figures or personal relations to elicit payments.”

    Source: FBI IC3 PSA, December 2024(opens in a new tab)
  • “Malicious actors have used manipulated photos or videos with the purpose of extorting victims for ransom” … “Complying with malicious actors does not guarantee your sensitive photos or content will not be shared.” … “retain all information regarding the incident” … “Do not provide any unknown or unfamiliar individuals with money or other items of value.”

    Source: FBI IC3 PSA, June 2023(opens in a new tab)
  • “Stop all interaction with the extortionist and do not be embarrassed or afraid to contact law enforcement.” “File a complaint with the FBI IC3 at www.ic3.gov.”

    Source: FBI IC3 PSA, September 2021(opens in a new tab)
  • “Do not send any money or additional content to the blackmailer.” … “tell a trusted adult, or the FBI.” … “Don’t be ashamed. Ask for help.”

    Source: FBI Detroit field office(opens in a new tab)
  • “Platforms must remove the intimate photos or videos, and known identical copies, within 48 hours of your request.” “The law applies to real images, digitally altered images, and deepfakes created with artificial intelligence.” “If someone shares an intimate image of a minor or an image of you without your consent, that’s a crime.” “You can also report a platform if you can’t find their removal request process or if it’s broken.”

    Source: FTC Consumer Alert, May 2026(opens in a new tab)
  • “Take It Down is a free service that can help you remove or stop the online sharing of nude, partially nude, or sexually explicit images or videos taken of you when you were under 18 years old.”

    Source: National Center for Missing & Exploited Children(opens in a new tab)

Lessons teach how money works. They are not financial advice.