| Hoax

Are deepfakes harmless fun or a bullying weapon?

Alžbeta Kovaľová | 13 Feb 2025

In July 2024, the BBC reported the case of a 12-year-old girl who became the victim of a new form of cyberbullying – deepfake. Bullies from her school posted an altered picture of the girl on Snapchat. Using AI tools, they added her face to a pornographic image creating a deepfake. Her schoolmates kept reposting the picture, while the victim became more and more traumatized. Sadly, this is not an isolated case as deepfakes are very easy to create and can lead to serious problems for their victims.

What are deepfakes?

As you may already know, deepfakes use deep learning (which is a subset of machine learning) to create very realistic images, videos, or audio. This technology mimics the voice or likeness of its target and superimposes it on an existing recording or image. Deepfake apps and software are usually quite easy and intuitive to use, creating convincing illusions. While this can be positive for various creative projects, it is also a major attraction for bullies.  

Simple versions of deepfakes can be created using apps such as FaceApp or FaceSwap. Some deepfakes have gone viral, such as videos of public figures like Elon Musk, Joe Biden or Volodymir Zelensky. Such videos have mostly been used to spread fake news.

How deepfakes are used

According to a study by an AI company Deeptrace, 96% of deepfake videos circulating online are pornographic and very often non-consensual. This issue remains unsolved on a legal level. Deepfakes have also been weaponized to damage reputations and careers, but less attention is paid to how they affect children.

The ease of use has made deepfakes a popular tool for bullying. For example, a child's face might be inserted into a music video with suggestive dancing. The emotional damage and humiliation the child experiences, as a result, can damage their self-esteem and also their relationships at school.  

Of course, deepfakes can also be used in a positive way. For example, children can become virtual stars in their favorite movies or games or meet their favorite celebrity. The Dalí Museum in Florida uses deepfake technology to create an interactive experience where a lifelike representation of the artist greets visitors. So, while deepfakes can foster creativity and engagement, it's important to stay informed and teach your children about the precautions to take against their misuse.  

Talking to kids about deepfakes

1. Watch and discuss deepfakes together

Start with the obvious – look at it together. You may be surprised to find that your children's tech-savviness means they may already have a keen eye for fake online content. Focus their attention on issues such as responsibility, consent, and the importance of not using your face or voice without their permission. Create a safe space for them and let them know that they can always come to you or the school authorities if they are bullied using deepfakes.

Find out more about AI-enabled bullying

2. Learn to spot deepfakes

Although deepfakes are increasingly difficult to spot, there are some signs that can help. Look for irregularities such as unnatural blinking, inconsistent audio and lip movements, or glitches near the hairline or face. Lighting inconsistencies – such as uneven shadows or different reflections in the eyes – can also be clues. Also consider the content itself; if the message seems outrageous or emotionally manipulative, it could be a deepfake. Keep in mind that as technology improves, these indicators may become harder to spot.

Find out more about spotting deepfake from Alan Turing Institute.

3. Encourage thoughtful online behavior

Talk to your children about sharing pictures and videos of themselves online in public groups. Explain how these can easily be misused to create deepfakes and suggest alternatives encouraging more thoughtful online behavior. Suggest that they only share photos in private group chats with close friends or family and reduce exposure wherever possible. Framing these precautions as empowering choices rather than restrictions may encourage a more positive response.  

Find out more about oversharing from a child psychologist.

4. Explore and educate together

While you can definitely educate your child, they can also introduce you to some interesting knowledge in return. Maybe they even use apps such as FaceApp or FaceSwap and you might create some harmless and fun videos together to educate each other. Your child will boost their understanding of this technology while also learning about its ethical use.

5. Consider additional safeguards

If you seek extra layers of protection, explore security solutions designed to monitor and manage online risks for kids for example ESET HOME Security packages. Those can help you monitor which sites your kids visit via parental control. It also offers online identity protection and encryption of sensitive data and photos.

Final thoughts

Deepfake technology has great potential and offers many creative opportunities for your children, but there are also risks that you should be aware of. To be a better digital guide for your children, stay informed about the dangers, but also encourage creative use. Explain the ethics of deepfakes and encourage them to seek help if they are bullied.

 

About the author

Alžbeta Kovaľová /
Security writer

Alžbeta has worked at ESET for two years...

Read more
ESET Parental Control for Android ESET Parental Control for Android

Make the internet safer for your children

With ESET Parental Control for Android

TRY FREE FOR 30 DAYS

Monthly newsletter

Quiz

How much do you know about internet security?

Check your knowledge and win a prize!

Enter the quiz