Social damage is not a side quest

Manipulated media and non-consensual deepfakes are documented online harms. Treat social damage as a primary design constraint.

The trap

Product demos celebrate creativity. Victims of manipulated media live with reputation, safety, and trust damage that never appears in a launch video. Social harm is not a side quest you unlock after growth.

What the evidence shows

The Federal Trade Commission (2022) reported to Congress on online harms including deepfakes and manipulated content, warning that detection-only AI races are incomplete and that technical mitigation alone will not end the problem. Hawkins et al. (2025) documented a large rise in downloadable non-consensual deepfake model variants on public repositories, with millions of downloads and many models targeting women, including people who are not global celebrities. Flynn et al. (2025) interviewed perpetrators and victims of sexualized deepfake abuse and described real, embodied harms and the ease of creation.

What this means for people

Trust in what you see and hear is a public good. When anyone can synthesize a classmate, coworker, or neighbor, verification habits and platform accountability are craft, not paranoia.

Practice (15 minutes)

Pick one channel your family or team uses for images or voice notes.
Write a three-step verify rule before resharing (source, context, second channel).
Agree who to call if someone is targeted (platform report path plus one human ally).
Refuse one funny synthetic likeness request this month.

Reflection

Whose reputation would you put at risk for a joke that travels faster than a correction?

Skeptic check

FTC (2022) is a policy report, not a prevalence census for 2026.
Repository scrapes measure availability and downloads, not confirmed victim counts (Hawkins et al., 2025).
Interview samples are deep but not statistically representative of all countries (Flynn et al., 2025).

References

Federal Trade Commission. (2022). Combatting online harms through innovation: Federal Trade Commission report to Congress. https://www.ftc.gov/system/files/ftc_gov/pdf/Combatting%20Online%20Harms%20Through%20Innovation%3B%20Federal%20Trade%20Commission%20Report%20to%20Congress.pdf

Flynn, A., Powell, A., Eaton, A., & Scott, A. J. (2025). Sexualized deepfake abuse: Perpetrator and victim perspectives on the motivations and forms of non-consensually created and shared sexualized deepfake imagery. Journal of Interpersonal Violence. Advance online publication. https://doi.org/10.1177/08862605251368834

Hawkins, W., Mittelstadt, B., & Russell, C. (2025). Deepfakes on demand: The rise of accessible non-consensual deepfake image generators. In Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency (pp. 1602-1614). Association for Computing Machinery. https://doi.org/10.1145/3715275.3732107