what’s a deepfake?
A deepfake is synthetic audio, image, or video produced with deep-learning models that depicts a real, identifiable person doing or saying something they did not.
the word was coined in late 2017 by a Reddit user with the handle deepfakes, who ran a subreddit sharing face-swap videos made with an open-source autoencoder. the original technical meaning was narrow: face replacement in video. usage has since broadened to cover any AI-synthesized depiction of a real person.
researchers split the category three ways. face swap replaces one person's face with another's in otherwise authentic footage. lip sync or reenactment keeps the original face but reshapes the mouth and expression to match new audio, which makes it the hardest variant to spot by eye. full synthesis generates an entirely fabricated person or scene, including voice clones and talking-head avatars like those used in customer-service videos.
volumes climbed sharply through 2024. the identity-verification vendor Sumsub reported a 4× year-over-year increase in deepfakes detected globally during the year of major democratic elections, and a 303% spike in the U.S. ahead of November. despite the worst fears, documented political deepfakes that meaningfully changed an election outcome remain rare. the dominant real-world harm is non-consensual intimate imagery and financial fraud (especially voice-clone scam calls), not propaganda.
the most common misconception, including in news copy, is that a deepfake must involve video. audio-only voice clones used in scam calls are deepfakes too, and as of 2024 they are the most economically damaging variant.
deepfake detection is harder than generic AI-image detection because the synthetic part of the content is often spatially or temporally local. a 30-second face swap inside an otherwise-real five-minute interview will fool a detector that averages a global score across frames. amige. handles this by trusting the loudest deepfake signal from either detector. that's also why our headline number for a flagged deepfake can be higher than the unweighted detector average.
bigger picture: in-the-wild detector accuracy on deepfakes is materially worse than in academic benchmarks. open-source detectors drop roughly 45 to 50% in AUC when moved from clean lab evaluation sets to actual social-media content (Deepfake-Eval-2024). commercial vendors report higher numbers; treat the lab figures as ceilings, not promises.
questions
what is a deepfake?
a deepfake is synthetic audio, image, or video made with deep-learning models that depicts a real, identifiable person doing or saying something they did not. a Reddit user coined the term in 2017 for face-swap videos. it now spans face swaps, lip sync and reenactment, and full synthesis including voice clones. one trait defines the category: it depicts a specific real person, so not every AI image qualifies.
are voice clones deepfakes?
yes. people assume a deepfake has to be video, but audio-only voice clones used in scam calls count too. as of 2024 they rank among the most economically damaging variants. the dominant real-world harm runs through non-consensual intimate imagery and financial fraud, ahead of political propaganda.
can deepfakes be detected reliably?
less reliably than vendors imply. detector accuracy in the wild falls well short of lab benchmarks. open-source detectors lose roughly 45 to 50% of AUC when moved to real social-media content (Deepfake-Eval-2024, 2025). read published lab figures as ceilings, not promises.
why is deepfake detection harder than AI-image detection?
the synthetic part often sits in a small slice of the file. a 30-second face swap inside an otherwise-real five-minute interview fools a detector that averages one global score across every frame. amige. trusts the loudest deepfake signal from either detector, so its headline number for a flagged deepfake can run higher than the unweighted detector average.
sources.
- 01Oxford English Dictionary — deepfake, n.Etymology and lexicographic scope of the term.
- 02Sumsub 2024 Identity Fraud Report — deepfake volumes4× year-over-year increase globally, 303% U.S. spike ahead of the 2024 election.
- 03Deepfake-Eval-2024 — in-the-wild benchmark (arXiv:2503.02857)45-50% AUC drop moving open-source detectors from lab to social media.
- 04
- ensemble detection →how amige. combines multiple detectors so a deepfake hit on one doesn’t get washed out by quiet scores from the others.
- model attribution →naming the model that generated the face swap, lip sync, or voice clone.
- AI watermarking →the only positive proof of AI origin that survives compression. and most generators don’t ship it.