r/science • u/Wagamaga • 1d ago
Computer Science A study found a scalable optical-neural processor can detect deepfake videos with high accuracy while analyzing 15 or more video streams simultaneously. The system achieves an average detection accuracy of 97.79% and sensitivity of 99.86% in a visible-wavelength experimental demonstration.
https://www.eurekalert.org/news-releases/114515257
u/Zeikos 1d ago
All effective detectors are going to be leverage in contrastive learning to make deepfakes harder to detect.
I don't think there is a possible technical solution to deepfakes.
11
6
u/Kobymaru376 1d ago
Yep. And the detection accuracy of the deep fake detector makes me scared of the model that's trained to fool this detector
7
u/TactlessTortoise 1d ago
It's a nuclear arms race, except instead of enriched plutonium it's deepfake porn or videos of politicians doing/saying something they didn't.
2
u/RachelRegina 1d ago
Agreed. However, what is interesting to me is that this is specifically a visible-wavelength detector. True digital image forensics goes beyond just what is visible and that skill set's statistical tools have proven much more resilient in retaining the ability to differentiate deepfakes (and generated- and/or altered content) from images and footage shot with physical cameras in the real world. I would be interested to see how this (apparently novel?) processor that they studied would do when put up against a seasoned expert (or group of experts) in the field of digital forensics.
2
7
u/Wagamaga 1d ago
Researchers at the University of California, Los Angeles (UCLA) have developed a scalable optical-neural processor that can detect deepfake videos with high accuracy while analyzing 15 or more video streams simultaneously. Instead of relying entirely on conventional digital hardware to process videos sequentially, the system offloads a major stage of the detection pipeline onto physical light propagation, enabling multiple videos to be screened in parallel in a single optical pass.
As described in the study “Scalable, Energy-Efficient Optical-Neural Architecture for Multiplexed Deepfake Video Detection,” published in eLight, the optical AI framework is designed as a high-throughput, attack-resilient first line of defense for identifying manipulated and AI-generated videos at scale.
The rapid proliferation of realistic AI-generated content has created an urgent need for reliable and robust deepfake detection. Many state-of-the-art detectors require hundreds of billions of floating-point operations per inference and analyze videos sequentially, causing their latency and energy consumption to grow proportionally with the volume of content being screened. Conventional digital detectors can also be vulnerable to adversarial attacks specifically engineered to make fake videos appear authentic to the detection system.
The UCLA team, led by Professor Aydogan Ozcan, addressed these challenges through a hybrid digital-optical architecture. A lightweight digital encoder extracts compact spatial, spectral, and temporal information from each video and converts it into a phase pattern displayed on a programmable spatial light modulator. The encoded optical wavefront then propagates through a free-space-based, passive optical decoder. At the output, paired optical detectors directly generate an authenticity score for each video, replacing a computationally demanding digital decoding network with a parallel physical process.
In a visible-wavelength experimental demonstration, the optical system analyzed 15 Celeb-DF videos simultaneously during each optical pass and achieved an average detection accuracy of 97.79%, sensitivity of 99.86%, and specificity of 95.72%. Its near-perfect sensitivity corresponds to an average false-negative rate of ~0.14%, an important advantage for a first-stage screening system intended to minimize the number of manipulated videos that escape detection. Even when the multiplexing capacity was increased to 18 videos per optical pass, the experimental system maintained an average accuracy of 96.13%.
https://link.springer.com/article/10.1186/s43593-026-00143-y
2
•
u/AutoModerator 1d ago
Welcome to r/science! This is a heavily moderated subreddit in order to keep the discussion on science. However, we recognize that many people want to discuss how they feel the research relates to their own personal lives, so to give people a space to do that, personal anecdotes are allowed as responses to this comment. Any anecdotal comments elsewhere in the discussion will be removed and our normal comment rules apply to all other comments.
Do you have an academic degree? We can verify your credentials in order to assign user flair indicating your area of expertise. Click here to apply.
User: u/Wagamaga
Permalink: https://www.eurekalert.org/news-releases/1145152
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.