A GENERALIZED ANALYTIC FOR THE DETECTION OF SYNTHETIC MEDIA
Loading...
Authors
Reilly, Patrick L.
Subjects
image classification
machine learning
synthetic media
image generation
neural networks
convolutional neural networks
CNNs
generative adversarial networks
GANs
deepfakes
machine learning
synthetic media
image generation
neural networks
convolutional neural networks
CNNs
generative adversarial networks
GANs
deepfakes
Advisors
Bassett, Robert L.
Date of Issue
2021-06
Date
Publisher
Monterey, CA; Naval Postgraduate School
Language
Abstract
Convolutional neural networks (CNNs) and generative adversarial networks (GANs) have quickly become leading tools for the creation of convincing synthetic images. Such images increase the difficulty of discerning fact from fiction in the information space, where such challenges can degrade the quality and timeliness of decision-making. To compete, we must develop tools that can automatically detect artificially generated images. A major challenge in this area centers around the high number of unique image generation methods. We therefore seek a classification analytic that can successfully generalize when tested on images from multiple image generation algorithms. The 2020 paper “CNN-generated Images Are Surprisingly Easy to Spot... For Now” by Wang et al. proposes such an approach. The study conducted here independently tests and validates this analytic in a variety of use cases. We begin by focusing on the reproducibility of the analytic using both publicly released and retrained models, the performance of the analytic on a dataset of images where generator type is unknown, and the analytic’s effectiveness in the detection of traditional deepfakes. We also examine the analytic’s robustness in response to reductions in image quality via compression and adversarial perturbations. Finally, we attempt to improve the analytic’s performance by using a state-of-the-art generator to produce a new image training set.
Type
Thesis
Description
Series/Report No
Department
Operations Research (OR)
Organization
Identifiers
NPS Report Number
Sponsors
Funder
Format
Citation
Distribution Statement
Approved for public release. Distribution is unlimited.
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.