Multimedia Forensics In The Age GANs – The War Has Just Begun
Image and video manipulation have lately become an epidemic, mainly due to the ease-of-use and availability of multimedia editing tools, such as Photoshop and GIMP. Further, recent advances in deep generative modeling, such as Generative Adversarial Networks (GAN), gave birth to a new era of photo-realistic synthetic images. The widespread of manipulated and generated multimedia, as tools of misinformation, on social networking platforms has major societal consequences, including child safety, public opinion and democracy and criminal justice. The prevalence of fabricated multimedia necessitated a new wave of forensic computer vision methods for detecting and localizing image and video manipulations. In this talk I will give a brief overview of current challenges in multimedia forensics then I will then present two novel multimedia forensics methods developed at VISTA. First, I will present ManTraNet (Manipulation Tracing Network) a unified deep convolutional neural network architecture for detecting and localizing various types of image manipulations, such as copy-move and splicing. ManTraNet is considered state-of-the-art image manipulation detection framework and have been evaluated on multiple standard datasets. Second, I will present a state-of-the-art deep learning pipeline for detecting deepfake videos. Our pipeline demonstrated state-of-the-art evaluation results on FaceForensics++, the only large scale deepfake dataset. Finally, I will wrap up with conclusions and thoughts for future directions in multimedia forensics research.
Dr. AbdAlmageed is a Research Associate Professor at Department of Electrical and Computer Engineering, and a research Team Leader and Supervising Computer Scientist with Information Sciences Institute, both are units of USC Viterbi School of Engineering. His research interests include representation learning, debiasing and fair representations, multimedia forensics and visual misinformation (including deepfake and image manipulation detection) and biometrics. Prior to joining ISI, Dr. AbdAlmageed was a research scientist with the University of Maryland at College Park, where he lead several research efforts for various NSF, DARPA and IARPA programs. He obtained his Ph.D. with Distinction from the University of New Mexico in 2003 where he was also awarded the Outstanding Graduate Student award. He has two patents and over 70 publications in top computer vision and high performance computing conferences and journals. Dr. AbdAlmageed is the recipient of 2019 USC Information Sciences Institute Achievement Award.