Abstract
Nowadays, the authenticity of digital image and videos becomes hard while the forgery techniques are more advanced. Given the recent progress on Generative Neural Network (GNN) development that may generate realistic images and videos, it becomes more difficult to detect the authenticity. In this paper, we expose a popular open source video forgery library called “DeepFaceLab” by making use of deep learning. We retrain the existing state-of-the-art image classification neural networks to capture the features from manipulated video frames. After passing various sets of forgery video frames through a well-trained neural network, a bottleneck layer is created for each image, this layer contains compact information for all images, and exposes the artifacts in forgery videos. We obtained above 99% accuracy when testing on DeepFake videos. In addition, we tested our method on FaceForensics dataset and achieved good detection accuracy.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Buzzfeed: You Won’t Believe What Obama Says in This Video! [video] (2019). https://www.youtube.com/watch?v=cQ54GDm1eL0
Facebook: Systems and Methods for Dynamically Generating Emojis Based on Image Analysis of Facial Features. US 20170140214A1 (2017)
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., Niessner, M.: Face2Face: real-time face capture and reenactment of RGB videos. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2387–2395 (2016)
Thies, J., Zollhöfer, M., Theobalt, C., Stamminger, M., Niessner, M.: Headon: real-time reenactment of human portrait videos. ACM Trans. Graph. 37(4), 1–13 (2018)
Suwajanakorn, S., Seitz, S., Kemelmacher-Shlizerman, I.: Synthesizing Obama: learning lip sync from audio. ACM Trans. Graph. 36(4), 1–13 (2017)
Karras, T., Laine, S., Aila, T.: A style-based generator architecture for generative adversarial networks, arXiv:1812.04948 [cs, stat] (2018)
Lample, G., Zeghidour, N., Usunier, N., Bordes, A., Denoyer, L., Ranzato, M.: Fader networks: manipulating images by sliding attributes, arXiv:1706.00409 [cs] (2017)
Lu,Y., Tai, Y.-W., Tang, C.-K.: Attribute-guided face generation using conditional CycleGAN, arXiv:1705.09966 [cs, stat] (2017)
Sharma, S.: Celebrity Face Generation using GANs (2018). https://medium.com/coinmonks/celebrity-face-generation-using-gans-tensorflow-implementation-eaa2001eef86
Liu, Z., Luo, P., Wang, X., Tang, X.: Deep learning face attributes in the wild. In: 2015 IEEE International Conference on Computer Vision (2015)
Seibold, C., Samek, W., Hilsmann, A., Eisert, P.: Detection of face morphing attacks by deep learning. In: Kraetzer, C., Shi, Y.-Q., Dittmann, J., Kim, H.J. (eds.) Digital Forensics and Watermarking, vol. 10431. Springer International Publishing, pp. 107–120 (2017)
Guera, D., Delp, E.J.: DeepFake video detection using recurrent neural networks. In: Proceedings 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Auckland, New Zealand, pp. 1–6 (2018)
Li, Y., Lyu, S.: Exposing DeepFake Videos By Detecting Face Warping Artifacts, arXiv:1811.00656 [cs] (2018)
Hui, J.: How deep learning fakes videos (DeepFake) and how to detect it? (2018). https://medium.com/@jonathan_hui/how-deep-learning-fakes-videos-DeepFakes-and-how-to-detect-it-c0b50fbf7cb9
Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (2014). https://doi.org/10.1109/cvpr.2014.241
GitHub. DeepFaceLab (2019). https://github.com/iperov/DeepFaceLabm/iperov/DeepFaceLab
Li, C., Balaban, S.: Transfer Learning with TensorFlow Tutorial: Image Classification Example (2018). https://lambdalabs.com/blog/transfer-learning-with-tensorflow-tutorial-image-classification-example/
TensorFlow Hub. How to Retrain an Image Classifier for NewCategories (2019): https://www.tensorflow.org/hub/tutorials/image_retraining#bottlenecks
Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., Nießner, M.: FaceForensics: a large-scale video dataset for forgery detection in human faces, arXiv:1803.09179 [cs] (2018)
Howard, A.G., et al.: MobileNets: efficient convolutional neural networks for mobile vision applications, arXiv:1704.04861 [cs] (2017)
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision, arXiv:1512.00567 [cs] (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, Z., Liu, Q. (2020). Detect Video Forgery by Performing Transfer Learning on Deep Neural Network. In: Liu, Y., Wang, L., Zhao, L., Yu, Z. (eds) Advances in Natural Computation, Fuzzy Systems and Knowledge Discovery. ICNC-FSKD 2019. Advances in Intelligent Systems and Computing, vol 1075. Springer, Cham. https://doi.org/10.1007/978-3-030-32591-6_44
Download citation
DOI: https://doi.org/10.1007/978-3-030-32591-6_44
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32590-9
Online ISBN: 978-3-030-32591-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)