A New Approach for Deepfake Detection with the Choquet Fuzzy Integral

• Published in: Applied sciences Vol. 14; no. 16; p. 7216
• Main Authors: Karaköse, Mehmet, İlhan, İsmail, Yetiş, Hasan, Ataş, Serhat
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01-08-2024
• Subjects: Accuracy; Algorithms; Artificial intelligence; Choquet fuzzy integral; Classification; COVID-19; Datasets; Deep learning; Deepfake; deepfake video detection; Disease transmission; face reenactment; faceswap; Forgery; manipulation; Methods; Mouth; Neural networks; Social networks; New Jersey
• ISSN: 2076-3417; 2076-3417
• DOI: 10.3390/app14167216

Deepfakes have become widespread and have continued to develop rapidly in recent years. In addition to the use of deepfakes in movies and for humorous purposes, this technology has also begun to pose a threat to many companies and politicians. Deepfake detection is critical to the prevention of this threat. In this study, a Choquet fuzzy integral-based deepfake detection method is proposed to increase overall performance by combining the results obtained from different deepfake detection methods. Three different deepfake detection models were used in the study: XceptionNet, which has better performance in detecting real images/videos; EfficientNet, which has better performance in detecting fake videos; and a model based on their hybrid uses. The proposed method based on the Choquet fuzzy integral aims to eliminate the shortcomings of these methods by using each of the other methods. As a result, a higher performance was achieved with the proposed method than found when all three methods were used individually. As a result of the testing and validation studies carried out on FaceForensics++, DFDC, Celeb-DF, and DeepFake-TIMIT datasets, the individual performance levels of the algorithms used were 81.34%, 82.78%, and 79.15% on average, according to the AUC curve, while the level of 97.79% was reached with the proposed method. Considering that the average performance of the three methods across all datasets is 81.09%, it can be seen that an improvement of approximately 16.7% is achieved. In the FaceForensics++ dataset, in which individual algorithms are more successful, the performance of the proposed method reaches the highest AUC value, 99.8%. It can be seen that the performance rates can be increased by changing the individual methods discussed in the proposed method. We believe that the proposed method will inspire researchers and will be further developed.