FakeStack: Hierarchical Tri-BERT-CNN-LSTM stacked model for effective fake news detection

• Published in: PloS one Vol. 18; no. 12; p. e0294701
• Main Authors: Keya, Ashfia Jannat, Shajeeb, Hasibul Hossain, Rahman, Md. Saifur, Mridha, M. F
• Format: Journal Article
• Language: English
• Published: San Francisco Public Library of Science 01-12-2023; Public Library of Science (PLoS)
• Subjects: Accuracy; Analysis; Artificial neural networks; Automation; Classification; Comparative analysis; Computational linguistics; Datasets; Decision making; Deep learning; Detectors; Disinformation; False information; Identification; Language; Language processing; Long short-term memory; Machine learning; Natural language; Natural language interfaces; Neural networks; News; Performance measurement; Public opinion; Social media; Social networks; Bangladesh; Taiwan
• ISSN: 1932-6203; 1932-6203
• DOI: 10.1371/journal.pone.0294701

False news articles pose a serious challenge in today's information landscape, impacting public opinion and decision-making. Efforts to counter this issue have led to research in deep learning and machine learning methods. However, a gap exists in effectively using contextual cues and skip connections within models, limiting the development of comprehensive detection systems that harness contextual information and vital data propagation. Thus, we propose a model of deep learning, FakeStack, in order to identify bogus news accurately. The model combines the power of pre-trained Bidirectional Encoder Representation of Transformers (BERT) embeddings with a deep Convolutional Neural Network (CNN) having skip convolution block and Long Short-Term Memory (LSTM). The model has been trained and tested on English fake news dataset, and various performance metrics were employed to assess its effectiveness. The results showcase the exceptional performance of FakeStack, achieving an accuracy of 99.74%, precision of 99.67%, recall of 99.80%, and F1-score of 99.74%. Our model's performance was extended to two additional datasets. For the LIAR dataset, our accuracy reached 75.58%, while the WELFake dataset showcased an impressive accuracy of 98.25%. Comparative analysis with other baseline models, including CNN, BERT-CNN, and BERT-LSTM, further highlights the superiority of FakeStack, surpassing all models evaluated. This study underscores the potential of advanced techniques in combating the spread of false news and ensuring the dissemination of reliable information.