Beyond Reported Accuracy: A Verifiability-Focused, Multi-Axis Review of Content and Context Based Fake News Detection
DOI:
https://doi.org/10.62411/jcta.17476Keywords:
Fake news detection, Graph neural networks, Large Language Models, Agricultural misinformation detection, Multimodal learning, Risk of bias, Structured review, Vision TransformerAbstract
Fake news undermines information integrity, and the proliferation of large language models (LLMs) has intensified both its generation and its detection. Prior surveys catalogue methods but rarely verify the performance figures they synthesize, restrict comparison to same-benchmark settings, or assess risk of bias, so reported accuracies are often over-read. This verifiability-focused review analyzes an enumerated, non-exhaustive corpus of 45 content- and context-based detection studies (2018-2025; 42 quantitative-core) in which each reported headline metric is traced to its primary source and confirmed against it wherever the source is accessible (36 of 45; the nine paywalled studies are flagged as reported-but-unconfirmed), and released with the corpus. Studies are grouped into five method families, Transformer/PLM (31.0%), multimodal (26.2%), LLM-based (21.4%), graph/propagation (16.7%), and traditional machine learning (4.8%), and interpreted through a four-axis framework of evidence source, detection time, data dependence, and deployment objective. Without metric conversion or pooling, reported accuracies are strongly heterogeneous and not comparable across families (Transformer 74.8-99.36%, multimodal 82.4-99.97%, graph 84.4-94.36% or 0.75-0.93 AUC, LLM-based 48.6-89.0%); within Weibo, seven multimodal models span 82.4-91.8%, and GPT-4 attains 68.2% (not the ~95% often cited) on LIAR-binary. Three findings follow. First, reported performance appears shaped as much by data and evaluation design as by architecture, so architecture-only interpretations can be misleading; near-perfect results may reflect dataset-specific separability, leakage, or favorable evaluation designs rather than superior transferable capability. Second, the field has evolved cumulatively from static content cues toward multi-source evidence integration and reasoning, so the families are complementary evidence sources rather than exclusive choices. Third, no family is optimal across scenarios, and a central open problem is sustaining reliability under drift, new languages, attacks, and AI-generated content. We derive a dependency-ordered research agenda and, from a Vietnamese case study, transferable design principles for low-resource languages.References
World Economic Forum, “The Global Risks Report 2024,” 2024. [Online]. Available: https://www.weforum.org/publications/global-risks-report-2024/
S. Vosoughi, D. Roy, and S. Aral, “The spread of true and false news online,” Science (80-. )., vol. 359, no. 6380, pp. 1146–1151, Mar. 2018, doi: 10.1126/science.aap9559.
X. Zhou and R. Zafarani, “A survey of fake news: Fundamental theories, detection methods, and opportunities,” ACM Comput. Surv., vol. 53, no. 5, pp. 1–40, 2020, doi: 10.1145/3395046.
K. Shu, A. Sliva, S. Wang, J. Tang, and H. Liu, “Fake news detection on social media: A data mining perspective,” ACM SIGKDD Explor. Newsl., vol. 19, no. 1, pp. 22–36, 2017, doi: 10.1145/3137597.3137600.
X. Zhang and A. A. Ghorbani, “An overview of online fake news: Characterization, detection, and discussion,” Inf. Process. Manag., vol. 57, no. 2, p. 102025, 2020, doi: 10.1016/j.ipm.2019.03.004.
J. Devlin, M.-W. W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” in Proceedings of the 2019 Conference of the North, Stroudsburg, PA, USA: Association for Computational Linguistics, Oct. 2019, pp. 4171–4186. doi: 10.18653/v1/N19-1423.
Y. Liu et al., “RoBERTa: A robustly optimized BERT pretraining approach,” arXiv Prepr. arXiv1907.11692, 2019, [Online]. Available: https://arxiv.org/abs/1907.11692
Y. Wang et al., “EANN: Event adversarial neural networks for multi-modal fake news detection,” in in Proc. 24th ACM SIGKDD Int. Conf. Knowledge Discovery & Data Mining (KDD 2018), 2018, pp. 849-8571145/3219819.3219903, 2018. doi: 10.1145/3219819.3219903.
D. Khattar, J. S. Goud, M. Gupta, and V. Varma, “MVAE: Multimodal variational autoencoder for fake news detection,” in in Proc. World Wide Web Conf. (WWW 2019), 2019, pp. 2915-29211145/3308558.3313552, 2019. doi: 10.1145/3308558.3313552.
S. Singhal, R. R. Shah, T. Chakraborty, P. Kumaraguru, and S. Satoh, “SpotFake: A multi-modal framework for fake news detection,” in in Proc. IEEE 5th Int. Conf. Multimedia Big Data (BigMM 2019), 2019, pp. 39-471109/BigMM.2019.00-44, 2019. doi: 10.1109/BigMM.2019.00-44.
T. Bian et al., “Rumor detection on social media with bi-directional graph convolutional networks,” in in Proc. AAAI Conf. Artificial Intelligence, vol. 34, no. 01, 2020, pp. 549-5561609/aaai.v34i01.5393, 2020. doi: 10.1609/aaai.v34i01.5393.
F. Monti, F. Frasca, D. Eynard, D. Mannion, and M. M. Bronstein, “Fake News Detection on Social Media Using Geometric Deep Learning,” arXiv Prepr. arXiv1902.06673, 2019, doi: 10.48550/arXiv.1902.06673.
K. Pelrine et al., “Towards reliable misinformation mitigation: Generalization, uncertainty, and GPT-4,” in in Proc. 2023 Conf. Empirical Methods in Natural Language Processing (EMNLP 2023), 2023, pp. 6399-642918653/v1/2023.emnlp-main.395, 2023. doi: 10.18653/v1/2023.emnlp-main.395.
Y. Huang and L. Sun, “FakeGPT: Fake news generation, explanation and detection of large language models,” 2023. doi: 10.48550/arXiv.2310.05046.
C. Chen and K. Shu, “Can LLM-generated misinformation be detected?,” in in Proc. 12th Int. Conf. Learning Representations (ICLR 2024), 2024, p. 2024.
D. Moher, A. Liberati, J. Tetzlaff, and D. G. Altman, “Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement,” PLoS Med., vol. 6, no. 7, p. e1000097, 2009, doi: 10.1371/journal.pmed.1000097.
M. J. Page et al., “The PRISMA 2020 statement: an updated guideline for reporting systematic reviews,” BMJ, p. n71, Mar. 2021, doi: 10.1136/bmj.n71.
B. Kitchenham, “Procedures for performing systematic reviews,” 2004.
S. Gong, R. O. Sinnott, J. Qi, and C. Paris, “Fake news detection through graph-based neural networks: A survey,” 2023. doi: 10.48550/arXiv.2307.12639.
C. Comito, L. Caroprese, and E. Zumpano, “Multimodal fake news detection on social media: A survey of deep learning techniques,” Soc. Netw. Anal. Min., vol. 13, no. 1, p. 101, 2023, doi: 10.1007/s13278-023-01104-w.
B. Guo, Y. Ding, L. Yao, Y. Liang, and Z. Yu, “The future of false information detection on social media: New perspectives and trends,” ACM Comput. Surv., vol. 53, no. 4, pp. 1–36, 2020, doi: 10.1145/3393880.
F. Alam et al., “A survey on multimodal disinformation detection,” in in Proc. 29th Int. Conf. Computational Linguistics (COLING), Gyeongju, Republic of Korea, 2022, 2022, pp. 6625–6643.
A. B. Athira, S. D. M. Kumar, and A. M. Chacko, “A systematic survey on explainable AI applied to fake news detection,” 2023, doi: 10.1016/j.engappai.2023.106087.
C. Chen and K. Shu, “Combating misinformation in the age of LLMs: Opportunities and challenges,” AI Mag., vol. 45, no. 3, pp. 354–368, 2024, doi: 10.1002/aaai.12188.
X. Wang, W. Zhang, and S. Rajtmajer, “Monolingual and multilingual misinformation detection for low-resource languages: A comprehensive survey,” 2024. doi: 10.48550/arXiv.2410.18390.
R. Yang, X. Wang, Y. Jin, C. Li, J. Lian, and X. Xie, “Reinforcement subgraph reasoning for fake news detection,” in in Proc. 28th ACM SIGKDD Conf. Knowledge Discovery and Data Mining (KDD 2022), 2022, pp. 2253-22621145/3534678.3539277, 2022. doi: 10.1145/3534678.3539277.
R. Kumari and A. Ekbal, “AMFB: Attention based multimodal factorized bilinear pooling for multimodal fake news detection,” 2021, doi: 10.1016/j.eswa.2021.115412.
B. Xie et al., “Multi-knowledge and LLM-inspired heterogeneous graph neural network for fake news detection,” IEEE Trans. Comput. Soc. Syst., vol. 12, no. 2, pp. 682–694, 2025, doi: 10.1109/TCSS.2024.3488191.
H. Yuan, J. Zheng, Q. Ye, Y. Qian, and Y. Zhang, “Improving fake news detection with domain-adversarial and graph-attention neural network,” 2021, doi: 10.1016/j.dss.2021.113633.
C.-O. Truică and E.-S. Apostol, “It’s All in the Embedding! Fake News Detection Using Document Embeddings,” Mathematics, vol. 11, no. 3, p. 508, 2023, doi: 10.3390/math11030508.
S. Raza and C. Ding, “Fake news detection based on news content and social contexts: a transformer-based approach,” Int. J. Data Sci. Anal., vol. 13, no. 4, pp. 335–362, 2022, doi: 10.1007/s41060-021-00302-z.
R. K. Kaliyar, A. Goswami, and P. Narang, “FakeBERT: Fake news detection in social media with a BERT-based deep learning approach,” Multimed. Tools Appl., vol. 80, no. 8, pp. 11765–11788, Mar. 2021, doi: 10.1007/s11042-020-10183-2.
J. Alghamdi, Y. Lin, and S. Luo, “Towards COVID-19 fake news detection using transformer-based models,” 2023, doi: 10.1016/j.knosys.2023.110642.
S. F. N. Azizah, H. D. Cahyono, S. W. Sihwi, and W. Widiarto, “Performance analysis of transformer based models (BERT, ALBERT and RoBERTa) in fake news detection,” 2023. doi: 10.1109/ICOIACT59844.2023.10455849.
J. Wu, J. Guo, and B. Hooi, “Fake news in sheep’s clothing: Robust fake news detection against LLM-empowered style attacks,” in in Proc. 30th ACM SIGKDD Conf. Knowledge Discovery and Data Mining (KDD 2024), 2024, 2024, pp. 3367–3378. doi: 10.1145/3637528.3671977.
X. Zhou, J. Wu, and R. Zafarani, “SAFE: Similarity-aware multi-modal fake news detection,” 2020, doi: 10.1007/978 3-030-47436-2_27.
Y. Chen et al., “Cross-modal ambiguity learning for multimodal fake news detection,” in in Proc. ACM Web Conf. (WWW 2022), 2022, pp. 2897-29051145/3485447.3511968, 2022. doi: 10.1145/3485447.3511968.
S. Qian, J. Wang, J. Hu, Q. Fang, and C. Xu, “Hierarchical multi-modal contextual attention network for fake news detection,” in in Proc. 44th Int. ACM SIGIR Conf. Research and Development in Information Retrieval (SIGIR 2021), 2021, pp. 153-1621145/3404835.3462871, 2021. doi: 10.1145/3404835.3462871.
Q. Ying, X. Hu, Y. Zhou, Z. Qian, D. Zeng, and S. Ge, “Bootstrapping multi-view representations for fake news detection,” in in Proc. AAAI Conf. Artificial Intelligence, vol. 37, no. 4, 2023, pp. 5384-53921609/aaai.v37i4.25670, 2023. doi: 10.1609/aaai.v37i4.25670.
I. Segura-Bedmar and S. Alonso-Bartolome, “Multimodal Fake News Detection,” Information, vol. 13, no. 6, p. 284, Jun. 2022, doi: 10.3390/info13060284.
M. Al-alshaqi, D. B. Rawat, and C. Liu, “A BERT-based multimodal framework for enhanced fake news detection using text and image data fusion,” Computers, vol. 14, no. 6, p. 237, 2025, doi: 10.3390/computers14060237.
J. Wang, Z. Zhu, C. Liu, R. Li, and X. Wu, “LLM-enhanced multimodal detection of fake news,” PLoS One, vol. 19, no. 10, p. e0312240, 2024, doi: 10.1371/journal.pone.0312240.
Y. Dou, K. Shu, C. Xia, P. S. Yu, and L. Sun, “User preference-aware fake news detection,” in in Proc. 44th Int. ACM SIGIR Conf. Research and Development in Information Retrieval (SIGIR 2021), 2021, pp. 2051-20551145/3404835.3462990, 2021. doi: 10.1145/3404835.3462990.
N. Mehta, M. L. Pacheco, and D. Goldwasser, “Tackling fake news detection by continually improving social context representations using graph neural networks,” in in Proc. 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022), 2022, pp. 1363-138018653/v1/2022.acl-long.97, 2022. doi: 10.18653/v1/2022.acl-long.97.
V.-H. Nguyen, K. Sugiyama, P. Nakov, and M.-Y. Kan, “FANG: Leveraging social context for fake news detection using graph representation,” in in Proc. 29th ACM Int. Conf. Information and Knowledge Management (CIKM 2020), 2020, pp. 1165-11741145/3340531.3412046, 2020. doi: 10.1145/3340531.3412046.
Y. Han, S. Karunasekera, and C. Leckie, “Graph Neural Networks with Continual Learning for Fake News Detection from Social Media,” arXiv Prepr. arXiv2007.03316, 2020, [Online]. Available: https://arxiv.org/abs/2007.03316
S. Koka, A. Vuong, and A. Kataria, “Evaluating the efficacy of large language models in detecting fake news: A comparative analysis,” 2024. doi: 10.48550/arXiv.2406.06584.
B. Hu et al., “Bad actor, good advisor: Exploring the role of large language models in fake news detection,” in in Proc. AAAI Conf. Artificial Intelligence, vol. 38, no. 20, 2024, pp. 22105-221131609/aaai.v38i20.30214, 2024. doi: 10.1609/aaai.v38i20.30214.
Q. Nan, Q. Sheng, J. Cao, B. Hu, D. Wang, and J. Li, “Let silence speak: Enhancing fake news detection with generated comments from large language models,” 2024. doi: 10.1145/3627673.3679519.
W. Jin et al., “Veracity-oriented context-aware large language models-based prompting optimization for fake news detection,” 2025, doi: 10.1155/int/5920142.
Y. Liu et al., “Detect, Investigate, Judge and Determine: A Knowledge-Guided Framework for Few-Shot Fake News Detection,” in Proceedings of the 25th IEEE International Conference on Data Mining (ICDM 2025), 2025, pp. 477–486. doi: 10.1109/ICDM65498.2025.00055.
J. Y. Khan, M. T. I. Khondaker, S. Afroz, G. Uddin, and A. Iqbal, “A benchmark study of machine learning models for online fake news detection,” Mach. Learn. with Appl., vol. 4, p. 100032, Jun. 2021, doi: 10.1016/j.mlwa.2021.100032.
K. Shu, D. Mahudeswaran, S. Wang, D. Lee, and H. Liu, “FakeNewsNet: A data repository with news content, social context, and spatiotemporal information for studying fake news on social media,” Big Data, vol. 8, no. 3, pp. 171–188, 2020, doi: 10.1089/big.2020.0062.
W. Y. Wang, “Liar, liar pants on fire: A new benchmark dataset for fake news detection,” in in Proc. 55th Annual Meeting of the Association for Computational Linguistics (ACL 2017), 2017, pp. 422-42618653/v1/P17-2067, 2017. doi: 10.18653/v1/P17-2067.
K. Nakamura, S. Levy, and W. Y. Wang, “Fakeddit: A new multimodal benchmark dataset for fine-grained fake news detection,” in in Proc. 12th Language Resources and Evaluation Conf. (LREC 2020), 2020, 2020, pp. 6149–6157.
L. Cui and D. Lee, “CoAID: COVID-19 Healthcare Misinformation Dataset,” arXiv Prepr. arXiv2006.00885, 2020, [Online]. Available: https://arxiv.org/abs/2006.00885
P. K. Verma, P. Agrawal, I. Amorim, and R. Prodan, “WELFake: Word Embedding Over Linguistic Features for Fake News Detection,” IEEE Trans. Comput. Soc. Syst., vol. 8, no. 4, pp. 881–893, Aug. 2021, doi: 10.1109/TCSS.2021.3068519.
D. S. Nielsen and R. McConville, “MuMiN: A large-scale multilingual multimodal fact-checked misinformation social network dataset,” in in Proc. 45th Int. ACM SIGIR Conf. Research and Development in Information Retrieval (SIGIR 2022), 2022, pp. 3141-31531145/3477495.3531744, 2022. doi: 10.1145/3477495.3531744.
D. Q. Nguyen and A. T. Nguyen, “PhoBERT: Pre-trained language models for Vietnamese,” 2020, doi: 10.18653/v1/2020.findings-emnlp.92.
A. Conneau et al., “Unsupervised Cross-lingual Representation Learning at Scale,” in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Stroudsburg, PA, USA: Association for Computational Linguistics, 2020, pp. 8440–8451. doi: 10.18653/v1/2020.acl-main.747.
C.-V. Nguyen Thi, T.-T. Vuong, D.-T. Le, and Q.-T. Ha, “v3MFND: A Deep Multi-Domain Multimodal Fake News Detection Model for Vietnamese,” in Asian Conference on Intelligent Information and Database Systems (ACIIDS 2022), in Lecture Notes in Artificial Intelligence, vol. 13757. 2022, pp. 608–620. doi: 10.1007/978-3-031-21743-2_49.
A.-T. Huynh and P. Tran, “Utilizing transformer models to detect Vietnamese fake news on social media platforms,” KSII Trans. Internet Inf. Syst., vol. 19, no. 2, pp. 472–487, 2025, doi: 10.3837/tiis.2025.02.006.
T. N. Hieu, H. C. N. Minh, H. T. Van, and B. V Quoc, “ReINTEL challenge 2020: Vietnamese fake news detection using ensemble model with PhoBERT embeddings,” in in Proc. 7th Workshop on Vietnamese Language and Speech Processing (VLSP 2020), 2020, 2020, pp. 1–5.
H. V. Trinh et al., “ReINTEL Challenge 2020: A Comparative Study of Hybrid Deep Neural Network for Reliable Intelligence Identification on Vietnamese SNSs,” in Proceedings of the 7th International Workshop on Vietnamese Language and Speech Processing, Hanoi, Vietnam: Association for Computational Linguistics, 2020, pp. 6–12. [Online]. Available: https://aclanthology.org/2020.vlsp-1.2/
N.-D. Pham, T.-H. Le, T.-D. Do, T.-T. Vuong, T.-H. Vuong, and Q.-T. Ha, “Vietnamese fake news detection based on hybrid transfer learning model and TF-IDF,” in in Proc. 2021 13th Int. Conf. on Knowledge and Systems Engineering (KSE), 2021, pp. 1-61109/KSE53942.2021.9648676, 2021. doi: 10.1109/KSE53942.2021.9648676.
K. D. Pham, D. Van Thin, and N. L.-T. Nguyen, “Improving Vietnamese Fake News Detection Based on Contextual Language Model and Handcrafted Features,” Sci. Technol. Dev. J., vol. 26, no. 2, pp. 2705–2712, 2023, doi: 10.32508/stdj.v26i1.3927.
T. H. Vo, T. L. T. Phan, and K. C. Ninh, “Development of a fake news detection tool for Vietnamese based on deep learning techniques,” Eastern-European J. Enterp. Technol., vol. 5, no. 2 (119), pp. 14–20, 2022, doi: 10.15587/1729-4061.2022.265317.
T. N. Le, K. T. B. Nguyen, and N. T. V Khanh, “An application of machine learning models in detecting Vietnamese fake news,” Int. J. Softw. Innov., vol. 12, no. 1, pp. 1–15, 2024, doi: 10.4018/IJSI.362623.
H. Rama Moorthy et al., “Dual Stream Graph Augmented Transformer Model Integrating BERT and GNNs for Context Aware Fake News Detection,” Sci. Rep., vol. 15, p. 25436, 2025, doi: 10.1038/s41598-025-05586-w.
M. Szczepanski, M. Pawlicki, R. Kozik, and M. Choras, “New explainability method for BERT-based model in fake news detection,” 2021, doi: 10.1038/s41598-021-03100-6.
K. Shu, L. Cui, S. Wang, D. Lee, and H. Liu, “dEFEND: Explainable fake news detection,” in in Proc. 25th ACM SIGKDD Int. Conf. Knowledge Discovery & Data Mining (KDD 2019), 2019, pp. 395-4051145/3292500.3330935, 2019. doi: 10.1145/3292500.3330935.
E. Hashmi, S. Y. Yayilgan, M. M. Yamin, S. Ali, and M. Abomhara, “Advancing fake news detection: Hybrid deep learning with FastText and explainable AI,” 2024, doi: 10.1109/ACCESS.2024.3381038.
T. Le, S. Wang, and D. Lee, “MALCOM: Generating malicious comments to attack neural fake news detection models,” in in Proc. IEEE Int. Conf. Data Mining (ICDM 2020), 2020, pp. 282-2911109/ICDM50108.2020.00037, 2020. doi: 10.1109/ICDM50108.2020.00037.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Long Dinh Tuan, Le Ngoc An, Dinh Thai Duong
This work is licensed under a Creative Commons Attribution 4.0 International License.
