Improving Credit Card Fraud Detection with Ensemble Deep Learning-Based Models: A Hybrid Approach Using SMOTE-ENN
DOI:
https://doi.org/10.62411/jcta.12021Keywords:
Credit Card Frauds Detection, Credit Card transaction datasets, Deep learning-based ensemble models, Imbalanced datasets, Synthetic minority over-sampling technique with edited nearest neighborsAbstract
Advances in information and internet technologies have significantly transformed the business environment, including the financial sector. The COVID-19 pandemic has further accelerated this digital adoption, expanding the e-commerce industry and highlighting the necessity for secure online transactions. Credit Card Fraud Detection (CCFD) stands critical as the prevalence of fraudulent activities continues to rise with the increasing volume of online transactions. Traditional methods for detecting fraud, such as rule-based systems and basic machine learning models, tend to fail to keep pace with fraudsters' evolving tactics. This study proposes a novel ensemble deep learning-based approach that combines Convolutional Neural Networks (CNN), Gated Recurrent Units (GRU), and Multilayer Perceptron (MLP) with the Synthetic Minority Oversampling Technique and Edited Nearest Neighbors (SMOTE-ENN) to address class imbalance and improve detection accuracy. The methodology integrates CNN for feature extraction, GRU for sequential transaction analysis, and Multilayer Perceptron (MLP) as a meta-learner in a stacking framework. By leveraging SMOTE-ENN, the proposed approach enhances data balance and prevents overfitting. With synthetic data, the robustness and accuracy of the model have been improved, particularly in scenarios where fraudulent examples are scarce. The experiments conducted on real-world credit card transaction datasets have established that our approach outperforms existing methods, achieving higher metrics performance.References
A. Cherif, A. Badhib, H. Ammar, S. Alshehri, M. Kalkatawi, and A. Imine, “Credit card fraud detection in the era of disruptive technologies: A systematic review,” J. King Saud Univ. - Comput. Inf. Sci., vol. 35, no. 1, pp. 145–174, Jan. 2023, doi: 10.1016/j.jksuci.2022.11.008.
M. Fang, J. Yin, and X. Zhu, “Transfer Learning across Networks for Collective Classification,” in 2013 IEEE 13th International Conference on Data Mining, Dec. 2013, pp. 161–170. doi: 10.1109/ICDM.2013.116.
V. Van Vlasselaer et al., “APATE: A novel approach for automated credit card transaction fraud detection using network-based extensions,” Decis. Support Syst., vol. 75, pp. 38–48, Jul. 2015, doi: 10.1016/j.dss.2015.04.013.
V. Arora, R. S. Leekha, K. Lee, and A. Kataria, “Facilitating User Authorization from Imbalanced Data Logs of Credit Cards Using Artificial Intelligence,” Mob. Inf. Syst., vol. 2020, no. 1, pp. 1–13, Oct. 2020, doi: 10.1155/2020/8885269.
J. Karthika and A. Senthilselvi, “An integration of deep learning model with Navo Minority Over-Sampling Technique to detect the frauds in credit cards,” Multimed. Tools Appl., vol. 82, no. 14, pp. 21757–21774, Jun. 2023, doi: 10.1007/s11042-023-14365-6.
R. Banger, “Modern Deep Learning Techniques for Credit Card Fraud Detection: A Review (2019 to 2023),” ResearchGate. 2023. doi: 10.13140/RG.2.2.32173.67043.
I. D. Mienye and Y. Sun, “A Deep Learning Ensemble With Data Resampling for Credit Card Fraud Detection,” IEEE Access, vol. 11, pp. 30628–30638, 2023, doi: 10.1109/ACCESS.2023.3262020.
N. L. Fitriyani, M. Syafrudin, G. Alfian, C. Yang, J. Rhee, and S. M. Ulyah, “Chronic Disease Prediction Model Using Integration of DBSCAN, SMOTE-ENN, and Random Forest,” in 2022 ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS), Jun. 2022, pp. 289–294. doi: 10.1109/ICETSIS55481.2022.9888806.
S. Mishra et al., “Improving the Accuracy of Ensemble Machine Learning Classification Models Using a Novel Bit-Fusion Algorithm for Healthcare AI Systems,” Front. Public Heal., vol. 10, p. 858282, May 2022, doi: 10.3389/fpubh.2022.858282.
E. Esenogho, I. D. Mienye, T. G. Swart, K. Aruleba, and G. Obaido, “A Neural Network Ensemble With Feature Engineering for Improved Credit Card Fraud Detection,” IEEE Access, vol. 10, pp. 16400–16407, 2022, doi: 10.1109/ACCESS.2022.3148298.
Y. Xie, G. Liu, C. Yan, C. Jiang, and M. Zhou, “Time-Aware Attention-Based Gated Network for Credit Card Fraud Detection by Extracting Transactional Behaviors,” IEEE Trans. Comput. Soc. Syst., vol. 10, no. 3, pp. 1004–1016, Jun. 2023, doi: 10.1109/TCSS.2022.3158318.
P. R. Vardhani, Y. I. Priyadarshini, and Y. Narasimhulu, “CNN Data Mining Algorithm for Detecting Credit Card Fraud,” in Soft Computing and Medical Bioinformatics, 2019, pp. 85–93. doi: 10.1007/978-981-13-0059-2_10.
C. M. Nalayini, J. Katiravan, A. R. Sathyabama, P. V Rajasuganya, and K. Abirami, “Identification and Detection of Credit Card Frauds Using CNN,” in International Conference on Computers, Management & Mathematical Sciences, Springer, 2023, pp. 267–280. doi: 10.1007/978-3-031-25194-8_22.
K. Fu, D. Cheng, Y. Tu, and L. Zhang, “Credit Card Fraud Detection Using Convolutional Neural Networks,” in Neural Information Processing: 23rd International Conference, {ICONIP} 2016, Kyoto, Japan, October 16–21, 2016, Proceedings, Part {III} 23, Springer, 2016, pp. 483–490. doi: 10.1007/978-3-319-46675-0_53.
D. S. Sisodia, N. K. Reddy, and S. Bhandari, “Performance evaluation of class balancing techniques for credit card fraud detection,” in 2017 IEEE International Conference on Power, Control, Signals and Instrumentation Engineering (ICPCSI), Sep. 2017, pp. 2747–2752. doi: 10.1109/ICPCSI.2017.8392219.
M. I. Akazue, I. A. Debekeme, A. E. Edje, C. Asuai, and U. J. Osame, “UNMASKING FRAUDSTERS: Ensemble Features Selection to Enhance Random Forest Fraud Detection,” J. Comput. Theor. Appl., vol. 1, no. 2, pp. 201–211, Dec. 2023, doi: 10.33633/jcta.v1i2.9462.
X. Li et al., “Transaction Fraud Detection Using GRU-centered Sandwich-structured Model,” in 2018 IEEE 22nd International Conference on Computer Supported Cooperative Work in Design ((CSCWD)), May 2018, pp. 467–472. doi: 10.1109/CSCWD.2018.8465147.
D. R. I. M. Setiadi, S. Widiono, A. N. Safriandono, and S. Budi, “Phishing Website Detection Using Bidirectional Gated Recurrent Unit Model and Feature Selection,” J. Futur. Artif. Intell. Technol., vol. 1, no. 2, pp. 75–83, Jul. 2024, doi: 10.62411/faith.2024-15.
A. Çetin and S. Öztürk, “Comprehensive Exploration of Ensemble Machine Learning Techniques for IoT Cybersecurity Across Multi-Class and Binary Classification Tasks,” J. Futur. Artif. Intell. Technol., vol. 1, no. 4, pp. 371–384, Feb. 2025, doi: 10.62411/faith.3048-3719-51.
Z. S. Dhahir, “A Hybrid Approach for Efficient DDoS Detection in Network Traffic Using CBLOF-Based Feature Engineering and XGBoost,” J. Futur. Artif. Intell. Technol., vol. 1, no. 2, pp. 174–190, Sep. 2024, doi: 10.62411/faith.2024-33.
A. Iqbal and R. Amin, “Time series forecasting and anomaly detection using deep learning,” Comput. Chem. Eng., vol. 182, p. 108560, Mar. 2024, doi: 10.1016/j.compchemeng.2023.108560.
A. Pathirana et al., “A Reinforcement Learning-Based Approach for Promoting Mental Health Using Multimodal Emotion Recognition,” J. Futur. Artif. Intell. Technol., vol. 1, no. 2, pp. 124–142, Sep. 2024, doi: 10.62411/faith.2024-22.
A. Roy, J. Sun, R. Mahoney, L. Alonzi, S. Adams, and P. Beling, “Deep learning detecting fraud in credit card transactions,” in 2018 Systems and Information Engineering Design Symposium (SIEDS), Apr. 2018, pp. 129–134. doi: 10.1109/SIEDS.2018.8374722.
M. Liang et al., “A Stacking Ensemble Learning Framework for Genomic Prediction,” Front. Genet., vol. 12, p. 600040, Mar. 2021, doi: 10.3389/fgene.2021.600040.
M. Y. Turaba, M. Hasan, N. I. Khan, and H. A. Rahman, “Fraud Detection During Financial Transactions Using Machine Learning and Deep Learning Techniques,” in 2022 International Conference on Communications, Computing, Cybersecurity, and Informatics (CCCI), Oct. 2022, pp. 1–8. doi: 10.1109/CCCI55352.2022.9926503.
Asniar, N. U. Maulidevi, and K. Surendro, “SMOTE-LOF for noise identification in imbalanced data classification,” J. King Saud Univ. - Comput. Inf. Sci., vol. 34, no. 6, pp. 3413–3423, Jun. 2022, doi: 10.1016/j.jksuci.2021.01.014.
C. Bhavani and A. Govardhan, “Cervical cancer prediction using stacked ensemble algorithm with SMOTE and RFERF,” Mater. Today Proc., vol. 80, pp. 3451–3457, 2023, doi: 10.1016/j.matpr.2021.07.269.
D. R. I. M. Setiadi, K. Nugroho, A. R. Muslikh, S. W. Iriananda, and A. A. Ojugo, “Integrating SMOTE-Tomek and Fusion Learning with XGBoost Meta-Learner for Robust Diabetes Recognition,” J. Futur. Artif. Intell. Technol., vol. 1, no. 1, pp. 23–38, May 2024, doi: 10.62411/faith.2024-11.
T. Le, M. T. Vo, B. Vo, M. Y. Lee, and S. W. Baik, “A Hybrid Approach Using Oversampling Technique and Cost‐Sensitive Learning for Bankruptcy Prediction,” Complexity, vol. 2019, no. 1, p. 8460934, Jan. 2019, doi: 10.1155/2019/8460934.
Z.-H. Zhou, Ensemble Methods. Chapman and Hall/CRC, 2012. doi: 10.1201/b12207.
J. Chung and K. Lee, “Credit Card Fraud Detection: An Improved Strategy for High Recall Using KNN, LDA, and Linear Regression,” Sensors, vol. 23, no. 18, p. 7788, Sep. 2023, doi: 10.3390/s23187788.
F. Zhang, “Improved credit card fraud detection method based on XGBoost algorithm,” BCP Bus. Manag., vol. 38, pp. 2888–2895, Mar. 2023, doi: 10.54691/bcpbm.v38i.4206.
J. Cook and V. Ramadas, “When to consult precision-recall curves,” Stata J. Promot. Commun. Stat. Stata, vol. 20, no. 1, pp. 131–148, Mar. 2020, doi: 10.1177/1536867X20909693.
M. Zhu, Y. Zhang, Y. Gong, C. Xu, and Y. Xiang, “Enhancing Credit Card Fraud Detection: A Neural Network and SMOTE Integrated Approach,” J. Theory Pract. Eng. Sci., vol. 4, no. 02, pp. 23–30, Feb. 2024, doi: 10.53469/jtpes.2024.04(02).04.
M. N. Yousuf Ali, T. Kabir, N. L. Raka, S. Siddikha Toma, M. L. Rahman, and J. Ferdaus, “SMOTE Based Credit Card Fraud Detection Using Convolutional Neural Network,” in 2022 25th International Conference on Computer and Information Technology (ICCIT), Dec. 2022, pp. 55–60. doi: 10.1109/ICCIT57492.2022.10054727.
I. Benchaji, S. Douzi, B. El Ouahidi, and J. Jaafari, “Enhanced credit card fraud detection based on attention mechanism and LSTM deep model,” J. Big Data, vol. 8, no. 1, p. 151, Dec. 2021, doi: 10.1186/s40537-021-00541-8.
E. Ajitha, S. Sneha, S. Makesh, and K. Jaspin, “A Comparative Analysis of Credit Card Fraud Detection with Machine Learning Algorithms and Convolutional Neural Network,” in 2023 International Conference on Advances in Computing, Communication and Applied Informatics (ACCAI), May 2023, pp. 1–8. doi: 10.1109/ACCAI58221.2023.10200905.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Lossan Bonde, Abdoul Karim Bichanga
This work is licensed under a Creative Commons Attribution 4.0 International License.
