Journal of Information Technology Management

Journal of Information Technology Management

Predicting Customer Lifetime Value Using Machine Learning Algorithms with Cross-Validation

Document Type : Research Paper

Authors
Department of Economics of Bank Management, College of Business Economics, Al-Nahrain University, Baghdad, Iraq.
10.22059/jitm.2026.109971
Abstract
This study highlights the importance of using machine learning (ML) algorithms to predict customer lifetime value (CLV) while ensuring fair and realistic treatment of datasets during the training process without favoring specific feature classes. The research applies several ML algorithms, including Gradient Boosting (GB), Logistic Regression (LR), Random Forest (RF), Linear Support Vector Machine (SVM), and Neural Network (NN), using a five-fold cross-validation technique for repeated training and testing. The RandomizedSearchCV method is used for hyperparameter tuning, along with data shuffling and fixed random seeds to ensure reproducibility. Model performance is evaluated using accuracy, precision, recall, F1-score, and ROC-AUC metrics through Python programming. The approach aims to achieve better behavioral understanding because of ML’s ability to handle large, mixed, and diversified datasets with reduced error after preprocessing and training, allowing models to generalize effectively to new data. The comparison results show that the Gradient Boosting algorithm achieved the statistically highest mean ROC-AUC among the evaluated algorithms, while NN achieved the highest holdout ROC-AUC; GB consistently outperformed NN based on the statistical comparison across the cross-validation folds.
Keywords

Abidar, L., Zaidouni, D., El Asri, I., & Ennouaary, A. (2023). Predicting customer segment changes to enhance customer retention: A case study for online retail using machine learning. International Journal of Advanced Computer Science and Applications (IJACSA), 14(7).
Akter, J., Roy, A., Rahman, S., Mohona, S., & Ara, J. (2025). Artificial intelligence-driven customer lifetime value (CLV) forecasting: Integrating RFM analysis with machine learning for strategic customer retention. Journal of Computer Science and Technology Studies, 7(1).
Ali, A. A. (2026). Mastering Python from fundamentals to advanced applications (1st ed.). Al-Nahrain University.
Ali, A., & Mashwani, W. K. (2023). Supervised machine learning algorithms: Applications, challenges, and recommendations. Proceedings of the Pakistan Academy of Sciences: Physical and Computational Sciences, 60(4).
Ali, N., & Shabn, O. S. (2024). Customer lifetime value (CLV) insights for strategic marketing success and its impact on organizational financial performance. Cogent Business & Management, 11(1), 2361321. https://doi.org/10.1080/23311975.2024.2361321
Alnuaimi, A. F. A. H., & Albaldawi, T. H. K. (2024). An overview of machine learning classification techniques. BIO Web of Conferences, 97, 00133. https://doi.org/10.1051/bioconf/20249700133
Blattberg, R. C., Malthouse, E. C., & Neslin, S. A. (2009). Customer lifetime value: Empirical generalizations and some conceptual questions. Journal of Interactive Marketing, 23, 157–168.
Carrington, A. M., Manuel, D. G., Fieguth, P., et al. (2022). Deep ROC analysis and AUC as balanced average accuracy, for improved classifier selection, audit and explanation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(1).
Gil, C. (2020). The end of marketing: Humanizing your brand in the age of social media and AI. Kogan Page.
Guolin, K., Meng, Q., Finley, T., Wang, T., Chen, W., et al. (2017). LightGBM: A highly efficient gradient boosting decision tree. Proceedings of the 31st International Conference on Neural Information Processing Systems.
Haddadi, A. M., & Hamidi, H. (2025). A hybrid model for improving customer lifetime value prediction using stacking ensemble learning algorithm. Computers in Human Behavior Reports, 18, 100616.
Ibrahim, A. A., & Kaml, B. S. (2024). Customer behavior prediction using machine learning with fuzzy multiple linear regression. Journal of Logistics, Informatics and Service Science, 11(10).
Insurance Authority. (2016). Motor vehicle insurance policy against loss and damage. Central Bank of the United Arab Emirates.
Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., et al. (2017). LightGBM: A highly efficient gradient boosting decision tree. Proceedings of the 31st International Conference on Neural Information Processing Systems.
Lumumba, V. W., Kiprotich, D., Mpaine, M. L., Makena, N. G., & Kavita, M. D. (2024). Comparative analysis of cross-validation techniques: LOOCV, K-fold cross-validation, and repeated K-fold cross-validation in machine learning models. American Journal of Theoretical and Applied Statistics, 13(5).
Mabel, E., Carter, E., & Hayes, M. (2025). Using RFM analysis to predict high-value customers. ResearchGate. Retrieved July 22, 2025, from https://www.researchgate.net/publication/392017535
Miller, C., Portlock, T., Nyaga, D. M., & O’Sullivan, J. M. (2024). A review of model evaluation metrics for machine learning in genetics and genomics. Frontiers in Bioinformatics, 4, 1457619. https://doi.org/10.3389/fbinf.2024.1457619
Natekin, A., & Knoll, A. (2013). Gradient boosting machines: A tutorial. Frontiers in Neurorobotics, 7, 21. https://doi.org/10.3389/fnbot.2013.00021
Obi, J. C. (2023). A comparative study of several classification metrics and their performances on data. World Journal of Advanced Engineering Technology and Sciences, 8(1).
Osisanwo, F. Y., Akinsola, J. E. T., Awodele, O., Hinmikaiye, J. O., Olakanmi, O., & Akinjobi, J. (2017). Supervised machine learning algorithms: Classification and comparison. International Journal of Computer Trends and Technology, 48(3), 128–138.
Platos, J. (2025). Fundamentals of machine learning evaluation metrics for machine learning. Department of Computer Science, Faculty of Electrical Engineering and Computer Science, VSB–Technical University of Ostrava.
Shanbharkar, A., Rakhade, V. M., & Yadav, L. N. (2024). Neural network. International Journal of Futuristic Innovation in Arts, Humanities and Management, 3.
Steurer, M., Hill, R. J., & Pfeifer, N. (2020). Metrics for evaluating the performance of machine learning-based automated valuation models. Paper presented at the 36th IARIW Virtual General Conference, University of Graz.
Tang, Y.-C., & Li, K.-H. (2023). A machine-learning approach to setting optimal thresholds and its application in rolling bearing fault diagnosis. Machine Learning: Science and Technology. https://doi.org/10.1088/2632-2153/ad0ab3
Vujović, Ž. Đ. (2021). Classification model evaluation metrics. International Journal of Advanced Computer Science and Applications (IJACSA), 12(6).