PREDICTING CONSUMER PURCHASE BEHAVIOR TOWARD THE PREMIUM VERSION OF A FINTECH MOBILE APPLICATION: A SUPERVISED MACHINE LEARNING APPROACH
DOI:
https://doi.org/10.56596/jrefm.v5i1.202Keywords:
Fintech Mobile Applications, Supervised Machine Learning, Consumer Behavior Prediction, XGBoost, Premium Subscription ConversionAbstract
Financial technology (FinTech) companies are increasingly using behavioral data to better comprehend consumers’ choice of upgrading their free mobile banking app to a premium app, instead of traditional survey instruments. This study uses a commercial bank's FinTech application behavioral data set of 50,000 customers to predict which customers who are on a free plan will upgrade to the paid premium plan, using seven supervised machine learning classifiers: Decision Tree, K-Nearest Neighbors, Naïve Bayes, Random Forest, Logistic Regression, Support Vector Machine and XGBoost. After data cleaning, feature engineering and feature correlation-based feature selection, the models were trained on an 80/20 split and tested with accuracy, precision, recall, F1-score, as well as ROC-AUC. The best overall result (accuracy = 0.79, ROC-AUC = 0.84) was obtained by XGBoost, followed by Support Vector Machine, while Decision Tree had the worst results in all five measures. One of the most important behavioral metrics that influenced conversion was the number of screens that the user visited during the trial period. The number of screens visited during the trial period proved to be one of the most important behavioral metrics that influenced conversion. The results provide an actionable, data-informed targeting approach for reducing the costs of marketing to the wrong audience, whilst enhancing premium conversion marketing initiatives by FinTech providers, and complement the increasing body of literature on machine learning applications in digital financial services
References
Alonso Robisco, A., & Carbó Martínez, J. M. (2022). Measuring the model risk-adjusted performance of machine learning algorithms in credit default prediction. Financial Innovation, 8, Article 70. https://doi.org/10.1186/s40854-022-00366-1
Arora, N., & Kaur, P. (2020). A Bolasso-based consistent feature selection-enabled random forest classification algorithm: An application to credit risk assessment. Applied Soft Computing, 86, Article 105936. https://doi.org/10.1016/j.asoc.2019.105936
Aslam, F., Awan, T. M., & Fatima, T. (2022). Classification of m-payment users' behavior using machine learning models. Journal of Financial Services Marketing, 27, 264–275. https://doi.org/10.1057/s41264-021-00114-z
Bajari, P., Nekipelov, D., Ryan, S. P., & Yang, M. (2015). Machine learning methods for demand estimation. American Economic Review, 105(5), 481–485. https://doi.org/10.1257/aer.p20151021
Belanche, D., Casaló, L. V., & Flavián, C. (2019). Artificial intelligence in FinTech: Understanding robo-advisors adoption among customers. Industrial Management & Data Systems, 119(7), 1411–1430. https://doi.org/10.1108/IMDS-08-2018-0368
Blanco-Oliver, A., Lara-Rubio, J., Irimia-Diéguez, A., & Liébana-Cabanillas, F. (2024). Examining user behavior with machine learning for effective mobile peer-to-peer payment adoption. Financial Innovation, 10, Article 94. https://doi.org/10.1186/s40854-024-00625-3
Breiman, L. (1996). Bagging predictors. Machine Learning, 24(2), 123–140. https://doi.org/10.1007/BF00058655
Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32. https://doi.org/10.1023/A:1010933404324
Cao, L., Yu, P. S., & Kumar, V. (2015). Non-occurring behavior analytics: A new area. IEEE Intelligent Systems, 30(6), 4–11. https://doi.org/10.1109/MIS.2015.105
Chan, J. Y., Leow, S. M., Bea, K. T., Cheng, W. K., Phoong, S. W., Hong, Z. W., & Chen, Y. L. (2022). Mitigating the multicollinearity problem and its machine learning approach: A review. Mathematics, 10(8), Article 1283. https://doi.org/10.3390/math10081283
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002). SMOTE: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, 16, 321–357. https://doi.org/10.1613/jair.953
Chen, T., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 785–794). Association for Computing Machinery. https://doi.org/10.1145/2939672.2939785
Chen, W., Yang, K., Yu, Z., Shi, Y., & Chen, C. L. P. (2024). A survey on imbalanced learning: Latest research, applications and future directions. Artificial Intelligence Review, 57, Article 137. https://doi.org/10.1007/s10462-024-10684-8
Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273–297. https://doi.org/10.1007/BF00994018
Cover, T. M., & Hart, P. E. (1967). Nearest neighbor pattern classification. IEEE Transactions on Information Theory, 13(1), 21–27. https://doi.org/10.1109/TIT.1967.1053964
Davenport, T., Guha, A., Grewal, D., & Bressgott, T. (2020). How artificial intelligence will change the future of marketing. Journal of the Academy of Marketing Science, 48(1), 24–42. https://doi.org/10.1007/s11747-019-00696-0
Duda, R. O., Hart, P. E., & Stork, D. G. (2001). Pattern classification (2nd ed.). Wiley-Interscience.
Fahimifar, S., Mousavi, K., Mozaffari, F., & Ausloos, M. (2023). Identification of the most important external features of highly cited scholarly papers through 3 (i.e., Ridge, Lasso, and Boruta) feature selection data mining methods. Quality & Quantity, 57(1), 671–692. https://doi.org/10.1007/s11135-022-01480-z
Fares, O. H., Butt, I., & Lee, S. H. M. (2023). Utilization of artificial intelligence in the banking sector: A systematic literature review. Journal of Financial Services Marketing, 28, 835–852. https://doi.org/10.1057/s41264-022-00176-7
Flavián, C., Pérez-Rueda, A., Belanche, D., & Casaló, L. V. (2022). Intention to use analytical artificial intelligence (AI) in services—The effect of technology readiness and awareness. Journal of Service Management, 33(2), 293–320. https://doi.org/10.1108/JOSM-10-2020-0378
Freund, Y., & Schapire, R. E. (1997). A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55(1), 119–139. https://doi.org/10.1006/jcss.1997.1504
Friedman, J., Hastie, T., & Tibshirani, R. (2000). Additive logistic regression: A statistical view of boosting. The Annals of Statistics, 28(2), 337–407. https://doi.org/10.1214/aos/1016218223
Friedman, J., Hastie, T., & Tibshirani, R. (2009). The elements of statistical learning: Data mining, inference, and prediction (2nd ed.). Springer.
Gomber, P., Koch, J.-A., & Siering, M. (2017). Digital finance and FinTech: Current research and future research directions. Journal of Business Economics, 87(5), 537–580. https://doi.org/10.1007/s11573-017-0852-x
Guitart, A., Tan, S. H., Fernández del Río, A., Chen, P. P., & Periáñez, Á. (2019). From non-paying to premium: Predicting user conversion in video games with ensemble learning. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (pp. 2373–2376). Association for Computing Machinery. https://doi.org/10.1145/3357384.3358163
Guo, M., Zhang, Q., Liao, X., Chen, F. Y., & Zeng, D. D. (2021). A hybrid machine learning framework for analyzing human decision-making through learning preferences. Omega, 101, Article 102263. https://doi.org/10.1016/j.omega.2020.102263
Géron, A. (2019). Hands-on machine learning with Scikit-Learn, Keras, and TensorFlow (2nd ed.). O'Reilly Media.
Han, J., Kamber, M., & Pei, J. (2012). Data mining: Concepts and techniques (3rd ed.). Morgan Kaufmann.
He, H., & Garcia, E. A. (2009). Learning from imbalanced data. IEEE Transactions on Knowledge and Data Engineering, 21(9), 1263–1284. https://doi.org/10.1109/TKDE.2008.239
Hemmatian, J., Hajizadeh, R., Nazari, F., Akbar, S., & Imoize, A. L. (2025). Addressing imbalanced data classification with Cluster-Based Reduced Noise SMOTE. PLOS ONE, 20(2), Article e0317396. https://doi.org/10.1371/journal.pone.0317396
Higueras-Castillo, E., Liébana-Cabanillas, F. J., & Villarejo-Ramos, Á. F. (2023). Intention to use e-commerce vs. physical shopping: Difference between consumers in the post-COVID era. Journal of Business Research, 157, Article 113622. https://doi.org/10.1016/j.jbusres.2023.113622
Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013). Applied logistic regression (3rd ed.). Wiley.
Irimia-Diéguez, A., Velicia-Martín, F., & Aguayo-Camacho, M. (2023). Predicting FinTech innovation adoption: The mediator role of social norms and attitudes. Financial Innovation, 9, Article 36. https://doi.org/10.1186/s40854-022-00434-6
James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013). An introduction to statistical learning: With applications in R. Springer.
Jünger, M., & Mietzner, M. (2020). Banking goes digital: The adoption of FinTech services by German households. Finance Research Letters, 34, Article 101260. https://doi.org/10.1016/j.frl.2019.08.008
Kotsiantis, S. B., Kanellopoulos, D., & Pintelas, P. E. (2006). Handling imbalanced datasets: A review. GESTS International Transactions on Computer Science and Engineering, 30(1), 25–36.
Kuhn, M., & Johnson, K. (2013). Applied predictive modeling. Springer.
Lee, M., & Kim, W. C. (2025). Predicting mobile payment behavior through explainable machine learning and application usage analysis. Journal of Theoretical and Applied Electronic Commerce Research, 20(2), Article 117. https://doi.org/10.3390/jtaer20020117
Lee, V. H., Hew, J. J., Leong, L. Y., Tan, G. W. H., & Ooi, K. B. (2020). Wearable payment: A deep learning-based dual-stage SEM–ANN analysis. Expert Systems with Applications, 157, Article 113477. https://doi.org/10.1016/j.eswa.2020.113477
Leong, L. Y., Hew, J. J., Wong, L. W., & Lin, B. (2022). The past and beyond of mobile payment research: A development of the mobile payment framework. Internet Research, 32(6), 1757–1782. https://doi.org/10.1108/INTR-04-2021-0245
Lundberg, S. M., & Lee, S.-I. (2017). A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems (Vol. 30, pp. 4765–4774).
Ma, S., & Fildes, R. (2020). Forecasting third-party mobile payments with implications for customer flow prediction. International Journal of Forecasting, 36(3), 739–760. https://doi.org/10.1016/j.ijforecast.2019.08.012
Mantello, P., Ho, M.-T., Nguyen, M.-H., & Vuong, Q.-H. (2023). Machines that feel: Behavioral determinants of attitude towards affect recognition technology. Humanities and Social Sciences Communications, 10, Article 1. https://doi.org/10.1057/s41599-023-01837-1
Manzoor, A., Qureshi, M. A., Kidney, E., & Longo, L. (2024). A review on machine learning methods for customer churn prediction and recommendations for business practitioners. IEEE Access, 12, 70434–70463. https://doi.org/10.1109/ACCESS.2024.3402092
Martín, A., Fernández-Isabel, A., Martín de Diego, I., & Beltrán, M. (2021). A survey for user behavior analysis based on machine learning techniques: Current models and applications. Applied Intelligence, 51(9), 6029–6055. https://doi.org/10.1007/s10489-020-02160-x
Murphy, K. P. (2012). Machine learning: A probabilistic perspective. MIT Press.
Nguyen, D. K., Sermpinis, G., & Stasinakis, C. (2023). Big data, artificial intelligence and machine learning: A transformative symbiosis in favor of financial technology. European Financial Management, 29(2), 517–548. https://doi.org/10.1111/eufm.12365
Petropoulos, A., Siakoulis, V., Stavroulakis, E., & Vlachogiannakis, N. E. (2020). Predicting bank insolvencies using machine learning techniques. International Journal of Forecasting, 36(3), 1092–1113. https://doi.org/10.1016/j.ijforecast.2019.11.005
Quinlan, J. R. (1986). Induction of decision trees. Machine Learning, 1(1), 81–106. https://doi.org/10.1007/BF00116251
Ullah, S., Kiani, U. S., Raza, B., & Mustafa, A. (2022). Consumers' intention to adopt m-payment/m-banking: The role of their financial skills and digital literacy. Frontiers in Psychology, 13, Article 873708. https://doi.org/10.3389/fpsyg.2022.873708
Weber, P., Carl, K. V., & Hinz, O. (2024). Applications of explainable artificial intelligence in finance—A systematic review of finance, information systems, and computer science literature. Management Review Quarterly, 74, 867–907. https://doi.org/10.1007/s11301-023-00320-0
Xie, C., Zhang, J.-L., Zhu, Y., Xiong, B., & Wang, G.-J. (2023). How to improve the success of bank telemarketing? Prediction and interpretability analysis based on machine learning. Computers & Industrial Engineering, 175, Article 108874. https://doi.org/10.1016/j.cie.2022.108874
Xiong, T., Ma, Z., Li, Z., & Dai, J. (2022). The analysis of influence mechanism for internet financial fraud identification and user behavior based on machine learning approaches. International Journal of System Assurance Engineering and Management, 13(3), 996–1007. https://doi.org/10.1007/s13198-021-01181-0
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Abdul Aziz, Roshan Ali , Mazhar Ali Dootio

This work is licensed under a Creative Commons Attribution 4.0 International License.
This work published in the journal is licensed under a Creative Commons Attribution 4.0 International License
.

