Beyond Accuracy: Leakage-Audited Machine Learning for Explainable Microcredit Risk Screening at Bank Mandiri

  • Puja Malika Information Systems Study Program, Universitas Bina Darma, Palembang, Indonesia
  • Ari Muzakir Information Systems Study Program, Universitas Bina Darma, Palembang, Indonesia
  • Evi Yulianingsih Information Systems Study Program, Universitas Bina Darma, Palembang, Indonesia
  • Maria Ulfa Information Systems Study Program, Universitas Bina Darma, Palembang, Indonesia
  • Nia Oktaviani Information Systems Study Program, Universitas Bina Darma, Palembang, Indonesia
Keywords: microcredit risk, data leakage, explainable machine learning, class imbalance, decision threshold

Abstract

Accuracy can misrank models when at-risk borrowers are rare and missed risk is costlier than unnecessary review. This study evaluates a leakage-audited, explainable machine-learning framework for microcredit risk screening at Bank Mandiri and addresses prior work that rarely links temporal feature availability, class imbalance, and asymmetric error costs. A quantitative cross-sectional experiment used 1,718 anonymized active-facility records from four Palembang microbusiness units. An audit reduced 29 candidate fields to 13 operational predictors. Logistic Regression, Decision Tree, and Random Forest were evaluated through a stratified 80:20 split and training-only fivefold cross-validation. A tuned Decision Tree achieved the highest test accuracy (96.22%; 331/344) but detected 15 of 24 at-risk facilities. Random Forest at a training-selected 0.46 threshold achieved 95.35% accuracy and detected 18 of 24. The accuracy difference was not significant (exact McNemar p = .607). Cost analysis showed that thresholded Random Forest becomes preferable when a false negative costs more than twice a false positive. Account liquidity explained 88.72% of Decision Tree impurity reduction. The study contributes a transparent governance rule connecting leakage control, interpretability, and asymmetric screening costs while preserving human oversight.

References

Akinjole, A., Shobayo, O., Popoola, J., Okoyeigbo, O., & Ogunleye, B. (2024). Ensemble-based machine learning algorithm for loan default risk prediction. Mathematics, 12(21), 3423. https://doi.org/10.3390/math12213423

Bahlool, R., Hewahi, N., & Elmedany, W. (2026). Performance, fairness, and explainability in AI-based credit scoring: A systematic literature review. Journal of Risk and Financial Management, 19(2), 104. https://doi.org/10.3390/jrfm19020104

Branco, P., Torgo, L., & Ribeiro, R. P. (2016). A survey of predictive modeling on imbalanced domains. ACM Computing Surveys, 49(2), Article 31. https://doi.org/10.1145/2907070

Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32. https://doi.org/10.1023/A:1010933404324

Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002). SMOTE: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, 16, 321–357. https://doi.org/10.1613/jair.953

Dumitrescu, E., Hué, S., Hurlin, C., & Tokpavi, S. (2022). Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects. European Journal of Operational Research, 297(3), 1178–1192. https://doi.org/10.1016/j.ejor.2021.06.053

Gu, Z., Lv, J., Wu, B., Hu, Z., & Yu, X. (2024). Credit risk assessment of small and micro enterprise based on machine learning. Heliyon, 10(5), e27096. https://doi.org/10.1016/j.heliyon.2024.e27096

Kapoor, S., & Narayanan, A. (2023). Leakage and the reproducibility crisis in machine-learning-based science. Patterns, 4(9), 100804. https://doi.org/10.1016/j.patter.2023.100804

Kpatcha, E. (2025). Balancing fairness and accuracy in machine learning-based probability of default modeling via threshold optimization. Journal of Risk and Financial Management, 18(12), 724. https://doi.org/10.3390/jrfm18120724

Lemaître, G., Nogueira, F., & Aridas, C. K. (2017). Imbalanced-learn: A Python toolbox to tackle the curse of imbalanced datasets in machine learning. Journal of Machine Learning Research, 18(17), 1–5. https://www.jmlr.org/papers/v18/16-365.html

Nahriana. (2024). Analysis of the health assessment level of cooperatives in view of NPL and investment levels in the MSME sector during the COVID-19 pandemic: Case study of the Berkah Savings and Loans Cooperative in Makassar City. International Journal of Education, Vocational and Social Science, 3(1), 47–58.

Noriega, J. P., Rivera, L. A., & Herrera, J. A. (2023). Machine learning for credit risk prediction: A systematic literature review. Data, 8(11), 169. https://doi.org/10.3390/data8110169

Otoritas Jasa Keuangan. (2019). Peraturan Otoritas Jasa Keuangan Nomor 40/POJK.03/2019 tentang penilaian kualitas aset bank umum. https://www.ojk.go.id

Otoritas Jasa Keuangan. (2025). Tata kelola kecerdasan artifisial perbankan Indonesia. https://www.ojk.go.id/id/Publikasi/Roadmap-dan-Pedoman/Perbankan/

Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., & Duchesnay, É. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12(85), 2825–2830. https://jmlr.org/papers/v12/pedregosa11a.html

Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1, 206–215. https://doi.org/10.1038/s42256-019-0048-x

Suhadolnik, N., Ueyama, J., & da Silva, S. (2023). Machine learning for enhanced credit risk assessment: An empirical approach. Journal of Risk and Financial Management, 16(12), 496. https://doi.org/10.3390/jrfm16120496

Tahu, G. P. (2026). The influence of macroeconomic stability on financial performance, credit risk, and the resilience of the Indonesian banking sector. International Journal of Education, Vocational and Social Science, 5(3), 2985–3000.

Tu, J., & Wu, Z. (2025). Inherently interpretable machine learning for credit scoring: Optimal classification tree with hyperplane splits. European Journal of Operational Research, 322(2), 647–664. https://doi.org/10.1016/j.ejor.2024.10.046

Varma, S., & Simon, R. (2006). Bias in error estimation when using cross-validation for model selection. BMC Bioinformatics, 7, 91. https://doi.org/10.1186/1471-2105-7-91

Wulansari, & Purwitasari, D. (2023). Algoritma Random Forest pada prediksi status Kredit Usaha Rakyat untuk mengurangi non-performing loan rate. Journal of Intelligent System and Computation, 5(2), 109–114. https://doi.org/10.52985/insyst.v5i2.358
Published
2026-09-11
How to Cite
Malika, P., Muzakir, A., Yulianingsih, E., Ulfa, M., & Oktaviani, N. (2026). Beyond Accuracy: Leakage-Audited Machine Learning for Explainable Microcredit Risk Screening at Bank Mandiri. International Journal of Education, Vocational and Social Science , 5(04), 846-865. https://doi.org/10.63922/ijevss.v5i04.6418