Beyond Accuracy: Leakage-Audited Machine Learning for Explainable Microcredit Risk Screening at Bank Mandiri
Abstract
Accuracy can misrank models when at-risk borrowers are rare and missed risk is costlier than unnecessary review. This study evaluates a leakage-audited, explainable machine-learning framework for microcredit risk screening at Bank Mandiri and addresses prior work that rarely links temporal feature availability, class imbalance, and asymmetric error costs. A quantitative cross-sectional experiment used 1,718 anonymized active-facility records from four Palembang microbusiness units. An audit reduced 29 candidate fields to 13 operational predictors. Logistic Regression, Decision Tree, and Random Forest were evaluated through a stratified 80:20 split and training-only fivefold cross-validation. A tuned Decision Tree achieved the highest test accuracy (96.22%; 331/344) but detected 15 of 24 at-risk facilities. Random Forest at a training-selected 0.46 threshold achieved 95.35% accuracy and detected 18 of 24. The accuracy difference was not significant (exact McNemar p = .607). Cost analysis showed that thresholded Random Forest becomes preferable when a false negative costs more than twice a false positive. Account liquidity explained 88.72% of Decision Tree impurity reduction. The study contributes a transparent governance rule connecting leakage control, interpretability, and asymmetric screening costs while preserving human oversight.
References
Bahlool, R., Hewahi, N., & Elmedany, W. (2026). Performance, fairness, and explainability in AI-based credit scoring: A systematic literature review. Journal of Risk and Financial Management, 19(2), 104. https://doi.org/10.3390/jrfm19020104
Branco, P., Torgo, L., & Ribeiro, R. P. (2016). A survey of predictive modeling on imbalanced domains. ACM Computing Surveys, 49(2), Article 31. https://doi.org/10.1145/2907070
Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32. https://doi.org/10.1023/A:1010933404324
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002). SMOTE: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, 16, 321–357. https://doi.org/10.1613/jair.953
Dumitrescu, E., Hué, S., Hurlin, C., & Tokpavi, S. (2022). Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects. European Journal of Operational Research, 297(3), 1178–1192. https://doi.org/10.1016/j.ejor.2021.06.053
Gu, Z., Lv, J., Wu, B., Hu, Z., & Yu, X. (2024). Credit risk assessment of small and micro enterprise based on machine learning. Heliyon, 10(5), e27096. https://doi.org/10.1016/j.heliyon.2024.e27096
Kapoor, S., & Narayanan, A. (2023). Leakage and the reproducibility crisis in machine-learning-based science. Patterns, 4(9), 100804. https://doi.org/10.1016/j.patter.2023.100804
Kpatcha, E. (2025). Balancing fairness and accuracy in machine learning-based probability of default modeling via threshold optimization. Journal of Risk and Financial Management, 18(12), 724. https://doi.org/10.3390/jrfm18120724
Lemaître, G., Nogueira, F., & Aridas, C. K. (2017). Imbalanced-learn: A Python toolbox to tackle the curse of imbalanced datasets in machine learning. Journal of Machine Learning Research, 18(17), 1–5. https://www.jmlr.org/papers/v18/16-365.html
Nahriana. (2024). Analysis of the health assessment level of cooperatives in view of NPL and investment levels in the MSME sector during the COVID-19 pandemic: Case study of the Berkah Savings and Loans Cooperative in Makassar City. International Journal of Education, Vocational and Social Science, 3(1), 47–58.
Noriega, J. P., Rivera, L. A., & Herrera, J. A. (2023). Machine learning for credit risk prediction: A systematic literature review. Data, 8(11), 169. https://doi.org/10.3390/data8110169
Otoritas Jasa Keuangan. (2019). Peraturan Otoritas Jasa Keuangan Nomor 40/POJK.03/2019 tentang penilaian kualitas aset bank umum. https://www.ojk.go.id
Otoritas Jasa Keuangan. (2025). Tata kelola kecerdasan artifisial perbankan Indonesia. https://www.ojk.go.id/id/Publikasi/Roadmap-dan-Pedoman/Perbankan/
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., & Duchesnay, É. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12(85), 2825–2830. https://jmlr.org/papers/v12/pedregosa11a.html
Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1, 206–215. https://doi.org/10.1038/s42256-019-0048-x
Suhadolnik, N., Ueyama, J., & da Silva, S. (2023). Machine learning for enhanced credit risk assessment: An empirical approach. Journal of Risk and Financial Management, 16(12), 496. https://doi.org/10.3390/jrfm16120496
Tahu, G. P. (2026). The influence of macroeconomic stability on financial performance, credit risk, and the resilience of the Indonesian banking sector. International Journal of Education, Vocational and Social Science, 5(3), 2985–3000.
Tu, J., & Wu, Z. (2025). Inherently interpretable machine learning for credit scoring: Optimal classification tree with hyperplane splits. European Journal of Operational Research, 322(2), 647–664. https://doi.org/10.1016/j.ejor.2024.10.046
Varma, S., & Simon, R. (2006). Bias in error estimation when using cross-validation for model selection. BMC Bioinformatics, 7, 91. https://doi.org/10.1186/1471-2105-7-91
Wulansari, & Purwitasari, D. (2023). Algoritma Random Forest pada prediksi status Kredit Usaha Rakyat untuk mengurangi non-performing loan rate. Journal of Intelligent System and Computation, 5(2), 109–114. https://doi.org/10.52985/insyst.v5i2.358

















Contact Person +6282139474255
Email : ijevss@citakonsultindo.or.id / editor.ijevss@gmail.com