AarXiv14 Sep 2025

Enhancing ML Models Interpretability for Credit Scoring

Schwartz, Sagi, Qinling Wang, Fang Fang

Abstract

Predicting default is essential for banks to ensure profitability and financial stability. While modern machine learning methods often outperform traditional regression techniques, their lack of transparency limits their use in regulated environments. Explainable artificial intelligence (XAI) has emerged as a solution in domains like credit scoring. However, most XAI research focuses on post-hoc interpretation of black-box models, which does not produce models lightweight or transparent enough to meet regulatory requirements, such as those for Internal Ratings-Based (IRB) models.

A figure from Enhancing ML Models Interpretability for Credit Scoring — fig. from the paper

§ The Valyu brief

The paper, in five minutes

Read from the full text via Valyu Contents

A hybrid XAI approach selects features with SHAP then trains transparent glass‑box models, achieving comparable credit‑scoring performance with 88.5% fewer features.

What’s new

i.Proposes a hybrid method that uses post‑hoc SHAP interpretations for feature selection followed by glass‑box model training.
ii.Demonstrates on the Lending Club dataset that the glass‑box models achieve performance comparable to XGBoost while using only 10 features, an 88.5% reduction.
iii.Applies model refinement through feature interaction analysis, correlation checks, and expert input to boost interpretability and robustness.
iv.Evaluates Explainable Boosting Machine (EBM) and Penalized Logistic Tree Regression (PLTR) as transparent alternatives to black‑box models.

How they did it

The authors applied SHAP to an XGBoost benchmark model to identify the most influential features, then trained glass‑box models (EBM and PLTR) on the reduced feature set. They used the public Lending Club dataset for training and evaluation, and further refined models using interaction analysis, correlation checks, and domain expert feedback.

What they found

The glass‑box models matched the benchmark’s predictive performance while using only 10 features, representing an 88.5% feature reduction.

§ The Valyu brief

Reading the full paper and taking notes. This takes a few seconds…

§ Ask this paper

Ask a question about this paper

Valyu reads the full text and answers from what the paper actually says.

§ Related work in other archives

Enhancing ML Models Interpretability for Credit Scoring

The paper, in five minutes

Ask a question about this paper

Similar papers in all four archives

The paper, in five minutes

Similar papers in all four archives