14 papers · ranked by Valyu relevance
Christian Oliva, Luis F. Lago-Fernández
The rapid adoption of deep learning models in high-risk domains has intensified the need for trustworthy Explainable Artificial Intelligence (XAI). However, objectively evaluating explanation fidelity and aligning XAI metrics with human-centered understanding remain critical open challenges. In this work, we propose a…
Othman Benchekroun, Adel Rahimi, Zhang Qi-ni, Tetiana Kodliuk
Explainable AI (XAI) is paramount in industrygrade AI; however existing methods fail to address this necessity, in part due to a lack of standardisation of explainability methods. The purpose of this paper is to offer a perspective on the current state of the area of explainability, and to provide novel definitions for…
Clive Gomes, Lalitha Natraj, Shijun Liu, Anushka Datta
In this survey paper, we deep dive into the field of Explainable Artificial Intelligence (XAI). After introducing the scope of this paper, we start by discussing what an "explanation" really is. We then move on to discuss some of the existing approaches to XAI and build a taxonomy of the most popular methods. Next, we…
Sheikh Rabiul Islam, William Eberle, Sheikh Ghafoor
Artificial Intelligence (AI) has become an integral part of domains such as security, finance, healthcare, medicine, and criminal justice. Explaining the decisions of AI systems in human terms is a key challenge—due to the high complexity of the model, as well as the potential implications on human interests, rights…
Ryan Zhou, Ting Hu
Machine learning models are increasingly being used in critical sectors, but their black-box nature has raised concerns about accountability and trust. The field of explainable artificial intelligence (XAI) or explainable machine learning (XML) has emerged in response to the need for human understanding of these…
George Paterakis, Andrea Castellani, George Papoutsoglou, Tobias Rodemann + 1 more
Artificial intelligence is reshaping science and industry, yet many users still regard its models as opaque "black boxes". Conventional explainable artificialintelligence methods clarify individual predictions but overlook the upstream decisions and downstream quality checks that determine whether insights can be…
Hoa Khanh Dam, Truyen Tran, Aditya Ghose
Software analytics has been the subject of considerable recent attention but is yet to receive significant industry traction. One of the key reasons is that software practitioners are reluctant to trust predictions produced by the analytics machinery without understanding the rationale for those predictions. While…
Kevin Fauvel, Véronique Masson, Élisa Fromont
Our research aims to propose a new performanceexplainability analytical framework to assess and benchmark machine learning methods. The framework details a set of characteristics that systematize the performance-explainability assessment of existing machine learning methods. In order to illustrate the use of the…
Sanjoy Dasgupta, Nave Frost, Michal Moshkovitz
We study the faithfulness of an explanation system to the underlying prediction model. We show that this can be captured by two properties, consistency and sufficiency, and introduce quantitative measures of the extent to which these hold. Interestingly, these measures depend on the test-time data distribution. For a…
Ian Covert, Scott Lundberg, Su‐In Lee
Researchers have proposed a wide variety of model explanation approaches, but it remains unclear how most methods are related or when one method is preferable to another. We examine the literature and find that many methods are based on a shared principle of explaining by removing—essentially, measuring the impact of…
Gregory Plumb, Maruan Al-Shedivat, Eric P. Xing, Ameet Talwalkar
Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, which lack guarantees about their explanation quality. We propose an alternative to these approaches by directly…
Ikhtiyor Nematov, Dimitris Sacharidis, Tomer Sagi, Katja Hose
Outliers Authors: ['Ikhtiyor Nematov' 'Dimitris Sacharidis' 'Tomer Sagi' 'Katja Hose'] Abstract. This study explores the impact of class outliers on the effectiveness of example-based explainability methods for black-box machine learning models. We reformulate existing explainability evaluation metrics, such as…
Kaivalya Rawal, Zihao Fu, Eoin Delaney, Chris Russell
There can be many competing and contradictory explanations for a single model prediction, making it difficult to select which one to use. Current explanation evaluation frameworks measure quality by comparing against ideal "ground-truth" explanations, or by verifying model sensitivity to important inputs. We outline…
Benjamin Leblanc, Pascal Germain
Interpretability and explainability have gained more and more attention in the field of machine learning as they are crucial when it comes to high-stakes decisions and troubleshooting. Since both provide information about predictors and their decision process, they are often seen as two independent means for one single…