14 papers · ranked by Valyu relevance
Aniek F. Markus, Jan A. Kors, Peter R. Rijnbeek
Artificial intelligence (AI) has huge potential to improve the health and well-being of people, but adoption in clinical practice is still limited. Lack of transparency is identified as one of the main barriers to implementation, as clinicians should be confident the AI system can be trusted. Explainable AI has the…
Derek Doran, Sarah Schulz, Tarek R. Besold
We characterize three notions of explainable AI that cut across research fields: opaque systems that offer no insight into its algorithmic mechanisms; interpretable systems where users can mathematically analyze its algorithmic mechanisms; and comprehensible systems that emit symbols enabling user-driven explanations…
Yuhao Zhang, Jiaxin An, Ben Wang, Yan Zhang + 1 more
Human-centered explainability has become a critical foundation for the responsible development of interactive information systems, where users must be able to understand, interpret, and scrutinize AI-driven outputs to make informed decisions. This systematic survey of literature aims to characterize recent progress in…
Kacper Sokol, Peter Flach
Explainable artificial intelligence and interpretable machine learning are research domains growing in importance. Yet, the underlying concepts remain somewhat elusive and lack generally agreed definitions. While recent inspiration from social sciences has refocused the work on needs and expectations of human…
Sheikh Rabiul Islam, William Eberle, Sheikh Ghafoor
Artificial Intelligence (AI) has become an integral part of domains such as security, finance, healthcare, medicine, and criminal justice. Explaining the decisions of AI systems in human terms is a key challenge—due to the high complexity of the model, as well as the potential implications on human interests, rights…
Arno Leue, Akhila Bairy, Maike Schwammberger
Autonomous and software-intensive systems have been growing in occurrence, complexity, and assumed responsibility. Due to the high complexity of these systems, properties like transparency and explainability must be a focus of investigation. To date, no universally applicable definition and guide for the development of…
Kacper Sokol, Peter Flach
Explanations in Machine Learning come in many forms, but a consensus regarding their desired properties is yet to emerge. In this paper we introduce a taxonomy and a set of descriptors that can be used to characterise and systematically assess explainable systems along five key dimensions: functional, operational…
Kristijonas Čyras, Ramamurthy Badrinath, Swarup Kumar Mohalik, Anusha Mujumdar + 4 more
'Anusha Mujumdar' 'Alexandros Nikou' 'Alessandro Previti' 'Vaishnavi Sundararajan' 'Aneta Vulgarakis Feljan'] As a field of AI, Machine Reasoning (MR) uses largely symbolic means to formalize and emulate abstract reasoning. Studies in early MR have notably started inquiries into Explainable AI (XAI) – arguably one of…
Meike Nauta, Jan Trienes, Shreyasi Pathak, Elisa Nguyen + 5 more
'Michelle Peters' 'Yasmin Schmitt' 'Jörg Schlötterer' 'Maurice van Keulen' 'Christin Seifert'] MEIKE NAUTA, University of Twente, the Netherlands and University of Duisburg-Essen, Germany JAN TRIENES, University of Duisburg-Essen, Germany SHREYASI PATHAK, University of Twente, the Netherlands and University of…
Timo Speith
—The increasing complexity of software systems and the influence of software-supported decisions in our society have sparked the need for software that is safe, reliable, and fair. Explainability has been identified as a means to achieve these qualities. It is recognized as an emerging non-functional requirement (NFR)…
Valérie Beaudouin, Isabelle Bloch, David Bounie, Stéphan Clémençon + 5 more
'Florence d’Alché–Buc' 'James Eagan' 'Winston Maxwell' 'Pavlo Mozharovskyi' 'Jayneel Parekh'] The recent enthusiasm for artificial intelligence (AI) is due principally to advances in deep learning. Deep learning methods are remarkably accurate, but also opaque, which limits their potential use in safety-critical…
Francesco Sovrano, Salvatore Sapienza, Monica Palmirani, Fabio Vitali
'Fabio Vitali'] Abstract. This study discusses the interplay between metrics used to measure the explainability of the AI systems and the proposed EU Artificial Intelligence Act. A standardisation process is ongoing: several entities (e.g. ISO) and scholars are discussing how to design systems that are compliant with…
Avi Rosenfeld, Ariella Richardson
This paper presents a taxonomy of explainability in Human-Agent Systems. We consider fundamental questions about the Why, Who, What, When and How of explainability. First, we define explainability, and its relationship to the related terms of interpretability, transparency, explicitness, and faithfulness. These…
Daniel S. Weld, Gagan Bansal
Since Artificial Intelligence (AI) software uses techniques like deep lookahead search and stochastic optimization of huge neural networks to fit mammoth datasets, it often results in complex behavior that is difficult for people to understand. Yet organizations are deploying AI algorithms in many mission-critical…