CNR Author
operator:
and / or
Typology
operator:
and / or
Language
operator:
and / or
Date
operator:
and / or
Rights
operator:
and / or
2022
Journal article
Open Access
Stable and actionable explanations of black-box models through factual and counterfactual rules
Guidotti R., Monreale A., Ruggieri S., Naretto F., Turini F., Pedreschi D., Giannotti F.
Recent years have witnessed the rise of accurate but obscure classification models that hide the logic of their internal decision processes. Explaining the decision taken by a black-box classifier on a specific input instance is therefore of striking interest. We propose a local rule-based model-agnostic explanation method providing stable and actionable explanations. An explanation consists of a factual logic rule, stating the reasons for the black-box decision, and a set of actionable counterfactual logic rules, proactively suggesting the changes in the instance that lead to a different outcome. Explanations are computed from a decision tree that mimics the behavior of the black-box locally to the instance to explain. The decision tree is obtained through a bagging-like approach that favors stability and fidelity: first, an ensemble of decision trees is learned from neighborhoods of the instance under investigation; then, the ensemble is merged into a single decision tree. Neighbor instances are synthetically generated through a genetic algorithm whose fitness function is driven by the black-box behavior. Experiments show that the proposed method advances the state-of-the-art towards a comprehensive approach that successfully covers stability and actionability of factual and counterfactual explanations.Source: DATA MINING AND KNOWLEDGE DISCOVERY, vol. 38, pp. 2825-2862
DOI: 10.1007/s10618-022-00878-5
Project(s): NoBIAS
, TAILOR , HumanE-AI-Net , SAI: Social Explainable Artificial Intelligence , XAI , SoBigData-PlusPlus , SAI , Social Explainable Artificial Intelligence (SAI)
Metrics:
Guidotti R., Monreale A., Ruggieri S., Naretto F., Turini F., Pedreschi D., Giannotti F.
Recent years have witnessed the rise of accurate but obscure classification models that hide the logic of their internal decision processes. Explaining the decision taken by a black-box classifier on a specific input instance is therefore of striking interest. We propose a local rule-based model-agnostic explanation method providing stable and actionable explanations. An explanation consists of a factual logic rule, stating the reasons for the black-box decision, and a set of actionable counterfactual logic rules, proactively suggesting the changes in the instance that lead to a different outcome. Explanations are computed from a decision tree that mimics the behavior of the black-box locally to the instance to explain. The decision tree is obtained through a bagging-like approach that favors stability and fidelity: first, an ensemble of decision trees is learned from neighborhoods of the instance under investigation; then, the ensemble is merged into a single decision tree. Neighbor instances are synthetically generated through a genetic algorithm whose fitness function is driven by the black-box behavior. Experiments show that the proposed method advances the state-of-the-art towards a comprehensive approach that successfully covers stability and actionability of factual and counterfactual explanations.Source: DATA MINING AND KNOWLEDGE DISCOVERY, vol. 38, pp. 2825-2862
DOI: 10.1007/s10618-022-00878-5
Project(s): NoBIAS
, TAILOR , HumanE-AI-Net , SAI: Social Explainable Artificial Intelligence , XAI , SoBigData-PlusPlus , SAI , Social Explainable Artificial Intelligence (SAI) Metrics:
See at:
Archivio istituzionale della Ricerca - Scuola Normale Superiore 
| Archivio istituzionale della Ricerca - Scuola Normale Superiore | Archivio della Ricerca - Università di Pisa | Archivio della Ricerca - Università di Pisa | Software Heritage 
| Software Heritage | IRIS Cnr | GitHub | GitHub | GitHub | IRIS Cnr | CNR IRIS | IRIS Cnr