Taking the Whys Seriously: Limitations of Counterfactual Explanations in Justification and Recourse

Research from arXiv highlights significant limitations in the application of counterfactual explanations (CEs) within explainable artificial intelligence (AI), particularly when used for justification of decisions and providing algorithmic recourse. While CEs are widely used to illustrate how model outputs change with manipulated inputs, their naive application in real-life deployment settings can overlook critical, contestable choices made during model development, leading to insufficient or misleading explanations for stakeholders. The study emphasizes that the normative legitimacy of CEs for high-stakes purposes like justification and recourse requires stricter criteria than for other uses like model debugging.

The findings underscore a critical challenge in the responsible deployment and governance of AI systems, particularly concerning transparency and accountability. Organizations relying on AI for high-stakes decisions must re-evaluate their approaches to explaining and justifying these decisions to ensure normative legitimacy and avoid potential ethical or legal liabilities.

Counterfactual explanations (CEs) are a common technique in explainable AI to demonstrate changes in model outputs based on input feature manipulation.

Forward consideration, not a verified fact.