“For many critical applications in defense, medicine, finance, and law, explanations are essential for users to understand, trust, and effectively manage these new, artificially intelligent partners
The purpose of an explainable AI (XAI) system is to make its behavior more intelligible to humans by providing explanations.
Accuracy versus interpretability – Interpretability needs to consider tradeoffs involving accuracy and fidelity and to strike a balance between accuracy, interpretability, and tractability.”