Information Structures for Causally Explainable Decisions

Abstract

For an AI agent to make trustworthy decision recommendations under uncertainty on behalf of human principals, it should be able to explain why its recommended decisions make preferred outcomes more likely and what risks they entail. Such rationales use causal models to link potential courses of action to resulting outcome probabilities. They reflect an understanding of possible actions, preferred outcomes, the effects of action on outcome probabilities, and acceptable risks and trade-offs—the standard ingredients of normative theories of decision-making under uncertainty, such as expected utility theory. Competent AI advisory systems should also notice changes that might affect a user’s plans and goals. In response, they should apply both learned patterns for quick response (analogous to fast, intuitive “System 1” decision-making in human psychology) and also slower causal inference and simulation, decision optimization, and planning algorithms (analogous to deliberative “System 2” decision-making in human psychology) to decide how best to respond to changing conditions. Concepts of conditional independence, conditional probability tables (CPTs) or models, causality, heuristic search for optimal plans, uncertainty reduction, and value of information (VoI) provide a rich, principled framework for recognizing and responding to relevant changes and features of decision problems via both learned and calculated responses. This paper reviews how these and related concepts can be used to identify probabilistic causal dependencies among variables, detect changes that matter for achieving goals, represent them efficiently to support responses on multiple time scales, and evaluate and update causal models and plans in light of new data. The resulting causally explainable decisions make efficient use of available information to achieve goals in uncertain environments.

Designing Interpretable ML System to Enhance Trustworthy AI in Healthcare: A Systematic Review of the Last Decade to A Proposed Robust Framework

“…This shows it understands possible actions, desired results, and the impact of actions on outcomes. A robust AI system should also recognize changes in a user's plans and goals and respond quickly using learned patterns or take more time to think through the best response [151].…”

Time-Aware Explainable Recommendation via Updating Enabled Online Prediction

“…Recent years have seen a surge in approaches that achieve the explainability of recommendations [ 1 , 20 , 21 ]. There are several different lines of research to build explainable recommendations; in this paper, we focus on explainable KG-based recommendations that are capable of leveraging knowledge graph embeddings as rich content information to enhance both of the recommendation performance and explainability [ 12 , 17 ].…”

The Role of Instrumental Variables in Causal Inference Based on Independence of Cause and Mechanism

“…Thus, [24] provides a geometric interpretation of information flow as a causal inference. Speaking of probabilistic causal inference approaches, we would like to mention [25], which is a survey considering probabilistic causal dependencies among variables. Information theory is used in [26] to apply bivariate analysis to discover the causal skeleton for multivariate systems.…”