An official website of the United States government
Counterfactuals – expressing what might have been true under different circumstances – have been widely applied in statistics and machine learning to help understand causal relationships. More recently, counterfactuals have begun to emerge as a technique being applied within visualization research. However, it remains unclear to what extent counterfactuals can aid with visual data communication. In this paper, we primarily focus on assessing the quality of users’ understanding of data when provided with counterfactual visualizations. We propose a preliminary model of causality comprehension by connecting theories from causal inference and visual data communication. Leveraging this model, we conducted an empirical study to explore how counterfactuals can improve users’ understanding of data in static visualizations. Our results indicate that visualizing counterfactuals had a positive impact on participants’ interpretations of causal relations within datasets. These results motivate a discussion of how to more effectively incorporate counterfactuals into data visualizations.
more »
« less
Sufficient Causes: On Oxygen, Matches, and Fires
Abstract We demonstrate how counterfactuals can be used to compute the probability that one event was/is a sufficient cause of another, and how counterfactuals emerge organically from basic scientific knowledge, rather than manipulative experiments. We contrast this demonstration with the potential outcome framework and address the distinction between causes and enablers.
more »
« less
- Award ID(s):
- 1704932
- PAR ID:
- 10180287
- Date Published:
- Journal Name:
- Journal of Causal Inference
- Volume:
- 7
- Issue:
- 2
- ISSN:
- 2193-3685
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Post-hoc explanations of machine learning models are crucial for people to understand and act on algorithmic predictions. An intriguing class of explanations is through counterfactuals, hypothetical examples that show people how to obtain a different prediction. We posit that effective counterfactual explanations should satisfy two properties: feasibility of the counterfactual actions given user context and constraints, and diversity among the counterfactuals presented. To this end, we propose a framework for generating and evaluating a diverse set of counterfactual explanations based on determinantal point processes. To evaluate the actionability of counterfactuals, we provide metrics that enable comparison of counterfactual-based methods to other local explanation methods. We further address necessary tradeoffs and point to causal implications in optimizing for counterfactuals. Our experiments on four real-world datasets show that our framework can generate a set of counterfactuals that are diverse and well approximate local decision boundaries, outperforming prior approaches to generating diverse counterfactuals. We provide an implementation of the framework at https://github.com/microsoft/DiCE.more » « less
-
Counterfactuals are often described as 'retrospective,' focusing on hypothetical alternatives to a realized past. This description relates to an often implicit assumption about the structure and stability of exogenous variables in the system being modeled --- an assumption that is reasonable in many settings where counterfactuals are used. In this work, we consider cases where we might reasonably make a different assumption about exogenous variables; namely, that the exogenous noise terms of each unit do exhibit some unit-specific structure and/or stability. This leads us to a different use of counterfactuals --- a forward-looking rather than retrospective counterfactual. We introduce "counterfactual treatment choice," a type of treatment choice problem that motivates using forward-looking counterfactuals. We then explore how mismatches between interventional versus forward-looking counterfactual approaches to treatment choice, consistent with different assumptions about exogenous noise, can lead to counterintuitive results.more » « less
-
Counterfactuals are often described as 'retrospective,' focusing on hypothetical alternatives to a realized past. This description relates to an often implicit assumption about the structure and stability of exogenous variables in the system being modeled –– an assumption that is reasonable in many settings where counterfactuals are used. In this work, we consider cases where we might reasonably make a different assumption about exogenous variables, namely, that the exogenous noise terms of each unit do exhibit some unit-specific structure and/or stability. This leads us to a different use of counterfactuals — a 'forward-looking' rather than 'retrospective' counterfactual. We introduce counterfactual treatment choice, a type of treatment choice problem that motivates using forward-looking counterfactuals. We then explore how mismatches between interventional versus forward-looking counterfactual approaches to treatment choice, consistent with different assumptions about exogenous noise, can lead to counterintuitive results.more » « less
-
Abstract The ability to engage in counterfactual thinking (reason about what elsecouldhave happened) is critical to learning, agency, and social evaluation. However, not much is known about how individual differences in counterfactual reasoning may play a role in children's social evaluations. In the current study, we investigate how prompting children to engage in counterfactual thinking about positive moral actions impacts children's social evaluations. Eighty‐seven 4‐8‐year‐olds were introduced to a character who engaged in a positive moral action (shared a sticker with a friend) and asked about whatelsethe character could have done with the sticker (counterfactual simulation). Children were asked to generate either a high number of counterfactuals (five alternative actions) or a low number of counterfactuals (one alternative action). Children were then asked a series of social evaluation questions contrasting that character with one who did not have a choice and had no alternatives (was told to give away the sticker to his friend). Results show that children who generatedselfishcounterfactuals were more likely to positively evaluate the character with choice than children who did not generate selfish counterfactuals, suggesting that generating counterfactuals most distant from the chosen action (prosociality) leads children to view prosocial actions more positively. We also found age‐related changes: as children got older, regardless of the type of counterfactuals generated, they were more likely to evaluate the character with choice more positively. These results highlight the importance of counterfactual reasoning in the development of moral evaluations. Research HighlightsOlder children were more likely to endorse agents whochooseto share over those who do not have a choice.Children who were prompted to generate more counterfactuals were more likely to allocate resources to characters with choice.Children who generated selfish counterfactuals more positively evaluated agents with choice.Comparable to theories suggesting children punish willful transgressors more than accidental transgressors, we propose children also consider free will when making positive moral evaluations.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1515/jci-2019-0026
