skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Beyond killing one to save five: Sensitivity to ratio and probability in moral judgment
A great deal of current research on moral judgments centers on moral dilemmas concerning tradeoffs between one and five lives. Whether one considers killing one innocent person to save five others to be morally required or impermissible has been taken to determine whether one is appealing to consequentialist or non-consequentialist reasoning. But this focus on tradeoffs between one and five may obscure more nuanced commitments involved in moral decision-making that are revealed when the numbers and ratio of lives to be traded off are varied, and when the probabilities of each outcome occurring are less than certain. Four studies examine participants’ reactions to scenarios that diverge in these ways from the standard ones. Study 1 examines the extent to which people are sensitive to the ratio of lives saved to lives ended by a particular action. Study 2 verifies that the ratio rather than the difference between the two values is operative. Study 3 examines whether participants treat probabilistic harm to some as equivalent to certainly harming fewer, holding expected ratio constant. Study 4 explores an analogous issue regarding the sensitivity of probabilistic saving. Participants are remarkably sensitive to expected ratio for probabilistic harms while deviating from expected value for probabilistic saving. Collectively, the studies provide evidence that people’s moral judgments are consistent with the principle of threshold deontology.  more » « less
Award ID(s):
2049935
PAR ID:
10481523
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
Elsevier
Date Published:
Journal Name:
Journal of Experimental Social Psychology
Volume:
108
Issue:
C
ISSN:
0022-1031
Page Range / eLocation ID:
104499
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. When news about moral transgressions goes viral on social media, the same person may repeatedly encounter identical reports about a wrongdoing. In a longitudinal experiment ( N = 607 U.S. adults from Mechanical Turk), we found that these repeated encounters can affect moral judgments. As participants went about their lives, we text-messaged them news headlines describing corporate wrongdoings (e.g., a cosmetics company harming animals). After 15 days, they rated these wrongdoings as less unethical than new wrongdoings. Extending prior laboratory research, these findings reveal that repetition can have a lasting effect on moral judgments in naturalistic settings, that affect plays a key role, and that increasing the number of repetitions generally makes moral judgments more lenient. Repetition also made fictitious descriptions of wrongdoing seem truer, connecting this moral-repetition effect with past work on the illusory-truth effect. The more times we hear about a wrongdoing, the more we may believe it—but the less we may care. 
    more » « less
  2. When a group member commits wrongdoing, people sometimes assign responsibility and blame not only to the wrongdoer but also to other members of the same group. We examined such assignment of collective responsibility in the context of exploitation of one family by another. Participants were recruited from the United States and South Korea, which are known to vary in cultural norms and endorsement of collectivistic values. Participants in both countries rated the degree to which an agent (grandson) should be held responsible for his grandfather’s exploitation of a victimized family, while varying the closeness of familial connection. Participants’ responsibility judgments showed sensitivity to whether the grandson received financial benefit from the wrongdoer and to the perceived closeness between the grandson and the wrongdoer. Korean participants imposed greater responsibility on the agent than did American participants. Implications for understanding the influence of social norms on moral judgments are discussed. 
    more » « less
  3. For contractualist accounts of morality, actions are moral if they correspond to what rational or reasonable agents would agree to do, were they to negotiate explicitly. This, in turn, often depends on each party’s bargaining power, which varies with each party’s stakes in the potential agreement and available alternatives in case of disagreement. If there is an asymmetry, with one party enjoying higher bargaining power than another, this party can usually get a better deal, as often happens in real negotiations. A strong test of contractualist accounts of morality, then, is whether moral judgments do take bargaining power into account. We explore this in vive preregistered experiments (n = 3,025; U.S.-based Prolific participants). We construct scenarios depicting everyday social interactions between two parties in which one of them can perform a mutually beneficial but unpleasant action. We find that the same actions (asking the other to perform the unpleasant action or explicitly refusing to do it) are perceived as less morally appropriate when performed by the party with lower bargaining power, as compared to the party with higher bargaining power. In other words, participants tend to give more moral leeway to parties with better bargaining positions and to hold disadvantaged parties to stricter moral standards. This effect appears to depend only on the relative bargaining power of each party but not on the magnitude of the bargaining power asymmetry between them. We discuss implications for contractualist theories of moral cognition and the emergence and persistence of unfair norms and inequality. 
    more » « less
  4. Abstract Constraining the actions of AI systems is one promising way to ensure that these systems behave in a way that is morally acceptable to humans. But constraints alone come with drawbacks as in many AI systems, they are not flexible. If these constraints are too rigid, they can preclude actions that are actually acceptable in certain, contextual situations. Humans, on the other hand, can often decide when a simple and seemingly inflexible rule should actually be overridden based on the context. In this paper, we empirically investigate the way humans make these contextual moral judgements, with the goal of building AI systems that understand when to follow and when to override constraints. We propose a novel and general preference-based graphical model that captures a modification of standarddual processtheories of moral judgment. We then detail the design, implementation, and results of a study of human participants who judge whether it is acceptable to break a well-established rule:no cutting in line. We then develop an instance of our model and compare its performance to that of standard machine learning approaches on the task of predicting the behavior of human participants in the study, showing that our preference-based approach more accurately captures the judgments of human decision-makers. It also provides a flexible method to model the relationship between variables for moral decision-making tasks that can be generalized to other settings. 
    more » « less
  5. What is the fair way to distribute resources? Past research documents widespread egalitarianintuitions. Charitable donations show the prevalence of redistributive concerns. For recentcontractualist accounts of moral cognition, however, moral judgments should coincide with whatrational agents would agree to in a negotiation, and reflect each party’s relative bargainingpower. How can these perspectives be reconciled? We suggest a key difference lies in whetherthe logic of bargaining drives the underlying interaction, turning existing asymmetries intobargaining power differences. Participants (n = 887) make third-party judgments about themorally best split of a fixed amount. When the context is one of bilateral (Study 1) or third-party(Study 2) negotiation, moral judgments overwhelmingly track bargaining power differences, andcan be predicted with striking quantitative precision. In a closely matched donation setting inwhich the logic of bargaining is irrelevant, moral intuitions are completely reversed, insteadreflecting redistributive or egalitarian concerns. 
    more » « less