skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Better Anticipating Unintended Consequences
If people want the benefits of innovations, must they simply accept the unintended adverse consequences? Versions of this question haunt many who care about the social implications of technology. Technological design processes could include impact assessment steps, but not all do. Adoption in the marketplace may ignore spillover effects. Jurisprudence is often reactive and focused on remediating obvious wrongs. Public policy also often requires evidence of harm before legislators or administrators are willing to act. The failure to anticipate adverse consequences is sometimes framed as a moral lapse, but it could equally be about competence or incentives. This paper considers the relative merits of methodology (analogizing, interpolating, projecting,) and procedure (reflecting, reasoning, discourse) as systematic approaches to anticipating unintended consequences of innovation. It weighs the efficacy of such approaches against current reactive remedies, highlighting the importance of tailoring approach to context, and building in early learning opportunities (observing and testing). Several examples suggest that society is often playing catch-up and trying to avoid adverse consequences before the innovation is widely deployed rather than before it is initially introduced.  more » « less
Award ID(s):
2021628
PAR ID:
10524574
Author(s) / Creator(s):
Publisher / Repository:
IEEE
Date Published:
Journal Name:
IEEE Transactions on Technology and Society
ISSN:
2637-6415
Page Range / eLocation ID:
1 to 1
Subject(s) / Keyword(s):
Futurism philosophical considerations risk analysis social implications of technology technology forecasting uncertainty unintended consequences
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; (, Proceedings Article published 10 Mar 2020 in 2020 Research on Equity and Sustained Participation in Engineering, Computing, and Technology (RESPECT))
    null (Ed.)
    This experience report provides insights into the unintended consequences of five states efforts to make computer science education policy changes in an effort to broaden participation in computing (BPC). At the 2019 Expanding Computing Education Pathways (ECEP) meeting, several member-states were invited to share about the unintended consequences of computer science education policy reform in their states. Due to the nature of policy making and implementation, marginalized communities including students, practitioners, and under resourced schools are most impacted by education policy reform efforts. As computer science education gains traction as an education policy priority in states and districts, it is important to learn the lessons of past education policy failures and successes, specifically how these policies could trigger unintended consequences that will impact the broadening of participation within K-12 computer science education. The examples put forth by the states include unintended consequences of policies such as making CS count as a graduation requirement, defining computer science, developing CS standards, and teacher certification. These experienced unintended consequences may be relevant to other states seeking to make CS policy changes. This paper concludes with a reflection on the ECEP model as a tool for mitigating these unintended consequences as part of the BPC efforts. 
    more » « less
  2. ; ; ; (, Environmental Data Science)
    Abstract Given the growing use of Artificial intelligence (AI) and machine learning (ML) methods across all aspects of environmental sciences, it is imperative that we initiate a discussion about the ethical and responsible use of AI. In fact, much can be learned from other domains where AI was introduced, often with the best of intentions, yet often led to unintended societal consequences, such as hard coding racial bias in the criminal justice system or increasing economic inequality through the financial system. A common misconception is that the environmental sciences are immune to such unintended consequences when AI is being used, as most data come from observations, and AI algorithms are based on mathematical formulas, which are often seen as objective. In this article, we argue the opposite can be the case. Using specific examples, we demonstrate many ways in which the use of AI can introduce similar consequences in the environmental sciences. This article will stimulate discussion and research efforts in this direction. As a community, we should avoid repeating any foreseeable mistakes made in other domains through the introduction of AI. In fact, with proper precautions, AI can be a great tool to helpreduceclimate and environmental injustice. We primarily focus on weather and climate examples but the conclusions apply broadly across the environmental sciences. 
    more » « less
  3. ; ; ; (, Menopause)
    Objective:To discuss the potential for adverse consequences that could arise from the quest to prolong the functional life span of the human ovary. Methods:A series of arguments are presented that: (a) question the dogma that monthly ovulatory menstrual cycles are critical for women’s health; (b) review adverse consequences of decades of menstrual cyclicity; (c) review the evidence for a longevity benefit of ovarian steroid hormone treatment after the age at natural menopause has been achieved; and (d) utilize a mathematical model of ovarian follicle loss over time to raise the possibility that current strategies directed at delaying menopause might well backfire and in fact cause a woman to have a prolonged menopause transition. Results:Regular, monthly menstrual cycles have not been the reality for women for most of history. Rather, when not pregnant, lactational amenorrhea and nutritionally based hypothalamic amenorrhea were the norm for reproductive-aged women. Moreover, monthly menstrual cycles cause substantial morbidity for women during their reproductive years. Providing steroid hormones after menopause has failed to demonstrate an increase in the female life span. Restoring ovarian follicles either surgically or medically has a high probability of causing women to spend more years of life in the menopause transition. Conclusions:Strategies to prevent or delay menopause would benefit from careful consideration of unintended consequences as they are implemented. Directing treatment trials to those with the greatest chance for benefit should be undertaken before adopting this type of treatment for a broader population. 
    more » « less
  4. ; ; (, Conservation Biology)
    Abstract Increasingly intensive strategies to maintain biodiversity and ecosystem function are being deployed in response to global anthropogenic threats, including intentionally introducing and eradicating species via assisted migration, rewilding, biological control, invasive species eradications, and gene drives. These actions are highly contentious because of their potential for unintended consequences. We conducted a global literature review of these conservation actions to quantify how often unintended outcomes occur and to elucidate their underlying causes. To evaluate conservation outcomes, we developed a community assessment framework for systematically mapping the range of possible interaction types for 111 case studies. Applying this tool, we quantified the number of interaction types considered in each study and documented the nature and strength of intended and unintended outcomes. Intended outcomes were reported in 51% of cases, a combination of intended outcomes and unintended outcomes in 26%, and strictly unintended outcomes in 10%. Hence, unintended outcomes were reported in 36% of all cases evaluated. In evaluating overall conservations outcomes (weighing intended vs. unintended effects), some unintended effects were fairly innocuous relative to the conservation objective, whereas others resulted in serious unintended consequences in recipient communities. Studies that assessed a greater number of community interactions with the target species reported unintended outcomes more often, suggesting that unintended consequences may be underreported due to insufficient vetting. Most reported unintended outcomes arose from direct effects (68%) or simple density‐mediated or indirect effects (25%) linked to the target species. Only a few documented cases arose from more complex interaction pathways (7%). Therefore, most unintended outcomes involved simple interactions that could be predicted and mitigated through more formal vetting. Our community assessment framework provides a tool for screening future conservation actions by mapping the recipient community interaction web to identify and mitigate unintended outcomes from intentional species introductions and eradications for conservation. 
    more » « less
  5. ; ; ; (, Proceedings of the USENIX conference)
    Security & Privacy (S&P) software is created to have positive impacts on people: to protect them from surveillance and attacks, enhance their privacy, and keep them safe. Despite these positive intentions, S&P software can have unintended consequences, such as enabling and protecting criminals, misleading people into using the software with a false sense of security, and being inaccessible to users without strong technical backgrounds or with specific accessibility needs. In this study, through 14 semi-structured expert interviews with S&P software creators, we explore whether and how S&P software creators foresee and mitigate unintended consequences. We find that unintended consequences are often overlooked and ignored. When addressed, they are done in unstructured ways—often ad hoc and just based on user feedback—thereby shifting the burden to users. To reduce this burden on users and more effectively create positive change, we recommend S&P software creators to proactively consider and mitigate unintended consequences through increasing awareness and education, promoting accountability at the organizational level to mitigate issues, and using systematic toolkits for anticipating impacts. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email