An official website of the United States government
We present a Research-to-Practice paper where we used role-play case studies to improve student understanding of the ethics of algorithms. As the use of algorithmic decision-making continues to grow across areas of society, there is a need to prepare future technology workforce for ethical thinking related. Our work was informed by the situated learning paradigm, and our goal was to improve perspectival thinking among students. Recognizing an issue from multiple perspectives and taking on different perspectives to examine it leads to increased understanding. Drawing on this work, we created and implemented a role-play case study in an undergraduate computing data mining course. The role-play case study focused on the use of algorithms for facial recognition. Data were collected from pre-and post- discussion assignments, and a student survey. Thirty-one students enrolled in the course and completed the ethics module. The data collected in the assignments focused on student's recognition of ethical dilemmas, the change in student's perspective on the case due to creating a collaborative consensus and understanding the complexity of algorithmic decision making. To formally analyze the data, we created a coding schema drawing on the literature and preliminary qualitative analysis of our data. The data were independently coded by multiple coders. The findings indicate that through their participation in collaborative role-play scenarios, students were able to recognize a wide range of issues and offer potential solutions. We discuss the implications of the work. Curriculum material created as part of this work is available as an open education resource.
more »
« less
Using the Boeing Max Air Disaster as A Role-play Scenario for Teaching Ethical Thinking
Algorithms are a central component of most services we use across a range of domains. These services, platforms, and devices rely on computing and technology professionals – who work as data scientists, programmers, or artificial intelligence (AI) experts – to meet their intended goals. How do we train future professionals to have an ethical mindset in their understanding, design, and implementation of algorithms? This was the question that prompted the use of a role-playing case study, which we designed, implemented, and studied in an undergraduate engineering course. We used the Boeing Max 8 flight disaster as the scenario for this case study as it encapsulates how a software algorithm shapes decision-making in a complex scenario. Theoretically, our work is guided by the situated learning paradigm, specifically the need to learn perspectival thinking for decision-making. The ability to make ethical decisions relies to a large extent on the ability of the decision-maker to take context into account – to understand not just the immediate technical need of the work but also larger implications that might even result from unanticipated consequences. Findings from the evaluation of the role-play scenario show that students reported a higher engagement with case study material and a better understanding of the scenario due to taking on a specific role related to the scenario. Analysis of pre-and post-discussion assignments shows a shift in their perspective of the case, further supporting the overall goal of developing a more situated understanding of ethical decision-making.
more »
« less
- Award ID(s):
- 1937950
- PAR ID:
- 10314608
- Date Published:
- Journal Name:
- 2021 ASEE Virtual Annual Conference
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This Innovative Practice Full Paper presents a novel, narrative, game-based approach to introducing first-year engineering students to concepts in ethical decision making. Approximately 250 first-year engineering students at the University of Connecticut played through our adventure, titled Mars: An Ethical Expedition, by voting weekly as a class on a presented dilemma. Literature shows that case studies still dominate learning sciences research on engineering ethical education, and that novel, active learning-based techniques, such as games, are infrequently used but can have a positive impact on both student engagement and learning. In this work, we suggest that games are a form of situated (context-based) learning, where the game setting provides learners with an authentic but safe space in which to explore engineering ethical choices and their consequences. As games normalize learning through failure, they present a unique opportunity for students to explore ethical decision making in a non-judgmental, playful, and safe way.We explored the situated nature of ethical decision making through a qualitative deconstruction of the weekly scenarios that students engaged with over the course of the twelve-week narrative. To assess their ethical reasoning, students took the Engineering Ethics Reasoning Instrument (EERI), a quantitative engineering ethics reasoning survey, at the beginning and end of the semester. The EERI scenarios were deconstructed to reveal their core ethical dilemmas, and then common elements between the EERI and our Mars adventure were compared to determine how students responded to similar ethical dilemmas presented in each context.We noted that students' responses to the ethical decisions in the Mars adventure scenarios were sometimes substantially different both from their response to the EERI scenario as well as from other decisions they made within the context of the game, despite the core ethical dilemma being the same. This suggests that they make ethical decisions in some situations that differ from a presumed abstract understanding of post-conventional moral reasoning. This has implications for how ethical reasoning can be taught and scaffolded in educational settings.more » « less
-
The Defining Issues Test 2 (DIT-2) and Engineering Ethical Reasoning Instrument (EERI) are designed to measure ethical reasoning of general (DIT-2) and engineering-student (EERI) populations. These tools—and the DIT-2 especially—have gained wide usage for assessing the ethical reasoning of undergraduate students. This paper reports on a research study in which the ethical reasoning of first-year undergraduate engineering students at multiple universities was assessed with both of these tools. In addition to these two instruments, students were also asked to create personal concept maps of the phrase “ethical decision-making.” It was hypothesized that students whose instrument scores reflected more postconventional levels of moral development and more sophisticated ethical reasoning skills would likewise have richer, more detailed concept maps of ethical decision-making, reflecting their deeper levels of understanding of this topic and the complex of related concepts. In fact, there was no significant correlation between the instrument scores and concept map scoring, suggesting that the way first-year students conceptualize ethical decision making does not predict the way they behave when performing scenario-based ethical reasoning (perhaps more situated). This disparity indicates a need to more precisely quantify engineering ethical reasoning and decision making, if we wish to inform assessment outcomes using the results of such quantitative analyses.more » « less
-
Abstract The Defining Issues Test 2 (DIT-2) and Engineering Ethical Reasoning Instrument (EERI) are designed to measure ethical reasoning of general (DIT-2) and engineering-student (EERI) populations. These tools—and the DIT-2 especially—have gained wide usage for assessing the ethical reasoning of undergraduate students. This paper reports on a research study in which the ethical reasoning of first-year undergraduate engineering students at multiple universities was assessed with both of these tools. In addition to these two instruments, students were also asked to create personal concept maps of the phrase “ethical decision-making.” It was hypothesized that students whose instrument scores reflected more postconventional levels of moral development and more sophisticated ethical reasoning skills would likewise have richer, more detailed concept maps of ethical decision-making, reflecting their deeper levels of understanding of this topic and the complex of related concepts. In fact, there was no significant correlation between the instrument scores and concept map scoring, suggesting that the way first-year studentsconceptualizeethical decision making does not predict the way they behave whenperformingscenario-based ethical reasoning (perhaps more situated). This disparity indicates a need to more precisely quantify engineering ethical reasoning and decision making, if we wish to inform assessment outcomes using the results of such quantitative analyses.more » « less
-
Ethical decision-making is difficult, certainly for robots let alone humans. If a robot's ethical decision-making process is going to be designed based on some approximation of how humans operate, then the assumption is that a good model of how humans make an ethical choice is readily available. Yet no single ethical framework seems sufficient to capture the diversity of human ethical decision making. Our work seeks to develop the computational underpinnings that will allow a robot to use multiple ethical frameworks that guide it towards doing the right thing. As a step towards this goal, we have collected data investigating how regular adults and ethics experts approach ethical decisions related to the use in a healthcare and game playing scenario. The decisions made by the former group is intended to represent an approximation of a folk morality approach to these dilemmas. On the other hand, experts were asked to judge what decision would result if a person was using one of several different types of ethical frameworks. The resulting data may reveal which features of the pill sorting and game playing scenarios contribute to similarities and differences between expert and non-expert responses. This type of approach to programming a robot may one day be able to rely on specific features of an interaction to determine which ethical framework to use in the robot's decision making.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
