skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Attention:

The DOI auto-population feature in the Public Access Repository (PAR) will be unavailable from 4:00 PM ET on Tuesday, July 8 until 4:00 PM ET on Wednesday, July 9 due to scheduled maintenance. We apologize for the inconvenience caused.


Title: Using Role-Plays to Improve Ethical Understanding of Algorithms Among Computing Students
We present a Research-to-Practice paper where we used role-play case studies to improve student understanding of the ethics of algorithms. As the use of algorithmic decision-making continues to grow across areas of society, there is a need to prepare future technology workforce for ethical thinking related. Our work was informed by the situated learning paradigm, and our goal was to improve perspectival thinking among students. Recognizing an issue from multiple perspectives and taking on different perspectives to examine it leads to increased understanding. Drawing on this work, we created and implemented a role-play case study in an undergraduate computing data mining course. The role-play case study focused on the use of algorithms for facial recognition. Data were collected from pre-and post- discussion assignments, and a student survey. Thirty-one students enrolled in the course and completed the ethics module. The data collected in the assignments focused on student's recognition of ethical dilemmas, the change in student's perspective on the case due to creating a collaborative consensus and understanding the complexity of algorithmic decision making. To formally analyze the data, we created a coding schema drawing on the literature and preliminary qualitative analysis of our data. The data were independently coded by multiple coders. The findings indicate that through their participation in collaborative role-play scenarios, students were able to recognize a wide range of issues and offer potential solutions. We discuss the implications of the work. Curriculum material created as part of this work is available as an open education resource.  more » « less
Award ID(s):
1937950
PAR ID:
10314609
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Frontiers of Education
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The omnipresence of software systems across all aspects of society has necessitated that future technology professionals are aware of ethical concerns raised by the design and development of software and are trained to minimize harm by undertaking responsible engineering. This need has become even more urgent with artificial intelligence (AI) driven software deployment. In this paper we present a study of an interactive pedagogical intervention – role-play case studies – designed to teach undergraduate technology students about ethics with a focus on software systems. Drawing on the situated learning perspective from the Learning Sciences, we created case studies, associated stakeholder roles, discussion scripts, and pre and post discussion assignments to guide students’ learning. Open-ended data was collected from thirty-nine students and analyzed qualitatively. Findings from the study show that by taking on different perspectives on a problem, students were able to identify a range of ethical issues and understand the role of the software system process holistically, taking context, complexity, and trade-offs into account. In their discussion and reflections, students deliberated the role of software in society and the role of humans in automation. The curricula, including case studies, are publicly available for implementation. 
    more » « less
  2. Case studies are among the most popular and effective pedagogical techniques in ethics education. In this paper, we present a framework to develop and effectively use one type of case study: role-plays. We argue that role-plays are particularly effective for allowing students to think through complex problems and bridge multi-level issues, a core concern of ethics education. The fictional case implemented in the study presented here focuses on the use of algorithms for making lending decisions. The case narrative and its associated roles highlight and emphasize the interdependent and intertwined individual and societal perspectives. Thirty-six students consented to the research study in the course where the role-plays were implemented. Student responses related to their engagement with the role were analyzed. We found that participants moved between the multi-level perspectives in the case, identified ethical principles at each level, and connected case examples to real-world occurrences. Overall, using role-plays strongly encouraged students to appreciate the complexity of technology. This work is part of a larger project on using role-play case studies, and in our conclusions, we draw implications from our overall findings. 
    more » « less
  3. Algorithms are a central component of most services we use across a range of domains. These services, platforms, and devices rely on computing and technology professionals – who work as data scientists, programmers, or artificial intelligence (AI) experts – to meet their intended goals. How do we train future professionals to have an ethical mindset in their understanding, design, and implementation of algorithms? This was the question that prompted the use of a role-playing case study, which we designed, implemented, and studied in an undergraduate engineering course. We used the Boeing Max 8 flight disaster as the scenario for this case study as it encapsulates how a software algorithm shapes decision-making in a complex scenario. Theoretically, our work is guided by the situated learning paradigm, specifically the need to learn perspectival thinking for decision-making. The ability to make ethical decisions relies to a large extent on the ability of the decision-maker to take context into account – to understand not just the immediate technical need of the work but also larger implications that might even result from unanticipated consequences. Findings from the evaluation of the role-play scenario show that students reported a higher engagement with case study material and a better understanding of the scenario due to taking on a specific role related to the scenario. Analysis of pre-and post-discussion assignments shows a shift in their perspective of the case, further supporting the overall goal of developing a more situated understanding of ethical decision-making. 
    more » « less
  4. There is a lack of access to critical knowledge on machine ethics and the impacts of technology on individuals and communities in everyday life. This project pioneers an inclusive curriculum design process to broaden accessibility to machine ethics education. Our approach uses a ''source'' course to develop materials for seven "target" courses. The source course is a machine ethics curriculum development course in which students and faculty collaboratively build curricular materials for integration into non-computer science courses. Here we describe the development of the ''source'' course using a curriculum co-creation process that leverages student and faculty expertise. The process emphasizes an inclusive design approach, rooted in continuous stakeholder feedback and consistent, transparent communication. The products of this process include course materials that incorporate underrepresented ethical frameworks. Additionally, it features peer-reviewed journal assignments that promote reflective learning and sharing of diverse perspectives, as well as a final module project in which students collaborate with faculty to co-create curricular materials. Our approach aims to broaden a culturally relevant understanding of ethical challenges in technology while ensuring that the curriculum resonates with diverse student backgrounds. Our presentation will describe key insights about the process and products of our curriculum design. 
    more » « less
  5. We contend a better way to teach ethics to freshman engineering students would be to address engineering ethics not solely in the abstract of philosophy or moral development, but as situated in the everyday decisions of engineers. Since everyday decisions are not typically a part of university courses, our approach in large lecture classes is to simulate engineering decision-making situations using the role-playing mechanic and narrative structure of a fictional choose-your-own-adventure. Drawing on the contemporary learning theory of situated learning [1], [2], such playful learning may enable instructors to create assignments that induce students to break free of the typical student mindset of finding the “right” answer. Mars: An Ethical Expedition! is an interactive, 12 week, narrative game about the colonization of Mars by various engineering specialists. Students take on the role of a head engineer and are presented with situations that require high-stakes decision-making. Various game mechanics induce students to act as they would on-the-fly, within a real engineering project context, using personal reasoning and richly context-dependent justifications, rather than simply right/wrong answers. Each segment of the game is presented in audio and text that ends with a binary decision that determines what will happen next in the story. Historically, this game had been led by an instructor and played weekly, as a whole-class assignment, completed at the beginning of class. The class votes and the majority option is presented next. In addition to the central decision, there are also follow-up questions at the end of each week that provoke deeper analysis of the situation and reflection on the ethical principles involved. This prototype was initially developed within a learning management system, then supported by the TwineTM game engine, and studied in use in our 2021 NSF EETHICS grant. In 2022-23 the game was redesigned and extended using the GodotTM game engine. In addition to streamlining the gameplay loop and reducing the set-up and data management required by instructors, this redesign supported instructors with an option to allow the game to be student-paced and played by individual students or to keep the instructor-led 12 week whole-class playstyle. Our proposed driving research question is "In what ways does individual student play differ from whole class instructor-led play with regard to learning that ethical behavior is situated?" In the next phase of our ongoing investigation, we plan to further evaluate the use of playful assessment to estimate its validity and reliability in comparison to current best practices of engineering ethics assessment. 
    more » « less