skip to main content


Title: Who Gets What, According to Whom? An Analysis of Fairness Perceptions in Service Allocation
Algorithmic fairness research has traditionally been linked to the disciplines of philosophy, ethics, and economics, where notions of fairness are prescriptive and seek objectivity. Increasingly, however, scholars are turning to the study of what different people perceive to be fair, and how these perceptions can or should help to shape the design of machine learning, particularly in the policy realm. The present work experimentally explores five novel research questions at the intersection of the "Who," "What," and "How" of fairness perceptions. Specifically, we present the results of a multi-factor conjoint analysis study that quantifies the effects of the specific context in which a question is asked, the framing of the given question, and who is answering it. Our results broadly suggest that the "Who" and "What," at least, matter in ways that are 1) not easily explained by any one theoretical perspective, 2) have critical implications for how perceptions of fairness should be measured and/or integrated into algorithmic decision-making systems.  more » « less
Award ID(s):
1939579
NSF-PAR ID:
10310026
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Machines increasingly decide over the allocation of resources or tasks among people resulting in what we call Machine Allocation Behavior. People respond strongly to how other people or machines allocate resources. However, the implications for human relationships of algorithmic allocations of, for example, tasks among crowd workers, annual bonuses among employees, or a robot’s gaze among members of a group entering a store remains unclear. We leverage a novel research paradigm to study the impact of machine allocation behavior on fairness perceptions, interpersonal perceptions, and individual performance. In a 2 × 3 between-subject design that manipulates how the allocation agent is presented (human vs. artificial intelligent [AI] system) and the allocation type (receiving less vs. equal vs. more resources), we find that group members who receive more resources perceive their counterpart as less dominant when the allocation originates from an AI as opposed to a human. Our findings have implications on our understanding of the impact of machine allocation behavior on interpersonal dynamics and on the way in which we understand human responses towards this type of machine behavior. 
    more » « less
  2. Engineers are responsible to many stakeholders, including the public and their employer. One such responsibility is considering and accounting for the potential impacts and risks associated with a technology that they create. A relatively new, and potentially risky, technology that has been on the rise over the past two decades is social media. The advent of social media, such as Facebook and Twitter, and its integration into our daily lives raises questions about the duty engineers bear for its responsible usage and design versus the responsibilities users have as they use the technology. This paper analyzes qualitative interview data from a study on engineering students’ perceptions of engineering ethics and social responsibility to answer the following research question: In what ways do students change (or not change) how they talk about engineers’ social and professional responsibilities to the technologies they create when framed in the context of social media? Our findings show that mentioning social media as a specific application of engineering ethics rendered visible the relationship between engineers, users, and technology that students then utilized to address the broader question about engineers’ responsibility to the technologies they create. In this study, a total of 33 students from three U.S. universities were interviewed longitudinally, once in the first year of their degree and again in the fourth year. In the interviews, the students were asked about their views on the social and professional duties engineers have for the technologies they create, framed in the context of social media. Analysis of student responses involved open and axial coding of relevant interview portions performed by two researchers to identify common themes and longitudinal changes between student interviews. These themes included: communication between the engineer and user, collective responsibility, benefits to society, high quality engineering, and misinformation. While students typically maintained elements of their views across both interviews, it was also common to see students change their responses to include new themes or exclude themes present in their initial interview. The students tended to believe that engineers have a responsibility to think through potential uses (or misuses) of their technology, but also believe that the users share some responsibility to use the technology appropriately. When social media was mentioned specifically, some students believed that the users were entirely responsible for how the technology is used, occasionally contradicting their views of engineering ethics when probed without the context of social media. This paper highlights the central tension between user responsibility and engineer responsibility. By illuminating students’ views, it will support educators in opening a dialogue with their students about who is ultimately responsible for the design and use of new technologies. 
    more » « less
  3. This work in progress research paper considers the question, what kind of problems do engineering students commonly solve during their education? Engineering problems have been generally classified as ill-structured/open-ended or well-structured/closed-ended. Various authors have identified the characteristics of ill-structured problems or presented typologies of problems. Simple definitions state that well-structured problems are simple, concrete, and have a single solution, while ill-structured problems are complex, abstract, and have multiple possible solutions (Jonassen, 1997, 2000). More detailed classifications have been provided by Shin, Jonassen, and McGee (2003), Voss (2006), and Johnstone (2001). It is commonly understood that classroom problems are well-structured while workplace problems are ill-structured, but we cannot find any empirical data to confirm or deny this proposition. Engineers commonly encounter ill-structured problems such as design problems in the field therefore problem-solving skills are invaluable and should be taught in engineering courses. This research specifically looks at the types of problems present in the two most commonly used statics textbooks (Hibbeler, 2016; Beer, et al., 2019). All end-of-chapter problems in these textbooks were classified using Jonassen’s (2000) well-known typology of problem types. Out of 3,387 problems between both books, 99% fell into the algorithmic category and the remaining fell into the logic category. These preliminary results provide an understanding of the types of problems engineering students most commonly encounter in their classes. Prior research has documented that textbook example problems exert a strong influence on students' problem-solving strategies (Lee et al., 2013). If instructors only assign textbook problems, students in statics courses do not see any ill-structured problems at that stage in their education. We argue that even in foundational courses such as statics, students should be exposed to ill-structured problems. By providing opportunities for students to solve more ill-structured problems, students can become more familiar with them and become better prepared for the workforce. Moving forward, textbooks from several other courses will be analyzed to determine the difference between a fundamental engineering course such as statics and upper-level courses. This research will allow us to determine how the problem types differ between entry level and advanced classes and reveal if engineering textbooks primarily contain well-structured problems. Keywords: problem solving, textbooks, ill-structured problems 
    more » « less
  4. Broadening participation in engineering is critical given the gap between the nation’s need for engineering graduates and its production of them. Efforts to spark interest in engineering among PreK-12 students have increased substantially in recent years as a result. However, past research has demonstrated that interest is not always sufficient to help students pursue engineering majors, particularly for rural students. In many rural communities, influential adults (family, friends, teachers) are often the primary influence on career choice, while factors such as community values, lack of social and cultural capital, limited course availability, and inadequate financial resources act as potential barriers. To account for these contextual factors, this project shifts the focus from individual students to the communities to understand how key stakeholders and organizations support engineering as a major choice and addresses the following questions: RQ1. What do current undergraduate engineering students who graduated from rural high schools describe as influences on their choice to attend college and pursue engineering as a post-secondary major? RQ2. How does the college choice process differ for rural students who enrolled in a 4-year university immediately after graduating from high school and those who transferred from a 2-year institution? RQ3. How do community members describe the resources that serve as key supports as well as the barriers that hinder support in their community? RQ4. What strategies do community members perceive their community should implement to enhance their ability to support engineering as a potential career choice? RQ5. How are these supports transferable or adaptable by other schools? What community-level factors support or inhibit transfer and adaptation? To answer the research questions, we employed a three-phase qualitative study. Phase 1 focused on understanding the experiences and perceptions of current [University Name] students from higher-producing rural schools. Analysis of focus group and interview data with 52 students highlighted the importance of interest and support from influential adults in students’ decision to major in engineering. One key finding from this phase was the importance of community college for many of our participants. Transfer students who attended community college before enrolling at [University Name] discussed the financial influences on their decision and the benefits of higher education much more frequently than their peers. In Phase 2, we used the findings from Phase 1 to conduct interviews within the participants’ home communities. This phase helped triangulate students’ perceptions with the perceptions and practices of others, and, equally importantly, allowed us to understand the goals, attitudes, and experiences of school personnel and local community members as they work with students. Participants from the students’ home communities indicated that there were few opportunities for students to learn more about engineering careers and provided suggestions for how colleges and universities could be more involved with students from their community. Phase 3, scheduled for Spring 2020, will bring the findings from Phases 1 and 2 back to rural communities via two participatory design workshops. These workshops, designed to share our findings and foster collaborative dialogue among the participants, will enable us to explore factors that support or hinder transfer of findings and to identify policies and strategies that would enhance each community’s ability to support engineering as a potential career choice. 
    more » « less
  5. This research paper focuses on the effect of recent national events on first-year engineering students’ attitudes about their political identity, social welfare, perspectives of diversity, and approaches to social situations. Engineering classrooms and cultures often focus on mastery of content and technical expertise with little prioritization given to integrating social issues into engineering. This depoliticization (i.e., the removal of social issues) in engineering removes the importance of issues related to including diverse individuals in engineering, working in diverse teams, and developing cultural sensitivity. This study resulted from the shift in the national discourse, during the 2016 presidential election, around diversity and identities in and out of the academy. We were collecting interview data as a part of a larger study on students attitudes about diversity in teams. Because these national events could affect students’ perceptions of our research topic, we changed a portion of our interviews to discuss national events in science, technology, engineering, and mathematics (STEM) classrooms and how students viewed these events in relation to engineering. We interviewed first-year undergraduate students (n = 12) who indicated large differences of attitudes towards diverse individuals, experiences with diverse team members, and/or residing at the intersection of multiple diversity markers. We asked participants during the Spring of 2017 to reflect on the personal impact of recent national events and how political discussions have or have not been integrated into their STEM classrooms. During interviews students were asked: 1) Have recent national events impacted you in any way? 2) Have national events been discussed in your STEM classes? 3) If so, what was discussed and how was it discussed? 4) Do these conversations have a place in STEM classes? 5) Are there events you wish were discussed that have not been? Inductive coding was used to analyze interviews and develop themes that were audited for quality by the author team. Two preliminary themes emerged from analysis: political awareness and future-self impact. Students expressed awareness of current political events at the local, national and global levels. They recognized personal and social impacts that these events imposed on close friends, family members, and society. However, students were unsure of how to interpret political dialogue as it relates to policy in engineering disciplines and practices. This uncertainty led students to question their future-selves or careers in engineering. As participants continued to discuss their uncertainty, they expressed a desire to make explicit connections between politics and STEM and their eventual careers in STEM. These findings suggest that depoliticization in the classroom results in engineering students having limited consciousness of how political issues are relevant to their field. This disconnect of political discourse in the classroom gives us a better understanding of how engineering students make sense of current national events in the face of depoliticization. By re-politicising STEM classrooms in a way relevant to students’ futures, educators can better utilize important dialogues to help students understand how their role as engineers influence society and how the experiences of society can influence their practice of engineering. 
    more » « less