An official website of the United States government
Research exploring how to support decision-making has often used machine learning to automate or assist human decisions. We take an alternative approach for improving decision-making, using machine learning to help stakeholders surface ways to improve and make fairer decision-making processes. We created "Deliberating with AI", a web tool that enables people to create and evaluate ML models in order to examine strengths and shortcomings of past decision-making and deliberate on how to improve future decisions. We apply this tool to a context of people selection, having stakeholders---decision makers (faculty) and decision subjects (students)---use the tool to improve graduate school admission decisions. Through our case study, we demonstrate how the stakeholders used the web tool to create ML models that they used as boundary objects to deliberate over organization decision-making practices. We share insights from our study to inform future research on stakeholder-centered participatory AI design and technology for organizational decision-making.
more »
« less
High school students’ data modeling practices and processes: From modeling unstructured data to evaluating automated decisions
It’s critical to foster artificial intelligence (AI) literacy for high school students, the first generation to grow up surrounded by AI, to understand working mechanism of data-driven AI technologies and critically evaluate automated decisions from predictive models. While efforts have been made to engage youth in understanding AI through developing machine learning models, few provided in-depth insights into the nuanced learning processes. In this study, we examined high school students’ data modeling practices and processes. Twenty-eight students developed machine learning models with text data for classifying negative and positive reviews of ice cream stores. We identified nine data modeling practices that describe students’ processes of model exploration, development, and testing and two themes about evaluating automated decisions from data technologies. The results provide implications for designing accessible data modeling experiences for students to understand data justice as well as the role and responsibility of data modelers in creating AI technologies.
more »
« less
- Award ID(s):
- 1949110
- PAR ID:
- 10416959
- Date Published:
- Journal Name:
- Learning, Media and Technology
- ISSN:
- 1743-9884
- Page Range / eLocation ID:
- 1 to 19
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)In this paper, we present a co-design study with teachers to contribute towards the development of a technology-enhanced Artificial Intelligence (AI) curriculum, focusing on modeling unstructured data. We created an initial design of a learning activity prototype and explored ways to incorporate the design into high school classes. Specifically, teachers explored text classification models with the prototype and reflected on the exploration as a user, learner, and teacher. They provided insights about learning opportunities in the activity and feedback for integrating it into their teaching. Findings from qualitative analysis demonstrate that exploring text classification models provided an accessible and comprehensive approach for integrated learning of mathematics, language arts, and computing with the potential of supporting the understanding of core AI concepts including identifying structure within unstructured data and reasoning about the roles of human insight in developing AI technologies.more » « less
-
Artificial Intelligence (AI) enhanced systems are widely adopted in post-secondary education, however, tools and activities have only recently become accessible for teaching AI and machine learning (ML) concepts to K-12 students. Research on K-12 AI education has largely included student attitudes toward AI careers, AI ethics, and student use of various existing AI agents such as voice assistants; most of which has focused on high school and middle school. There is no consensus on which AI and Machine Learning concepts are grade-appropriate for elementary-aged students or how elementary students explore and make sense of AI and ML tools. AI is a rapidly evolving technology and as future decision-makers, children will need to be AI literate[1]. In this paper, we will present elementary students’ sense-making of simple machine-learning concepts. Through this project, we hope to generate a new model for introducing AI concepts to elementary students into school curricula and provide tangible, trainable representations of ML for students to explore in the physical world. In our first year, our focus has been on simpler machine learning algorithms. Our desire is to empower students to not only use AI tools but also to understand how they operate. We believe that appropriate activities can help late elementary-aged students develop foundational AI knowledge namely (1) how a robot senses the world, and (2) how a robot represents data for making decisions. Educational robotics programs have been repeatedly shown to result in positive learning impacts and increased interest[2]. In this pilot study, we leveraged the LEGO® Education SPIKE™ Prime for introducing ML concepts to upper elementary students. Through pilot testing in three one-week summer programs, we iteratively developed a limited display interface for supervised learning using the nearest neighbor algorithm. We collected videos to perform a qualitative evaluation. Based on analyzing student behavior and the process of students trained in robotics, we found some students show interest in exploring pre-trained ML models and training new models while building personally relevant robotic creations and developing solutions to engineering tasks. While students were interested in using the ML tools for complex tasks, they seemed to prefer to use block programming or manual motor controls where they felt it was practical.more » « less
-
de Vries, E.; Hod, Y.; Ahn, J. (Ed.)In this paper, we present a co-design study with teachers to contribute towards development of a technology-enhanced Artificial Intelligence (AI) curriculum, focusing on modeling unstructured data. We created an initial design of a learning activity prototype and explored ways to incorporate the design into high school classes. Specifically, teachers explored text classification models with the prototype and reflected on the exploration as a user, learner, and teacher. They provided insights about learning opportunities in the activity and feedback for integrating it into their teaching. Findings from qualitative analysis demonstrate that exploring text classification models provided an accessible and comprehensive approach for integrated learning of mathematics, language arts, and computing with the potential of supporting the understanding of core AI concepts including identifying structure within unstructured data and reasoning about the roles of human insight in developing AI technologies.more » « less
-
Work-in-Progress: Uncovering AI Adoption Trends Among University Engineering Students for Learning and Career Preparedness-progress study explores self-reported data on AI use by university engineering students. The purpose of this study is to investigate how students are utilizing AI technologies and to understand their views on the role of AI in their future. The primary research question formulated was: How does the adoption of AI technologies for learning vary across demographic groups among university engineering students? Advances in technology and the emergence of AI tools have attracted attention from academia, research, and industry. The rapid growth of deep learning technologies has changed the landscape in the work environment, and universities may need to adapt to keep pace. Dynamic changes in the workplace have accelerated as these AI technologies are being leveraged to complete tasks at a high-speed rate. Research indicates that the workforce is increasingly demanding higher skill levels, including specialized AI skills. Formal education in AI basics could be crucial for future career readiness. Over 150 engineering students reported their demographics, including age, race, gender, year in school, and if they identify as having any form of disability. Currently, the survey remains open. The final study will incorporate more responses, and additional data will come from semi-structured interviews. This research explores the ways in which undergraduate and graduate students at a major R1 land-grant university in the western United States interact with AI tools. Students reported on using AI technologies, like ChatGPT, to aid in their learning. Preliminary findings suggest that freshman students are less likely to have used AI technologies than those later in their college careers. Encouragingly, students closest to entering the workforce are the ones with the most exposure to these technologies. Interestingly, students who identify as having any form of a disability or condition that impacts their learning (e.g., learning disability, neurodiversity, physical disability, etc.) initially reported lower usage of AI technologies compared to their classmates. The lower use by freshmen and increasing exposure to generative AI throughout students’ university experience is noteworthy. Students were also asked for their views on the formal integration of AI technologies into the College of Engineering courses. It could be valuable for universities to explore adding formal training to help equip students for the workforce. We anticipate that this study will highlight how exposure to AI technologies may prove essential for engineering students in preparing for a rapidly evolving workplace, as AI has the potential to enhance real-world problem-solving skills and help students become more equipped for workplace demands.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript
- Journal Article:
- https://doi.org/10.1080/17439884.2023.2189735
