An official website of the United States government
This study investigates how high school-aged youth engage in algorithm auditing to identify and understand biases in artificial intelligence and machine learning (AI/ML) tools they encounter daily. With AI/ML technologies being increasingly integrated into young people’s lives, there is an urgent need to equip teenagers with AI literacies that build both technical knowledge and awareness of social impacts. Algorithm audits (also called AI audits) have traditionally been employed by experts to assess potential harmful biases, but recent research suggests that non-expert users can also participate productively in auditing. We conducted a two-week participatory design workshop with 14 teenagers (ages 14–15), where they audited the generative AI model behind TikTok’s Effect House, a tool for creating interactive TikTok filters. We present a case study describing how teenagers approached the audit, from deciding what to audit to analyzing data using diverse strategies and communicating their results. Our findings show that participants were engaged and creative throughout the activities, independently raising and exploring new considerations, such as age-related biases, that are uncommon in professional audits. We drew on our expertise in algorithm auditing to triangulate their findings as a way to examine if the workshop supported participants to reach coherent conclusions in their audit. Although the resulting number of changes in race, gender, and age representation uncovered by the teens were slightly different from ours, we reached similar conclusions. This study highlights the potential for auditing to inspire learning activities to foster AI literacies, empower teenagers to critically examine AI systems, and contribute fresh perspectives to the study of algorithmic harms.
more »
« less
AMBY: A development environment for youth to create conversational agents
Conversational AIs such as Alexa and ChatGPT are increasingly ubiquitous in young people’s lives, but these young users are often not afforded the opportunity to learn about the inner workings of these technologies. One of the most powerful ways to foster this learning is to empower youth to create AI that is personally and socially meaningful to them. We have built a novel development environment, AMBY–‘‘AI Made By You’’–for youth to create conversational agents. AMBY was iteratively designed with and for youth aged 12–13 through contextual inquiry and usability studies. AMBY is designed to foster AI learning with features that enable users to generate training datasets and visualize conversational flow. We report on results from a two-week summer camp deployment, and contribute design implications for conversational AI authoring tools that empower AI learning for youth.
more »
« less
- Award ID(s):
- 2048480
- PAR ID:
- 10497837
- Publisher / Repository:
- Elsevier
- Date Published:
- Journal Name:
- International Journal of Child-Computer Interaction
- Volume:
- 38
- Issue:
- C
- ISSN:
- 2212-8689
- Page Range / eLocation ID:
- 100618
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This study investigates how high school-aged youth engage in algorithm auditing to identify and understand biases in artificial intelligence and machine learning (AI/ML) tools they encounter daily. With AI/ML technologies being increasingly integrated into young people’s lives, there is an urgent need to equip teenagers with AI literacies that build both technical knowledge and awareness of social impacts. Algorithm audits (also called AI audits) have traditionally been employed by experts to assess potential harmful biases, but recent research suggests that non-expert users can also participate productively in auditing. We conducted a two-week participatory design workshop with 14 teenagers (ages 14–15), where they audited the generative AI model behind TikTok’s Effect House, a tool for creating interactive TikTok filters. We present a case study describing how teenagers approached the audit, from deciding what to audit to analyzing data using diverse strategies and communicating their results. Our findings show that participants were engaged and creative throughout the activities, independently raising and exploring new considerations, such as age-related biases, that are uncommon in professional audits. We drew on our expertise in algorithm auditing to triangulate their findings as a way to examine if the workshop supported participants to reach coherent conclusions in their audit. Although the resulting number of changes in race, gender, and age representation uncovered by the teens were slightly different from ours, we reached similar conclusions. This study highlights the potential for auditing to inspire learning activities to foster AI literacies, empower teenagers to critically examine AI systems, and contribute fresh perspectives to the study of algorithmic harms.more » « less
-
Over the past two decades, innovations powered by artificial intelligence (AI) have extended into nearly all facets of human experience. Our ethnographic research suggests that while young people sense they can't “trust” AI, many are not sure how it works or how much control they have over its growing role in their lives. In this study, we attempt to answer the following questions: 1) What can we learn about young people's understandings of AI when they produce media with and about it? 2) What are the design features of an ethics-centered pedagogy that promotes STEM engagement via AI? To answer these questions, we co-developed and documented three projects at YR Media, a national network of youth journalists and artists who create multimedia for public distribution. Participants are predominantly youth of color and those contending with economic and other barriers to full participation in STEM fields. Findings showed that by creating a learning ecology that centered the cultures and experiences of its learners while leveraging familiar tools for critical analysis, youth deepened their understanding of AI. Our study also showed that providing opportunities for youth to produce ethics-centered Interactive stories interrogating invisibilized AI functionalities, and to release those stories to the public, empowered them to creatively express their understandings and apprehensions about AI.more » « less
-
Hoadley, C; Wang, C (Ed.)While there is widespread interest in supporting young people to critically evaluate machine learning-powered systems, there is little research on how we can support them in inquiring about how these systems work and what their limitations and implications may be. Outside of K-12 education, an effective strategy in evaluating black-boxed systems is algorithm auditing—a method for understanding algorithmic systems’ opaque inner workings and external impacts from the outside in. In this paper, we review how expert researchers conduct algorithm audits and how end users engage in auditing practices to propose five steps that, when incorporated into learning activities, can support young people in auditing algorithms. We present a case study of a team of teenagers engaging with each step during an out-of-school workshop in which they audited peer-designed generative AI TikTok filters. We discuss the kind of scaffolds we provided to support youth in algorithm auditing and directions and challenges for integrating algorithm auditing into classroom activities. This paper contributes: (a) a conceptualization of five steps to scaffold algorithm auditing learning activities, and (b) examples of how youth engaged with each step during our pilot study.more » « less
-
As conversational AI apps such as Siri and Alexa become ubiquitous among children, the CS education community has begun leveraging this popularity as a potential opportunity to attract young learners to AI, CS, and STEM learning. However, teaching conversational AI to K-12 learners remains challenging and unexplored due in part to the abstract and complex nature of some conversational AI concepts, such as intents and training phrases. One promising approach to teaching complex topics in engaging ways is through unplugged activities, which have been shown to be highly effective in fostering CS conceptual understanding without using computers. Research efforts are underway toward developing unplugged activities for teaching AI, but few thus far have focused on conversational AI. This experience report describes the design and iterative refinement of a series of novel unplugged activities for a conversational AI summer camp for middle school learners. We discuss learner responses and lessons learned through our implementation of these unplugged activities. Our hope is that these insights support CS education researchers in making conversational AI learning more engaging and accessible to all learners.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1016/j.ijcci.2023.100618
