skip to main content


Title: Beyond black-boxes: teaching complex machine learning ideas through scaffolded interactive activities
Existing approaches to teaching artifcial intelligence and machine learning (ML) often focus on the use of pre-trained models or fne-tuning an existing black-box architecture. We believe ML techniques and core ML topics, such as optimization and adversarial examples, can be designed for high school age students given appropriate support. Our curricular approach focuses on teaching ML ideas by enabling students to develop deep intuition about these complex concepts by first making them accessible to novices through interactive tools, pre-programmed games, and carefully designed programming activities. Then, students are able to engage with the concepts via meaningful, hands-on experiences that span the entire ML process from data collection to model optimization and inspection. This paper describes our AI & Cybersecurity for Teens suite of curricular activities aimed at high school students and teachers.  more » « less
Award ID(s):
2113803
NSF-PAR ID:
10463534
Author(s) / Creator(s):
;
Date Published:
Journal Name:
The Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI-23)
Volume:
37
Issue:
13
Page Range / eLocation ID:
15990-15998
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Existing approaches to teaching artificial intelligence and machine learning often focus on the use of pre-trained models or fine-tuning an existing black-box architecture. We believe advanced ML topics, such as optimization and adversarial examples, can be learned by early high school age students given appropriate support. Our approach focuses on enabling students to develop deep intuition about these complex concepts by first making them accessible to novices through interactive tools, pre-programmed games, and carefully designed programming activities. Then, students are able to engage with the concepts via meaningful, hands-on experiences that span the entire ML process from data collection to model optimization and inspection. 
    more » « less
  2. Artificial Intelligence (AI) enhanced systems are widely adopted in post-secondary education, however, tools and activities have only recently become accessible for teaching AI and machine learning (ML) concepts to K-12 students. Research on K-12 AI education has largely included student attitudes toward AI careers, AI ethics, and student use of various existing AI agents such as voice assistants; most of which has focused on high school and middle school. There is no consensus on which AI and Machine Learning concepts are grade-appropriate for elementary-aged students or how elementary students explore and make sense of AI and ML tools. AI is a rapidly evolving technology and as future decision-makers, children will need to be AI literate[1]. In this paper, we will present elementary students’ sense-making of simple machine-learning concepts. Through this project, we hope to generate a new model for introducing AI concepts to elementary students into school curricula and provide tangible, trainable representations of ML for students to explore in the physical world. In our first year, our focus has been on simpler machine learning algorithms. Our desire is to empower students to not only use AI tools but also to understand how they operate. We believe that appropriate activities can help late elementary-aged students develop foundational AI knowledge namely (1) how a robot senses the world, and (2) how a robot represents data for making decisions. Educational robotics programs have been repeatedly shown to result in positive learning impacts and increased interest[2]. In this pilot study, we leveraged the LEGO® Education SPIKE™ Prime for introducing ML concepts to upper elementary students. Through pilot testing in three one-week summer programs, we iteratively developed a limited display interface for supervised learning using the nearest neighbor algorithm. We collected videos to perform a qualitative evaluation. Based on analyzing student behavior and the process of students trained in robotics, we found some students show interest in exploring pre-trained ML models and training new models while building personally relevant robotic creations and developing solutions to engineering tasks. While students were interested in using the ML tools for complex tasks, they seemed to prefer to use block programming or manual motor controls where they felt it was practical. 
    more » « less
  3. Artificial Intelligence (AI) and cybersecurity are becoming increasingly intertwined, with AI and Machine Learning (AI/ML) being leveraged for cybersecurity, and cybersecurity helping address issues caused by AI. The goal in our exploratory curricular initiative is to dovetail the need to teach these two critical, emerging topics in highschool, and create a suite of novel activities, 'AI & Cybersecurity for Teens' (ACT) that introduces AI/ML in the context of cybersecurity and prepares high school teachers to integrate them in their cybersecurity curricula. Additionally, ACT activities are designed such that teachers (and students) build a deeper understanding of how ML works and how the machine actually "learns". Such understanding will aid more meaningful interrogation of critical issues such as AI ethics and bias. ACT introduces core ML topics contextualized in cybersecurity topics through a range of programming activities and pre-programmed games in NetsBlox, an easy-to-use block-based programming environment. We conducted 2 pilot workshops with 12 high school cybersecurity teachers focused on ACT activities. Teachers' feedback was positive and encouraging but also highlighted potential challenges in implementing ACT in the classroom. This paper reports on our approach and activities design, and teachers' experiences and feedback on integrating AI into high school cybersecurity curricula. 
    more » « less
  4. null (Ed.)
    This study investigates how teachers verbally support students to engage in integrated engineering, science, and computer science activities across the implementation of an engineering project. This is important as recent research has focused on understanding how precollege students’ engagement in engineering practices is supported by teachers (Watkins et al., 2018) and the benefits of integrating engineering in precollege classes, including improved achievement in science, ability to engage in science and engineering practices inherent to engineering (i.e., engineering design), and increased awareness of engineering (National Academy of Engineering and the National Research Council; Katehi et al., 2009). Further, there is a national emphasis on integrating engineering, science, and computer science practices and concepts in science classrooms (NGSS Lead States, 2013). Yet little research has considered how teachers implement these disciplines together within one classroom, particularly elementary teachers who often have little prior experience in teaching engineering and may need support to integrate engineering design into elementary science classroom settings. In particular, this study explores how elementary teachers verbally support science and computer science concepts and practices to be implicitly and explicitly integrated into an engineering project by implementing support intended by curricular materials and/or adding their own verbal support. Implicit use of integration included students engaging in integrated practices without support to know that they were doing so; explicit use of integration included teachers providing support for students to know how and why they were integrating disciplines. Our research questions include: (1) To what extent did teachers provide implicit and explicit verbal support of integration in implementation versus how it was intended in curricular materials? (2) Does this look different between two differently-tracked class sections? Participants include two fifth-grade teachers who co-led two fifth-grade classes through a four-week engineering project. The project focused on redesigning school surfaces to mitigate water runoff. Teachers integrated disciplines by supporting students to create computational models of underlying scientific concepts to develop engineering solutions. One class had a larger proportion of students who were tracked into accelerated mathematics; the other class had a larger proportion of students with individualized educational plans (IEPs). Transcripts of whole class discussion were analyzed for instances that addressed the integration of disciplines or supported students to engage in integrated activities. Results show that all instances of integration were implicit for the class with students in advanced mathematics while most were explicit for the class with students with IEPs. Additionally, support was mainly added by the teachers rather than suggested by curricular materials. Most commonly, teachers added integration between computer science and engineering. Implications of this study are an important consideration for the support that teachers need to engage in the important, but challenging, work of integrating science and computer science practices through engineering lessons within elementary science classrooms. Particularly, we consider how to assist teachers with their verbal supports of integrated curricula through engineering lessons in elementary classrooms. This study then has the potential to significantly impact the state of knowledge in interdisciplinary learning through engineering for elementary students. 
    more » « less
  5. This is a work-in-progress paper. The flipped classroom (FC) model is a well established teaching strategy dating to 1970’s practices in the Soviet Union. FC has two decades of use in post-secondary education since it was proposed by Lage et al. However, breaking studies find no academic improvement with FC model among minority students. Rather, it distances at-risk students. Indeed, certain demographics prefer authoritative over dialogic instruction style. We are motivated to determine FCs effectiveness with students at a medium-sized Hispanic Serving Institution (HSI) and Minority Serving Institution (MSI). For one of our NSF grant activities, we piloted two variations of the flipped classroom model. The key idea is that literature finds that FC classes need better regulation of underperforming students. Generally, the FC models in our work included peer-instruction, active learning, recorded lectures, and pre-assessment quizzes. There were no post-assessment assignments or traditional homework. Some sections employed Just-in-Time-Teaching, and careful selection of groups according to skill (within-class homogenous grouping). Other sections experimented with diversity and inclusion-based grouping and project-based learning. Students at the university are non-traditional, a term used to describe individuals who meet some of the following criteria: having a significant gap between post-secondary education and high-school graduation, being financially independent from their parents, having dependents, and working twenty or more hours per week. 60% of the individuals at our campus are Pell eligible. We study an intersectional inequality: wage-based work is disinclined to accommodate students attending lecture during the work day, and minorities may not prefer dialogic instruction. We analyze student attitudes since Fall 2020, among tens of class sections and hundreds of students. Class sections in the study are upper-division core courses in Computer Science, Computer Engineering and Electrical Engineering. Data is collected from mostly online sections during the COVID-19 pandemic. A pre- and post-surveys were administered collecting demographic information and student attitudes. Hispanic/Latino(a) students found videos to be a complete study medium—that it was not required to seek out third-party materials to prepare for class. They found the class to be more engaging, and self-identified that they could identify previous concepts important to the task at hand. Results were surprising because there were no statistically significant differences with a general population’s exposure to FC. Hispanic/Latino(a)s find the FC model described in our work engaging and effective. 
    more » « less