More Like this

1. How teachers conceptualise shared control with an AI co‐orchestration tool: A multiyear teacher‐centred design process

   https://doi.org/10.1111/bjet.13372  

   Lawrence, LuEttaMae ; Echeverria, Vanessa ; Yang, Kexin ; Aleven, Vincent ; Rummel, Nikol ( August 2023 , British Journal of Educational Technology)

   Artificial intelligence (AI) can enhance teachers' capabilities by sharing control over different parts of learning activities. This is especially true for complex learning activities, such as dynamic learning transitions where students move between individual and collaborative learning in un‐planned ways, as the need arises. Yet, few initiatives have emerged considering how shared responsibility between teachers and AI can support learning and how teachers' voices might be included to inform design decisions. The goal of our article is twofold. First, we describe a secondary analysis of our co‐design process comprising six design methods to understand how teachers conceptualise sharing control with an AI co‐orchestration tool, calledPair‐Up. We worked with 76 middle school math teachers, each taking part in one to three methods, to create a co‐orchestration tool that supports dynamic combinations of individual and collaborative learning using two AI‐based tutoring systems. We leveraged qualitative content analysis to examine teachers' views about sharing control withPair‐Up, and we describe high‐level insights about the human‐AI interaction, including control, trust, responsibility, efficiency, and accuracy. Secondly, we use our results as an example showcasing how human‐centred learning analytics can be applied to the design of human‐AI technologies and share reflections for human‐AI technology designers regarding the methods that might be fruitful to elicit teacher feedback and ideas. Our findings illustrate the design of a novel co‐orchestration tool to facilitate the transitions between individual and collaborative learning and highlight considerations and reflections for designers of similar systems.

   What is already known about this topic:

   Artificial Intelligence (AI) can help teachers facilitate complex classroom activities, such as having students move between individual and collaborative learning in unplanned ways.

   Designers should use human‐centred design approaches to give teachers a voice in deciding what AI might do in the classroom and if or how they want to share control with it.

   What this paper adds:

   Presents teacher views about how they want to share control with AI to support students moving between individual and collaborative learning.

   Describes how we adapted six design methods to design AI features.

   Illustrates a complete, iterative process to create human‐AI interactions to support teachers as they facilitate students moving from individual to collaborative learning.

   Implications for practice:

   We share five implications for designers that teachers highlighted as necessary when designing AI‐features, including control, trust, responsibility, efficiency and accuracy.

   Our work also includes a reflection on our design process and implications for future design processes.

    

   more » « less
2. Engaging Female High School Students in the Frontiers of Computing

   Stein, G. ; Gransbury, I. ; Jean, D. ; Alvarez ; L. ; Hill, M. ; Catete, V. ; Grover, S. ; Barnes, T. ; Broll, B. ; et al ( January 2022 , 2022 ASEE Annual Conference & Exposition)

   Creating pathways that stimulate high school learners’ interest in advanced topics with the goal of building a diverse, gender-balanced, future-ready workforce is crucial. To this end, we present the curriculum of a new, high school computer science course under development called Computer Science Frontiers (CSF). Building on the foundations set by the AP Computer Science Principles course, we seek to dramatically expand access, especially for high school girls, to the most exciting and emerging frontiers of computing, such as distributed computation, the internet of things (IoT), cybersecurity, and machine learning. The modular, open-access, hands-on curriculum provides an engaging introduction to these advanced topics in high school because currently they are accessible only to CS majors in college. It also focuses on other 21st century skills required to productively leverage computational methods and tools in virtually every profession. To address the dire gender disparity in computing, the curriculum was designed to engage female students by focusing on real world application domains, such as climate change and health, by including social applications and by emphasizing collaboration and teamwork. Our paper describes the design of curricular modules on Distributed Computing, IoT/Cybersecurity, and AI/Machine Learning. All project-based activities are designed to be collaborative, situated in contexts that are engaging to high school students, and often involve real-world world data. We piloted these modules in teacher PD workshops with 8 teachers from North Carolina, Tennessee, Massachusetts, Pennsylvania, and New York who then facilitated virtual summer camps with high school students in 2020 and 2021. Findings from teacher PD workshops as well as student camps indicate high levels of engagement in and enthusiasm for the curricular activities and topics. Post-intervention surveys suggest that these experiences generate student interest exploring these ideas further and connections to areas of interest to students. 

   more » « less
3. Initial Steps in Developing Classroom Observation Rubrics Designed Around Instructional Practices that Support Equity and Access in Classrooms with Potential for “Success”

   https://doi.org/10.1177/01614681221140963  

   Wilson, Jonee ( November 2022 , Teachers College Record: The Voice of Scholarship in Education)

   Background: The field of mathematics education has made progress toward generating a set of instructional practices that could support improvements in the learning opportunities made available to groups of students who historically have been underserved and marginalized. Studies that contribute to this growing body of work are often conducted in learning environments that are framed as “successful.” As a researcher who is concerned with issues of equity and who acknowledges the importance of closely attending to the quality of the mathematical activity in which students are being asked to engage, my stance on “successful learning environments” pulls from both Gutiérrez’s descriptions of what characterizes classrooms as aiming for equity and the emphasis on the importance of conceptually oriented goals for student learning that is outlined in documents like the Standards. Though as a field we are growing in our knowledge of practices that support these successful learning environments, this knowledge has not yet been reflected in many of the observational tools, rubrics, and protocols used to study these environments. In addition, there is a growing need to develop empirically grounded ways of attending to the extent to which the practices that are being outlined in research literature actually contribute to the “success” of these learning environments. Purpose: The purpose of this article is to explore one way of meeting this growing need by describing the complex work of developing a set of classroom observation rubrics (the Equity and Access Rubrics for Mathematics Instruction, EAR-MI) designed to support efforts in identifying and observing critical features of classrooms characterized as having potential for “success.” In developing the rubrics, I took as my starting place findings from an analysis that compared a set of classrooms that were characterized as demonstrating aspects of successful learning environments and a set of classrooms that were not characterized as successful. This paper not only describes the process of developing the rubrics, but also outlines some of the qualitative differences that distinguished more and less effective examples of the practices the rubrics are designed to capture. Research Design: In designing the rubrics, I engaged in multiple cycles of qualitative analyses of video data collected from a large-scale study. Specifically, I iteratively designed, tested, and revised the developing rubrics while consistently collaborating with, consulting with, and receiving feedback from different experts in the field of education. Conclusions: Although I fully acknowledge and recognize that there are several tensions and limitations of this work, I argue that developing rubrics like the EAR-MI is still worthwhile. One reason that I give for continuing these types of efforts is that it contributes to the work of breaking down forms of practice into components and identifying key aspects of specific practices that are critical for supporting student learning in ways that make potentially productive routines of action visible to and learnable by others, which may ultimately contribute to the development of more successful learning environments. I also argue that rubrics like the EAR-MI have the potential to support researchers in developing stronger evidence of the effectiveness of practices that prior research has identified as critical for marginalized students and in more accurately and concretely identifying and describing learning environments as having potential for “success.” 

   more » « less
4. Technology ecosystem for orchestrating dynamic transitions between individual and collaborative AI-tutored problem solving

   Yang, K. ; Lu, Z. ; Echeverria, V. ; Sewall, J. ; Lawrence, L. ; Rummel, N. ; & Aleven, V. ( January 2022 , Proceedings of the 23rd International Conference on Artificial Intelligence in Education, AIED 2023)

   Rodrigo, M.M. ; Matsuda, N. ; Cristea, A.I. ; Dimitrova, V. (Ed.)

   It might be highly effective if students could transition dynamically between individual and collaborative learning activities, but how could teachers manage such complex classroom scenarios? Although recent work in AIED has focused on teacher tools, little is known about how to orchestrate dynamic transitions between individual and collaborative learning. We created a novel technology ecosystem that supports these dynamic transitions. The ecosystem integrates a novel teacher orchestration tool that provides monitoring support and pairing suggestions with two AI-based tutoring systems that support individual and collaborative learning, respectively. We tested the feasibility of this ecosystem in a classroom study with 5 teachers and 199 students over 22 class sessions. We found that the teachers were able to manage the dynamic transitions and valued them. The study contributes a new technology ecosystem for dynamically transitioning between individual and collaborative learning, plus insight into the orchestration functionality that makes these transitions feasible. 

   more » « less
5. An Effectiveness Study of Teacher-Led AI Literacy Curriculum in K-12 Classrooms.

   Zhang, H. ; Lee, I. ; Moore, K. S ( February 2024 , Proceedings of the EAAI-24: The 14th Symposium on Educational Advances in Artificial Intelligence.)

   Artificial intelligence (AI) has rapidly pervaded and reshaped almost all walks of life, but efforts to promote AI literacy in K-12 schools remain limited. There is a knowledge gap in how to prepare teachers to teach AI literacy in inclusive classrooms and how teacher-led classroom implementations can impact students. This paper reports a comparison study to investigate the effectiveness of an AI literacy curriculum when taught by classroom teachers. The experimental group included 89 middle school students who learned an AI literacy curriculum during regular school hours. The comparison group consisted of 69 students who did not learn the curriculum. Both groups completed the same pre and post-test. The results show that students in the experimental group developed a deeper understanding of AI concepts and more positive attitudes toward AI and its impact on future careers after the curriculum than those in the comparison group. This shows that the teacher-led classroom implementation successfully equipped students with a conceptual understanding of AI. Students achieved significant gains in recognizing how AI is relevant to their lives and felt empowered to thrive in the age of AI. Overall this study confirms the potential of preparing K-12 classroom teachers to offer AI education in classrooms in order to reach learners of diverse backgrounds and broaden participation in AI literacy education among young learners. 

   more » « less