skip to main content

Title: Co-designing AI-based orchestration tools to support dynamic transitions: Design narratives through conjecture mapping
Dynamically transitioning between individual and collaborative learning has been hypothesized to have positive effects, such as providing the optimal learning mode based on students’ needs. There are, however, challenges in orchestrating these transitions in real-time while managing a classroom of students. AI-based orchestration tools have the potential to alleviate some of the orchestration load for teachers. In this study, we describe a sequence of three design sessions with teachers where we refine prototypes of an orchestration tool to support dynamic transitions. We leverage design narratives and conjecture mapping for the design of our novel orchestration tool. Our contributions include the orchestration tool itself; a description of how novel tool features were revised throughout the sessions with teachers, including shared control between teachers, students, and AI and the use of AI to support dynamic transitions, and a reflection of the changes to our design and theoretical conjectures.  more » « less
Award ID(s):
Author(s) / Creator(s):
; ; ; ; ; ; ; ;
Weinberger, A.; Chen, W.; Hernández-Leo, D.; Chen, B.
Date Published:
Journal Name:
Computersupported collaborative learning
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract  
    more » « less
  2. Rodrigo, M.M. ; Matsuda, N. ; Cristea, A.I. ; Dimitrova, V. (Ed.)
    It might be highly effective if students could transition dynamically between individual and collaborative learning activities, but how could teachers manage such complex classroom scenarios? Although recent work in AIED has focused on teacher tools, little is known about how to orchestrate dynamic transitions between individual and collaborative learning. We created a novel technology ecosystem that supports these dynamic transitions. The ecosystem integrates a novel teacher orchestration tool that provides monitoring support and pairing suggestions with two AI-based tutoring systems that support individual and collaborative learning, respectively. We tested the feasibility of this ecosystem in a classroom study with 5 teachers and 199 students over 22 class sessions. We found that the teachers were able to manage the dynamic transitions and valued them. The study contributes a new technology ecosystem for dynamically transitioning between individual and collaborative learning, plus insight into the orchestration functionality that makes these transitions feasible. 
    more » « less
  3. Schmidt, A. ; Väänänen, K. ; Goyal, T. ; Kristensson, P. O. ; Peters, A. ; Mueller, S. ; Williamson, J. R. ; Wilson, M. L. (Ed.)
    Enabling students to dynamically transition between individual and collaborative learning activities has great potential to support better learning. We explore how technology can support teachers in orchestrating dynamic transitions during class. Working with five teachers and 199 students over 22 class sessions, we conducted classroom-based prototyping of a co-orchestration technology ecosystem that supports the dynamic pairing of students working with intelligent tutoring systems. Using mixed-methods data analysis, we study the resulting observed classroom dynamics, and how teachers and students perceived and experienced dynamic transitions as supported by our technology. We discover a potential tension between teachers’ and students’ preferred level of control: students prefer more control over the dynamic transitions that teachers are hesitant to grant. Our study reveals design implications and challenges for future human-AI co-orchestration in classroom use, bringing us closer to realizing the vision of highly-personalized smart classrooms that can address the unique needs of each student. 
    more » « less
  4. Dynamically transitioning between individual and collaborative learning activities during a class session (i.e., in an un-planned way, as-the-need-arises) has advantages for students, but existing orchestration tools are not designed to support such transitions. This work reports findings from a technology probe study that explored alternative designs for classroom co-orchestration support for dynamically transitioning between individual and collaborative learning, focused on how control over the transitions should be divided or shared among teachers, students, and orchestration system. This study involved 1) a pilot in an authentic classroom scenario with AI support for individual and collaborative learning; and 2) design workshops and interviews with students and teachers. Findings from the study suggest the need for hybrid control between students, teachers, and AI systems over transitions as well as for adaptivity and/or adaptability for different classrooms, teachers, and students’ prior knowledge. This study is the first to explore human–AI control over dynamic transitions between individual and collaborative learning in actual classrooms. 
    more » « less
  5. null (Ed.)
    Orchestration tools may support K-12 teachers in facilitating student learning, especially when designed to address classroom stakeholders’ needs. Our previous work revealed a need for human-AI shared control when dynamically pairing students for collaborative learning in the classroom, but offered limited guidance on the role each agent should take. In this study, we designed storyboards for scenarios where teachers, students and AI co-orchestrate dynamic pairing when using AI-based adaptive math software for individual and collaborative learning. We surveyed 54 math teachers on their co-orchestration preferences. We found that teachers would like to share control with the AI to lessen their orchestration load. As well, they would like to have the AI propose student pairs with explanations, and identify risky proposed pairings. However, teachers are hesitant to let the AI auto-pair students even if they are busy, and are less inclined to let AI override teacher-proposed pairing. Our study contributes to teachers’ needs, preference, and boundaries for how they want to share the task and control of student pairing with the AI and students, and design implications in human-AI co-orchestration tools. 
    more » « less