Search for: All records

Abstract The Institute for Student‐AI Teaming (iSAT) addresses the foundational question:how to promote deep conceptual learning via rich socio‐collaborative learning experiences for all students?—a question that is ripe for AI‐based facilitation and has the potential to transform classrooms. We advance research in speech, computer vision, human‐agent teaming, computer‐supported collaborative learning, expansive co‐design, and the science of broadening participation to design and study next generation AI technologies (called AI Partners) embedded in student collaborative learning teams in coordination with teachers. Our institute ascribes to theoretical perspectives that aim to create a normative environment of widespread engagement through responsible design of technology, curriculum, and pedagogy in partnership with K–12 educators, racially diverse students, parents, and other community members. 

Abstract Student’s shift of attention away from a current learning task to task-unrelated thought, also called mind wandering, occurs about 30% of the time spent on education-related activities. Its frequent occurrence has a negative effect on learning outcomes across learning tasks. Automated detection of mind wandering might offer an opportunity to assess the attentional state continuously and non-intrusively over time and hence enable large-scale research on learning materials and responding to inattention with targeted interventions. To achieve this, an accessible detection approach that performs well for various systems and settings is required. In this work, we explore a new, generalizable approach to video-based mind wandering detection that can be transferred to naturalistic settings across learning tasks. Therefore, we leverage two datasets, consisting of facial videos during reading in the lab (N = 135) and lecture viewing in-the-wild (N = 15). When predicting mind wandering, deep neural networks (DNN) and long short-term memory networks (LSTMs) achieve F$$_{1}$$ ${}_1$scores of 0.44 (AUC-PR = 0.40) and 0.459 (AUC-PR = 0.39), above chance level, with latent features based on transfer-learning on the lab data. When exploring generalizability by training on the lab dataset and predicting on the in-the-wild dataset, BiLSTMs on latent features perform comparably to the state-of-the-art with an F$$_{1}$$ ${}_1$score of 0.352 (AUC-PR = 0.26). Moreover, we investigate the fairness of predictive models across gender and show based on post-hoc explainability methods that employed latent features mainly encode information on eye and mouth areas. We discuss the benefits of generalizability and possible applications. 

ObjectiveThis review and synthesis examines approaches for measuring and assessing team coordination dynamics (TCD). The authors advance a system typology for classifying TCD approaches and their applications for increasing levels of dynamic complexity. BackgroundThere is an increasing focus on how teams adapt their coordination in response to changing and uncertain operational conditions. Understanding coordination is significant because poor coordination is associated with maladaptive responses, whereas adaptive coordination is associated with effective responses. This issue has been met with TCD approaches that handle increasing complexity in the types of TCD teams exhibit. MethodA three-level system typology of TCD approaches for increasing dynamic complexity is provided, with examples of research at each level. For System I TCD, team states converge toward a stable, fixed-point attractor. For System II TCD, team states are periodic, which can appear complex, yet are regular and relatively stable. In System III TCD, teams can exhibit periodic patterns, but those patterns change continuously to maintain effectiveness. ResultsSystem I and System II are applicable to TCD with known or discoverable behavioral attractors that are stationary across mid-to long-range timescales. System III TCD is the most generalizable to dynamic environments with high requirements for adaptive coordination across a range of timescales. ConclusionWe outline current challenges for TCD and next steps in this burgeoning field of research. ApplicationSystem III approaches are becoming widespread, as they are generalizable to time- and/or scale-varying TCD and multimodal analyses. Recommendations for deploying TCD in team settings are provided. 

This study explores the relation between students’ discourse dynamics and performance during collaborative problem-solving activities utilizing Linguistic Inquiry Word Count (LIWC). We analyzed linguistic variables from students’ communications to explore social and cognitive behavior. Participants include 279 undergraduate students from two U.S. universities engaged in a controlled lab setting using the physics related educational game named Physics Playground. Findings highlight the relationship between social and cognitive linguistic variables and student’s physics performance outcome in a virtual collaborative learning context. This study contributes to a deeper understanding of how these discourse dynamics are related to learning outcomes in collaborative learning. It provides insights for optimizing educational strategies in collaborative remote learning environments. We further discuss the potential for conducting computational linguistic modeling on learner discourse and the role of natural language processing in deriving insights on learning behavior to support collaborative learning.