An official website of the United States government
The metacognitive strategies of planning, monitoring, and evaluating can be promoted through systematic reflection to drive self-directed, lifelong learning. This article reports on a three-year study on systematic written reflection within an undergraduate Fluid Mechanics course to promote planning, monitoring, and evaluation. Students were prompted weekly to reflect on their in-class problem-solving, classroom and exam preparation, performance, behaviors, and learning in a flipped classroom at a large southeastern U.S. university. In addition, they received intentional instruction on how to plan, monitor, and evaluate their problem-solving during class. To enable a comparative assessment, a flipped classroom without these interventions was also implemented as a non-experimental cohort. The cohorts were compared using a final exam, concept inventory, and the Metacognitive Activities Inventory (MCAI). The MCAI indicated a significantly higher positive change (pre- to post-course) in self-regulatory behavior for the experimental cohort ( p = 0.037). The weekly reflections were studied using an inductive content analysis to assess students’ self-regulatory behaviors. They were also used to investigate statistical associations between reflection content and course outcomes. This revealed that academic self-discipline via planning, monitoring one's work, or being careful and diligent may be as aligned with course performance in STEM as is practice with the problem-solving itself. The effects for the final exam in the experimental cohort were positive overall as well as statistically or practically significant for various demographic strata. These results provided evidence for the potential enhancement of course performance with metacognition support. A positive shift in students’ perspectives regarding the value of the reflection questions was observed throughout the study. Therefore, as an implementation guide for other educators, the reflection questions and any changes made in posing them to students are discussed chronologically. Overall, the study points to the desirability of providing metacognition support in a STEM course.
more »
« less
Agent-in-the-Loop: Conversational Agent Support in Service of Reflection for Learning During Collaborative Programming
Dynamic conversational agent-based support for collaborative learning has shown significant positive effects on learning over no-support or static-support control conditions in prior studies. In order to understand the boundary between human-led and AI-led support for collaboration, we compare in this study an approach where the agent’s primary role is to help students regulate their own collaboration with two more typical prompting strategies that are used only during a reflection phase: one designed to provide a specific informational focus for the reflection, and the other designed to draw out evaluation, elaboration, and exploration of alternative perspectives. Significant positive effects on learning over and above just the human-led form of support are observed when either of the prompting strategies are used.
more »
« less
- PAR ID:
- 10174692
- Date Published:
- Journal Name:
- Artificial Intelligence in Education. AIED 2020. Lecture Notes in Computer Science
- Volume:
- 12164
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Pursuing productivity, students often adopt a divide-and-conquer strategy that undercuts collaborative learning opportunities. In this study, we introduce a task structuring and role scaffolding paradigm to create opportunities for transactive exchange in such performance-oriented tasks and experimentally compare two prompting strategies -- one designed to create a focused discussion and another to intensify transactivity -- while controlling for time on task. We find significant learning gains of each strategy when used separately, but not in tandem.more » « less
-
For the past 15 years, in computer-supported collaborative learning applications, conversational agents have been used to structure group interactions in online chat-based environments. A series of experimental studies has provided an empirical foundation for the design of chat based conversational agents that significantly improve learning over no-support control conditions and static-support control conditions. In this demo, we expand upon this foundation, bringing conversational agents to structure group interaction into physical spaces, with the specific goal of facilitating collaboration and learning in workplace scenarios.more » « less
-
Many teacher education models involve reflecting on teaching practice for the sake of improving it. Such reflection must be carefully structured to help practitioners identify and act upon significant opportunities for improvement (SOIs). Learning from SOIs requires the cognitive activities of noticing students’ mathematical thinking and its connection to instructional practice, along with an affective disposition to view sub-optimal teaching practices as learning opportunities. We draw upon existing literature and theory related to the notion of developing positive error cultures to identify design principles for helping teachers learn from their own sub-optimal practices rather than becoming discouraged by them. The design principles include experience-based learning, low-stakes settings, collaboration, process reflection, and exploration of disagreements. We then describe a mathematics teacher education environment incorporating the design principles. Examples of pre-service teachers’ work within the environment are analysed for possible patterns of learning from SOIs within a positive error culture. Based on these examples, a four-quadrant model to characterise teachers’ learning from SOIs is proposed. The four quadrants describe various outcomes related to recognising and resolving SOIs.more » « less
-
Generative, ML-driven interactive systems have the potential to change how people interact with computers in creative processes - turning tools into co-creators. However, it is still unclear how we might achieve effective human-AI collaboration in open-ended task domains. There are several known challenges around communication in the interaction with ML-driven systems. An overlooked aspect in the design of co-creative systems is how users can be better supported in learning to collaborate with such systems. Here we reframe human-AI collaboration as a learning problem: Inspired by research on team learning, we hypothesize that similar learning strategies that apply to human-human teams might also increase the collaboration effectiveness and quality of humans working with co-creative generative systems. In this position paper, we aim to promote team learning as a lens for designing more effective co-creative human-AI collaboration and emphasize collaboration process quality as a goal for co-creative systems. Furthermore, we outline a preliminary schematic framework for embedding team learning support in co-creative AI systems. We conclude by proposing a research agenda and posing open questions for further study on supporting people in learning to collaborate with generative AI systems.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1007/978-3-030-52240-7_50
