skip to main content


Title: Intelligent teacher dashboards that support students’ self-regulated learning, engagement, and teachers’ decision making
Teachers’ ability to self-regulate their own learning is closely related to their competency to enhance self-regulated learning (SRL) in their students. Accordingly, there is emerging research for the design of teacher dashboards that empower instructors by providing access to quantifiable evidence of student performance and SRL processes. Typically, they capture evidence of student learning and performance to be visualized through activity traces (e.g., bar charts showing correct and incorrect response rates, etc.) and SRL data (e.g., eye-tracking on content, log files capturing feature selection, etc.) in order to provide teachers with monitoring and instructional tools. Critics of the current research on dashboards used in conjunction with advanced learning technologies (ALTs) such as simulations, intelligent tutoring systems, and serious games, argue that the state of the field is immature and has 1) focused only on exploratory or proof-of-concept projects, 2) investigated data visualizations of performance metrics or simplistic learning behaviors, and 3) neglected most theoretical aspects of SRL including teachers’ general lack of understanding their’s students’ SRL. Additionally, the work is mostly anecdotal, lacks methodological rigor, and does not collect critical process data (e.g. frequency, duration, timing, or fluctuations of cognitive, affective, metacognitive, and motivational (CAMM) SRL processes) during learning with ALTs used in the classroom. No known research in the areas of learning analytics, teacher dashboards, or teachers’ perceptions of students’ SRL and CAMM engagement has systematically and simultaneously examined the deployment, temporal unfolding, regulation, and impact of all these key processes during complex learning. In this manuscript, we 1) review the current state of ALTs designed using SRL theoretical frameworks and the current state of teacher dashboard design and research, 2) report the important design features and elements within intelligent dashboards that provide teachers with real-time data visualizations of their students’ SRL processes and engagement while using ALTs in classrooms, as revealed from the analysis of surveys and focus groups with teachers, and 3) propose a conceptual system design for integrating reinforcement learning into a teacher dashboard to help guide the utilization of multimodal data collected on students’ and teachers’ CAMM SRL processes during complex learning.  more » « less
Award ID(s):
1916417
NSF-PAR ID:
10232100
Author(s) / Creator(s):
Editor(s):
Michalsky, Tova; Moos, Daniel
Date Published:
Journal Name:
Frontiers in education
Volume:
6
ISSN:
2504-284X
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract  
    more » « less
  2. Educational technologies, such as teacher dashboards, are being developed to support teachers’ instruction and students’ learning. Specifically, dashboards support teachers in providing the just-in-time instruction needed by students in complex contexts such as science inquiry. In this study, we used the Inq-Blotter teacher-alerting dashboard to investigate whether teacher support elicited by the technology influenced students’ inquiry performance in a science intelligent tutoring system, Inq-ITS. Results indicated that students’ inquiry improved after receiving teachers’ help, elicited by the Inq-Blotter alerts. This inquiry improvement was significantly greater than for matched students who did not receive help from the teacher in response to alerts. Epistemic network analyses were then used to investigate the patterns in the discursive supports provided to students by teachers. These analyses revealed significant differences in the types of support that fostered (versus did not foster) student improvement; differences across teachers were also found. Overall, this study used innovative tools and analyses to understand how teachers use this technological genre of alerting dashboards to dynamically support students in science inquiry. 
    more » « less
  3. Abstract

    Capturing evidence for dynamic changes in self‐regulated learning (SRL) behaviours resulting from interventions is challenging for researchers. In the current study, we identified students who were likely to do poorly in a biology course and those who were likely to do well. Then, we randomly assigned a portion of the students predicted to perform poorly to a science of learning to learn intervention where they were taught SRL study strategies. Learning outcome and log data (257 K events) were collected fromn = 226 students. We used a complex systems framework to model the differences in SRL including the amount, interrelatedness, density and regularity of engagement captured in digital trace data (ie, logs). Differences were compared between students who were predicted to (1) perform poorly (control,n = 48), (2) perform poorly and received intervention (treatment,n = 95) and (3) perform well (not flagged,n = 83). Results indicated that the regularity of students' engagement was predictive of course grade, and that the intervention group exhibited increased regularity in engagement over the control group immediately after the intervention and maintained that increase over the course of the semester. We discuss the implications of these findings in relation to the future of artificial intelligence and potential uses for monitoring student learning in online environments.

    Practitioner notes

    What is already known about this topic

    Self‐regulated learning (SRL) knowledge and skills are strong predictors of postsecondary STEM student success.

    SRL is a dynamic, temporal process that leads to purposeful student engagement.

    Methods and metrics for measuring dynamic SRL behaviours in learning contexts are needed.

    What this paper adds

    A Markov process for measuring dynamic SRL processes using log data.

    Evidence that dynamic, interaction‐dominant aspects of SRL predict student achievement.

    Evidence that SRL processes can be meaningfully impacted through educational intervention.

    Implications for theory and practice

    Complexity approaches inform theory and measurement of dynamic SRL processes.

    Static representations of dynamic SRL processes are promising learning analytics metrics.

    Engineered features of LMS usage are valuable contributions to AI models.

     
    more » « less
  4. Teacher dashboards are visual displays that provide information to teachers about their learners. In this article, we address teacher dashboards in the context of computer-supported student collaboration in primary education. We examine the role of different types of dashboards for the specific purpose of aiding teachers in identifying which group of collaborating students is in need of support. This question is addressed using qualitative and quantitative approaches. First, an interview study is reported in which teachers’ views (n = 10) on and perceptions of the acceptability of different types of dashboards were examined. Then, the results of an experimental vignette study are reported, which built upon on the interview study, and in which teachers (n = 35) interacted with mirroring or advising dashboards. Together, the studies revealed that the classroom situation, such as differing levels of time pressure, plays an important role regarding what type of dashboard is beneficial for a teacher to use in the classroom. The theoretical contribution of our study lies in a conceptual and empirical investigation of the relation between teachers’ need for control and their perception of different types of dashboards. Our study also points to several practical implications and directions for future research. 
    more » « less
  5. This fundamental research in pre-college education engineering study investigates the ways in which elementary school students and their teacher balance the tradeoffs in engineering design. STEM education reforms promote the engagement of K-12 students in the epistemic practices of disciplinary experts to teach content.1,2,3 This emphasis on practices is a paradigm shift that requires both extensive professional development and research to learn about the ways in which students and teacher learn about and participate in these practices. Balancing tradeoffs is an important practice in engineering but most often in classroom curricula it is embedded in the concept of iteration1,4; however, improving a design is not always the same as balancing trade-offs.1 Optimizing a multivariate problem requires students to engage in a number of engineering practices, like considering multiple solution, making tradeoffs between criteria and constraints, applying math and science knowledge to problem solving, constructing models, making evidence-based decisions, and assessing the implications of solutions5. The ways in which teachers and students collectively balance these tradeoffs in a design has been understudied1. Our primary research questions are, “How do teachers and students make decisions about making tradeoffs between criteria and constraints” and “How do experiences in teacher workshops affect the ways they implement engineering projects in their classes.” We take an ethnographic perspective to investigate these phenomena, and collected video data, field notes, student journals, and semi-structured interviews of eight elementary teachers in a workshop and similar data from two of the workshop teachers’ classes as they implemented the curriculum they learned in the workshop. Our analyses focus on the disciplinary practices teachers and students use to make decisions for balancing tradeoffs, how they are supported (or impeded) by teachers, and how they justify these decisions. Similarly, we compared two of the teachers wearing their “student hat” in the workshop as well as their “teacher hat” in the classroom5. Our analyses suggest three significant findings. First, teachers and students tended to focus on one criterion (e.g. cost, performance) and had few discussions about trying to minimize cost and maximize performance. Second, curriculum design significantly impacts the choices students make. Using two examples, we will show the impact of weighting criteria differently on the design strategies teachers and students make. Last, we noted most of the feedback given was related to managing classroom activity rather than supporting students’ designs. Implications of this study are relevant to both engineering educators and engineering curriculum developers. 
    more » « less