skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Designing a Dashboard for Student Teamwork Analysis
Classroom dashboards are designed to help instructors effectively orchestrate classrooms by providing summary statistics, activity tracking, and other information [12]. Existing dashboards are generally specific to an LMS or platform and they generally summarize individual work, not group behaviors. However, CS courses typically involve constellations of tools and mix on- and offline collaboration. Thus, cross-platform monitoring of individuals and teams is important to develop a full picture of the class. In this work, we describe our work on Concert, a data integration platform that collects data about student activities from several sources such as Piazza, My Digital Hand, and GitHub and uses it to support classroom monitoring through analysis and visualizations. We discuss team visualizations that we have developed to support effective group management and to help instructors identify teams in need of intervention.  more » « less
Award ID(s):
1821475
PAR ID:
10392592
Author(s) / Creator(s):
Editor(s):
Merkle, Larry; Doyle, Maureen; Sheard, Judithe; Soh, Leen-Kiat; Dorn, Brian
Date Published:
Journal Name:
Proceedings of the 53rd ACM Technical Symposium on Computer Science Education
Page Range / eLocation ID:
446-452
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Michalsky, Tova; Moos, Daniel (Ed.)
    Teachers’ ability to self-regulate their own learning is closely related to their competency to enhance self-regulated learning (SRL) in their students. Accordingly, there is emerging research for the design of teacher dashboards that empower instructors by providing access to quantifiable evidence of student performance and SRL processes. Typically, they capture evidence of student learning and performance to be visualized through activity traces (e.g., bar charts showing correct and incorrect response rates, etc.) and SRL data (e.g., eye-tracking on content, log files capturing feature selection, etc.) in order to provide teachers with monitoring and instructional tools. Critics of the current research on dashboards used in conjunction with advanced learning technologies (ALTs) such as simulations, intelligent tutoring systems, and serious games, argue that the state of the field is immature and has 1) focused only on exploratory or proof-of-concept projects, 2) investigated data visualizations of performance metrics or simplistic learning behaviors, and 3) neglected most theoretical aspects of SRL including teachers’ general lack of understanding their’s students’ SRL. Additionally, the work is mostly anecdotal, lacks methodological rigor, and does not collect critical process data (e.g. frequency, duration, timing, or fluctuations of cognitive, affective, metacognitive, and motivational (CAMM) SRL processes) during learning with ALTs used in the classroom. No known research in the areas of learning analytics, teacher dashboards, or teachers’ perceptions of students’ SRL and CAMM engagement has systematically and simultaneously examined the deployment, temporal unfolding, regulation, and impact of all these key processes during complex learning. In this manuscript, we 1) review the current state of ALTs designed using SRL theoretical frameworks and the current state of teacher dashboard design and research, 2) report the important design features and elements within intelligent dashboards that provide teachers with real-time data visualizations of their students’ SRL processes and engagement while using ALTs in classrooms, as revealed from the analysis of surveys and focus groups with teachers, and 3) propose a conceptual system design for integrating reinforcement learning into a teacher dashboard to help guide the utilization of multimodal data collected on students’ and teachers’ CAMM SRL processes during complex learning. 
    more » « less
  2. The ultimate goal of using learning analytics dashboards is to improve teaching and learning processes. Instructors that use an analytics dashboard are presented with data about their students and/or about their teaching practices. Despite growing research in analytics dashboards, little is known about how instructors make sense of the data they receive and reflect on it. Moreover, there is limited evidence on how instructors who use these dashboards take further actions and improve their pedagogical practices. My dissertation work addresses these issues by examining instructors’ sense making, reflective practice and subsequent actions taken from classroom analytics in three phases: (a) problem analysis from systematic literature review (current), (b) implementation and examination of instructors’ sense-making and reflective practice (current) and (c) human-centered approaches to co-designing instructors’ dashboards with stakeholders (current). The findings will contribute to the conceptual basis of instructors’ change of their pedagogical practices and practical implications of human-centered principles in designing effective dashboards. 
    more » « less
  3. Data dashboards provide a means for sharing multiple data products at a glance and were ubiquitous during the COVID-19 pandemic. Data dashboards tracked global and country-specific statistics and provided cartographic visualizations of cases, deaths, vaccination rates and other metrics. We examined the role of geospatial data on COVID-19 dashboards in the form of maps, charts, and graphs. We organize our review of 193 COVID-19 dashboards by region and compare the accessibility and operationality of dashboards over time and the use of web maps and geospatial visualizations. We found that of the dashboards reviewed, only 17% included geospatial visualizations. We observe that many of the COVID-19 dashboards from our analysis are no longer accessible (66%) and consider the ephemeral nature of data and dashboards. We conclude that coordinated efforts and a call to action to ensure the standardization, storage, and maintenance of geospatial data for use on data dashboards and web maps are needed for long-term use, analyses, and monitoring to address current and future public health and other challenging issues. 
    more » « less
  4. It is widely accepted that active learning and group work generally enhance learning in the statistics classroom, but how should those groups be formed? This study aims to better understand the characteristics of a productive team in the undergraduate introductory statistics course. Specifically, we explore the relationship between the attitudes of a student’s teammates and that student’s academic performance in both individual and group settings. We find moderate evidence that positive teammate attitudes towards statistics are associated with greater improvement from a student’s individual to the team exam score. If we can better understand what combination of student characteristics results in productive teams, instructors can be intentional with how they form groups in the classroom, realizing the full efficacy of active learning. 
    more » « less
  5. Teamwork is critical to engineering professional work. While some aspects of teaming with engineering students are well understood and implemented into instructional tools, tools for handling student teams dealing with implicit and explicit racism, sexism, and homophobia are infrequent. Instructors of large undergraduate courses need tools to help make team-level marginalization visible at the classroom level to interrupt discriminatory or marginalizing behavior amongst teammates, and to model allyship so teammates learn how to interrupt others' marginalizing behavior when instructors are not around. This paper describes the broader project, and describes some early results, focused on an algorithm that can help identify teams engaging in marginalizing behaviors against minoritized students, whether minoritized by race, gender, nationality, LGBTQ identity, or other categorization schemes. We describe how the algorithm is proving useful to identify student teams to focus on for analysis to answer some of our research questions focused on how engineering undergraduate teams marginalize minoritized members, and illustrate one such analysis. We describe our continuing work on the broader project. 
    more » « less