skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Evaluating the Design of a Learning Analytics Dashboard from a User Experience Approach
This study reported the process of developing and evaluating a student-facing learning analytics dashboard (LAD) for an online STEM skill practice system from a user experience approach. A usability survey was administered to 19 LAD users to gather information on what the learners believed were the most important features and what needed to be done to further improve the design of the LAD. Our findings showed that the most important LAD feature to students was showing the accuracy level of their practice and providing the option to redo the practice. These findings informed the revisions of the preliminary design of the LAD and provided insights into future development of student-facing LADs in online learning environments.  more » « less
Award ID(s):
2142608
PAR ID:
10510627
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
Association for the Advancement of Computing in Education (AACE)
Date Published:
Journal Name:
Proceedings of Society for Information Technology & Teacher Education International Conference
Format(s):
Medium: X
Location:
Las Vegas, Nevada, United States
Sponsoring Org:
National Science Foundation
More Like this
  1. Despite the potential of learning analytics dashboards (LADs) to support learners’ needs for autonomy, little research has been conducted on designing LADs to support student autonomy. In this paper, we reported the process of designing a student-facing LAD that offers students’ autonomy support by providing necessary information for students to set their own goals and choose learning activities that are aligned with their goals. A leaderboard was also integrated into the LAD to promote student motivation. Reeves’s (2006) design-based research model was adopted to develop the LAD. The final version of the LAD was presented, and the significance of the work was discussed. 
    more » « less
  2. A key goal of science education articulated in A Framework for K-12 Science Education is to create opportunities for students to answer questions about the world that connect to their interests, experiences, and identities. Interest can be seen as a malleable relationship between a person and object (such a phenomenon students might study). In this paper, we analyzed data from a design study of an online course focused on preparing 11 secondary teachers to design three-dimensional tasks that align to the Next Generation Science Standards and that connect to students’ interests. Our data sources were teachers’ descriptions of their design decisions about what phenomena to use to anchor assessment, designed assessment tasks, and interviews with them about those decisions. We found that interest was an important consideration for assessment design, but they considered student interests in different ways. Some teachers shifted their views of what it meant to engage student interests in the context of assessment design over the course of their participation in professional learning. Most teachers made decisions about what they believed their students were interested in based on their knowledge of students or beliefs about their students’ interests. In supporting teachers to design summative assessments that link to students’ interest, it is critical to assume teachers bring a range of conceptions of interest, and to consider the feasibility and utility of task design tools from teachers’ point of view. 
    more » « less
  3. This paper demonstrated how to apply Machine Learning (ML) techniques to analyze student interaction data collected in an online mathematics game. Using a data-driven approach, we examined 1) how different ML algorithms influenced the precision of middle-school students’ (N = 359) performance (i.e. posttest math knowledge scores) prediction and 2) what types of in-game features (i.e. student in-game behaviors, math anxiety, mathematical strategies) were associated with student math knowledge scores. The results indicated that the Random Forest algorithm showed the best performance (i.e. the accuracy of models, error measures) in predicting posttest math knowledge scores among the seven algorithms employed. Out of 37 features included in the model, the validity of the students’ first mathematical transformation was the most predictive of their posttest math knowledge scores. Implications for game learning analytics and supporting students’ algebraic learning are discussed based on the findings. 
    more » « less
  4. Argumentation is a core disciplinary practice in mathematics and science that is important for both content understanding and everyday reasoning. In this report, we investigate how the National Science Foundation’s (NSF’s) recent research investments have advanced understanding and supported the development of interventions that improve the teaching and learning of argumentation in mathematics and science education. In the 5 years spanning 2011 to 2015, NSF’s Discovery Research PreK–12 (DRK-12) program funded or cofunded 23 projects relating to argumentation, with more than $40 million awarded. These 23 DRK-12 projects primarily focused on argumentation in high school and middle school and applied correlational/observational and longitudinal methods (rather than quasiexperimental or experimental methods), often reporting on the design and implementation of technological supports for the teaching and learning of argumentation. Our synthesis of empirical findings focused on how these projects studied both teacher- and student-facing interventions that improved the teaching and learning of argumentation, as well as naturalistic observations of argumentation in classroom settings that helped inform the design and development of future argumentation interventions. Link to PDF: https://www.air.org/sites/default/files/2022-05/Mathematical-and-Scientific-Argumentation-in-PreK-12-April-2022.pdf 
    more » « less
  5. Inquiry is featured prominently in the Next Generation Science Standards (NGSS) as a promising pedagogical approach. Building on current conceptions of inquiry, a mixed-methods research design was used to explore the effects of Project-Based Inquiry (PBI) Global on student science content knowledge, motivation, and perspectives related to inquiry in a cross-school collaboration. The data sources included pre-/post-tests on science content and student motivation (n = 75), transcripts from student focus groups (n = 26), and students’ multimodal learning products (n = 18 teams). The quantitative findings indicated School B students were more motivated by the project than School A students, which mirrored student performance. The student focus group findings generated three themes: constructing empathy, learning for impact, and navigating challenges. The discussion focuses on an integrated view of what students gained and did not gain from the PBI Global experience, including a nuanced explanation of how motivation and content knowledge may be influenced by student experiences and school contextual factors during PBI Global. Implications for instructional practice highlight how relationship building, mutual respect, and consensus making are essential components of constructing cross-school collaborations and the importance of integrating instructional frameworks with teachers and students. Future research will focus on investigating the effects of PBI Global on student learning in cross-school partnerships through experimental-designed studies, and the systemic and structural barriers to scaling cross-school inquiry-based learning. 
    more » « less