Despite the potential of learning analytics dashboards (LADs) to support learners’ needs for autonomy, little research has been conducted on designing LADs to support student autonomy. In this paper, we reported the process of designing a student-facing LAD that offers students’ autonomy support by providing necessary information for students to set their own goals and choose learning activities that are aligned with their goals. A leaderboard was also integrated into the LAD to promote student motivation. Reeves’s (2006) design-based research model was adopted to develop the LAD. The final version of the LAD was presented, and the significance of the work was discussed.
more »
« less
This content will become publicly available on March 25, 2025
Evaluating the Design of a Learning Analytics Dashboard from a User Experience Approach
This study reported the process of developing and evaluating a student-facing learning analytics dashboard (LAD) for an online STEM skill practice system from a user experience approach. A usability survey was administered to 19 LAD users to gather information on what the learners believed were the most important features and what needed to be done to further improve the design of the LAD. Our findings showed that the most important LAD feature to students was showing the accuracy level of their practice and providing the option to redo the practice. These findings informed the revisions of the preliminary design of the LAD and provided insights into future development of student-facing LADs in online learning environments.
more »
« less
- Award ID(s):
- 2142608
- PAR ID:
- 10510627
- Publisher / Repository:
- Association for the Advancement of Computing in Education (AACE)
- Date Published:
- Journal Name:
- Proceedings of Society for Information Technology & Teacher Education International Conference
- Format(s):
- Medium: X
- Location:
- Las Vegas, Nevada, United States
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
An instrumental case study was conducted at a large, public research university in the mid-Atlantic region of the United States to understand undergraduate use of learning analytics dashboard (LAD) interventions. Eighty-one undergraduate students participated in focus groups. Scenario-based questions, modeled on current and future LAD interventions, were asked to understand student uses, perceptions, and reactions to these interfaces. Results indicate that student sensemaking is tied to data relevance, accuracy, and context. Further, trust in both data, especially predictive data, and in relationships, especially with faculty, are foundational to the sensemaking of LAD data and interventions. A model of student sensemaking of LAD interventions is provided.
-
This paper demonstrated how to apply Machine Learning (ML) techniques to analyze student interaction data collected in an online mathematics game. Using a data-driven approach, we examined 1) how different ML algorithms influenced the precision of middle-school students’ (N = 359) performance (i.e. posttest math knowledge scores) prediction and 2) what types of in-game features (i.e. student in-game behaviors, math anxiety, mathematical strategies) were associated with student math knowledge scores. The results indicated that the Random Forest algorithm showed the best performance (i.e. the accuracy of models, error measures) in predicting posttest math knowledge scores among the seven algorithms employed. Out of 37 features included in the model, the validity of the students’ first mathematical transformation was the most predictive of their posttest math knowledge scores. Implications for game learning analytics and supporting students’ algebraic learning are discussed based on the findings.more » « less
-
Sacristán, A.I. (Ed.)The development of a model that explains how teachers learn from teaching is critical for informing the design of quality professional development, which in turn can support teachers’ effectiveness and student learning. This article reports the authors’ effort to develop a model that brings together critical findings from existing research to unpack when and under what conditions teachers learn from teaching. Grounded in evidence drawn from research relating to teachers’ learning and practice, the authors build a rationale for the Learning from Teaching (LFT) model, introduce each component of the model and propose two conditions that increase the likelihood of teachers’ learning from their own teaching.more » « less
-
Argumentation is a core disciplinary practice in mathematics and science that is important for both content understanding and everyday reasoning. In this report, we investigate how the National Science Foundation’s (NSF’s) recent research investments have advanced understanding and supported the development of interventions that improve the teaching and learning of argumentation in mathematics and science education. In the 5 years spanning 2011 to 2015, NSF’s Discovery Research PreK–12 (DRK-12) program funded or cofunded 23 projects relating to argumentation, with more than $40 million awarded. These 23 DRK-12 projects primarily focused on argumentation in high school and middle school and applied correlational/observational and longitudinal methods (rather than quasiexperimental or experimental methods), often reporting on the design and implementation of technological supports for the teaching and learning of argumentation. Our synthesis of empirical findings focused on how these projects studied both teacher- and student-facing interventions that improved the teaching and learning of argumentation, as well as naturalistic observations of argumentation in classroom settings that helped inform the design and development of future argumentation interventions. Link to PDF: https://www.air.org/sites/default/files/2022-05/Mathematical-and-Scientific-Argumentation-in-PreK-12-April-2022.pdfmore » « less
