An instrumental case study was conducted at a large, public research university in the mid-Atlantic region of the United States to understand undergraduate use of learning analytics dashboard (LAD) interventions. Eighty-one undergraduate students participated in focus groups. Scenario-based questions, modeled on current and future LAD interventions, were asked to understand student uses, perceptions, and reactions to these interfaces. Results indicate that student sensemaking is tied to data relevance, accuracy, and context. Further, trust in both data, especially predictive data, and in relationships, especially with faculty, are foundational to the sensemaking of LAD data and interventions. A model of student sensemaking of LAD interventions is provided.
more » « less- PAR ID:
- 10545181
- Publisher / Repository:
- SAGE Publications
- Date Published:
- Journal Name:
- Journal of Educational Technology Systems
- Volume:
- 48
- Issue:
- 1
- ISSN:
- 0047-2395
- Format(s):
- Medium: X Size: p. 130-154
- Size(s):
- p. 130-154
- Sponsoring Org:
- National Science Foundation
More Like this
-
This poster will describe and compare different visualizations for collaborative writing using cloud-based platforms (e.g., Google Docs). The aim is to develop effective visualizations for a Learning Analytics Dashboard (LAD) to understand the processes undergirding cloud-based group writing and to support team textual practices. Theoretically situated in the literatures on Collaborative Learning Analytics, collaborative sense making, and social annotations, the visualizations will provide valuable and varied insights to researchers, educators, and students. We will be testing the visualizations and the final LAD with undergraduate students, instructors, and researchers from the fields of learning sciences and educational psychology.more » « less
-
Despite the potential of learning analytics dashboards (LADs) to support learners’ needs for autonomy, little research has been conducted on designing LADs to support student autonomy. In this paper, we reported the process of designing a student-facing LAD that offers students’ autonomy support by providing necessary information for students to set their own goals and choose learning activities that are aligned with their goals. A leaderboard was also integrated into the LAD to promote student motivation. Reeves’s (2006) design-based research model was adopted to develop the LAD. The final version of the LAD was presented, and the significance of the work was discussed.more » « less
-
This study reported the process of developing and evaluating a student-facing learning analytics dashboard (LAD) for an online STEM skill practice system from a user experience approach. A usability survey was administered to 19 LAD users to gather information on what the learners believed were the most important features and what needed to be done to further improve the design of the LAD. Our findings showed that the most important LAD feature to students was showing the accuracy level of their practice and providing the option to redo the practice. These findings informed the revisions of the preliminary design of the LAD and provided insights into future development of student-facing LADs in online learning environments.more » « less
-
This paper presents the progress made in the first year of a five-year NSF ER2 (Ethical and Responsible Research)-funded project on ethical and responsible research and practices in science and engineering undertaken at a large public university in the southwestern United States. The objective of this research is to improve instructor training, interventions, and student outcomes in high schools and universities to improve awareness and commitment to ethical practices in STEM coursework. The paper will describe the progress made in several components of the grant: i) Preliminary analysis of measures of ethical knowledge, reasoning skills, attitudes, and practices of several hundred undergraduate freshmen and seniors, correlated with demographic data, based on data captured in the first year of the grant; ii) Progress made in the development of the concept of “ethical self-efficacy” and an instrument to measure it for freshmen and senior engineering students, and in assessing how it relates to ethical competency and student background; iii) Implications of these analyses in the construction of a three-week professional development program that guides high school STEM teachers through the development of learning modules on ethical issues related to their courses; iv) The assessment of the undergraduate engineering curriculum in two majors to determine appropriate courses for ethics interventions to help students understand how technical activities fit within broader social, economic, and environmental contexts; the construction of these interventions; and the development of measures to track their success; and, v) Initial steps toward measuring impact of other experiences (e.g., undergraduate research, internships, service learning) and courses (e.g., humanities, social science, and business courses) on development of ethical practices, on assessments taken in senior engineering capstone courses.more » « less
-
Sensemaking is conceptualized as a trajectory to develop better understanding and is advocated as one of the fundamental practices in science education. However, the field is lacking of a framework to view the prolonged process of sensemaking that starts from a raise of uncertainty of a target phenomenon to a grasping of a better understanding of a target phenomenon. The process requires teachers to recognize the role of scientific uncertainty in different phases of sensemaking and develop responsive instructional supports to help students navigate the uncertainties. With an attention on student scientific uncertainty as a potential driver of the trajectory of sensemaking, this study aims to identify different phases of sensemaking that can be developed with students’ scientific uncertainty. This study especially attends to two types of scientific uncertainty—conceptual and epistemic uncertainties. Conceptual uncertainty refers to student struggle of using conceptual understanding (e.g., mastery of content and everyday knowledge) to respond to an encountered phenomenon. Epistemic uncertainty emerges from struggles in using epistemic understanding to generate new ideas. Based on the multiple case study method, we examined sensemaking activities in two Korean science classrooms and one American science classroom and identified three phases of sensemaking: (a) focusing on a driving question related to a target phenomenon, (b) delving into multiple resources to develop plausible explanation(s), and (c) examining the successfulness of the new understanding and concretizing it. Based on the findings, we discuss two emerging themes. First, sensemaking progresses through three distinctive phases driven by students’ dynamically evolving scientific uncertainty. Second, attending to both epistemic and conceptual uncertainties can support developing sensemaking coherent with students’ view.more » « less