An official website of the United States government
Recent studies have shown that students follow stable behavioral patterns while learning in online educational systems. These behavioral patterns can further be used to group the students into different clusters. However, as these clusters include both high- and low-performance students, the relation between the behavioral patterns and student performance is yet to be clarified. In this work, we study the relationship between students’ learning behaviors and their performance, in a self-organized online learning system that allows them to freely practice with various problems and worked examples. We represent each student’s behavior as a vector of highsupport sequential micro-patterns. Then, we discover both the prevalent behavioral patterns in each group and the shared patterns across groups using discriminative non-negative matrix factorization. Our experiments show that we can successfully detect such common and specific patterns in students’ behavior that can be further interpreted into student learning behavior trait patterns and performance patterns.
more »
« less
Annotated Examples and Parameterized Exercises: Analyzing Students’ Behavior Patterns
Recent studies of student problem-solving behavior have shown stable behavior patterns within student groups. In this work, we study patterns of student behavior in a richer self-organized practice context where student worked with a combination of problems to solve and worked examples to study. We model student behavior in the form of vectors of micro-patterns and examine student behavior stability in various ways via these vectors. To discover and examine global behavior patterns associated with groups of students, we cluster students according to their behavior patterns and evaluate these clusters in accordance with student performance.
more »
« less
- Award ID(s):
- 1755910
- PAR ID:
- 10176148
- Date Published:
- Journal Name:
- Journal of artificial intelligence in education
- Volume:
- 11625
- ISSN:
- 1043-1020
- Page Range / eLocation ID:
- 308-319
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Understanding student practice behavior and its connection to their learning is essential for effective recommender systems that provide personalized learning support. In this study, we apply a sequential pattern mining approach to analyze student practice behavior in a practice system for introductory Python programming. Our goal is to identify different types of practice behavior and connect them to student performance. We examine two types of practice sequences: (1) by login session and (2) by learning topic. For each sequence type, we use SPAM (Sequential PAttern Mining) to identify the most frequent micro-patterns and build behavior profiles of individual learners as vectors of micro-pattern frequencies observed in their behavior. We confirm that these vectors are stable for both sequence types (p < 0.03 for session sequences and p < 0.003 for topic sequences). Using the vectors, we perform K-means clustering where we identify two practice behaviors: example explorers and persistent finishers. We repeat this experiment using different coding approaches for student sequences and obtain similar clusters. Our results suggest that example explorers and persistent finishers might represent two typical types of divergent student behaviors in a programming practice system. Finally, to better understand the relationship between students' background knowledge, learning outcomes, and practice behavior, we perform statistical analyses to assess the significance of the associations among pre-test scores, cluster assignments, and final course grades.more » « less
-
Recent studies have identified an incomplete student understanding of how elastic rebound causes earthquakes. We hypothesized that realistic imaging of spatial patterns in ground motions over the course of the earthquake cycle would improve student understanding. Incorporating spatial change information in the form of both motion vectors and before-during-after contrasts should require most students to change an existing mental model or develop a new model. Using a quasi-experimental design, we developed instructional interventions for presenting variations in ground motion, including map views of fence bending and GPS velocity vectors. We measured the impact on student performance based on assignment questions related to the ground motion at different points in the earthquake cycle following several interventions in four undergraduate courses from introductory to upper level over 4 years. The first round of study was a free-response format and then multiple-choice answers were created from the most common answers, including new “worked example” questions inquiring about the reasons answers were correct or incorrect. We identified two key misconceptions based on student answer choices: (a) difficulty in recognizing velocity vector patterns when presented in a new reference frame, and (b) difficulty in reasoning that the fault must be locked for the strain to accumulate and produce an earthquake. Our analysis indicates the largest performance increases occur with simple animations that demonstrate the bending, breaking, and rebending of a fence, along with associated GPS vectors, plotted successively in different reference frames. This suggests difficulties in understanding elastic rebounds can be mitigated when spatial patterns are presented in a context with repeated opportunities to make predictions combined with animations to support mental models that connect the spatial patterns with ground movement.more » « less
-
Novice programmers can greatly improve their understanding of challenging programming concepts by studying worked examples that demonstrate the implementation of these concepts. Despite the extensive repositories of effective worked examples created by CS education experts, a key challenge remains: identifying the most relevant worked example for a given programming problem and the specific difficulties a student faces solving the problem. Previous studies have explored similar example recommendation approaches. Our research introduces a novel method by utilizing deep learning code representation models to generate code vectors, capturing both syntactic and semantic similarities among programming examples. Driven by the need to provide relevant and personalized examples to programming students, our approach emphasizes similarity assessment and clustering techniques to identify similar code problems, examples, and challenges. This method aims to deliver more accurate and contextually relevant recommendations based on individual learning needs. Providing tailored support to students in real-time facilitates better problem-solving strategies and enhances students' learning experiences, contributing to the advancement of programming education.more » « less
-
In recent years, research has associated grade point average (GPA) with a variety of student outcomes during their undergraduate careers. The studies link higher GPAs to students being more likely to graduate in their major, while lower GPAs have been linked to students switching majors or leaving the institution. Further research, which focuses on how Black female and male students remain successful in different engineering degrees, is necessary to identify the underlying elements contributing to their entrance into and exit from engineering disciplines. This quantitative examination of trends among the GPAs of Black women and men is part of a larger NSF-funded mixed-methods study that includes in-depth student interviews of Black students who persisted in and switched from ME. In this quantitative paper, we examine the GPA patterns of Black students in Mechanical Engineering (ME). Students who have ever enrolled in ME have four potential, mutually exclusive, outcomes: 1) they can persist for 12 semesters without graduating; 2) they can graduate in ME within 12 semesters; 3) they can switch to another major; or 4) they can leave school. In this research, we identify the most common GPA patterns associated with graduated ME students. We hypothesize a relationship between distinct GPA patterns and whether a student persists in ME, graduates in ME, switches away from ME, or leaves the institution altogether. This quantitative investigation uses the Multiple-Institution Database for Investigating Engineering Longitudinal Development (MIDFIELD) to collect the cumulative GPA of ME students at each term. We use a functional cluster analysis approach to group similar patterns. First, a function is fit to each student record. Then a cluster analysis is conducted on the function parameters to identify natural groupings in the data. Once students are grouped according to their GPA profile, we examine the other characteristics and outcomes of the group. We present a visual quantitative analysis of the patterns in the GPAs of Black women and men who enroll in ME. Clustering analysis suggests that first-time-in-college (FTIC) Black female students in ME who graduated have a higher proportion of students in the higher GPA clusters than the proportion of FTIC Black male students who graduated in ME. A higher proportion of the male student population is clustered in the lower GPA cluster groups as compared to women in the lower GPA cluster groups. A higher proportion of students who graduated are in the higher GPA clusters than the proportion of graduated students in the lower GPA clusters.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1007/978-3-030-23204-7_26
