An official website of the United States government
We compared students' learning behavior when completing identical online calculus-based physics homework assignments organized in two ways. One was designed for mastery learning where content is divided into smaller units, and students are required to attempt the assessment once before accessing the content. Students can proceed to the next unit after passing the assessment either before or after studying the content. The second is a conventional design in which students first study a set of instructional materials equivalent to several mastery units then complete multiple assessment problems at once. Our major findings are: 1. in the mastery condition, students solved more problems correctly either immediately after studying the instructional content, or on attempts before accessing the instructional content; 2. for students who solved similar numbers of problems correctly, the mastery condition students spent significantly less time studying compared to the traditional condition students; and 3. students who did not pass mastery units on their initial assessment attempts spent similar amounts of time studying as traditional condition students.
more »
« less
Comparing student behavior in mastery and conventional style online physics homework
We compared students' learning behavior when completing identical online calculus-based physics homework assignments organized in two ways. One was designed for mastery learning where content is divided into smaller units, and students are required to attempt the assessment once before accessing the content. Students can proceed to the next unit after passing the assessment either before or after studying the content. The second is a conventional design in which students first study a set of instructional materials equivalent to several mastery units then complete multiple assessment problems at once. Our major findings are: 1. in the mastery condition, students solved more problems correctly either immediately after studying the instructional content, or on attempts before accessing the instructional content; 2. for students who solved similar numbers of problems correctly, the mastery condition students spent significantly less time studying compared to the traditional condition students; and 3. students who did not pass mastery units on their initial assessment attempts spent similar amounts of time studying as traditional condition students.
more »
« less
- Award ID(s):
- 1845436
- PAR ID:
- 10133049
- Date Published:
- Journal Name:
- Physics Education Research Conference 2019
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The current study measures the extent to which students’ self-regulated learning tactics and learning outcomes change as the result of a deliberate, data-driven improvement in the learning design of mastery-based online learning modules. In the original design, students were required to attempt the assessment once before being allowed to access the learning material. The improved design gave students the choice to skip the first attempt and access the learning material directly. Student learning tactics were measured using a multi-level clustering and process mining algorithm, and a quasi-experiment design was implemented to remove or reduce differences in extraneous factors, including content being covered, time of implementation, and naturally occurring fluctuations in student learning tactics. The analysis suggests that most students who chose to skip the first attempt were effectively self-regulating their learning and were thus successful in learning from the instructional materials. Students who would have failed the first attempt were much more likely to skip it than those who would have passed the first attempt. The new design also resulted in a small improvement in learning outcome and median learning time. The study demonstrates the creation of a closed loop between learning design and learning analytics: first, using learning analytics to inform improvements to the learning design, then assessing the effectiveness and impact of the improvements.more » « less
-
Classroom and lab-based research have shown the advantages of exposing students to a variety of problems with format differences between them, compared to giving students problem sets with a single problem format. In this paper, we investigate whether this approach can be effectively deployed in an intelligent tutoring system, which affords the opportunity to automatically generate and adapt problem content for practice and assessment purposes. We conducted a randomized controlled trial to compare students who practiced problems based on a single template to students who practiced problems based on multiple templates within the same intelligent tutoring system. No conclusive evidence was found for differences in the two conditions on students’ post-test performance and hint request behavior. However, students who saw multiple templates spent more time answering practice items compared to students who solved problems of a single structure, making the same degree of progress but taking longer to do so.more » « less
-
Confrustion, a mix of confusion and frustration sometimes experienced while grappling with instructional materials, is not necessarily detrimental to learning. Prior research has shown that studying erroneous examples can increase students’ experiences of confrustion, while at the same time helping them learn and overcome their misconceptions. In the study reported in this paper, we examined students’ knowledge and misconceptions about decimal numbers before and after they interacted with an intelligent tutoring system presenting either erroneous examples targeting misconceptions (erroneous example condition) or practice problems targeting the same misconceptions (problem-solving condition). While students in both conditions significantly improved their performance from pretest to posttest, students in the problem-solving condition improved significantly more and experienced significantly less confrustion. When controlling for confrustion levels, there were no differences in performance. This study is interesting in that, unlike prior studies, the higher confrustion that resulted from studying erroneous examples was not associated with better learning outcomes; instead, it was associated with poorer learning. We propose several possible explanations for this different outcome and hypothesize that revisions to the explanation prompts to make them more expert-like may have also made them – and the erroneous examples that they targeted – less understandable and less effective. Whether prompted self-explanation options should be modeled after the shorter, less precise language students tend to use or the longer, more precise language of experts is an open question, and an important one both for understanding the mechanisms of self-explanation and for designing self-explanation options deployed in instructional materials.more » « less
-
STEM undergraduate instructors teaching remote courses often use traditional lecture-based instruction, despite evidence that active learning methods improve student engagement and learning outcomes. One simple way to use active learning online is to incorporate exploratory learning. In exploratory learning, students explore a novel activity (e.g., problem solving) before a lecture on the underlying concepts and procedures. This method has been shown to improve learning outcomes during in-person courses, without requiring the entire course to be restructured. The current study examined whether the benefits of exploratory learning extend to a remote undergraduate physics lesson, taught synchronously online. Undergraduate physics students (N = 78) completed a physics problem-solving activity either before instruction (explore-first condition) or after (instruct-first condition). Students then completed a learning assessment of the problem-solving procedures and underlying concepts. Despite lower accuracy on the learning activity, students in the explore-first condition demonstrated better understanding on the assessment, compared to students in the instruct-first condition. This finding suggests that exploratory learning can serve as productive failure in online courses, challenging students but improving learning, compared to the more widely-used lecture-then-practice method.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1119/perc.2019.pr.Guthrie
