skip to main content


Title: Comparing student behavior in mastery and conventional style online physics homework
We compared students' learning behavior when completing identical online calculus-based physics homework assignments organized in two ways. One was designed for mastery learning where content is divided into smaller units, and students are required to attempt the assessment once before accessing the content. Students can proceed to the next unit after passing the assessment either before or after studying the content. The second is a conventional design in which students first study a set of instructional materials equivalent to several mastery units then complete multiple assessment problems at once. Our major findings are: 1. in the mastery condition, students solved more problems correctly either immediately after studying the instructional content, or on attempts before accessing the instructional content; 2. for students who solved similar numbers of problems correctly, the mastery condition students spent significantly less time studying compared to the traditional condition students; and 3. students who did not pass mastery units on their initial assessment attempts spent similar amounts of time studying as traditional condition students.  more » « less
Award ID(s):
1845436
NSF-PAR ID:
10133049
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Physics Education Research Conference 2019
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. We compared students' learning behavior when completing identical online calculus-based physics homework assignments organized in two ways. One was designed for mastery learning where content is divided into smaller units, and students are required to attempt the assessment once before accessing the content. Students can proceed to the next unit after passing the assessment either before or after studying the content. The second is a conventional design in which students first study a set of instructional materials equivalent to several mastery units then complete multiple assessment problems at once. Our major findings are: 1. in the mastery condition, students solved more problems correctly either immediately after studying the instructional content, or on attempts before accessing the instructional content; 2. for students who solved similar numbers of problems correctly, the mastery condition students spent significantly less time studying compared to the traditional condition students; and 3. students who did not pass mastery units on their initial assessment attempts spent similar amounts of time studying as traditional condition students. 
    more » « less
  2. For students to advance beyond arithmetic, they must learn how to attend to the structure of math notation. This process can be challenging due to students' left-to-right computing tendencies. Brackets are used in mathematics to indicate precedence but can also be used as superfluous cues and perceptual grouping mechanisms in instructional materials to direct students’ attention and facilitate accurate and efficient problem solving. This online study examines the impact of operator position and superfluous brackets on students’ performance solving arithmetic problems. A total of 528 students completed a baseline assessment of math knowledge, then were randomly assigned to one of six conditions that varied in the placement of higher-order operator and the presence or absence of superfluous brackets: 1) brackets-left (e.g., (5 * 4) + 2 + 3), 2) no brackets-left (e.g., 5 * 4 + 2 + 3), 3) brackets-center (e.g., 2 + (5 * 4) + 3), 4) no brackets-center (e.g., 2 + 5 * 4 + 3), 5) brackets-right (e.g., 2 + 3 + (5 * 4)), and 6) no brackets-right (e.g., 2 + 3 + 5 * 4). Participants simplified expressions in an online learning platform with the goal to “master” the content by answering three questions correctly in a row. Results showed that, on average, students were more accurate in problem solving when the higher-order operator was on the left side and less accurate when it was on the right compared to the center. There was also a main effect of the presence of brackets on mastery speed. However, interaction effects showed that these main effects were driven by the center position: superfluous brackets only improved accuracy when students solved expressions with brackets with the operator in the center. This study advances research on perceptual learning in math by revealing how operator position and presence of superfluous brackets impact students’ performance. Additionally, this research provides implications for instructors who can use perceptual cues to support students during problem solving. 
    more » « less
  3. For students to advance beyond arithmetic, they must learn how to attend to the structure of math notation. This process can be challenging due to students' left-to-right computing tendencies. Brackets are used in mathematics to indicate precedence but can also be used as superfluous cues and perceptual grouping mechanisms in instructional materials to direct students’ attention and facilitate accurate and efficient problem solving. This online study examines the impact of operator position and superfluous brackets on students’ performance solving arithmetic problems. A total of 528 students completed a baseline assessment of math knowledge, then were randomly assigned to one of six conditions that varied in the placement of higher-order operator and the presence or absence of superfluous brackets: [a] brackets-left (e.g., (5 * 4) + 2 + 3), [b] no brackets-left (e.g., 5 * 4 + 2 + 3), [c] brackets-center (e.g., 2 + (5 * 4) + 3), [d] no brackets-center (e.g., 2 + 5 * 4 + 3), [e] brackets-right (e.g., 2 + 3 + (5 * 4)), and [f] no brackets-right (e.g., 2 + 3 + 5 * 4). Participants simplified expressions in an online learning platform with the goal to “master” the content by answering three questions correctly in a row. Results showed that, on average, students were more accurate in problem solving when the higher-order operator was on the left side and less accurate when it was on the right compared to in the center. There was also a main effect of the presence of brackets on mastery speed. However, interaction effects showed that these main effects were driven by the center position: superfluous brackets only improved accuracy when students solved expressions with brackets with the operator in the center. This study advances research on perceptual learning in math by revealing how operator position and presence of superfluous brackets impact students’ performance. Additionally, this research provides implications for instructors who can use perceptual cues to support students during problem solving. 
    more » « less
  4. This Research Full paper focuses on perceptions and experiences of freshman and sophomore engineering students when playing an online serious engineering game that was designed to improve engineering intuition and knowledge of statics. Use of serious educational engineering games has increased in engineering education to help students increase technical competencies in engineering disciplines. However, few have investigated how these engineering games are experienced by the students; how games influence students' perceptions of learning, or how these factors may lead to inequitable perspectives among diverse populations of students. Purpose/Hypothesis: The purpose of this study was to explore the perceptions, appeal, and opinions about the efficacy of educational online games among a diverse population of students in an engineering mechanics statics course. It was hypothesized that compared to majority groups (e.g., men, White), women of color who are engineering students would experience less connections to the online educational game in terms of ease of use and level of frustration while playing. It is believed that these discordant views may negatively influence the game's appeal and efficacy towards learning engineering in this population of students. Design/Method: The Technology Acceptance Model (TAM) is expanded in this study, where the perspectives of women of colour (Latinx, Asian and African American) engineering students are explored. The research approach employed in this study is a mixed-method sequential exploratory design, where students first played the online engineering educational game, then completed a questionnaire, followed by participation in a focus group. Responses were initially analyzed through open and magnitude coding approaches to understand whether students thought these educational games reflected their personal culture. Results: Preliminary results indicate that though the majority of the students were receptive to using the online engineering software for their engineering education, merely a few intimated that they would use this software for engineering exam or technical job interview preparation. A level-one categorical analysis identified a few themes that comprised unintended preservation of inequality in favor of students who enjoyed contest-based education and game technology. Competition-based valuation of presumed mastery of course content fostered anxiety and intimidation among students, which caused some to "game the game" instead of studying the material, to meet grade goals. Some students indicated that they spent more time (than necessary) to learn the goals of the game than engineering content itself, suggesting a need to better integrate course material while minimizing cognitive effort in learning to navigate the game. Conclusions: Preliminary results indicate that engineering software's design and the way is coupled with course grading and assessment of learning outcomes, affect student perceptions of the technology's acceptance, usefulness, and ease of use as a "learning tool." Students were found to have different expectations of serious games juxtaposed software/apps designed for entertainment. Conclusions also indicate that acceptance of inquiry-based educational games in a classroom among diverse populations of students should clearly articulate and connect the game goals/objectives with class curriculum content. Findings also indicate that a multifaceted schema of tools, such as feedback on game challenges, and explanations for predictions of the game should be included in game/app designs. 
    more » « less
  5. null (Ed.)
    Engineering graduates need a deep understanding of key concepts in addition to technical skills to be successful in the workforce. However, traditional methods of instruction (e.g., lecture) do not foster deep conceptual understanding and make it challenging for students to learn the technical skills, (e.g., professional modeling software), that they need to know. This study builds on prior work to assess engineering students’ conceptual and procedural knowledge. The results provide an insight into how the use of authentic online learning modules influence engineering students’ conceptual knowledge and procedural skills. We designed online active learning modules to support and deepen undergraduate students’ understanding of key concepts in hydrology and water resources engineering (e.g., watershed delineation, rainfall-runoff processes, design storms), as well as their technical skills (e.g., obtaining and interpreting relevant information for a watershed, proficiency using HEC-HMS and HEC-RAS modeling tools). These modules integrated instructional content, real data, and modeling resources to support students’ solving of complex, authentic problems. The purpose of our study was to examine changes in students’ self-reported understanding of concepts and skills after completing these modules. The participants in this study were 32 undergraduate students at a southern U.S. university in a civil engineering senior design course who were assigned four of these active learning modules over the course of one semester to be completed outside of class time. Participants completed the Student Assessment of Learning Gains (SALG) survey immediately before starting the first module (time 1) and after completing the last module (time 2). The SALG is a modifiable survey meant to be specific to the learning tasks that are the focus of instruction. We created versions of the SALG for each module, which asked students to self-report their understanding of concepts and ability to implement skills that are the focus of each module. We calculated learning gains by examining differences in students’ self-reported understanding of concepts and skills from time 1 to time 2. Responses were analyzed using eight paired samples t-tests (two for each module used, concepts and skills). The analyses suggested that students reported gains in both conceptual knowledge and procedural skills. The data also indicated that the students’ self-reported gain in skills was greater than their gain in concepts. This study provides support for enhancing student learning in undergraduate hydrology and water resources engineering courses by connecting conceptual knowledge and procedural skills to complex, real-world problems. 
    more » « less