Spatial skills are fundamental to learning and developing expertise in engineering. This paper describes a new virtual and physical manipulatives (VPM) technology that this research team recently developed to enhance undergraduate engineering students’ spatial skills. This technology consists of ten manipulatives spanning a variety of levels of geometrical complexity. Each manipulative is authentic due to their real-world engineering applications that were chosen to stimulate student interest in engineering. A computer program was developed to connect virtual and physical manipulatives, allowing students to receive spatial training anytime, anywhere through the Internet. Quasi-experimental research, involving an intervention group (n = 37) and a control group (n = 34), was conducted. Each group completed a pre- and post-test using the same assessment instrument that measured students’ spatial skills. Normality tests were conducted. The results show that the data involved in the present study did not have a normal distribution. Thus, non-parametric statistical analysis was performed, including descriptive analysis, correlation analysis, and Mann-Whitney U tests. The results show that the mean value of normalized learning gains is 41.2% for the intervention group, which is 33% higher than that for the control group (8.2%). A statistically significant difference exists between the intervention and control groups in terms of normalized learning gains (P < 0.01). The new VPM technology developed from the present study has a medium effect size (0.34) on improving students’ spatial skills.
more »
« less
Improving Student Learning of Impulse and Momentum in Particle Dynamics Through Computer Simulation and Animation
Computer simulation and animation (CSA) is educational technology in which computer programs are employed to simulate and animate real-world physical phenomena and processes. CSA has attracted growing attention and received an increasing number of applications in the international science, technology, engineering, and mathematics education community in recent years. The present study focuses on developing and assessing two CSA learning modules for improving student learning and problem-solving related to impulse and momentum in particle dynamics. Both CSA learning modules integrate mathematical problem-solving procedures into computer simulation and animation. They have interactive computer graphical user interfaces, which enable students to change input variables and visualize how output variables change accordingly. A quasi-experimental, quantitative research study was performed, involving 285 undergraduate engineering students divided into a comparison group that did not use CSA and an intervention group that used CSA. The results of statistical non-parametric analysis on the data collected from pre- and post-tests on the two groups show that, on average, the intervention group achieved more learning gains than the comparison group by 44% and 40% from two CSA learning modules, respectively. The difference in learning gains between the two groups of student participants was statistically significant.
more » « less- NSF-PAR ID:
- 10367364
- Publisher / Repository:
- SAGE Publications
- Date Published:
- Journal Name:
- Journal of Educational Computing Research
- Volume:
- 60
- Issue:
- 8
- ISSN:
- 0735-6331
- Page Range / eLocation ID:
- p. 1969-1990
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Security is a critical aspect in the design, development, and testing of software systems. Due to the increasing need for security-related skills within software systems and engineering, there is a growing demand for these skills to be taught at the university level. A series of 41 security modules was developed to assess the impact of these modules on teaching critical cyber security topics to students. This paper presents the implementation and outcomes of the first set of six security modules in a Freshman level course. This set consists of five modules presented in lectures as well as a sixth module emphasizing encryption and decryption used as the semester project for the course. Each module is a collection of concepts related to cyber security. The individual cyber security concepts are presented with a general description of a security issue to avoid, sample code with the security issue written in the Java programming language, and a second version of the code with an effective solution. The set of these modules was implemented in Computer Science I during the Fall 2019 semester. Incorporating each of the concepts in these modules into lectures depends on both the topic covered and the approach to resolving the related security issue. Students were introduced to computing concepts related to both the security issue and the appropriate solution to fully grasp the overall concept. After presenting the materials to students, continual review with students is also essential. This reviewal process requires exploring use-cases for the programming mechanisms presented as solutions to the security issues discussed. In addition to the security modules presented in lectures, students were given a hands-on approach to understanding the concepts through Model-Eliciting Activities (MEAs). MEAs are open-ended, problem-solving activities in which groups of three to four students work to solve realistic complex problems in a classroom setting. The semester project related to encryption and decryption was implemented into the course as an MEA. To assess the effectiveness of incorporating security modules with the MEA project into the curriculum of Computer Science I, two sections of the course were used as a control group and a treatment group. The treatment group included the security modules in lectures and the MEA project while the control group did not. To measure the overall effectiveness of incorporating security modules with the MEA project, both the instructor’s effectiveness as well as the student’s attitudes and interest were measured. For instructors, the primary question to address was to what extent do instructors change their attitudes towards student learning and their teaching practices because of the implementation of cyber security modules through MEAs. For students, the primary question to address was how the inclusion of security modules with the MEA project improved their understanding of the course materials and their interests in computer science. After implementing security modules with the MEA project, students showed a better understanding of cyber security concepts and a greater interest in broader computer science concepts. The instructor’s beliefs about teaching, learning, and assessment shifted from teacher-centered to student-centered, during his experience with the security modules and MEA.more » « less
-
We propose and assess the effectiveness of novel immersive simulation-based learning (ISBL) modules for teaching and learning engineering economy concepts. The proposed intervention involves technology-enhanced problem-based learning where the problem context is represented via a three-dimensional (3D), animated discrete-event simulation model that resembles a real-world system or situation that students may encounter in future professional settings. Students can navigate the simulated environment in both low- and high-immersion modes (i.e., on a typical personal computer or via a virtual reality headset). The simulation helps contextualize and visualize the problem setting, allowing students to observe and understand the underlying dynamics, collect relevant data/information, evaluate the effect of changes on the system, and learn by doing. The proposed ISBL approach is supported by multiple pedagogical and psychological theories, namely the information processing approach to learning theory, constructivism theory, self-determination theory, and adult learning theory. We design and implement a set of ISBL modules in an introductory undergraduate engineering economy class. The research experiments involve two groups of students: a control group and an intervention group. Students in the control group complete a set of traditional assignments, while the intervention group uses ISBL modules. We use well-established survey instruments to collect data on demographics, prior preparation, motivation, experiential learning, engineering identity, and self-assessment of learning objectives based on Bloom’s taxonomy. Statistical analysis of the results suggests that ISBL enhances certain dimensions related to motivation and experiential learning, namely relevance, confidence, and utility. We also provide a qualitative assessment of the proposed intervention based on detailed, one-on-one user testing and evaluation interviews.more » « less
-
The need to adapt quickly to online or remote instruction has been a challenge for instructors during the COVID pandemic. A common issue instructors face is finding high-quality curricular materials that can enhance student learning by engaging them in solving complex, real-world problems. The current study evaluates a set of 15 web-based learning modules that promote the use of authentic, high-cognitive demand tasks. The modules were developed collaboratively by a group of instructors during a HydroLearn hackathon-workshop program. The modules cover various topics in hydrology and water resources, including physical hydrology, hydraulics, climate change, groundwater flow and quality, fluid mechanics, open channel flow, remote sensing, frequency analysis, data science, and evapotranspiration. The study evaluates the impact of the modules on students’ learning in terms of two primary aspects: understanding of fundamental concepts and improving technical skills. The study uses a practical instrument to measure students’ perceived changes in concepts and technical skills known as the Student Assessment of Learning Gains (SALG) survey. The survey was used at two-time points in this study: before the students participated in the module (pre) and at the conclusion of the module (post). The surveys were modified to capture the concepts and skills aligned with the learning objectives of each module. We calculated the learning gains by examining differences in students’ self-reported understanding of concepts and skills from pre- to post-implementation on the SALG using paired samples t -tests. The majority of the findings were statistically at the 0.05 level and practically significant. As measured by effect size, practical significance is a means for identifying the strength of the conclusions about a group of differences or the relationship between variables in a study. The average effect size in educational research is d = 0.4. The effect sizes from this study [0.45, 1.54] suggest that the modules play an important role in supporting students’ gains in conceptual understanding and technical skills. The evidence from this study suggests that these learning modules can be a promising way to deliver complex subjects to students in a timely and effective manner.more » « less
-
Problem solving is a vital skill required to be successful in many engineering industries. One way for students to practice problem solving is through solving homework problems. However, solutions manuals for textbook problems are usually available online, and students can easily default to copying from solution manual. To address the solution manual dilemma and promote better problem-solving ability, this study utilizes novel homework problems that integrate a video component as an alternative to text-only, textbook problems. Building upon research showing visuals promote better learning, YouTube videos are reversed engineered by students to create new homework problems. Previous studies have catalogued student-written problems in a material and energy balance course, which are called YouTube problems. In this study, textbook homework problems were replaced with student-written YouTube problems. We additionally focused on examining learning attitudes after students solve YouTube problems. Data collection include attitudinal survey responses using a validated instrument called CLASS (Colorado Learning Attitudes about Science Survey). Students completed the survey at the beginning and end of the course. Analysis compared gains in attitudes for participants in the treatment groups. Mean overall attitude of participants undergoing YouTube intervention was improved by a normalized gain factor of 0.15 with a small effect size (Hedge’s g = 0.35). Improvement was most prominent in attitudes towards personal application and relation to real world connection with normalized gain of 0.49 and small effect size (Hedge’s g = 0.38).more » « less
