skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Analyzing Immersive Simulation-based Learning Modules in Remote and In-Person Settings
This paper presents a study on the impact of class delivery mode (remote vs. in-person) on students’ learning experience when Immersive Simulation-Based Learning (ISBL) modules are used as course assignments. ISBL involves problem-based learning via a 3-dimensional (3D) simulated environment that mimics real-life applications such as manufacturing and healthcare systems, airports, and other service systems. Within the simulated environment, students can observe the corresponding system, collect data, understand relationships between the system components, make changes to the model and observe the impact of those changes, and learn by doing. ISBL is advantageous when access to real-world facilities is difficult or impossible due to geographical barriers or safety concerns as well as in remote and online learning due to geographically dispersed students. This study compares two groups of students. Both groups are taught by the same instructor and use the same course material, including the ISBL modules. The only difference between the two groups is the course delivery mode, where one group is taught remotely through synchronous online sessions, and the other is taught in person in a traditional classroom setting. We collect data on demographics, prior preparation, motivation, experiential learning, usability scale, and self-assessment of learning objectives based on Bloom’s taxonomy. We then perform statistical comparisons to investigate the impact of delivery mode when ISBL modules are used. We use the comparison results to test the hypothesis that ISBL modules will help maintain remote students’ motivation and learning outcomes compared to in-person students. The results show no statistically significant difference between the two groups on any measure, suggesting that ISBL is equally effective in the two delivery modes.  more » « less
Award ID(s):
2000599
PAR ID:
10528753
Author(s) / Creator(s):
; ;
Publisher / Repository:
American Society for Engineering Education (ASEE)
Date Published:
Subject(s) / Keyword(s):
Immersive Simulation-Based Learning Immersive Technologies Remote Instruction In-Person Instruction
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. We propose and assess the effectiveness of novel immersive simulation-based learning (ISBL) modules for teaching and learning engineering economy concepts. The proposed intervention involves technology-enhanced problem-based learning where the problem context is represented via a three-dimensional (3D), animated discrete-event simulation model that resembles a real-world system or situation that students may encounter in future professional settings. Students can navigate the simulated environment in both low- and high-immersion modes (i.e., on a typical personal computer or via a virtual reality headset). The simulation helps contextualize and visualize the problem setting, allowing students to observe and understand the underlying dynamics, collect relevant data/information, evaluate the effect of changes on the system, and learn by doing. The proposed ISBL approach is supported by multiple pedagogical and psychological theories, namely the information processing approach to learning theory, constructivism theory, self-determination theory, and adult learning theory. We design and implement a set of ISBL modules in an introductory undergraduate engineering economy class. The research experiments involve two groups of students: a control group and an intervention group. Students in the control group complete a set of traditional assignments, while the intervention group uses ISBL modules. We use well-established survey instruments to collect data on demographics, prior preparation, motivation, experiential learning, engineering identity, and self-assessment of learning objectives based on Bloom’s taxonomy. Statistical analysis of the results suggests that ISBL enhances certain dimensions related to motivation and experiential learning, namely relevance, confidence, and utility. We also provide a qualitative assessment of the proposed intervention based on detailed, one-on-one user testing and evaluation interviews. 
    more » « less
  2. Researchers have looked into ways to make computer science assignments more engaging, practical, and beneficial to students to improve learning outcomes by increasing student appeal. Offering a pool of assignments and allowing students to choose their preferred assignments is considered as a potential method for improving learning outcomes. In this paper, we investigate the effect of context choice for assignments in an object-oriented programming course that covers various topics such as object-oriented programming concepts, database design and implementation, graphical user interface design, and web application development. Students complete three immersive simulation-based learning (ISBL) modules as course assignments. ISBL modules involve technology-enhanced problem-based learning where the problem context is represented via a three-dimensional (3D), animated discrete-event simulation model that resembles a real-world system or context, in this case, we have three simulated systems/contexts around which ISBL assignments are defined: an airport, a manufacturing system, and a hospital emergency department. The research experiments involve four groups: (1) students with no choice who use the same assigned simulated system for all three ISBL assignments; (2) students with no choice who are given a different simulated system for each ISBL assignment; (3) students who can choose their preferred simulated system at the beginning but cannot change their choice for future assignments; and, (4) students who can choose at the beginning and switch between the three simulated systems for subsequent assignments. Data are collected over multiple semesters and statistical analyses are conducted to compare the four groups in terms of motivation, experiential learning, and self assessment of learning. We also conduct qualitative assessments in the form of interviews to support and explain our statistical results. 
    more » « less
  3. With the increasing use of virtual simulated environments and immersive technologies in STEM education and workforce training, it is becoming increasingly important to study and understand how learners’ interactions and navigation in virtual environments affect their learning and skill development. In this paper, we quantify and assess the effect of learners’ navigation in an immersive simulated environment on learning outcomes, where navigation is characterized by the total time spent in the simulation and time allocations to different areas within the virtual environment. We implement a set of immersive simulation-based learning (ISBL) modules in an undergraduate computer science course with eighteen students and record their screen as they navigate in the simulation environment to perform the tasks needed to complete the ISBL assignments. We use a video analytics tool to process and analyze the videos and collect statistics related to a set of navigation-related measures for each student. We also use surveys to collect data on students’ demographics, prior knowledge and experience, personality, experiential learning, and self-assessment of learning. We then perform a set of multivariable regression analyses to characterize and explain the relationship between navigation measures and constructs assessed via survey instruments to determine how/if users’ navigation in the simulated environment can be a predictor of their learning outcomes. The results indicate that the total time spent in the simulation and the distribution of time allocations among different areas within the simulated environment are predictors of experiential learning and students’ self-assessment of learning. 
    more » « less
  4. null (Ed.)
    Student perceptions of the complete online transition of two CS courses in response to the COVID-19 pandemic Due to the COVID-19 pandemic, universities across the globe switched from traditional Face-to-Face (F2F) course delivery to completely online. Our university declared during our Spring break that students would not return to campus, and that all courses must be delivered fully online starting two weeks later. This was challenging to both students and instructors. In this evidence-based practice paper, we present results of end-of-semester student surveys from two Spring 2020 CS courses: a programming intensive CS2 course, and a senior theory course in Formal Languages and Automata (FLA). Students indicated course components they perceived as most beneficial to their learning, before and then after the online transition, and preferences for each regarding online vs. F2F. By comparing student reactions across courses, we gain insights on which components are easily adapted to online delivery, and which require further innovation. COVID was unfortunate, but gave a rare opportunity to compare students’ reflections on F2F instruction with online instructional materials for half a semester vs. entirely online delivery of the same course during the second half. The circumstances are unique, but we were able to acquire insights for future instruction. Some course components were perceived to be more useful either before or after the transition, and preferences were not the same in the two courses, possibly due to differences in the courses. Students in both courses found prerecorded asynchronous lectures significantly less useful than in-person lectures. For CS2, online office hours were significantly less useful than in-person office hours, but we found no significant difference in FLA. CS2 students felt less supported by their instructor after the online transition, but no significant difference was indicated by FLA students. FLA students found unproctored online exams offered through Canvas more stressful than in-person proctored exams, but the opposite was indicated by CS2 students. CS2 students indicated that visual materials from an eTextbook were more useful to them after going online than before, but FLA students indicated no significant difference. Overall, students in FLA significantly preferred the traditional F2F version of the course, while no significant difference was detected for CS2 students. We did not find significant effects from gender on the preference of one mode over the other. A serendipitous outcome was learning that some changes forced by circumstance should be considered for long term adoption. Offering online lab sessions and online exams where the questions are primarily multiple choice are possible candidates. However, we found that students need to feel the presence of their instructor to feel properly supported. To determine what course components need further improvement before transitioning to fully online mode, we computed a logistic regression model. The dependent variable is the student's preference for F2F or fully online. The independent variables are the course components before and after the online transition. For both courses, in-person lectures were a significant factor negatively affecting students' preferences of the fully online mode. Similarly, for CS2, in-person labs and in-person office hours were significant factors pushing students’ preferences toward F2F mode. 
    more » « less
  5. Most chemical engineering core classes are best taught when students are exposed to a face-to-face learning/teaching environment. With the arrival of coronavirus disease 2019 (COVID-19), the whole education system and the setting were disrupted at Hampton University (HU). Traditional in-person face-to-face classes were forced to move to remote instructions to maintain a healthy and safe campus environment and minimize the spread of COVID-19 on campus and in the community. As an instructor teaching core courses and unit operations laboratory in the Department of Chemical Engineering, it was challenging to move completely virtual and deliver instructions remotely without affecting students' learning outcomes. However, with the appropriate modern technologies and adapting to the students' change and needs, online teaching can be done efficiently and can still have efficient learning outcomes. Various activities were introduced to make the online/virtual class environment engaging in developing technical and professional skills and inducing learning for students. Using the latest educational tools and online resources, formative assessments were conducted throughout the course in an effort to improve student learning and instructor teaching. In addition to that, innovative ways of technology were also used to evaluate student learning and understanding of the material for grading and reporting purposes. Many of the modern educational tools, including Blackboard Collaborate Ultra, Ka-hoot, linoit, surveys, polls, and chemical engineering processes’ simulations and videos were in-troduced to make the synchronous sessions interactive. Likert-like surveys conducted were anal-yses to gauge the effectiveness of incorporation of technology during remote learning. This paper describes the innovative use of technologies to adapt to the COVID-19 pandemic in the Chemical Engineering Classes. It will also explain the strategies to assess the mode of delivery efficacy and how to change the course of teaching to adapt to the students' changing needs. 
    more » « less