skip to main content


Title: An initial exploration of the perspectives and experiences of diverse learners’ acceptance of online educational engineering games as learning tools in the classroom
This Work-In-Progress falls within the research category of study and, focuses on the experiences and perceptions of first- and second year engineering students when using an online engineering game that was designed to enhance understanding of statics concepts. Technology and online games are increasingly being used in engineering education to help students gain competencies in technical domains in the engineering field. Less is known about the way that these online games are designed and incorporated into the classroom environment and how these factors can ignite inequitable perspectives and experiences among engineering students. Also, little if any work that combines the TAM model and intersectionality of race and gender in engineering education has been done, though several studies have been modified to account for gender or race. This study expands upon the Technology Acceptance Model (TAM) by exploring perspectives of intersectional groups (defined as women of color who are engineering students). A Mixed Method Sequential Exploratory Research Design approach was used that extends the TAM model. Students were asked to play the engineering educational game, complete an open-ended questionnaire and then to participate in a focus group. Early findings suggest that while many students were open to learning to use the game and recommended inclusion of online engineering educational games as learning tools in classrooms, only a few indicated that they would use this tool to prepare for exams or technical job interviews. Some of the main themes identified in this study included unintended perpetuation of inequality through bias in favor of students who enjoyed competition-based learning and assessment of knowledge, and bias for students having prior experience in playing online games. Competition-based assessment related to presumed learning of course content enhanced student anxiety and feelings of intimidation and led to some students seeking to “game the game” versus learning the material, in efforts to achieve grade goals. Other students associated use of the game and the classroom weighted grading with intense stress that led them to prematurely stop the use of the engineering tool. Initial findings indicate that both game design and how technology is incorporated into the grading and testing of learning outcomes, influence student perceptions of the technology’s usefulness and ultimately the acceptance of the online game as a "learning tool." Results also point to the need to explore how the crediting and assessment of students’ performance and learning gains in these types of games could yield inequitable experiences in these types of courses.  more » « less
Award ID(s):
1830812
NSF-PAR ID:
10158519
Author(s) / Creator(s):
;
Date Published:
Journal Name:
An initial exploration of the perspectives and experiences of diverse learners' acceptance of online educational engineering games as learning tools in the classroom
Page Range / eLocation ID:
1 to 9
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This Research Full paper focuses on perceptions and experiences of freshman and sophomore engineering students when playing an online serious engineering game that was designed to improve engineering intuition and knowledge of statics. Use of serious educational engineering games has increased in engineering education to help students increase technical competencies in engineering disciplines. However, few have investigated how these engineering games are experienced by the students; how games influence students' perceptions of learning, or how these factors may lead to inequitable perspectives among diverse populations of students. Purpose/Hypothesis: The purpose of this study was to explore the perceptions, appeal, and opinions about the efficacy of educational online games among a diverse population of students in an engineering mechanics statics course. It was hypothesized that compared to majority groups (e.g., men, White), women of color who are engineering students would experience less connections to the online educational game in terms of ease of use and level of frustration while playing. It is believed that these discordant views may negatively influence the game's appeal and efficacy towards learning engineering in this population of students. Design/Method: The Technology Acceptance Model (TAM) is expanded in this study, where the perspectives of women of colour (Latinx, Asian and African American) engineering students are explored. The research approach employed in this study is a mixed-method sequential exploratory design, where students first played the online engineering educational game, then completed a questionnaire, followed by participation in a focus group. Responses were initially analyzed through open and magnitude coding approaches to understand whether students thought these educational games reflected their personal culture. Results: Preliminary results indicate that though the majority of the students were receptive to using the online engineering software for their engineering education, merely a few intimated that they would use this software for engineering exam or technical job interview preparation. A level-one categorical analysis identified a few themes that comprised unintended preservation of inequality in favor of students who enjoyed contest-based education and game technology. Competition-based valuation of presumed mastery of course content fostered anxiety and intimidation among students, which caused some to "game the game" instead of studying the material, to meet grade goals. Some students indicated that they spent more time (than necessary) to learn the goals of the game than engineering content itself, suggesting a need to better integrate course material while minimizing cognitive effort in learning to navigate the game. Conclusions: Preliminary results indicate that engineering software's design and the way is coupled with course grading and assessment of learning outcomes, affect student perceptions of the technology's acceptance, usefulness, and ease of use as a "learning tool." Students were found to have different expectations of serious games juxtaposed software/apps designed for entertainment. Conclusions also indicate that acceptance of inquiry-based educational games in a classroom among diverse populations of students should clearly articulate and connect the game goals/objectives with class curriculum content. Findings also indicate that a multifaceted schema of tools, such as feedback on game challenges, and explanations for predictions of the game should be included in game/app designs. 
    more » « less
  2. The perceptions and experiences of freshman and sophomore engineering students when playing an online serious engineering game are explored. The engineering game of interest was designed to improve engineering intuition and knowledge of engineering mechanics in a statics course. Use of serious educational engineering games has increased in engineering education to help students increase technical competencies in engineering disciplines. However, few have investigated how these engineering games are experienced by the students; how games influence students’ perceptions of learning, or how these factors may lead to inequitable perspectives among diverse populations of students. A mixed method sequential analysis informed by the Technology Acceptance Model was performed to ascertain the experiences of one hundred and thirty-two students. Women of colour indicated that going to the next challenge level in the game made them feel as though they had increased their engineering knowledge to a higher degree than their male counterparts, this group also indicated higher levels of frustration than their male and Caucasian woman counterparts. Additional studies are need to more definitive conclusions. 
    more » « less
  3. The quest to incorporate digital games into US classrooms has been pervasive in educational communities over the last two decades. Educational video games have been studied as a mechanism for enhancing the engagement and performance of underrepresented groups (UGs) in spatial learning, physics, computer science, general engineering, software and electrical engineering, mechanical engineering (ME) computer aided design, and aerospace engineering. Less than a handful of these studies have explored games’ appeal, efficacy or UG performance as a function of gender. Preliminary findings on a study that explores the appeal, efficacy, and performance of UGs in engineering-based educational video games as a function of gender and those of intersectional backgrounds is discussed. Emphasis is placed on elucidating these students' perceptions of serious game structure, design and content, and how these factors motivate their learning of engineering concepts and self-identification as engineers. This work builds upon the Technology Acceptance Model. 
    more » « less
  4. This research paper presents preliminary results of the Educational Ecosystem Health Survey (EEHS), a survey instrument designed by the Eco-STEM team at California State University, Los Angeles, a regionally serving, very high Hispanic-enrolling Minority Serving Institution (MSI). The purpose of the instrument is to quantitatively measure the health of the STEM educational ecosystem from the perspectives of the actors within it. The Eco-STEM team is implementing an ongoing NSF-funded research project aiming to change the paradigm of teaching and learning in STEM and its aligned mental models from factory-like to ecosystem- like. We hypothesize that this model of education will better support students and their individual needs. The pilot results of administering the EEHS to students within the College of Engineering, Computer Science, and Technology and the College of Natural and Social Sciences provide a baseline from which the Eco-STEM team will analyze diversion – and, hopefully, improvement – over the coming years of the project. The pilot survey was administered to undergraduate and graduate students at California State University, Los Angeles, of which the majority have ethnically- and socioeconomically- minoritized backgrounds. The EEHS is comprised of validated survey instruments that query students’ perceptions of various aspects of systemic educational health. These instruments measure the constructs of Classroom Comfort, Faculty Understanding, Belongingness, Thriving, Mindfulness, and Motivation. T-tests and ANOVA models are employed to analyze variations in responses among students based on a host of demographic identifiers. Pilot results from the first administration of the survey include, for example, statistically significant lower reported levels of thriving and mindfulness for students who identify as LGBTQIA+ than those who do not, as well as far lower levels of ecosystem health overall for students who do not have access to stable housing. Additional statistically significant results are identified on the bases of students’ gender, race/ethnicity, disability status, veteran status, undergraduate versus graduate student status, college of study, employment situation, and more detailed housing situation. The pilot results of the EEHS provide detailed insight into the experiences and needs of students in STEM programs at MSIs and regionally serving institutions. The results may also be useful within the contexts of a diverse range of institutions as they strive to serve students from historically marginalized backgrounds. 
    more » « less
  5. Jeronen, Eila ; Gordon, Neil ; Reichgelt, Han (Ed.)
    The use of educational digital games as supplemental tools to course instruction materials has increased over the last several decades and especially since the COVID-19 pandemic. Though these types of instructional games have been employed in the majority of STEM disciplines, less is known about how diverse populations of students interpret and define the value of these games towards achieving academic and professional pursuits. A mixed-method sequential exploratory research design method that was framed on the Technology Acceptance Model, Game-Based Learning Theory and Expectancy Value Theory was used to examine how 201 students perceived the usefulness of an intuitive education game that was designed to teach engineering mechanics used in designing civil structures. We found that students had different expectations of educational digital games than games designed for entertainment used outside of classroom environments. Several students thought that the ability to design their own structures and observe structure failure in real-time was a valuable asset in understanding how truss structures responded to physical loading conditions. However, few students thought the educational game would be useful for exam (14/26) or job interview (19/26) preparation. Students associated more value with engineering games that illustrate course content and mathematical calculations used in STEM courses than those that do not include these elements. 
    more » « less