This preliminary study examined how users leveraged three different types of signaling elements in Scale Worlds, an immersive virtual reality (IVR) application designed to improve size and scale cognition. Signaling elements, which are instructional cues in the form of graphics, colors, sounds, or text in IVR, may improve learning outcomes by enhancing related cognitive processes. However, it is unclear the extent to which learners utilize these signaling elements in practice. A think-aloud protocol was used to examine how participants engaged with signaling elements, with thematic analysis suggesting that numerical measures were a particularly salient cue for conceptualizing the size and scale of entities in IVR. These findings can guide design decisions for future work on educational IVR in the context of size and scale cognition or STEM education, as implementing numerical measures to facilitate mathematical reasoning in IVR environments may bolster learning outcomes related to numeracy and conceptual understanding. 
                        more » 
                        « less   
                    
                            
                            Confounded or Controlled? A Systematic Review of Media Comparison Studies Involving Immersive Virtual Reality for STEM Education
                        
                    
    
            Abstract A substantial amount of media comparison research has been conducted in the last decade to investigate whether students learn Science, Technology, Engineering, and Mathematics (STEM) content better in immersive virtual reality (IVR) or more traditional learning environments. However, a thorough review of the design and implementation of conventional and IVR conditions in media comparison studies has not been conducted to examine the extent to which specific affordances of IVR can be pinpointed as the causal factor in enhancing learning. The present review filled this gap in the literature by examining the degree to which conventional and IVR conditions have been controlled on instructional methods and content within the K-12 and higher education STEM literature base. Thirty-eight published journal articles, conference proceedings, and dissertations related to IVR comparison studies in STEM education between the years 2013 and 2022 were coded according to 15 categories. These categories allowed for the extraction of information on the instructional methods and content characteristics of the conventional and IVR conditions to determine the degree of control within each experimental comparison. Results indicated only 26% of all comparisons examined between an IVR and conventional condition were fully controlled on five key control criteria. Moreover, 40% of the comparisons had at least one confound related to instructional method and content. When looking at the outcomes of the studies, it was difficult to gather a clear picture of the benefits or pitfalls of IVR when much of the literature was confounded and/or lacked sufficient information to determine if the conditions were controlled on key variables. Implications and recommendations for future IVR comparison research are discussed. 
        more » 
        « less   
        
    
                            - Award ID(s):
- 2222208
- PAR ID:
- 10520641
- Publisher / Repository:
- Springer Science + Business Media
- Date Published:
- Journal Name:
- Educational Psychology Review
- Volume:
- 36
- Issue:
- 3
- ISSN:
- 1040-726X
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
- 
            
- 
            We conducted a comprehensive, systematic review and meta-analysis on the effects of the BSCS 5E Instructional Model—and its related variants—on science, math, and motivation outcomes. The 5E Instructional Model is a framework for delivering STEM instruction that is based on constructivist learning theory; it has been used throughout the U.S. and other countries, particularly in Turkey. Despite its wide usage, no comprehensive systematic review and meta-analysis on the effects of 5E and related models has yet been conducted. Our search and screening procedures yielded 61 randomized controlled trial studies, estimating 156 effect sizes; 70% of studies met WWC standards with or without reservations. We found that the 5E instructional model resulted in improved science outcomes ( g = 0.82, 95% CI [0.67, 0.97]), but a large amount of heterogeneity requires some caution ( t = 0.56). We explored numerous explanations for the effect heterogeneity and provided practical recommendations.more » « less
- 
            Research focusing on the integration of computational thinking (CT) into science, technology, engineering, and mathematics (STEM) education started to emerge. We conducted a semi-systematic literature review on 55 empirical studies on this topic. Our findings include: (a) the majority of the studies adopted domain-general definitions of CT and a few proposed domain-specific CT definitions in STEM education; (b) the most popular instructional model was problem-based instruction, and the most popular topic contexts included game design, robotics, and computational modelling; (c) while the assessments of student learning in integrated CT and STEM education targeted different objectives with different formats, about a third of them assessed integrated CT and STEM; (d) about a quarter of the studies reported differential learning processes and outcomes between groups, but very few of them investigated how pedagogical design could improve equity. Based on the findings, suggestions for future research and practice in this field are discussed in terms of operationalizing and assessing CT in STEM contexts, instructional strategies for integrating CT in STEM, and research for broadening participation in integrated CT and STEM education.more » « less
- 
            There has been considerable investment in pre-college educational interventions for all areas of STEM (including computer science). The goal of many of these initiatives is to engage and interest students early in their educational career. In this study, a systematic literature review was undertaken to determine the demographic and program data collected and reported for the field of computing education and for other STEM disciplines for activities that were not designed as part of the formal in-class curriculum (e.g., outreach activities). A comparison-contrast analysis of the resulting 342 articles found similarities and key differences in the reporting of this data as well as overarching characteristics of missing or incomplete reporting across disciplines. Authors from both fields reported equally well in the four categories studied: information about evaluation, participant gender, participant race and/or ethnicity, and activity demographics. However, the computing education articles were more likely to have clearly stated research questions and comparative analysis based on demographic characteristics. They were less likely to include the number of participants in the study, participant age/grade level, socioeconomic status, disability information, location of intervention, and instructor demographics. Through this analysis, it was determined that reporting can be improved across all disciplines to improve the quantity of data needed to replicate studies and to provide complete data sets that provide for the comparison of collected data.more » « less
- 
            Despite proliferated efforts to integrate computer science in elementary education, there is a dearth of studies that synthesize the current state of CS education research in formal educational contexts, specifically in upper elementary classrooms. Further, while numerous studies have investigated approaches and strategies that broaden participation in computing, the majority of them focus on secondary and post-secondary settings. The present study uses a systematic literature review process to review research conducted with students in formal classroom settings in grades 4, 5, and 6 and published since 2013. We review the research through two questions: What are barriers to broadening participation in CS in upper elementary (grades 4-6)? What instructional approaches and strategies help broaden participation in CS in upper elementary (grades 4-6)? A systematic search of the literature highlighted approaches used for broadening participation, including using various teaching media, designing scaffolds in instruction, and integrating into other subject areas. We conclude by identifying gaps in the research and identifying areas for further research.more » « less
 An official website of the United States government
An official website of the United States government 
				
			 
					 
					
