skip to main content

Explore Research Products in the NSF-PAR

Title: Development of a Spatial Visualization Assessment Tool for Younger Students Using a Lego™ Assembly Task
In recent years, it has increasingly been recognized that spatial visualization skills are important in supporting student success in Science, Technology, Engineering, and Math (STEM) education and retention of these students in STEM careers. Many first year college engineering programs and high schools with pre-engineering curriculum have incorporated spatial visualization training into their courses. However, there is no reason why spatial visualization training could not occur at a much younger age, like elementary school. Often at the high school and college level, the Purdue Spatial Visualization Test: Rotations (PSVT:R), which is recognized as a gold standard assessment tool, is used to measure students’ spatial skills learning gains. The PSVT:R is a 20 minute timed test consisting of 30 three-dimensional rotations problems. While the PSVT:R test has been well validated, there are benefits to developing alternative methods of assessing spatial visualization skills suitable for elementary school grades. Researchers at XXX developed an assembly pre- and post- test based upon a timed Lego™ exercise. Students are timed to see how long it would take them to build small Lego shapes using only a picture of the final assembly, but no instructions. The test was implemented at the beginning and then at the end of the quarter/semester. The beauty of this assessment is that it lends itself well to K-12 students. The 20 minute, timed PSVT:R test is too challenging for elementary aged children and is not engaging. In order to validate the new instrument, the Lego™ Assembly test was implemented in a pilot study in 2 college freshman engineering courses using students who could do both the PSVT:R and the Lego Assembly™ assessments. At the beginning of the class all students took the PSVT:R test, and half the students performed a Lego™ assembly of one shape and the other half did the assembly test with another shape. During the class the students completed spatial visualization training which taught them how to sketch orthographic and isometric assignments using a mobile sketching app. At the end of the class the PSVT:R test was repeated for all students. The Lego Assembly™ test was also completed, but the students switched which shape they were building. This approach allowed us to normalize the difficulty of the assembly tasks based upon the average time it took to build the shapes in the pre-test. The Lego Assembly™ test was first implemented in winter and spring of 2018. The data showed a correlation of the R-Squared of 0.11 between the assembly times and the PSVT:R scores in pre-test and 0.14 in post-test. However, analysis of the assembly times indicated that the difficulty of the 2 Lego shapes were significantly different, which could skew the normalization of the assembly times. Accordingly, the test was repeated in winter and spring 2019 with Lego shapes of similar difficulty. This paper describes the results of the assembly tess in all 4 classes, and its suitability for a spatial visualization assessment for elementary school age students.  more » « less
Award ID(s):
1831294
NSF-PAR ID:
10221682
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
2020 ASEE Virtual Annual Conference Content Access
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ( , 2019 ASEE Annual Conference & Exposition)
    null (Ed.)
    Mobile devices are becoming a more common part of the education experience. Students can access their devices at any time to perform assignments or review material. Mobile apps can have the added advantage of being able to automatically grade student work and provide instantaneous feedback. However, numerous challenges remain in implementing effective mobile educational apps. One challenge is the small screen size of smartphones, which was a concern for a spatial visualization training app where students sketch isometric and orthographic drawings. This app was originally developed for iPads, but the wide prevalence of smartphones led to porting the software to iPhone and Android phones. The sketching assignments on a smartphone screen required more frequent zooming and panning, and one of the hypotheses of this study was that the educational effectiveness on smartphones was the same as on the larger screen sizes using iPad tablets. The spatial visualization mobile sketching app was implemented in a college freshman engineering graphics course to teach students how to sketch orthographic and isometric assignments. The app provides automatic grading and hint feedback to help students when they are stuck. Students in this pilot were assigned sketching problems as homework using their personal devices. Students were administered a pre- and post- spatial visualization test (PSVT-R, a reliable, well-validated instrument) to assess learning gains. The trial analysis focuses on students who entered the course with limited spatial visualization experience as identified based on a score of ≤70% on the PSVT:R since students entering college with low PSVT:R scores are at higher risk of dropping out of STEM majors. Among these low-performing students, those who used the app showed significant progress: (71%) raised their test scores above 70% bringing them out of the at-risk range for dropping out of engineering. While the PSVT:R test has been well validated, there are benefits to developing alternative methods of assessing spatial visualization skills. We developed an assembly pre- and post- test based upon a timed Lego™ exercise. At the start of the quarter, students were timed to see how long it would take them to build small lego sets using only visual instructions. Students were timed again on a different lego set after completion of the spatial visualization app. One benefit of the test was that it illustrated to the engineering students a skill that could be perceived as more relevant to their careers, and thus possibly increased their motivation for spatial visualization training. In addition, it may be possible to adapt the assembly test to elementary school grade levels where the PSVT:R test would not be suitable. Preliminary results show that the average lego build times decreased significantly after using the mobile app, indicating an improvement in students’ spatial reasoning skills. A comparison will also be done between normalized completion times on the assembly test and the PSVT:R tests in order to see how the assembly test compares to the “gold standard”. In addition to the PSVT-R instrument, a survey was conducted to evaluate student usage and their impressions of the app. Students found the app engaging, easy to use, and something they would do whenever they had “a free moment”. 95% of the students recommended the app to a friend if they are struggling with spatial visualization skills. This paper will describe the implementation of the mobile spatial visualization sketching app in a large college classroom, and highlight the app’s impact in increasing self-efficacy in spatial visualization and sketching 
    more » « less
  2. ; ; ; ( , Engineering design graphics journal)
    The current study examined the neural correlates of spatial rotation in eight engineering undergraduates. Mastering engineering graphics requires students to mentally visualize in 3D and mentally rotate parts when developing 2D drawings. Students’ spatial rotation skills play a significant role in learning and mastering engineering graphics. Traditionally, the assessment of students’ spatial skills involves no measurements of neural activity during student performance of spatial rotation tasks. We used electroencephalography (EEG) to record neural activity while students performed the Revised Purdue Spatial Visualization Test: Visualization of Rotations (Revised PSVT:R). The two main objectives were to 1) determine whether high versus low performers on the Revised PSVT:R show differences in EEG oscillations and 2) identify EEG oscillatory frequency bands sensitive to item difficulty on the Revised PSVT:R.  Overall performance on the Revised PSVT:R determined whether participants were considered high or low performers: students scoring 90% or higher were considered high performers (5 students), whereas students scoring under 90% were considered low performers (3 students). Time-frequency analysis of the EEG data quantified power in several oscillatory frequency bands (alpha, beta, theta, gamma, delta) for comparison between low and high performers, as well as between difficulty levels of the spatial rotation problems.   Although we did not find any significant effects of performance type (high, low) on EEG power, we observed a trend in reduced absolute delta and gamma power for hard problems relative to easier problems. Decreases in delta power have been reported elsewhere for difficult relative to easy arithmetic calculations, and attributed to greater external attention (e.g., attention to the stimuli/numbers), and consequently, reduced internal attention (e.g., mentally performing the calculation). In the current task, a total of three spatial objects are presented. An example rotation stimulus is presented, showing a spatial object before and after rotation. A target stimulus, or spatial object before rotation is then displayed. Students must choose one of five stimuli (multiple choice options) that indicates the correct representation of the object after rotation. Reduced delta power in the current task implies that students showed greater attention to the example and target stimuli for the hard problem, relative to the moderate and easy problems. Therefore, preliminary findings suggest that students are less efficient at encoding the target stimuli (external attention) prior to mental rotation (internal attention) when task difficulty increases.  Our findings indicate that delta power may be used to identify spatial rotation items that are especially challenging for students. We may then determine the efficacy of spatial rotation interventions among engineering education students, using delta power as an index for increases in internal attention (e.g., increased delta power). Further, in future work, we will also use eye-tracking to assess whether our intervention decreases eye fixation (e.g., time spent viewing) toward the target stimulus on the Revised PSVT:R. By simultaneously using EEG and eye-tracking, we may identify changes in internal attention and encoding of the target stimuli that are predictive of improvements in spatial rotation skills among engineering education students.  
    more » « less
  3. ; ; ; ( , 2020 ASEE Virtual Annual Conference)
    A diagnostic of thirty questions administered to incoming STEM students in Fall 2013 and Fall 2015 - Fall 2018 reflects that their spatial visualization skills (SVS) need to be improved. Previous studies in the SVS subject [1], [2], [3] report that well-developed SVS skills lead to students’ success in Engineering and Technology, Computer Science, Chemistry, Computer Aided Design and Mathematics. Authors [4], [5] mention that aptitude in spatial skills is gradually becoming a standard assessment of an individual’s likelihood to succeed as an engineer. This research reports the qualitative and quantitative results of a project designed to improve SVS’s for STEM students managed under two strategies. The first strategy utilized was a series of face-to-face (FtF), two-hour training sessions taught over six weeks to all majors in STEM. This strategy was offered in Spring 2014 and every semester from Fall 2015 - Spring 2018. The second strategy was an embedded training (ET) implemented by one faculty from Fall 2017- Fall 2018. The faculty embedded the training in the US 1100 freshman seminar and was highly motivated to increase awareness of students on the importance and applicability of SVS in their fields of study. As reported by Swail et al. [6], cognitive, social, and institutional factors are key elements to best support students’ persistence and achievement. Both interventions used in this project encompassed all these factors and were supported by an NSF IUSE grant (2015-2019) to improve STEM retention. The FtF training was taken by 34 students majoring in diverse STEM fields. Its effectiveness was statistically assessed through a t-test to compare the results in the Purdue Spatial Visualization Skills Test - Rotations before and after the training and through analysis of surveys. Results were very positive; 85.29% of the participants improved their scores. The average change in scores was 5.29 (from 16.85 to 22.15; 17.65% improvement) and it was statistically significant (p-value 3.9E-8). On the surveys, 90% of students answered that they were satisfied with the training. Several students reported that they appreciated a connection between SVS, Calculus II and Engineering Graphics classes while others based the satisfaction on perceiving the critical role SVS will play in their careers. Results from the ET strategy were also encouraging. Teaching methods, curriculum and results are discussed in this paper. Adjustments to the teaching methods were done over 3 semesters. In the last semester, the faculty found that covering the modules at a slower pace than in the FtF training, asking the students to complete the pre-and post-diagnostic in class, and introducing the Spatial VisTM app to provide students with additional practice were key elements to assure students success and satisfaction. In conclusion, both strategies were demonstrated to be powerful interventions to increase students’ success because they not only offer students, particularly freshman, a way to refine SVS but also increase motivation in STEM while creating a community among students and faculty. The ET is effective and apt to be institutionalized. Lastly, this experimental research strengthens the literature on SVS. 
    more » « less
  4. ; ( , 2018 ASEE Annual Conference & Exposition)
    null (Ed.)
    Spatial visualization training has been shown to increase GPAs and graduation rates in science, technology and math. Furthermore, prior research has correlated sketching on paper to improvement on the standardized spatial visualization test PSVT:R. To take advantage of touchscreen technology, an App, in which students draw orthographic and isometric assignments, was developed for spatial visualization training. Students draw on the touchscreen and then submit their sketch to be graded automatically. If the sketch is incorrect, the students are provided with the option to try again or get customized guidance from the app. This allows students to work independently and get immediate feedback. In 2014, a trial using the App with college engineering students showed that it increased students’ performance on the PSVT:R. The 2014 trial also showed that student persistence, as measured by the number of times they tried a sketch again without asking for help, correlated to increases in the PSVT:R. Since 2014, the App was modified significantly. The assignments were rewritten to take advantage of the touchscreen interface, and persistence was encouraged using gamification and by providing varying levels of guidance. In 2017, two trials were conducted with college engineering students; an elective class (n=32) and a required class (n=137). Overall the persistence metric increased from 40% in 2014 to 77% in 2017. The overall gains on the PSVT:R increased from 7% to 9%. However, much larger gains occurred among students who entered the class with low PSVT:R scores (70% and below). These students are considered “at-risk” in terms of low graduation rate due to low spatial visualization ability. In 2014, 23% of these at-risk students improved to the point of moving out of the at-risk category. In 2017 this percentage increased to 82% and 67%. This paper describes the modifications to the App that led to the successful trials in 2017. In O=one of the 2017 trials , the app was implemented as homework, thereby not taking up classroom lecture time, which further eases the incorporation of spatial visualization training into a crowded curriculum. 
    more » « less
  5. ; ; ( , 2020 ASEE Virtual Annual Conference Content Access)
    Modern 3D printing technology makes it relatively easy and affordable to produce physical models that offer learners concrete representations of otherwise abstract concepts and representations. We hypothesize that integrating hands-on learning with these models into traditionally lecture-dominant courses may help learners develop representational competence, the ability to interpret, switch between, and appropriately use multiple representations of a concept as appropriate for learning, communication and analysis. This approach also offers potential to mitigate difficulties that learners with lower spatial abilities may encounter in STEM courses. Spatial thinking connects to representational competence in that internal mental representations (i.e. visualizations) facilitate work using multiple external representations. A growing body of research indicates well-developed spatial skills are important to student success in many STEM majors, and that students can improve these skills through targeted training. This NSF-IUSE exploration and design project began in fall 2018 and features cross-disciplinary collaboration between engineering, math, and psychology faculty to develop learning activities with 3D-printed models, build the theoretical basis for how they support learning, and assess their effectiveness in the classroom. We are exploring how such models can support learners’ development of conceptual understanding and representational competence in calculus and engineering statics. We are also exploring how to leverage the model-based activities to embed spatial skills training into these courses. The project is addressing these questions through parallel work piloting model-based learning activities in the classroom and by investigating specific attributes of the activities in lab studies and focus groups. To date we have developed and piloted a mature suite of activities covering a variety of topics for both calculus and statics. Class observations and complementary studies in the psychology lab are helping us develop a theoretical framework for using the models in instruction. Close observation of how students use the models to solve problems and as communication tools helps identify effective design elements. We are administering two spatial skills assessments as pre/post instruments: the Purdue Spatial Visualizations Test: Rotations (PSVT:R) in calculus; and the Mental Cutting Test (MCT) in statics. We are also developing strategies and refining approaches for assessing representational competence in both subject areas. Moving forward we will be using these assessments in intervention and control sections of both courses to assess the effectiveness of the models for all learners and subgroups of learners. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email