skip to main content
Explore Scholarly Publications and Datasets in the NSF-PAR

  • NSF Public Access
  • Search Results
  • Accepted Manuscript: Neural efficiency and spatial task difficulty: A road forward to mapping students’ neural engagement in spatial cognition
Title: Neural efficiency and spatial task difficulty: A road forward to mapping students’ neural engagement in spatial cognition
The current study examined the neural correlates of spatial rotation in eight engineering undergraduates. Mastering engineering graphics requires students to mentally visualize in 3D and mentally rotate parts when developing 2D drawings. Students’ spatial rotation skills play a significant role in learning and mastering engineering graphics. Traditionally, the assessment of students’ spatial skills involves no measurements of neural activity during student performance of spatial rotation tasks. We used electroencephalography (EEG) to record neural activity while students performed the Revised Purdue Spatial Visualization Test: Visualization of Rotations (Revised PSVT:R). The two main objectives were to 1) determine whether high versus low performers on the Revised PSVT:R show differences in EEG oscillations and 2) identify EEG oscillatory frequency bands sensitive to item difficulty on the Revised PSVT:R.  Overall performance on the Revised PSVT:R determined whether participants were considered high or low performers: students scoring 90% or higher were considered high performers (5 students), whereas students scoring under 90% were considered low performers (3 students). Time-frequency analysis of the EEG data quantified power in several oscillatory frequency bands (alpha, beta, theta, gamma, delta) for comparison between low and high performers, as well as between difficulty levels of the spatial rotation problems.   more » Although we did not find any significant effects of performance type (high, low) on EEG power, we observed a trend in reduced absolute delta and gamma power for hard problems relative to easier problems. Decreases in delta power have been reported elsewhere for difficult relative to easy arithmetic calculations, and attributed to greater external attention (e.g., attention to the stimuli/numbers), and consequently, reduced internal attention (e.g., mentally performing the calculation). In the current task, a total of three spatial objects are presented. An example rotation stimulus is presented, showing a spatial object before and after rotation. A target stimulus, or spatial object before rotation is then displayed. Students must choose one of five stimuli (multiple choice options) that indicates the correct representation of the object after rotation. Reduced delta power in the current task implies that students showed greater attention to the example and target stimuli for the hard problem, relative to the moderate and easy problems. Therefore, preliminary findings suggest that students are less efficient at encoding the target stimuli (external attention) prior to mental rotation (internal attention) when task difficulty increases.  Our findings indicate that delta power may be used to identify spatial rotation items that are especially challenging for students. We may then determine the efficacy of spatial rotation interventions among engineering education students, using delta power as an index for increases in internal attention (e.g., increased delta power). Further, in future work, we will also use eye-tracking to assess whether our intervention decreases eye fixation (e.g., time spent viewing) toward the target stimulus on the Revised PSVT:R. By simultaneously using EEG and eye-tracking, we may identify changes in internal attention and encoding of the target stimuli that are predictive of improvements in spatial rotation skills among engineering education students.  « less
Authors:
; ; ;
Award ID(s):
1831740
Publication Date:
NSF-PAR ID:
10338197
Journal Name:
Engineering design graphics journal
Volume:
85
ISSN:
1949-9167
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ( , 2019 ASEE Annual Conference & Exposition)
    Mobile devices are becoming a more common part of the education experience. Students can access their devices at any time to perform assignments or review material. Mobile apps can have the added advantage of being able to automatically grade student work and provide instantaneous feedback. However, numerous challenges remain in implementing effective mobile educational apps. One challenge is the small screen size of smartphones, which was a concern for a spatial visualization training app where students sketch isometric and orthographic drawings. This app was originally developed for iPads, but the wide prevalence of smartphones led to porting the software tomore »iPhone and Android phones. The sketching assignments on a smartphone screen required more frequent zooming and panning, and one of the hypotheses of this study was that the educational effectiveness on smartphones was the same as on the larger screen sizes using iPad tablets. The spatial visualization mobile sketching app was implemented in a college freshman engineering graphics course to teach students how to sketch orthographic and isometric assignments. The app provides automatic grading and hint feedback to help students when they are stuck. Students in this pilot were assigned sketching problems as homework using their personal devices. Students were administered a pre- and post- spatial visualization test (PSVT-R, a reliable, well-validated instrument) to assess learning gains. The trial analysis focuses on students who entered the course with limited spatial visualization experience as identified based on a score of ≤70% on the PSVT:R since students entering college with low PSVT:R scores are at higher risk of dropping out of STEM majors. Among these low-performing students, those who used the app showed significant progress: (71%) raised their test scores above 70% bringing them out of the at-risk range for dropping out of engineering. While the PSVT:R test has been well validated, there are benefits to developing alternative methods of assessing spatial visualization skills. We developed an assembly pre- and post- test based upon a timed Lego™ exercise. At the start of the quarter, students were timed to see how long it would take them to build small lego sets using only visual instructions. Students were timed again on a different lego set after completion of the spatial visualization app. One benefit of the test was that it illustrated to the engineering students a skill that could be perceived as more relevant to their careers, and thus possibly increased their motivation for spatial visualization training. In addition, it may be possible to adapt the assembly test to elementary school grade levels where the PSVT:R test would not be suitable. Preliminary results show that the average lego build times decreased significantly after using the mobile app, indicating an improvement in students’ spatial reasoning skills. A comparison will also be done between normalized completion times on the assembly test and the PSVT:R tests in order to see how the assembly test compares to the “gold standard”. In addition to the PSVT-R instrument, a survey was conducted to evaluate student usage and their impressions of the app. Students found the app engaging, easy to use, and something they would do whenever they had “a free moment”. 95% of the students recommended the app to a friend if they are struggling with spatial visualization skills. This paper will describe the implementation of the mobile spatial visualization sketching app in a large college classroom, and highlight the app’s impact in increasing self-efficacy in spatial visualization and sketching« less
  2. ; ; ; ( , 2020 ASEE Virtual Annual Conference Content Access)
    In recent years, it has increasingly been recognized that spatial visualization skills are important in supporting student success in Science, Technology, Engineering, and Math (STEM) education and retention of these students in STEM careers. Many first year college engineering programs and high schools with pre-engineering curriculum have incorporated spatial visualization training into their courses. However, there is no reason why spatial visualization training could not occur at a much younger age, like elementary school. Often at the high school and college level, the Purdue Spatial Visualization Test: Rotations (PSVT:R), which is recognized as a gold standard assessment tool, is usedmore »to measure students’ spatial skills learning gains. The PSVT:R is a 20 minute timed test consisting of 30 three-dimensional rotations problems. While the PSVT:R test has been well validated, there are benefits to developing alternative methods of assessing spatial visualization skills suitable for elementary school grades. Researchers at XXX developed an assembly pre- and post- test based upon a timed Lego™ exercise. Students are timed to see how long it would take them to build small Lego shapes using only a picture of the final assembly, but no instructions. The test was implemented at the beginning and then at the end of the quarter/semester. The beauty of this assessment is that it lends itself well to K-12 students. The 20 minute, timed PSVT:R test is too challenging for elementary aged children and is not engaging. In order to validate the new instrument, the Lego™ Assembly test was implemented in a pilot study in 2 college freshman engineering courses using students who could do both the PSVT:R and the Lego Assembly™ assessments. At the beginning of the class all students took the PSVT:R test, and half the students performed a Lego™ assembly of one shape and the other half did the assembly test with another shape. During the class the students completed spatial visualization training which taught them how to sketch orthographic and isometric assignments using a mobile sketching app. At the end of the class the PSVT:R test was repeated for all students. The Lego Assembly™ test was also completed, but the students switched which shape they were building. This approach allowed us to normalize the difficulty of the assembly tasks based upon the average time it took to build the shapes in the pre-test. The Lego Assembly™ test was first implemented in winter and spring of 2018. The data showed a correlation of the R-Squared of 0.11 between the assembly times and the PSVT:R scores in pre-test and 0.14 in post-test. However, analysis of the assembly times indicated that the difficulty of the 2 Lego shapes were significantly different, which could skew the normalization of the assembly times. Accordingly, the test was repeated in winter and spring 2019 with Lego shapes of similar difficulty. This paper describes the results of the assembly tess in all 4 classes, and its suitability for a spatial visualization assessment for elementary school age students.« less
  3. ; ; ( , 2020 ASEE Virtual Annual Conference Content Access)
    Modern 3D printing technology makes it relatively easy and affordable to produce physical models that offer learners concrete representations of otherwise abstract concepts and representations. We hypothesize that integrating hands-on learning with these models into traditionally lecture-dominant courses may help learners develop representational competence, the ability to interpret, switch between, and appropriately use multiple representations of a concept as appropriate for learning, communication and analysis. This approach also offers potential to mitigate difficulties that learners with lower spatial abilities may encounter in STEM courses. Spatial thinking connects to representational competence in that internal mental representations (i.e. visualizations) facilitate work usingmore »multiple external representations. A growing body of research indicates well-developed spatial skills are important to student success in many STEM majors, and that students can improve these skills through targeted training. This NSF-IUSE exploration and design project began in fall 2018 and features cross-disciplinary collaboration between engineering, math, and psychology faculty to develop learning activities with 3D-printed models, build the theoretical basis for how they support learning, and assess their effectiveness in the classroom. We are exploring how such models can support learners’ development of conceptual understanding and representational competence in calculus and engineering statics. We are also exploring how to leverage the model-based activities to embed spatial skills training into these courses. The project is addressing these questions through parallel work piloting model-based learning activities in the classroom and by investigating specific attributes of the activities in lab studies and focus groups. To date we have developed and piloted a mature suite of activities covering a variety of topics for both calculus and statics. Class observations and complementary studies in the psychology lab are helping us develop a theoretical framework for using the models in instruction. Close observation of how students use the models to solve problems and as communication tools helps identify effective design elements. We are administering two spatial skills assessments as pre/post instruments: the Purdue Spatial Visualizations Test: Rotations (PSVT:R) in calculus; and the Mental Cutting Test (MCT) in statics. We are also developing strategies and refining approaches for assessing representational competence in both subject areas. Moving forward we will be using these assessments in intervention and control sections of both courses to assess the effectiveness of the models for all learners and subgroups of learners.« less
  4. ; ; ; ; ; ; ( , IEEE Transactions on Pattern Analysis and Machine Intelligence)
    A recent paper [1] claims to classify brain processing evoked in subjects watching ImageNet stimuli as measured with EEG and to employ a representation derived from this processing to construct a novel object classifier. That paper, together with a series of subsequent papers [2] , [3] , [4] , [5] , [6] , [7] , [8] , claims to achieve successful results on a wide variety of computer-vision tasks, including object classification, transfer learning, and generation of images depicting human perception and thought using brain-derived representations measured through EEG. Our novel experiments and analyses demonstrate that their results crucially dependmore »on the block design that they employ, where all stimuli of a given class are presented together, and fail with a rapid-event design, where stimuli of different classes are randomly intermixed. The block design leads to classification of arbitrary brain states based on block-level temporal correlations that are known to exist in all EEG data, rather than stimulus-related activity. Because every trial in their test sets comes from the same block as many trials in the corresponding training sets, their block design thus leads to classifying arbitrary temporal artifacts of the data instead of stimulus-related activity. This invalidates all subsequent analyses performed on this data in multiple published papers and calls into question all of the reported results. We further show that a novel object classifier constructed with a random codebook performs as well as or better than a novel object classifier constructed with the representation extracted from EEG data, suggesting that the performance of their classifier constructed with a representation extracted from EEG data does not benefit from the brain-derived representation. Together, our results illustrate the far-reaching implications of the temporal autocorrelations that exist in all neuroimaging data for classification experiments. Further, our results calibrate the underlying difficulty of the tasks involved and caution against overly optimistic, but incorrect, claims to the contrary.« less
  5. ; ; ; ( , Program and abstracts - V.M. Goldschmidt Conference)
    There is a large gap between the ability of experts and students in grasping spatial concepts and representations. Engineering and the geosciences require the highest expertise in spatial thinking, and weak spatial skills are a significant barrier to success for many students [1]. Spatial skills are also highly malleable [2]; therefore, a current challenge is to identify how to promote students’ spatial thinking. Interdisciplinary research on how students think about spatially-demanding problems in the geosciences has identified several major barriers for students and interventions to help scaffold learning at a variety of levels from high school through upper level undergraduatemore »majors. The Geoscience Education Transdisciplinary Spatial Learning Network (GET-Spatial; http://serc.carleton.edu/getspatial/) is an NSF-funded collaboration between geoscientists, cognitive psychologists, and education researchers. Our goal is to help students overcome initial hurdles in reasoning about spatial problems in an effort to diversify the geoscience workforce. Examples of spatial problems in the fields of geochemistry include scaling, both in size and time; penetrative thinking to make inferences about internal structures from surface properties; and graph-reading, especially ternary diagrams. Understanding scales outside of direct human experience, both very large (e.g. cosmochemistry, deep time) and very small (e.g. mineralogy, nanoparticles) can be acutely difficult for students. However, interventions have successfully resulted in improvements to scale estimations and improve exam performance [3]. We will discuss best practices for developing effective interdisciplinary teams, and how to overcome challenges of working across disciplines and across grade levels. We will provide examples of spatial interventions in scaling and penetrative thinking. [1] Hegarty et al. (2010) in Spatial Cognition VII 6222, 85- 94. [2] Uttal et al. (2012) Psychology of Learning and Motivation 57, 147-181. [3] Resnick et al. (2016) Educational Psychology Review, 1-15.« less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email