skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Improvement in Freehand Sketching Application for Spatial Visualization Training
Spatial visualization is the cognitive ability of mentally representing and manipulating two-dimensional and three-dimensional figures. This is a learnable cognitive skill that has been correlated with increased GPA’s and retention in science, technology, engineering, and math (S TEM) disciplines [ Sorby, 2009]. Traditional spatial visualization training includes freehand sketching assignments, which require human grading. A spatial visualization training application (app) was developed in which students freehand sketch on a touchscreen and an automatic grading algorithm provides immediate feedback. In spring 2014, the App was used with iPads in a one-unit spatial visualization course where students took pre and post spatial visualization assessment tests. In 2014, 46% of the students who scored low on the pre-assessment had a significant improvement of 10% or more on the post-assessment. This paper describes how the App was modified to increase student gains: feedback to the user was changed to motivate increased persistence; new assignments were developed, taking advantage of color and cues that are not present in traditional paper based sketching assignments; and assignments were modified to address common errors. The course was taught with the new user interface in 2017, during which 82% of incoming students with low spatial skills showed significant improvement. The increase from 46% to 82% is attributed to the capability of pen and touch technology to be adapted effectively for educational purposes.  more » « less
Award ID(s):
1648534
PAR ID:
10049502
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Conference on Pen and Touch Technology in Education
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Spatial visualization training has been shown to increase GPAs and graduation rates in science, technology and math. Furthermore, prior research has correlated sketching on paper to improvement on the standardized spatial visualization test PSVT:R. To take advantage of touchscreen technology, an App, in which students draw orthographic and isometric assignments, was developed for spatial visualization training. Students draw on the touchscreen and then submit their sketch to be graded automatically. If the sketch is incorrect, the students are provided with the option to try again or get customized guidance from the app. This allows students to work independently and get immediate feedback. In 2014, a trial using the App with college engineering students showed that it increased students’ performance on the PSVT:R. The 2014 trial also showed that student persistence, as measured by the number of times they tried a sketch again without asking for help, correlated to increases in the PSVT:R. Since 2014, the App was modified significantly. The assignments were rewritten to take advantage of the touchscreen interface, and persistence was encouraged using gamification and by providing varying levels of guidance. In 2017, two trials were conducted with college engineering students; an elective class (n=32) and a required class (n=137). Overall the persistence metric increased from 40% in 2014 to 77% in 2017. The overall gains on the PSVT:R increased from 7% to 9%. However, much larger gains occurred among students who entered the class with low PSVT:R scores (70% and below). These students are considered “at-risk” in terms of low graduation rate due to low spatial visualization ability. In 2014, 23% of these at-risk students improved to the point of moving out of the at-risk category. In 2017 this percentage increased to 82% and 67%. This paper describes the modifications to the App that led to the successful trials in 2017. In O=one of the 2017 trials , the app was implemented as homework, thereby not taking up classroom lecture time, which further eases the incorporation of spatial visualization training into a crowded curriculum. 
    more » « less
  2. null (Ed.)
    Mobile devices are becoming a more common part of the education experience. Students can access their devices at any time to perform assignments or review material. Mobile apps can have the added advantage of being able to automatically grade student work and provide instantaneous feedback. However, numerous challenges remain in implementing effective mobile educational apps. One challenge is the small screen size of smartphones, which was a concern for a spatial visualization training app where students sketch isometric and orthographic drawings. This app was originally developed for iPads, but the wide prevalence of smartphones led to porting the software to iPhone and Android phones. The sketching assignments on a smartphone screen required more frequent zooming and panning, and one of the hypotheses of this study was that the educational effectiveness on smartphones was the same as on the larger screen sizes using iPad tablets. The spatial visualization mobile sketching app was implemented in a college freshman engineering graphics course to teach students how to sketch orthographic and isometric assignments. The app provides automatic grading and hint feedback to help students when they are stuck. Students in this pilot were assigned sketching problems as homework using their personal devices. Students were administered a pre- and post- spatial visualization test (PSVT-R, a reliable, well-validated instrument) to assess learning gains. The trial analysis focuses on students who entered the course with limited spatial visualization experience as identified based on a score of ≤70% on the PSVT:R since students entering college with low PSVT:R scores are at higher risk of dropping out of STEM majors. Among these low-performing students, those who used the app showed significant progress: (71%) raised their test scores above 70% bringing them out of the at-risk range for dropping out of engineering. While the PSVT:R test has been well validated, there are benefits to developing alternative methods of assessing spatial visualization skills. We developed an assembly pre- and post- test based upon a timed Lego™ exercise. At the start of the quarter, students were timed to see how long it would take them to build small lego sets using only visual instructions. Students were timed again on a different lego set after completion of the spatial visualization app. One benefit of the test was that it illustrated to the engineering students a skill that could be perceived as more relevant to their careers, and thus possibly increased their motivation for spatial visualization training. In addition, it may be possible to adapt the assembly test to elementary school grade levels where the PSVT:R test would not be suitable. Preliminary results show that the average lego build times decreased significantly after using the mobile app, indicating an improvement in students’ spatial reasoning skills. A comparison will also be done between normalized completion times on the assembly test and the PSVT:R tests in order to see how the assembly test compares to the “gold standard”. In addition to the PSVT-R instrument, a survey was conducted to evaluate student usage and their impressions of the app. Students found the app engaging, easy to use, and something they would do whenever they had “a free moment”. 95% of the students recommended the app to a friend if they are struggling with spatial visualization skills. This paper will describe the implementation of the mobile spatial visualization sketching app in a large college classroom, and highlight the app’s impact in increasing self-efficacy in spatial visualization and sketching 
    more » « less
  3. Freehand sketching equips engineers to rapidly represent ideas in the design process, but most engineering curriculums fall short of equipping students with adequate sketching skills. This paper is focused on methods to improve engineers’ sketching skill through type of instruction, length of instruction, and delivery of and feedback for assignments using Sketchtivity, an intelligent sketch-tutoring software. We answer several key questions for providing better sketching education for engineers. Does perspective training improve freehand drawing ability? Can an intelligent tutoring software improve education outcomes? And how much sketching instruction is necessary for engineers? Analyzing the changes in sketching skill from pre- to post-sketching instruction between different instruction types (n = 116), we found that perspective sketching instruction significantly improved freehand sketching ability compared to traditional engineering sketching methods. When comparing pre to post sketching skill of students using Sketchtivity (n = 135), there was no significant difference in improvement between students using the intelligent tutoring software and those that exclusively practiced on paper – both groups improved equally. However, completing sketching tasks on tablets did not hinder students’ skill development even when measured on paper. Future work will more directly explore the influence of Sketchtivity on sketching skill development. Additionally, we found that five weeks of sketching instruction greatly improves sketching skill compared to only three weeks of instruction (n = 108), but both approaches significantly improve sketching self-efficacy. These outcomes support more extensive sketching instruction in engineering classrooms, and changes in instruction type to promote more freehand sketching skills. 
    more » « less
  4. Freehand sketching equips engineers to represent ideas rapidly in the design process, but most engineering curriculums fall short of equipping students with adequate sketching skills. This paper is focused on methods to improve engineers’ sketching skill through type of instruction, length of instruction, and delivery of and feedback for assignments using Sketchtivity, an intelligent sketch-tutoring software. We answer several key questions for providing better sketching education for engineers. Does perspective training improve freehand drawing ability? Can an intelligent tutoring software improve education outcomes? And how much sketching instruction is necessary for engineers? Analyzing the changes in sketching skill from pre- to post-sketching instruction between different instruction types (n = 116), we found that perspective sketching instruction significantly improved freehand sketching ability compared to traditional engineering sketching methods. When comparing pre to post sketching skill of students using Sketchtivity (n = 135), there was no significant difference in improvement between students using the intelligent tutoring software and those that exclusively practiced on paper – both groups improved equally. However, completing sketching tasks on tablets did not hinder students’ skill development even when measured on paper. Future work will more directly explore the influence of Sketchtivity on sketching skill development. Additionally, we found that five weeks of sketching instruction greatly improves sketching skill compared to only three weeks of instruction (n = 108), but both approaches significantly improve sketching self-efficacy. These outcomes support more extensive sketching instruction in engineering classrooms, and changes in instruction type to promote more freehand sketching skills. 
    more » « less
  5. null (Ed.)
    Spatial reasoning skills contribute to performance in many STEM fields. For example, drawing sectional views of three-dimensional objects is an essential skill for engineering students. There is considerable variation in the spatial reasoning skills of prospective engineering students, putting some at risk for compromised performance in their classes. This study takes place in a first-year engineering Spatial Visualization course to integrate recent practices in engineering design education with cognitive psychology research on the nature of spatial learning. We employed three main pedagogical strategies in the course - 1) in class instruction on sketching; 2) spatial visualization training; and 3) manipulation of physical objects (CAD/3D print creations). This course endeavors to use current technology, online accessibility, and implementation of the three pedagogical strategies to bring about student growth in spatial reasoning. This study is designed to determine the effect of adding two different spatial reasoning training apps to this environment. Over 230 students (three sections) participated in our study. In two of the three sections, students received interactive spatial visualization training using either a spatial visualization mobile touchscreen app in one section or an Augmented Reality (AR) app in the other section. Research suggests that there are benefits to using the Spatial Vis Classroom mobile app for college students.The app has been shown to increase student persistence resulting in large learning gains as measured by the Purdue assessment of spatial visualization (PSVT-R), especially for students starting with poor spatial visualization skills. The Spatial Vis Classroom app can be used in the classroom or assigned as homework. The AR app is designed to help users develop their mental rotation abilities. It is designed to support a holistic understanding of 3-dimensional objects, and research has shown that, in combination with a traditional curriculum, it increases students’ abilities also measured by the PSVT-R. Of particular interest, the data suggest that the app overcomes the advantage found by males over females in a traditional class alone focused on spatial reasoning. Both of the course sections were required to use the apps for approximately the same time in class and outside of class. Students in the control section were required to do hand sketching activities in class and outside of class, with roughly the same completion time as for the sections with the apps. Students grades were not affected by using the three different approaches as grading was based on completion only. Based on current literature, we hypothesize that overall benefits (PSVT-R gains) will be comparable across the 3 treatments but there will be different effects on attitude and engagement (confidence,enjoyment, and self-efficacy). Lastly, we hypothesize that the treatments will have different effects on male/female and ethnic categories of the study participants. The final paper will include an analysis of results and a report of the findings. 
    more » « less