More Like this

1. Freehand Sketching on Smartphones for Teaching Spatial Visualization

   https://doi.org/10.18260/1-2--32859  

   Van Den Einde, Lelli; Delson, Nathan; Cowan, Elizabeth (June 2019, 2019 ASEE Annual Conference & Exposition)

   null (Ed.)

   Mobile devices are becoming a more common part of the education experience. Students can access their devices at any time to perform assignments or review material. Mobile apps can have the added advantage of being able to automatically grade student work and provide instantaneous feedback. However, numerous challenges remain in implementing effective mobile educational apps. One challenge is the small screen size of smartphones, which was a concern for a spatial visualization training app where students sketch isometric and orthographic drawings. This app was originally developed for iPads, but the wide prevalence of smartphones led to porting the software to iPhone and Android phones. The sketching assignments on a smartphone screen required more frequent zooming and panning, and one of the hypotheses of this study was that the educational effectiveness on smartphones was the same as on the larger screen sizes using iPad tablets. The spatial visualization mobile sketching app was implemented in a college freshman engineering graphics course to teach students how to sketch orthographic and isometric assignments. The app provides automatic grading and hint feedback to help students when they are stuck. Students in this pilot were assigned sketching problems as homework using their personal devices. Students were administered a pre- and post- spatial visualization test (PSVT-R, a reliable, well-validated instrument) to assess learning gains. The trial analysis focuses on students who entered the course with limited spatial visualization experience as identified based on a score of ≤70% on the PSVT:R since students entering college with low PSVT:R scores are at higher risk of dropping out of STEM majors. Among these low-performing students, those who used the app showed significant progress: (71%) raised their test scores above 70% bringing them out of the at-risk range for dropping out of engineering. While the PSVT:R test has been well validated, there are benefits to developing alternative methods of assessing spatial visualization skills. We developed an assembly pre- and post- test based upon a timed Lego™ exercise. At the start of the quarter, students were timed to see how long it would take them to build small lego sets using only visual instructions. Students were timed again on a different lego set after completion of the spatial visualization app. One benefit of the test was that it illustrated to the engineering students a skill that could be perceived as more relevant to their careers, and thus possibly increased their motivation for spatial visualization training. In addition, it may be possible to adapt the assembly test to elementary school grade levels where the PSVT:R test would not be suitable. Preliminary results show that the average lego build times decreased significantly after using the mobile app, indicating an improvement in students’ spatial reasoning skills. A comparison will also be done between normalized completion times on the assembly test and the PSVT:R tests in order to see how the assembly test compares to the “gold standard”. In addition to the PSVT-R instrument, a survey was conducted to evaluate student usage and their impressions of the app. Students found the app engaging, easy to use, and something they would do whenever they had “a free moment”. 95% of the students recommended the app to a friend if they are struggling with spatial visualization skills. This paper will describe the implementation of the mobile spatial visualization sketching app in a large college classroom, and highlight the app’s impact in increasing self-efficacy in spatial visualization and sketching 

   more » « less
2. Sketching, Assessment, and Persistence in Spatial Visualization Training On a Touchscreen

   https://doi.org/10.18260/1-2--30968  

   Delson, Nathan; Van Den Einde, Lelli (June 2018, 2018 ASEE Annual Conference & Exposition)

   null (Ed.)

   Spatial visualization training has been shown to increase GPAs and graduation rates in science, technology and math. Furthermore, prior research has correlated sketching on paper to improvement on the standardized spatial visualization test PSVT:R. To take advantage of touchscreen technology, an App, in which students draw orthographic and isometric assignments, was developed for spatial visualization training. Students draw on the touchscreen and then submit their sketch to be graded automatically. If the sketch is incorrect, the students are provided with the option to try again or get customized guidance from the app. This allows students to work independently and get immediate feedback. In 2014, a trial using the App with college engineering students showed that it increased students’ performance on the PSVT:R. The 2014 trial also showed that student persistence, as measured by the number of times they tried a sketch again without asking for help, correlated to increases in the PSVT:R. Since 2014, the App was modified significantly. The assignments were rewritten to take advantage of the touchscreen interface, and persistence was encouraged using gamification and by providing varying levels of guidance. In 2017, two trials were conducted with college engineering students; an elective class (n=32) and a required class (n=137). Overall the persistence metric increased from 40% in 2014 to 77% in 2017. The overall gains on the PSVT:R increased from 7% to 9%. However, much larger gains occurred among students who entered the class with low PSVT:R scores (70% and below). These students are considered “at-risk” in terms of low graduation rate due to low spatial visualization ability. In 2014, 23% of these at-risk students improved to the point of moving out of the at-risk category. In 2017 this percentage increased to 82% and 67%. This paper describes the modifications to the App that led to the successful trials in 2017. In O=one of the 2017 trials , the app was implemented as homework, thereby not taking up classroom lecture time, which further eases the incorporation of spatial visualization training into a crowded curriculum. 

   more » « less
3. Board 121: Using Tutor-led Support to Enhance Engineering Student Writing for All

   Bodenhamer, J.; Weissbach, R.; Pflueger, R.; Renguette, C.; Sorge, B.; Dasgupta, A. (June 2023, American Society for Engineering Education)

   Writing Assignment Tutor Training in STEM (WATTS) is part of a three-year NSF IUSE grant with participants at three institutions. This research project seeks to determine to what extent students in the WATTS project show greater writing improvement than students using writing tutors not trained in WATTS. The team collected baseline, control, and experimental data. Baseline data included reports written by engineering and engineering technology students with no intervention to determine if there were variations in written communication related to student demographics and institutions. Control data included reports written by students who visited tutors with no WATTS training, and experimental data included reports written by students who visited tutors who were WATTS-trained. Reports were evaluated by the research team using a slightly modified version of the American Association of Colleges and Universities (AAC&U) Written Communication VALUE Rubric. Baseline data assessment also provided an opportunity to test the effectiveness of the rubric. This paper presents findings from the analysis of the control and experimental data to determine the impact of WATTS on student writing in lab reports. An aggregate score for each lab report was determined by averaging the reviewer scores. An analysis was run to determine if there was a statistical difference between pre-tutoring lab report scores from the baseline, control, and experimental rubric scores for each criterion and total scores; there was not a statistically significant difference. The research team ran a Wilcoxon signed-rank test to assess the relationship between control and experimental aggregate rubric scores for each criterion. The preliminary analysis of the control and experimental data shows that the WATTS intervention has a positive, statistically significant impact on written communication skills regardless of the campus student demographics. Since WATTS has been shown to be a low-cost, effective intervention to improve engineering and engineering technology students’ written communication skills at these participating campuses, it has potential use for other institutions to positively impact their students’ written communication. 

   more » « less
4. Using Tutor-led Support to Enhance Engineering Student Writing for All.

   Bodenhamer Johanna; Weissbach Robert; Pfluenger Ruth; Renguette Corinne; Sorge Brandon; Dasgupta Annwesa; Edinbarough Immanuel. (June 2023, 2023 ASEE Annual Conference & Exposition)

   Writing Assignment Tutor Training in STEM (WATTS) is part of a three-year NSF IUSE grant with participants at three institutions. This research project seeks to determine to what extent students in the WATTS project show greater writing improvement than students using writing tutors not trained in WATTS. The team collected baseline, control, and experimental data. Baseline data included reports written by engineering and engineering technology students with no intervention to determine if there were variations in written communication related to student demographics and institutions. Control data included reports written by students who visited tutors with no WATTS training, and experimental data included reports written by students who visited tutors who were WATTS-trained. Reports were evaluated by the research team using a slightly modified version of the American Association of Colleges and Universities (AAC&U) Written Communication VALUE Rubric. Baseline data assessment also provided an opportunity to test the effectiveness of the rubric. This paper presents findings from the analysis of the control and experimental data to determine the impact of WATTS on student writing in lab reports. An aggregate score for each lab report was determined by averaging the reviewer scores. An analysis was run to determine if there was a statistical difference between pre-tutoring lab report scores from the baseline, control, and experimental rubric scores for each criterion and total scores; there was not a statistically significant difference. The research team ran a Wilcoxon signed-rank test to assess the relationship between control and experimental aggregate rubric scores for each criterion. The preliminary analysis of the control and experimental data shows that the WATTS intervention has a positive, statistically significant impact on written communication skills regardless of the campus student demographics. Since WATTS has been shown to be a low-cost, effective intervention to improve engineering and engineering technology students’ written communication skills at these participating campuses, it has potential use for other institutions to positively impact their students’ written communication. 

   more » « less
5. Board 121: Using Tutor-led Support to Enhance Engineering Student Writing for All

   Bodenhamer, J. (June 2023, 2023 ASEE Annual Conference, Baltimore, MD, United States.)

   Writing Assignment Tutor Training in STEM (WATTS) is part of a three-year NSF IUSE grant with participants at three institutions. This research project seeks to determine to what extent students in the WATTS project show greater writing improvement than students using writing tutors not trained in WATTS. The team collected baseline, control, and experimental data. Baseline data included reports written by engineering and engineering technology students with no intervention to determine if there were variations in written communication related to student demographics and institutions. Control data included reports written by students who visited tutors with no WATTS training, and experimental data included reports written by students who visited tutors who were WATTS-trained. Reports were evaluated by the research team using a slightly modified version of the American Association of Colleges and Universities (AAC&U) Written Communication VALUE Rubric. Baseline data assessment also provided an opportunity to test the effectiveness of the rubric. This paper presents findings from the analysis of the control and experimental data to determine the impact of WATTS on student writing in lab reports. An aggregate score for each lab report was determined by averaging the reviewer scores. An analysis was run to determine if there was a statistical difference between pre-tutoring lab report scores from the baseline, control, and experimental rubric scores for each criterion and total scores; there was not a statistically significant difference. The research team ran a Wilcoxon signed-rank test to assess the relationship between control and experimental aggregate rubric scores for each criterion. The preliminary analysis of the control and experimental data shows that the WATTS intervention has a positive, statistically significant impact on written communication skills regardless of the campus student demographics. Since WATTS has been shown to be a low-cost, effective intervention to improve engineering and engineering technology students’ written communication skills at these participating campuses, it has potential use for other institutions to positively impact their students’ written communication. This material is based upon work supported by the National Science Foundation under Grant Nos. 2013467, 2013496, and 2013541. 

   more » « less