skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Investigating Priming Effects of Sketch Evaluation Instructions on Idea Generation Productivity
Abstract Engineering design involves intensive visual-spatial reasoning, and engineers depend upon external representation to develop concepts during idea generation. Previous research has not explored how our visual representation skills influence our idea generation effectiveness. A designer’s deficit in sketching skills could create a need for increased focus on the task of visual representation reducing cognitive resources available for the task at hand — generating concept. Further, this effect could be compounded if designers believed that their sketching skill would be evaluated or judged by their peers. This evaluation apprehension could cause additional mental workload distracting from the production of idea generation. The goal of this study is to investigate and better understand the relationship between designers’ sketching skills and idea generation abilities. In this paper, we present preliminary results of the relationship between independent measures of sketching skill and idea generation ability from an entry-level engineering design and graphics course. During data collection, task instructions were given in two ways to independent groups: one group was instructed upfront that sketching would be evaluated, while the second group was kept blind to the sketch evaluation. In this paper, we also examine the potential priming effects of sketch quality evaluation apprehension on idea generation productivity. The results show that sketching quality and idea quantity are largely independent, and that the priming effects of sketch evaluation instructions are small to negligible on idea generation productivity.  more » « less
Award ID(s):
2013612
PAR ID:
10405702
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Proceedings of the ASME 2022 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference IDETC-CIE2022
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract BackgroundSketching exists in many disciplines and varies in how it is assessed, making it challenging to define fundamental sketching skills and the characteristics of a high‐quality sketch. For instructors to apply effective strategies for teaching and assessing engineering sketching, a clear summary of the constructs, metrics, and objectives for sketching assessment across engineering education and related disciplines is needed. PurposeThis systematic literature review explores sketching assessment definitions and approaches across engineering education research. Methodology/ApproachWe collected 671 papers from five major engineering and education databases at all skill levels for reported sketching constructs and metrics, cognition, and learning contexts. Based on the selection criteria, we eliminated all but 41 papers, on which we performed content analysis. Findings/ConclusionsEngineering, design, and art emerged as three major disciplines in the papers reviewed. We found that sketching assessment most often employs metrics on accuracy, perspective, line quality, annotations, and aesthetics. Most collected studies examined beginners in undergraduate engineering design sketching or drawing ability tests. Cognitive skills included perceiving the sketch subject, creatively sketching ideas, using metacognition to monitor the sketching process, and using sketching for communication. ImplicationsSketching assessment varies by engineering discipline and relies on many types of feedback and scoring metrics. Cognitive theory can inform instructional activities as a foundation for sketching skills. There is a need for robust evidence of high‐quality assessment practices in sketching instruction. Assessment experts can apply their knowledge toward improving sketching assessment development, implementation, and validation. 
    more » « less
  2. Spatial visualization is the ability to mentally manipulate, visualize, and transform objects in one’s mind. Numerous research studies have reported that spatial ability is strongly associated with predicting success and retention in STEM-related fields such as math, engineering, computer programming, and science. Spatial skills are a critical cognitive ability for many technical fields, particularly engineering. Studies have shown the importance of free-hand sketching in the development of 3-D spatial skills. Similarly, sketching is an integral skill in the engineering design process, especially in the idea-generation phase. However, little work has been performed examining the link between spatial skills and the quality of sketches produced during the engineering design process. There were two phases to data collection for this research. In the first phase, 127 undergraduate engineering students completed four spatial tests. In the second phase, 101 students returned to complete three design tasks. This paper examines the performance of the 17 low spatial and 13 high spatial visualizers on one of these tasks where individuals are asked to design ways for remote villagers to catch and use rainwater. Through analysis of the sketches produced by the students, initial insights indicate that there may be an association between the spatial skills of students and the quality of the sketches they produce for their engineering design solutions. These insights will be discussed relative to the potential influence of spatial skills and sketch quality on engineering education, specifically in developing design capability. 
    more » « less
  3. Sketching is a valuable skill in engineering for representing information, developing design ideas, and communicating technical and abstract information. It is an important means of developing spatial abilities which are predictive of success in STEM fields. While existing spatial ability tests are predictive of engineering visualization skills, they do not allow students to develop drawing skills through spatial exercises. The Object Assembly Sketching test examines sketching skills with object assembly tasks using mental imagery and mental rotation. This study focuses on the development and pilot testing of a new sketching skills test using object assembly exercises. We piloted the test in two sections of an undergraduate mechanical engineering design course. Inter-rater reliability of two raters scoring students sketches on eight criteria was acceptable across exercises, but low across criteria. Students scored highest on Representation Accuracy, Scale, and Symmetry, and exhibited complex understanding of perspective sketching. We intend to revise the rubric to score for aesthetics and make instructions more precise. 
    more » « less
  4. Sketching is a valuable skill in engineering for representing information, developing design ideas, and communicating technical and abstract information. It is an important means of developing spatial abilities which are predictive of success in STEM fields. While existing spatial ability tests are predictive of engineering visualization skills, they do not allow students to develop drawing skills through spatial exercises. The Object Assembly Sketching test examines sketching skills with object assembly tasks using mental imagery and mental rotation. This study focuses on the development and pilot testing of a new sketching skills test using object assembly exercises. We piloted the test in two sections of an undergraduate mechanical engineering design course. Inter-rater reliability of two raters scoring students sketches on eight criteria was acceptable across exercises, but low across criteria. Students scored highest on Representation Accuracy, Scale, and Symmetry, and exhibited complex understanding of perspective sketching. We intend to revise the rubric to score for aesthetics and make instructions more precise. 
    more » « less
  5. The success of a design is not determined solely by its technical aspects. A design must work for the people who will be using it and in the context in which it will be used. Human-centered design approaches suggest strategies to remind engineering designers of the people impacted by their design decisions. While many of these strategies can be used within and across multiple design phases, during the act of sketching concepts during concept generation, there are few explicit strategies for centering people. We investigate possible impact from a simple intervention during a concept generation task through a between-subjects experiment. Working alone is a single design session, half of a group of mechanical engineering students were asked to explicitly “represent people” within their conceptual sketches. Afterwards, all students reviewed each of their concepts to answer, “Who is this idea for? Who do you imagine would use it?” Those who received the intervention requiring representation of people within concept sketches produced significantly longer reflections with greater depth compared to the control group. Adding drawings of people to sketches resulted in more consideration of the social and physical context of use and of the user's personal preferences and values. Depicting people in generated concepts substantially reduced claims a design is "for everyone,” suggesting explicit representation of potential users produced more thoughtful consideration of diversity among potential users. 
    more » « less