skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Out in the Field Versus Inside in the Lab: A Comparison of Design Professionals’ Concept Screening Practices (DETC2019-97564)
Abstract Concept screening is one of the gatekeepers of innovation process and thus is considered a vital component of engineering design. Yet, we know very little about how decisions are made during concept screening or the factors that inform these decisions. This is due, in part, to the fact that most prior work on concept screening in engineering design has focused on student populations or on industry professionals in an experimental setting which is not indicative of the risks and consequences professionals face in their daily work—particularly when it comes to innovative design process. Thus, the current study was developed to identify how the environmental settings (i.e., experimental versus naturalistic) and the role of the professionals in the design process (i.e., idea generators versus executives) impacts the criteria used to screen design ideas. Two studies were conducted including a workshop study with 45 design professionals from two companies in an experimental setting and a participatory ethnographic study with seven design professionals from a small electromechanical company in a naturalistic setting. The results showed stark differences in the criteria used to screen ideas between naturalistic and experimental practices and between idea generators and company executives. In addition, the results showed differences in the factors considered during concept screening between naturalistic and experimental environments. These results are used to identify opportunities for tools and methods that encourage the consideration of creative ideas in the engineering design industry and encourage appropriate risk-taking in engineering design.  more » « less
Award ID(s):
1351493
PAR ID:
10209533
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Journal of Mechanical Design
Volume:
143
Issue:
4
ISSN:
1050-0472
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract While psychological safety is a consistent, generalizable, and multilevel predictor of outcomes in team performance across fields that can positively impact the creative process, there have been limited investigations of psychological safety in the engineering domain. Without this knowledge, we do not know whether fostering psychological safety in a team environment is important for specific engineering design outputs from concept generation and screening practices. This study provides one of the first attempts at addressing this research gap through an empirical study with 69 engineering design student teams over the course of 4- and 8-week design projects. Specifically, we sought to identify the role of psychological safety on the number and quality (judged by goodness) of ideas generated. In addition, we explored the role of psychological safety on ownership bias and goodness in the concept screening process. The results of the study identified that while psychological safety was negatively related to the number of ideas a team developed, it was positively related to the quality (goodness) of the ideas developed. This result indicates that while psychological safety may not increase team productivity in terms of the number of ideas produced, it may impact team effectiveness in coming up with viable candidate ideas to move forward in the design process. In addition, there was no relationship between psychological safety and ownership bias during concept screening. These findings provide quantitative evidence on the role of psychological safety on engineering team idea production and identify areas for further study. 
    more » « less
  2. Psychological safety has been shown to be a consistent, generalizable, and multilevel predictor of outcomes in performance and learning across fields. While work in this field has suggested that psychological safety can impact the creative process, particularly in the generation of ideas and in the discussions surrounding idea development, there has been limited investigations of psychological safety in the engineering domain. Without this knowledge we do not know when to fostering psychological safety in a team environment is most important. This study provides the first attempt at answering this question through an empirical study with 53 engineering design student teams over the course of a 4- and 8-week design project. Specifically, we sought to identify the role of psychological safety on the number and quality (judged by goodness) of ideas generated. In addition, we explored the role of psychological safety on ownership bias and goodness in the concept screening process. The results of the study identified that while psychological safety was not related to the number of ideas a team developed, it was positively related to the quality (goodness) of the ideas developed. In addition, while no relationship was found between psychological safety and ownership bias during concept screening, the results showed that teams with high psychological safety selected a higher percentage of their team members ideas. 
    more » « less
  3. The capabilities of additive manufacturing (AM) open up designers’ solution space and enable them to build designs previously impossible through traditional manufacturing. To leverage AM, designers must not only generate creative ideas, but also propagate these ideas without discarding them in the early design stages. This emphasis on selecting creative ideas is particularly important in design for AM (DfAM), as ideas perceived as infeasible through the traditional design for manufacturing lens could now be feasible with AM. Several studies have discussed the role of DfAM in encouraging creative idea generation; however, there is a need to understand concept selection in DfAM. In this paper, we investigated the effect of two variations in DfAM education: 1) restrictive DfAM and 2) dual DfAM (opportunistic and restrictive) on students’ concept selection process. Specifically, we compared the creativity of the concepts generated by the students to the creativity of the concepts selected by them. Further, we performed qualitative analyses to explore the rationale provided by the students in making these design decisions. From the results, we see that teams from both educational groups select ideas of greater usefulness; however, only teams from the restrictive DfAM group select ideas of higher uniqueness and overall creativity. Further, we see that introducing students to opportunistic DfAM increases their emphasis on the complexity of designs when evaluating and selecting them. These results highlight the need for DfAM education to encourage AM designers to not just generate but also select creative ideas. 
    more » « less
  4. Abstract Though academic research for identifying and considering the social impact of products is emerging, additional insights can be gained from engineers who design products every day. This paper explores current practices in industries used by design engineers to consider the social impact of products. Forty-six individuals from 34 different companies were interviewed to discover what disconnects exist between academia and industry when considering a product’s social impact. These interviews were also used to discover how social impact might be considered in a design setting moving forward. This is not a study to find “the state of the art,” but considers the average engineering professional’s work to design products in various industries. Social impact assessments (SIA) and social life cycle assessments (SLCA) are two of the most common processes discussed in the literature to evaluate social impact, both generally and in products. Interestingly, these processes did not arise in any discussion in interviews, despite respondents affirming that they do consider social impact in the product design. Processes used to predict social impact, rather than simply evaluate, were discussed by the respondents. These tended to be developed within the company and often related to industry imposed government regulations. To build on this study, the findings herein should be further validated for executives, managers, and engineers. A study specific to these roles should be designed to understand the disconnect better. Additionally, processes should be developed to assist engineers in considering the social impact of their products. Work should also be done to help educate engineers and their leaders on the value of considering the social impact in product design. 
    more » « less
  5. null (Ed.)
    In the innovation process, design practice involves multiple iterations of framing and reframing under high levels of uncertainty and ambiguity. Additionally, as user desirability is a significant criterion for innovative design, designers' empathy in the framing and reframing process is considered a critical user-centered design ability that engineering students should develop. In this context, this study aims to discuss how problem framing and empathy manifestation interplay in the innovation process. As an exploratory study, this study investigates biomedical engineering (BME) students’ reframing processes and decisions in a one-semester design project involving problem definition and concept identification. This investigation is guided by the following research questions: 1) how do engineering students perceive the relationship between empathy and reframing in the innovation process, 2) how and how often do they make reframing decisions over the stages of problem definition and concept identification, and 3) how different are reframing processes and decisions between teams with higher and lower empathetic design tendency scores? This study was conducted in a junior-level design course, including 76 BME students. We collected and analyzed three data sources: students’ self-reflection reports about their reframing processes, empathic design tendency score, and interviews with selected teams and instructors. The results demonstrated that more than half of the students perceived the connection between empathy and their reframing decisions and that they usually had one reframing moment in the stages of problem definition and concept identification. Also, the findings illustrate triggers for their reframing moments, information sources guiding their reframing processes, changes made through reframing, and influences of reframing decisions on team project processes. Furthermore, the comparison of the selected two teams revealed two differences in reframing processes between the high and low empathic design tendency-scoring teams. The authors believe that the study expands engineering education research on engineering students’ empathy and problem-framing by illustrating students’ reframing processes throughout a design project and exploring the interplay of empathy and reframing processes. Also, based on our study findings, engineering design educators can promote student empathy development by including more project activities and evaluation criteria related to empathic design and providing formative feedback on their reframing processes. 
    more » « less