skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Framing Creative Work: Helping Novices Frame Better Problems through Interactive Scaffolding
Problem framing—the process of defining a problem—has been described by many researchers and designers as the crux of the design process. However, novice designers struggle with problem framing. To better understand this process and the potential for scaffolding, we conducted two studies. In the first study, we analyzed 41 problem statements from an introductory design course and found that novices often omit key information, like the primary stakeholder or the obstacles they face. To get novices to reflect on and include necessary design information, we created a tool called ProbLib that cues novices to explicitly reflect on aspects of the problem such as the stakeholders. To evaluate this approach, we conducted a between-subjects study (N=73) to compare ProbLib with an unstructured open text form. We found that participants using ProbLib wrote higher quality statements, included more information, and were more confident about specifying design needs. We observed creative behaviors such as brainstorming and analogical reasoning.  more » « less
Award ID(s):
1821618
PAR ID:
10290701
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
ACM Creativity and Cognition
Page Range / eLocation ID:
1 to 10
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Research suggests expert designers frame problems more broadly than novices, but authentic context may make a design problem too difficult. Yet decontextualized problems provide little opportunity for students to learn how to direct their framing and solving of problems. This paper considers characteristics of design problems that support students to develop design skills as they learn and apply concepts to the framing and solving of design problems. We selected and analyzed (un)successful design problems used over four years of iterations in an undergraduate chemical engineering program. We analyze salient features that made the design problems particularly educative and generalize an Educative Design Problem Framework, finding that such problems are relevant to students, have sociotechnical complexity, and are accessible yet require accurate application of technical content to solutions that are not deterministic—in other words, they are low-bar entry and high ceiling. Faculty can use this framework to evaluate and improve design problems in their teaching. 
    more » « less
  2. null (Ed.)
    In the innovation process, design practice involves multiple iterations of framing and reframing under high levels of uncertainty and ambiguity. Additionally, as user desirability is a significant criterion for innovative design, designers' empathy in the framing and reframing process is considered a critical user-centered design ability that engineering students should develop. In this context, this study aims to discuss how problem framing and empathy manifestation interplay in the innovation process. As an exploratory study, this study investigates biomedical engineering (BME) students’ reframing processes and decisions in a one-semester design project involving problem definition and concept identification. This investigation is guided by the following research questions: 1) how do engineering students perceive the relationship between empathy and reframing in the innovation process, 2) how and how often do they make reframing decisions over the stages of problem definition and concept identification, and 3) how different are reframing processes and decisions between teams with higher and lower empathetic design tendency scores? This study was conducted in a junior-level design course, including 76 BME students. We collected and analyzed three data sources: students’ self-reflection reports about their reframing processes, empathic design tendency score, and interviews with selected teams and instructors. The results demonstrated that more than half of the students perceived the connection between empathy and their reframing decisions and that they usually had one reframing moment in the stages of problem definition and concept identification. Also, the findings illustrate triggers for their reframing moments, information sources guiding their reframing processes, changes made through reframing, and influences of reframing decisions on team project processes. Furthermore, the comparison of the selected two teams revealed two differences in reframing processes between the high and low empathic design tendency-scoring teams. The authors believe that the study expands engineering education research on engineering students’ empathy and problem-framing by illustrating students’ reframing processes throughout a design project and exploring the interplay of empathy and reframing processes. Also, based on our study findings, engineering design educators can promote student empathy development by including more project activities and evaluation criteria related to empathic design and providing formative feedback on their reframing processes. 
    more » « less
  3. Over the past year, institutions have explored various manners to advance education while remaining socially distant, namely, through online and hybrid delivery methods. While these methods are actively employed now, the question regarding their effectiveness on student comprehension of the concepts highlighted remains. The aim of this work is to establish how effective online, asynchronous modules are for such. With respect to first-year programs geared towards establishing the foundational concepts of engineering design, two asynchronous, interactive modules were developed and deployed. Specifically, these modules introduced the foundational design concepts of stakeholders, need statements, information gathering, and design specifications. They were also developed in such a way that required student input such as identifying stakeholders or matching need statements. Student responses for each input was recorded and previously utilized to complete basic statistical analysis and derive preliminary trends. Upon completion of both modules, students completed an individual homework assignment that assessed their comprehension of the content covered in both modules. The assignment was comprised of several sections with multiple questions per section. Each question highlighted various aspects of the engineering problem framing process such as stakeholders or need statements. Basic statistical analysis was conducted for the scored items followed by correlation analysis with student performance on the modules previously completed. This work was intended to establish student comprehension of fundamental engineering design concepts after learning such through distance-learning methods, namely, asynchronous, interactive modules. Conclusions drawn from this work will possess broad ramifications and enable educators to determine if such methods are as sufficient as traditional in-person methods, if portions of the modules must be modified to enhance student comprehension, or if alternative methods must be employed altogether. 
    more » « less
  4. Despite the potential of generative AI (GenAI) design tools to enhance design processes, professionals often struggle to integrate AI into their workflows. Fundamental cognitive challenges include the need to specify all design criteria as distinct parameters upfront (intent formulation) and designers' reduced cognitive involvement in the design process due to cognitive offloading, which can lead to insufficient problem exploration, underspecification, and limited ability to evaluate outcomes. Motivated by these challenges, we envision novel metacognitive support agents that assist designers in working more reflectively with GenAI. To explore this vision, we conducted exploratory prototyping through a Wizard of Oz elicitation study with 20 mechanical designers probing multiple metacognitive support strategies. We found that agent-supported users created more feasible designs than non-supported users, with differing impacts between support strategies. Based on these findings, we discuss opportunities and tradeoffs of metacognitive support agents and considerations for future AI-based design tools. 
    more » « less
  5. Abstract Co‐production practices are increasingly being adopted in research conducted for the purpose of societal impact. However, the ways in which co‐production is conducted can perpetuate long‐standing inequity and inequality. This study investigates which principles of co‐production design are perceived to advance more equitable processes and outcomes based on the experiences of participants in three projects funded by U.S. federal programs that support decision‐relevant climate science, along with others engaged in co‐production efforts. We found three distinct perspectives: (a) Ways of Knowing and Power; (b) Participants and Interactions; and (c) Science as Capacity Building. Each viewpoint differentially weights the salience of statements associated with five dimensions of co‐production practices: (a) outcomes; (b) power; (c) place‐based, community rights and respect; (d) audiences and participation; and (e) interactions. In the final stage of the study, we hosted a workshop of participants representing various roles in co‐production efforts to vet and discuss each perspective. We found that the perspectives remained distinct after each of the groups selected core statements that reflect their views. The degree of variation across the three perspectives suggests that co‐production processes would benefit from an initial discussion of, and decisions about, rules of engagement to ensure that participants view the process as equitable. 
    more » « less