An official website of the United States government
Creativity focuses on the generation of novel and useful ideas. In this paper, we propose an approach to automatically generating creative requirements candidates via the adversarial examples resulted from applying small changes (perturbations) to the original requirements descriptions. We present an architecture where the perturbator and the classifier positively influence each other. Meanwhile, we ensure that each adversarial example is uniquely traceable to an existing feature of the software, instrumenting explainability. Our experimental evaluation of six datasets shows that around 20% adversarial shift rate is achievable. In addition, a human subject study demonstrates our results are more clear, novel, and useful than the requirements candidates outputted from a state-of-the-art machine learning method. To connect the creative requirements closer with software development, we collaborate with a software development team and show how our results can support behavior-driven development for a web app built by the team.
more »
« less
On the Way to a Framework for Evaluating Creativity in Requirements Engineering
Creativity in requirements engineering (RE) has recently emerged to help innovate “novel and useful” requirements and improve a software system’s sustainability. Existing research has mostly focused on workshops, techniques, and tools to aid creative requirements elicitation. Limited attention, however, has been dedicated to creativity evaluation, despite the current mechanisms being largely restricted to rating requirements for a broad notion of “novelty and appropriateness”. In addition, such mechanisms focus on evaluating creativity from an elicitation perspective, leaving other RE activities widely disregarded. To further advance the literature, we present a preliminary study on developing a framework that aims to evaluate creativity in a precise manner and accounts for the full spectrum of RE activities. In particular, we propose a “creative requirement diagnosis scale (CRDS)” that includes 27 indicators to assess creativity, present a novel framework to evaluate the creative merits of requirements in terms of the complete RE process, and further evaluate requirements using our framework in a study with 53 participants. The results suggest our framework’s potential to capture creativity aspects that would otherwise be undetected by traditional techniques. Our study also indicates the need for further refinement of the framework, thereby opening new avenues for creativity in RE.
more »
« less
- Award ID(s):
- 2236953
- PAR ID:
- 10507178
- Publisher / Repository:
- IEEE
- Date Published:
- ISBN:
- 979-8-3503-3458-6
- Page Range / eLocation ID:
- 191 to 198
- Subject(s) / Keyword(s):
- requirements engineering creativity in requirements engineering creativity evaluation requirements engineering activities
- Format(s):
- Medium: X
- Location:
- Bellevue, WA, USA
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Interviews are the most widely used elicitation technique in requirements engineering (RE). However, conducting a requirements elicitation interview is challenging. The mistakes made in design or conduct of the interviews can create problems in the later stages of requirements analysis. Empirical evidence about effective pedagogical approaches for training novices on conducting requirements elicitation interviews is scarce. In this paper, we present a novel pedagogical approach for training student analysts in the art of elicitation interviews. Our study is conducted in two parts: first, we perform an observational study of interviews performed by novices, and we present a classification of the most common mistakes made; second, we utilize this list of mistakes and monitor the students’ progress in three set of interviews to discover the individual areas for improvement. We conducted an empirical study involving role-playing and authentic assessment in two semesters on two different cohorts of students. In the first semester, we had 110 students, teamed up in 28 groups, to conduct three interviews with stakeholders. We qualitatively analysed the data to identify and classify the mistakes made from their first interview only. In the second semester, we had 138 students in 34 groups and we monitored and analysed their progress in all three interviews by utilizing the list of mistakes from the first study. First, we identified 34 unique mistakes classified into seven high-level themes, namely question formulation, question omission, interview order, communication skills, analyst behaviour, customer interaction, teamwork and planning. In the second study, we discovered that the students struggled mostly in the areas of question formulation, question omission and interview order and did not manage to improve their skills throughout the three interviews. Our study presents a novel and repeatable pedagogical design, and our findings extend the body of knowledge aimed at RE education and training by providing an empirically grounded categorization of mistakes made by novices. We offer an analysis of the main pain points in which instructors should pay more attention during their design and training.more » « less
-
null (Ed.)Investigations of creativity have been an intriguing topic for a long time, but assessing creativity is extremely complex. Creativity is a cornerstone of engineering disciplines, so understanding creativity and how to enhance creative abilities through engineering education has received substantial attention. Fields outside of engineering are no stranger to neuro-investigations of creativity and although some neuro-response studies have been conducted to understand creativity in engineering, these studies need to map the engineering design and concept generation processes better. Using neuroimaging techniques alongside engineering design and concept generation processes is necessary for understanding how to improve creative idea generation and creativity studies in engineering. In this paper, a survey is provided of the literature for the different neurological approaches that have been used to study the engineering design process and creative processes. Also presented are proposed strategies to apply these neurological approaches to engineering design to understand the creative process in greater detail. Furthermore, results from a pilot study investigating neuro-responses of engineers are presented.more » « less
-
Abstract Identifying ways to enable people to reach their creative potential is a core goal of creativity research with implications for education and professional attainment. Recently, we identified a potential barrier to creative achievement: creativity anxiety (i.e., anxiety specific to creative thinking). Initial work found that creativity anxiety is associated with fewer real-world creative achievements. However, the more proximal impacts of creativity anxiety remain unexplored. In particular, understanding how to overcome creativity anxiety requires understanding how creativity anxiety may or may not impact creative cognitive performance, and how it may relate to state-level anxiety and effort while completing creative tasks. The present study sought to address this gap by measuring creativity anxiety alongside several measures of creative performance, while concurrently surveying state-level anxiety and effort. Results indicated that creativity anxiety was, indeed, predictive of poor creative performance, but only on some of the tasks included. We also found that creativity anxiety predicted both state anxiety and effort during creative performance. Interestingly, state anxiety and effort did not explain the associations between creativity anxiety and creative performance. Together, this work suggests that creativity anxiety can often be overcome in the performance of creative tasks, but likewise points to increased state anxiety and effort as factors that may make creative performance and achievement fragile in more demanding real-world contexts.more » « less
-
Creativity is typically defined as the generation of novel and useful ideas or artifacts. This generative capacity is crucial to everyday problem solving, technological innovation, scientific discovery, and the arts. A central concern of cognitive scientists is to understand the processes that underlie human creative thinking. We review evidence that one process contributing to human creativity is the ability to generate novel representations of unfamiliar situations by completing a partially-specified relation or an analogy. In particular, cognitive tasks that trigger generation of relational similarities between dissimilar situations—distant analogies—foster a kind of creative mindset. We discuss possible computational mechanisms that might enable relation-driven generation, and hence may contribute to human creativity, and conclude with suggested directions for future research.more » « less
