An official website of the United States government
Abstract Creativity is increasingly recognized as a core competency for the 21st century, making its development a priority in education, research, and industry. To effectively cultivate creativity, researchers and educators need reliable and accessible assessment tools. Recent software developments have significantly enhanced the administration and scoring of creativity measures; however, existing software often requires expertise in experiment design and computer programming, limiting its accessibility to many educators and researchers. In the current work, we introduce CAP—the Creativity Assessment Platform—a free web application for building creativity assessments, collecting data, and automatically scoring responses (cap.ist.psu.edu). CAP allows users to create custom creativity assessments in ten languages using a simple, point-and-click interface, selecting from tasks such as the Short Story Task, Drawing Task, and Scientific Creative Thinking Test. Users can automatically score task responses using machine learning models trained to match human creativity ratings—with multilingual capabilities, including the new Cross-Lingual Alternate Uses Scoring (CLAUS), a large language model achieving strong prediction of human creativity ratings in ten languages. CAP also provides a centralized dashboard to monitor data collection, score assessments, and automatically generate text for a Methods section based on the study’s tasks, metrics, and instructions—with a single click—promoting transparency and reproducibility in creativity assessment. Designed for ease of use, CAP aims to democratize creativity measurement for researchers, educators, and everyone in between.
more »
« less
Do Creativity Metrics from Design Research Correlate with Those from Psychology?
processes used in designing and relate them to the metrics used in psychology for idea creativity, ie, novelty and fluency. Our goal was to test the reliability of psychometric measures of creativity to assess creativity in team design. We studied 19 teams of 3 professional engineers that engaged in a one hour-long design task. Design tasks have a greater ecological validity than single repetitive tasks like the AUT and the RAT. Engaging in a design task involves a wide range of cognitive activities, which contribute to creative ideation and to expanding the design space. This study focused on the relationship between the teams’ design idea creativity and design behaviors during the task. We explored to what extent design collaboration between teammates, design evaluation and the co-evolution of the problem-solution space relate to the psychometric measures of idea creativity. Results suggest no specific trend in the correlation between collaboration and idea creativity as measured by the metrics used in psychology, while more cognitive focus on problemsolution co-evolution negatively correlates with these measures of idea creativity. The paper concludes with potential explanations for this lack of correlation.
more »
« less
- PAR ID:
- 10524753
- Publisher / Repository:
- Taylor and Francis
- Date Published:
- Journal Name:
- Creativity Research Journal
- ISSN:
- 1040-0419
- Page Range / eLocation ID:
- 1 to 13
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Synchronous, face-to-face interactions such as brainstorming are considered essential for creative tasks (the old normal). However, face-to-face interactions are difficult to arrange because of the diverse locations and conflicting availability of people—a challenge made more prominent by work-from-home practices during the COVID-19 pandemic (the new normal). In addition, face-to-face interactions are susceptible to cognitive interference. We employ crowdsourcing as an avenue to investigate creativity in asynchronous, online interactions. We choose product ideation,a natural task for the crowd since it requires human insight and creativity into what product features would be novel and useful. We compare the performance of solo crowd workers with asynchronous teams of crowd workers formed without prior coordination. Our findings suggest that, first, crowd teamwork yields fewer but more creative ideas than solo crowdwork. The enhanced team creativity results when (1) team workers reflect on each other’s ideas, and (2) teams are composed of workers of reflective, as opposed to active or mixed, personality types. Second, cognitive interference, known to inhibit creativity in face-to-face teams, may not be significant in crowd teams. Third, teamwork promotes better achievement emotions for crowd workers. These findings provide a basis for trading off creativity, quantity, and worker happiness in setting up crowdsourcing workflows for product ideation.more » « less
-
null (Ed.)Abstract Creativity research requires assessing the quality of ideas and products. In practice, conducting creativity research often involves asking several human raters to judge participants’ responses to creativity tasks, such as judging the novelty of ideas from the alternate uses task (AUT). Although such subjective scoring methods have proved useful, they have two inherent limitations—labor cost (raters typically code thousands of responses) and subjectivity (raters vary on their perceptions and preferences)—raising classic psychometric threats to reliability and validity. We sought to address the limitations of subjective scoring by capitalizing on recent developments in automated scoring of verbal creativity via semantic distance, a computational method that uses natural language processing to quantify the semantic relatedness of texts. In five studies, we compare the top performing semantic models (e.g., GloVe, continuous bag of words) previously shown to have the highest correspondence to human relatedness judgements. We assessed these semantic models in relation to human creativity ratings from a canonical verbal creativity task (AUT; Studies 1–3) and novelty/creativity ratings from two word association tasks (Studies 4–5). We find that a latent semantic distance factor—comprised of the common variance from five semantic models—reliably and strongly predicts human creativity and novelty ratings across a range of creativity tasks. We also replicate an established experimental effect in the creativity literature (i.e., the serial order effect) and show that semantic distance correlates with other creativity measures, demonstrating convergent validity. We provide an open platform to efficiently compute semantic distance, including tutorials and documentation ( https://osf.io/gz4fc/ ).more » « less
-
null (Ed.)Nearly 60 years ago, Thomas Kuhn revolutionized how we think of scientific discovery and innovation when he identified that scientific change can occur in incremental developments that improve upon existing solutions, or it can occur as drastic change in the form of a paradigm shift. In engineering design, both types of scientific change are critical when exploring the solution space. However, most methods of examining design outputs look at whether an idea is creative or not and not the type of creativity that is deployed or if we can predict what types of individuals or teams is more likely to develop a paradigm-shifting idea. Without knowing how to identify who will generate ideas that fit a certain paradigm, we do not know how to build teams that can develop ideas that better explore the solution space. This study provides the first attempt at answering this question through an empirical study with 60 engineering design student teams over the course of a 4- and 8-week design project. Specifically, we sought to identify the role of cognitive style using KAI score, derived from Kirton’s Adaption-Innovation (A-I) theory, on the paradigm-relatedness of ideas generated by individuals and teams. We also sought to investigate the role of crowdsourcing for measuring the paradigm-relatedness of design solutions. The results showed that KAI was positively related to a greater likelihood of an individual’s idea being categorized as paradigm-breaking. In addition, the team KAI diversity was also linked to a greater likelihood of teams’ ideas being categorized as paradigm-challenging. Finally, the results support the use of crowdsourcing for measuring the paradigm-relatedness of design solutions.more » « less
-
Abstract Identifying ways to enable people to reach their creative potential is a core goal of creativity research with implications for education and professional attainment. Recently, we identified a potential barrier to creative achievement: creativity anxiety (i.e., anxiety specific to creative thinking). Initial work found that creativity anxiety is associated with fewer real-world creative achievements. However, the more proximal impacts of creativity anxiety remain unexplored. In particular, understanding how to overcome creativity anxiety requires understanding how creativity anxiety may or may not impact creative cognitive performance, and how it may relate to state-level anxiety and effort while completing creative tasks. The present study sought to address this gap by measuring creativity anxiety alongside several measures of creative performance, while concurrently surveying state-level anxiety and effort. Results indicated that creativity anxiety was, indeed, predictive of poor creative performance, but only on some of the tasks included. We also found that creativity anxiety predicted both state anxiety and effort during creative performance. Interestingly, state anxiety and effort did not explain the associations between creativity anxiety and creative performance. Together, this work suggests that creativity anxiety can often be overcome in the performance of creative tasks, but likewise points to increased state anxiety and effort as factors that may make creative performance and achievement fragile in more demanding real-world contexts.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1080/10400419.2024.2320513
