Do Creativity Metrics from Design Research Correlate with Those from Psychology?

ABSTRACT

In this paper, we explore measurements of design creativity through metrics related to the processes used in designing and relate them to the metrics used in psychology for idea creativity, ie, novelty and fluency. Our goal was to test the reliability of psychometric measures of creativity to assess creativity in team design. We studied 19 teams of 3 professional engineers that engaged in a one hour-long design task. Design tasks have a greater ecological validity than single repetitive tasks like the AUT and the RAT. Engaging in a design task involves a wide range of cognitive activities, which contribute to creative ideation and to expanding the design space. This study focused on the relationship between the teams’ design idea creativity and design behaviors during the task. We explored to what extent design collaboration between teammates, design evaluation and the co-evolution of the problem-solution space relate to the psychometric measures of idea creativity. Results suggest no specific trend in the correlation between collaboration and idea creativity as measured by the metrics used in psychology, while more cognitive focus on problem-solution co-evolution negatively correlates with these measures of idea creativity. The paper concludes with potential explanations for this lack of correlation.

Acknowledgments

This material is based upon work supported by the National Science Foundation see funding section). Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.

We wish to thank the anonymous reviewers for their comments as they improved the quality of this paper.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This work was supported by the National Science Foundation [1761774]; [1762415]; [1929896]; [2100138].