180
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Managing Your Muse: Exploring Three Levels of Metacognitive Control in Creative Ideation

Received 18 Jan 2024, Published online: 13 May 2024

ABSTRACT

Creative ideation tasks are typically ill-defined and thus should benefit from metacognition. However, the role of metacognitive processes―especially metacognitive control―in creative ideation appears understudied. Therefore, we conducted an online study investigating the relationship between different aspects of metacognitive control and divergent thinking (DT) performance. In line with the recently proposed creative metacognition framework , we devised measures that delineate metacognitive control at the levels of task, performance, and responses: Metacognitive control at task level was assessed in terms of attention focus devoted to each task; metacognitive control at performance level was assessed in terms of the goal-directedness of the employed task strategy; metacognitive control at response level was assessed in terms of how effectively uncreative ideas were screened out. We observed substantial individual differences in all three measures as well as first evidence of their validity. Importantly, metacognitive control at all three levels independently predicted higher DT creativity. Additional analyses suggested that effects of metacognitive control may extend to creative behavior, partly mediated by DT. In sum, this study provides first empirical support for the relevance of distinguishable aspects of metacognitive control at task, performance, and response levels in creative performance.

Introduction

Creative thinking involves unique challenges. First, creative thinking tasks pose ill-defined problems that cannot be solved based on experience or in a straightforward analytical way (Pham, Magistretti, & Dell’era, Citation2023). To solve such problems, people either adapt known, but typically ineffective strategies or devise new ad hoc strategies (Gilhooly, Fioratou, Anthony, & Wynn, Citation2007). Second, creative thinking tasks, especially creative idea generation tasks (viz. divergent thinking tasks), are open-ended and have no single correct solution, but many possible solutions differing in their quality (Guilford, Citation1967). As a consequence, people are never done when finding an idea. Effectively navigating this large solution space may involve decision on whether to further exploit the current area or explore new ones (Hart et al., Citation2018), and, more generally, whether it is worth investing more effort to find even more creative ideas (Lucas & Nordgren, Citation2020). Third, creative thinking tasks often ask to “be creative” (Acar, Runco, & Park, Citation2020), which imposes an ambiguous goal as lay conceptions of creativity differ substantially (Baas, Koch, Nijstad, & De Dreu, Citation2015; Benedek et al., Citation2021). Hence, upon generating a candidate solution, it needs to be evaluated for creativity to decide whether it should be reported or not. Addressing these unique challenges in creative ideation involves considerable strategizing and reflection on one’s performance, and thus metacognition in creative performance, or, in short, creative metacognition.

The relevance of metacognition in creative thinking has long been recognized, at least implicitly, by theory and research. Models of creative ideation unequivocally refer the interplay of generation and evaluation (Benedek, Beaty, Schacter, & Kenett, Citation2023; Finke, Citation1996; Simonton, Citation2011). Moreover, models of the creative process have identified nuanced stages and subprocesses devoted to regulating and optimizing creative performances, which include the definition and construction of the problem, preparation, as well as implementation planning and solution monitoring (Cropley, Citation2006; Mumford, Medeiros, & Partlow, Citation2012; for a particularly comprehensive model of creative problem solving, see also Isaksen, Dorval, & Treffinger, Citation2011). Further theorizing explicitly acknowledged creativity as a self-regulatory, metacognitive process (Pesut, Citation1990) that implies knowledge about when, where, why and how to be creative (Kaufman & Beghetto, Citation2013), and cycles of sifting ideas (Jia, Xu, & Zhang, Citation2022; Puryear, Citation2016). Pertinent research, so far, has been especially interested in how well people recognize the creativity of their ideas and if they can accurately discern creative from less creative ones (Karwowski, Czerwonka, & Kaufman, Citation2020; Kenett, Gooz, & Ackerman, Citation2023; Rominger et al., Citation2022; Runco & Smith, Citation1992; Sidi, Torgovitsky, Soibelman, Miron-Spektor, & Ackerman, Citation2020; Urban & Urban, Citation2021). Other works identified individual differences in task strategies across various forms of creative performance such as creative problem-solving, creative ideation, and creative writing (Fleck & Weisberg, Citation2004; Gilhooly, Fioratou, Anthony, & Wynn, Citation2007; Urban & Urban, Citation2024). Importantly, various aspects of self-reported metacognitive skills (e.g., conditional knowledge, regulation of cognition, monitoring) were found to predict creative performance and to moderate effects of creative potential on creative behavior (Puente-Diaz, Cavazos-Arroyo, & Vargas-Barrera, Citation2021; Puryear, Citation2015).

Building on the theorizing in and empirical evidence in creativity research, as well as metacognition theory more broadly, Lebuda and Benedek (Citation2023) have recently proposed a systematic framework of creative metacognition (CMC). The CMC framework distinguishes between core and metacognitive processes, and, within metacognition, considers three major components of metacognitive control, monitoring, and knowledge. Metacognitive control refers to the regulation of the creative process by means of strategic decisions such as whether to maintain or change the current task approach. Metacognitive monitoring represents evaluations of candidate responses and of the ongoing performance that eventually trigger the need to reconsider the current strategy. Finally, metacognitive knowledge in the context of creativity refers to experience or expertise associated with creative tasks and the concept of creativity, which allows to better calibrate judgments and make more informed decisions. Recent evidence supports the independent contributions of three main CMC components for creative performance (Lebuda & Benedek, Citation2024). Notably, the CMC framework outlines the dynamic interplay of the three components, which is not considered one-way, but also implies, for instance, how knowledge gets updated by monitoring, and how monitoring readjusts based on regulatory efforts.

As an important extension to other available metacognition models, the CMC framework (Lebuda & Benedek, Citation2023) distinguishes metacognitive control, monitoring and knowledge at three conceptual levels: task, performance, and response level. This distinction acknowledges that metacognitive processes can either refer to the task in general, the actual task performance, or to candidate responses within task performance. In the context of metacognitive control, decisions need to be made whether to engage in a task at all and how much cognitive resources to devote (task level; e.g., Plucker, Runco, & Lim, Citation2006); metacognitive control can further be applied to select or devise effective task strategies (performance level; e.g.; Gilhooly, Fioratou, Anthony, & Wynn, Citation2007), and to decide whether a candidate response should be reported, elaborated, or discarded (response level; Silvia, Citation2008). Metacognitive control at these three levels is informed by evaluations of the task (e.g., task difficulty; task level), monitoring of task performance (e.g., fluency of ideas; performance level), and judgments of the candidate responses (e.g., creativity evaluation; response level), respectively (Koriat & Levy-Sadot, Citation1999; Puente-Diaz, Cavazos-Arroyo, & Vargas-Barrera, Citation2021; Sidi, Torgovitsky, Soibelman, Miron-Spektor, & Ackerman, Citation2020; Urban & Urban, Citation2023; van Broekhoven, Belfi, Borghans, & Seegers, Citation2021). These evaluations are again calibrated by metacognitive knowledge about the task (task level), relevant strategies (performance level), and of what characterizes a creative idea (response level), respectively (Ceh, Edelmann, Hofer, & Benedek, Citation2022; Miroshnik & Shcherbakova, Citation2019; Runco & Acar, Citation2010). The differentiated structure of metacognitive processes across components and levels proposed by the CMC framework helped to consolidate available findings but also awaits more thorough empirical validation. Hence, it needs to be tested whether and how creative metacognitive at task, performance, and response levels, contributes to creative ideation performance. Moreover, as creative ideation (viz. divergent thinking ability) represents an important aspect of creative potential – latent abilities, traits and domain-specific expertise predicting creative activities in real-life (Benedek, Citation2024; Eysenck, Citation1995) – creative metacognition may further facilitate the engagement of creative behaviors and the production of achievements.

There have been extended discussions whether creativity relies on the spontaneous “kiss by a muse” (Gable, Hopper, & Schooler, Citation2019) or to what extent these “muses” are under our control (Silvia, Citation2015). In fact, the relevance of cognitive control for creative performance is a robust finding across different lines of research, including works on the relationship of creativity and intelligence (Gerwig et al., Citation2021; Miroshnik, Forthmann, Karwowski, & Benedek, Citation2023), the role of executive abilities in creative cognition (Benedek, Jauk, Sommer, Arendasy, & Neubauer, Citation2014; Gilhooly & Fioratou, Citation2009; Zabelina, Friedman, & Andrews-Hanna, Citation2019) and neuroscientific findings highlighting the relevance of the executive control network (Beaty, Benedek, Silvia, & Schacter, Citation2016; Ovando-Tellez et al., Citation2022; for reviews, see; Benedek & Jauk, Citation2018, Citation2019; Chrysikou, Citation2018). The CMC framework posits that the importance of cognitive control in creativity is partly due to the substantial involvement of metacognitive control in creative performance, which can apply at the levels of task, performance, and response control (Chevalier, Martis, Curran, & Munakata, Citation2015; Fernandez-Duque, Baird, & Posner, Citation2000; Roebers, Citation2017).

The present study

This study attempts a first empirical test of the notion that metacognitive control at different conceptual levels supports creative thinking, and eventually creative behavior, as suggested by the CMC framework (Lebuda & Benedek, Citation2023). To this end, we devised measures that assess metacognitive control at task, performance, and response level, and explored their contributions in creative ideation (i.e., divergent thinking tasks). This approach extends previous work that studied self-reported metacognitive skills in a trait-like, task-independent manner (e.g., Puryear, Citation2015) by ensuring that metacognitive assessments referred to the creative task at hand. Based on findings suggesting that the use of more complex cognitive strategies results in more creative ideas (Gilhooly, Fioratou, Anthony, & Wynn, Citation2007; Nusbaum & Silvia, Citation2011), we expected that metacognitive control at performance level increases divergent thinking (DT) performance (i.e., especially the rated creativity of ideas). We further assumed that metacognitive control at response level would support DT performance, as higher DT ability predicts higher discernment in idea evaluation which should inform accurate idea selection (Benedek et al., Citation2016; Grohman, Wodniecka, & Kłusak, Citation2006), and higher DT fluency and openness also predicts more accurate idea selection (Benedek, Mühlmann, Jauk, & Neubauer, Citation2013; Puente-Díaz, Cavazos-Arroyo, Puerta-Sierra, & Vargas-Barrera, Citation2022; Silvia, Citation2008). The available literature does not, however, support deriving clear hypotheses for the effects of metacognitive control at task level on DT performance. Finally, since creative ideation supports creative accomplishments (Said-Metwaly, Taylor, Camarda, & Barbot, Citation2022), we additionally explored relationships of metacognitive control with creative activities and achievements.

Methods

Participants

368 German-speaking participants fully completed the online study. In the course of data validity checks, 51 cases were excluded because of either missing any of the two attention checks (4.3%), overly short survey completion time (<1400 s; 2.4%), giving no response to any of the DT tasks (4.1%), or technical problems with the timing on the online assessment (9.0%). The final sample thus consisted of 317 participants (66.2% female, 33.1% male, 0.6% diverse) with an average age of 29.8 years (SD = 13.1; range = 17–73) with 59.3% being university students. Participants were recruited via the university student mailing list and via advertisements. Participants entered a raffle for 10 × 20€ gift cards; Psychology students additionally received partial course credits. The procedure has been approved by the local ethics committee.

Tasks and materials

Divergent thinking

Divergent thinking (DT) ability was assessed with three items of the alternate uses task (brick, car tire, pen), the most common task for DT assessments (Saretzki, Forthmann, & Benedek, Citationin press), each timed for three minutes (visible timer). Participants were instructed that it is more important to come up with creative ideas than to name many ideas (i.e., be creative instructions). Each response was written in a dedicated response field; at the beginning only two response fields were visible but as soon as participants entered responses additional response fields appeared. All responses (without corrections or removals) were rated by six trained raters for creativity (i.e., a holistic judgment reflecting both the originality and effectiveness of responses; 0, not creative, to 4, highly creative). Interrater-reliability was good (ICC(3,k) = .80, .83, .83, for brick, car tire, and pen, respectively). Creative performance per item was defined as the average ratings of the three most highly rated ideas (max-3 scoring) to reduce fluency confound (Benedek, Mühlmann, Jauk, & Neubauer, Citation2013). DT creativity was computed as the average across the three items (ω = .70). Additionally, we computed DT fluency as the average number of responses per item (ω = .88).

Metacognitive Control (MCC)

Metacognitive Control at task level (MCC-T) was assessed with three items that asked for the level of task focus during the three DT tasks. Note that we decided not to assess task focus in terms of length of self-paced task engagement, as higher time-on-task is necessarily related to higher DT performance (Paek, Abdulla Alabbasi, Acar, & Runco, Citation2021).; Instead, we assessed the perceived task focus as an index of the mental resources devoted to the task at hand. Specifically, participants were told “Maybe you have been partly distracted during the previous DT tasks or may not felt like fully focusing on the task. Please indicate the percentage of time that you were focused on the preceding DT tasks (0–100%).” Internal consistency for task focus across the three DT tasks was high (ω = .86) and a total score was computed by averaging across the three items.

Metacognitive Control at performance level (MCC-P) was assessed in terms of the goal-directedness of the employed task strategy. To this end, we asked participants to briefly describe their most effective strategy for generating creative ideas (note that open-ended questions are considered more appropriate as people tend to be over-confident in their strategy use when using scales; Zepeda & Nokes-Malach, Citation2021) These strategy descriptions were rated by twelve raters for goal-directedness from 0 (completely spontaneous) to 3 (fully strategic). Inter-rater-reliability was very high (ICC(3,k) = .95), and a total score was computed by averaging across the ratings. Additionally, we asked participants to estimate how strategic they approached the DT tasks in general, from 0 (waited for spontaneous ideas) to 100% (I consistently used a strategic approach). Finally, they also indicated how often they used specific established strategies including the property strategy, context strategy, memory strategy, disassembly strategy (Gilhooly, Fioratou, Anthony, & Wynn, Citation2007), or waited for spontaneous ideas using a scale from 0 (never used) to 6 (always used this strategy). Participants could openly add other strategies, which was seized by 9.8% of the participants. Additional strategies included, for instance, to imagine what a child would have done with this object; many descriptions reflected minor twists of the listed strategies, which suggested that main strategies had been well covered.

Metacognitive control at response level (MCC-R) was assessed in terms of the applied creativity threshold for reporting responses in the DT task. Applying metacognitive control should lead to more often holding back uncreative responses either to discard them or further elaborate them. Hence, higher metacognitive control should result in a higher creativity of the least creative response, or a higher “worst performance” (Forthmann, Karwowski, & Beaty, Citation2023). The creativity thresholds in the three DT tasks showed moderate internal consistency (ω = .62), and a total score was computed by averaging these three scores.

Additionally, we also assessed the creativity threshold for reporting ideas in an independent response selection task. To this end, we presented participants with 15 uncreative ideas and asked them, which of those responses they would have reported as response during a DT task if they had found them (self-paced). The selected uncreative ideas (five for each of the three DT) reflected DT responses that had been collected in a previous study using the same DT tasks and had been rated one standard deviation below the mean or less. Internal consistency across the three tasks was modest (ω = .68). As selections did not refer to actual task performance, we considered a lower number of uncreative responses that would have been reported as a measure of higher creative metacognitive knowledge at response level, which may inform metacognitive control (Lebuda & Benedek, Citation2023).

Creative behavior

Creative activities were assessed by the average frequency of activities across nine creative domains (literature, music, handicraft, interior design, culinary arts, visual arts, performing arts science and technology, and social; cf. Benedek, Bruckdorfer, & Jauk, Citation2020). For each domain, people reported how often they had performed these activities within the last twelve months from 0 (never) to 5 (every day); ω = .64.

Creative achievement was assessed by the rated creativity of the three top creative achievements (Ceh, Edelmann, Hofer, & Benedek, Citation2022; Diedrich et al., Citation2018). Participants described their most creative achievements so far, which were rated by six raters from 0 (not creative – nearly everyone is doing this) to 5 (exceptionally creative – the person has gain international recognition for this achievement). Inter-rater reliability was high (ICC(3,k) = .87); ω = .68. One person did not respond to this assessment, resulting in valid data for n = 316.

Participants completed further measures that were not in the focus of this study. All materials, data, and analysis scripts of this study are provided at the OSF (https://osf.io/9qpk5/).

Procedure

The study was realized on the online survey platform LimeSurvey. Participants gave informed consent and then completed all measures in the same order. The study took on average 39 minutes (SD = 11.8). The study procedure had been approved by the local intuitional review board (GZ. 39/146/63 ex 2020/21).

Results

We first present general descriptive statistics and intercorrelations of the central study measures, followed by detailed analyses of each creative metacognitive control measure, and finally determine independent contributions of metacognitive control aspects for divergent thinking performance, as well as creative activities and achievement.

Descriptive statistics

presents descriptive statistics and correlations of the creativity measures and metacognitive control.

Table 1. Descriptive statistics and correlations of the main study measures.

Metacognitive Control (MCC) measures

MCC at task level (MCC-T)

MCC-T ranged from 9 to 100% with an average of 74.5%, suggesting large individual differences in how much people focused on the DT tasks. Higher task focus was related to higher DT creativity (r = .18) and slightly higher DT fluency (r = .12; see ), suggesting that higher metacognitive control at task level improved DT performance.

MCC at performance level (MCC-P)

MCC-P was assessed in terms of the rated goal-directedness of the employed strategy during DT performance (0, spontaneous to 3 fully goal-directed). People differed substantially in the goal-directedness of their strategies, ranging from relying fully on spontaneous thinking (min = 0; e.g., “I acted on a gut level” or “intuitive”) to being highly strategic about the task (max = 2.75; e.g., “I thought about different contexts and tried to place the object there”). The rated goal-directedness of strategies was also reflected in higher self-reported goal-directedness of strategies (r = .35, p < .001), indicated that people had modest insight in the goal-directedness of their approach. Importantly, higher rated goal-directedness of strategies was correlated with higher DT creativity (r = .24) and a slightly higher DT fluency (r = .12), suggesting that higher metacognitive control at performance level improved DT performance.

In side-analyses, we explored how often specific strategies were used (self-reported from 0, never, to 6, always) and how they related to the goal-directedness measures (see ). The property strategy was used most frequently (3.95) followed by the context strategy (3.87) and the memory strategy (3.73), whereas the disassembly strategy was rather uncommon (2.30). Participants also frequently followed an undirected approach of waiting for spontaneous ideas (3.83). Spearman correlations showed that higher goal-directedness of strategies was related to more often using property and context strategies, and less often relying on a spontaneous approach. Using any specific strategy was only weakly related to DT performance, with only the disassembly strategy showing a significant positive association with both DT creativity and fluency. These findings replicate that DT performance involves both goal-directed and spontaneous strategies (Gilhooly, Fioratou, Anthony, & Wynn, Citation2007) but goal-directed strategies (such as disassembly) appear more conducive to creative performance.

Table 2. Self-reported frequency of using specific task strategies during DT performance (0-never to 6-always) and their association with the goal-directedness of the strategy and DT performance (spearman correlations).

MCC at response level (MCC-R)

MCC-R was measured as the individual creativity threshold applied during DT performance defined by the least creative response reported per task (i.e., worst performance). The average worst performance ranged between creativity ratings of 0 and 1.72 (on a scale of 0–4 with a mean across all responses of 1.51, and a mean of max-3 responses of 1.79), suggesting that people differed substantially in the minimal level of creativity in their responses. We found that people with a higher threshold regarding their worst performance during the timed DT tasks (i.e., their least creative idea was more creative compared to others) also selected fewer uncreative ideas in the response selection task (r = .32, p < .001). Importantly, higher worst performance (MCC-R) was associated with a lower number of responses (DT fluency; r = −.43) but a higher max-3 creativity (DT creativity; r = .16). Together, these findings support the validity of worst performance as an index of metacognitive control at response level, with higher MCC-R resulting in fewer responses and also a higher creativity of the best responses.

We observed an even higher association between worst performance and the average creativity of responses (r = .66), but average creativity, of course, is directly driven by less creative responses, whereas there is only limited overlap between worst performance and the three most creative ideas used in the max-3 DT score. People on average generated six responses and the proportion of people generating three or fewer responses ranged from 16–27% in the three DT tasks. Notably, when limiting the sample to the 196 participants who generated four responses or more in each DT task (i.e., fully avoiding overlap between worst performance, min-1, and best performance, max-3) even increased the relationship between these measures to r = .34 (p < .001), maybe by focusing on a subsample with more consistent, reliable performance. In sum, we see that higher metacognitive control at response level supports focusing on response quality over quantity and thereby increases not only the average creativity of responses but also enhances the quality of the most creative responses.

Independent contributions of MCC aspects for creativity

We examined the unique contributions of the MCC aspects for DT creativity and fluency by means of two regression analyses (see ). Higher MCC at all three levels (task, performance, and response level) independently predicted higher DT creativity, with the strongest contribution observed for MCC at performance level (rated goal-directedness of task strategy). DT fluency was predicted by higher MCC-P, and lower MCC-R, whereas MCC-T did not predict DT fluency beyond the other measures.

Table 3. Regression analysis predicting DT by metacognitive control aspects.

In a next step, we explored whether MCC also predicts real-life creativity in terms of creative activities and achievements in two additional regression analyses (). Given that MCC was found to predict DT, and DT is known to predict real-life creativity (Said-Metwaly, Taylor, Camarda, & Barbot, Citation2022; also confirmed in this study; cf. ), DT fluency and creativity was entered in a second block of predictors, which allowed to explore whether DT potentially mediates the relationship between MCC and real-life creativity. For creative activities, the regression model did not offer a significant explanation of the criterion by the MCC predictors, but only by DT fluency. Creative achievement was significantly predicted by MCC at task and performance levels at step 1. Adding DT measures at step 2, improved the overall model (ΔR2 = .04, p < .001), and DT creativity (but not DT fluency) significantly predicted creative achievements. At the same time, the prediction by MCC measures was attenuated with MCC at task level no longer explaining unique variance in creative achievement besides the other predictors. Formal mediation analyses (bootstrapped with 5000 samples) confirmed significant indirect effects of MCC at task level on creative achievement via DT creativity (MCC-T: β = .001, CI95% [.000, .002], p = .004; MCC-P: β = .043, CI95% [.018, .074], p = .003), with only a significant direct effect by MCC-P on creative achievement (β = .158, CI95% [.076, .242], p < .001), but not by MCC-T (β = .003, CI95% [−.001, .006], p = .161). In sum, these findings suggest that the relationship of MCC at task level with creative achievement is fully or partly mediated by DT creativity, whereas the relationship of MCC at performance level is partly mediated by DT creativity.

Table 4. Hierarchical regression analysis predicting real-life creative activities and achievements by metacognitive control aspects (MCC; step 1) and divergent thinking (DT; step 2).

Discussion

This study examined the relevance of metacognitive control for DT performance. Following the framework of creative metacognition (CMC; Lebuda & Benedek, Citation2023), measures were devised to assess metacognitive control at three conceptual levels (task, performance, response levels). As a main finding, higher metacognitive control at all three levels – control of DT task engagement, use of controlled, goal-directed strategies, and response control – independently predicted higher DT creativity. These findings offer empirical support for the validity of the CMC framework with respect to the facilitating role of metacognitive control at task, performance, and response levels for DT.

Metacognitive control assessments

Some new measures were devised to assess metacognitive control at task, performance, and response levels. All measures referred directly to the DT task performance at hand to ensure that they actually captured metacognitive control (i.e., control applied to regulate and optimize task performance). The new measures revealed considerable inter-individual variance in how much metacognitive control was applied. Metacognitive control at task-level ranged from people focusing 9 to 100% at the task; metacognitive control at performance level ranged from using fully spontaneous approaches to applying sophisticated strategies (range = 0–2.64, on the goal-directedness scale from 0 to 3); metacognitive control at response level ranged from people reporting even the most uncreative ideas to imposing high creativity thresholds (range of worst responses = 0–1.72, on a creativity scale from 0 to 4, with mean creativity across all responses being just 1.51). This descriptive analysis of metacognitive measures already offered intimate insights into how substantially people differ in the extent of how much metacognitive control they apply during DT performances. The observed substantial individual differences in metacognitive control is consistent with the view that metacognitive processes – unlike core cognitive processes – can be optionally recruited to optimize task performance (Lebuda & Benedek, Citation2023).

Interestingly, metacognitive control measures at the three levels showed only weak intercorrelations. This finding appears to run counter to a notion of one underlying trait (e.g., rationality; Stanovich, Citation2012) or ability (e.g., executive control) driving how much metacognitive control is applied at each level. Yet, it also seems possible that even though people wanted to apply control at each level, this was undermined by a lack of relevant metacognitive knowledge. For example, people may not know effective strategies, or inadequately believe that creative ideas mainly result from spontaneous inspiration (Lucas & Nordgren, Citation2020). Similarly, they may be unclear about when an idea is creative enough to be reported (Sidi, Torgovitsky, Soibelman, Miron-Spektor, & Ackerman, Citation2020). Indeed, our findings showed that higher metacognitive knowledge about what responses should not be reported informed higher metacognitive response control during DT performance. It further needs to be acknowledged that the three measures relied on different sources of information, including self-report (MCC-T), ratings of verbal descriptions (MCC-P), and performance data (MCC-R). Especially, self-reported CMC depends on the ability to adequately recognize and reflect ongoing cognitive processes and strategies and thus are likely moderated by a person’s metacognitive abilities. This may also be the reason why self-reports about the goal-directedness of one’s own approach showed only a modest association with the rated goal-directedness and did not predict actual DT performance in our study. Hence, future assessments of creative metacognition should (additionally) aim for objective, behavior-related indicators of metacognition, which could include aspects of performance data (like the response thresholds used in this study), process data (e.g., how much time people spend on elaborating their ideas when entering them (Barbot, Citation2018), or psychophysiological data such as eye tracking that allows to track the focus of attention without cognitive interference (Jankowska, Czerwonka, Lebuda, & Karwowski, Citation2018).

Metacognitive control as predictor of creativity

As a central result of this study, we found that higher metacognitive control at all three levels – fully engaging in the task, using goal-directed strategies, and effectively discarding uncreative ideas – independently predicted higher creative performance. A relatively higher contribution was observed for metacognitive control at performance level, suggesting that cognitive effort spent on choosing effective task strategies is particularly well invested. Our results are consistent with previous findings from a think-aloud study which also found that using more complex strategies supports creative ideation, with the disassembly strategy being most effective in the alternate uses task (Gilhooly, Fioratou, Anthony, & Wynn, Citation2007; cf.; Jia, Xu, & Zhang, Citation2022). We further observed that metacognitive control had a larger impact on supporting the creativity of ideas than the quantity of ideas. In fact, metacognitive control at response level apparently increased DT creativity at the cost of DT fluency. This finding reflects an effective adherence to task instructions that asked to focus on producing creative ideas rather than many ideas, which is likely supported by metacognitive control at response level. Less metacognitive control at response level may be needed in more traditional DT tasks that instruct to mainly come up with many ideas (Nusbaum, Silvia, & Beaty, Citation2014; Saretzki, Forthmann, & Benedek, Citationin press). In sum, we see how metacognitive control at different levels had nuanced, facilitative effects especially on the creativity of DT performance. These findings suggest that the robust positive relationship of cognitive control (Benedek & Jauk, Citation2019; Chrysikou, Citation2018) and DT performance is at least partly due to the supportive effects metacognitive control in creative ideation.

We further explored whether metacognitive control affects real-life behavior, such as via the established role of DT ability in creative activities and achievements (Said-Metwaly, Taylor, Camarda, & Barbot, Citation2022). Metacognitive control did not relate to how frequently people engage in creative behaviors, but it rather predicted the degree of people’s creative achievements. This appears plausible as the frequency of creative activities, unlike achievements, does not reflect the effectiveness or success of the activity. For example, intelligence (a common proxy of cognitive control) was previously found shown to be unrelated with creative activities but specifically predicted creative achievements and further moderated the effect of activities on achievements (Jauk, Benedek, & Neubauer, Citation2014; but also see, Lebuda, Zielinska, & Karwowski, Citation2021). These results are consistent with available findings showing that had demonstrated the relevance of self-reported metacognitive skills for real-life creative accomplishments (Puryear, Citation2015), and indicate that findings extend from trait-like measures of CMC to performance-related assessments of CMC. Specifically, higher levels of metacognitive control at task and performance levels (but not response control) predicted more creative achievements, and the effect of metacognitive control at performance level persisted even after controlling for covariation with DT ability. It seems possible that metacognitive control at performance level partly captured a more general tendency of how strategic people approach creative projects also known as creative self-regulation (Ivcevic & Nusbaum, Citation2017; Zielińska, Lebuda, & Karwowski, Citation2023). Together, these findings show that metacognitive control in DT may even be relevant for creative achievement, partly mediated by DT ability.

Limitations and future directions

Recent work has demonstrated that all three main components of CMC – metacognitive control, monitoring and knowledge – contribute independently to creative performance (Lebuda & Benedek, Citation2024). This study now delved into metacognitive control processes more specifically (at task, performance, and response levels), but it has not considered metacognitive monitoring and knowledge at the same level of detail. Hence, future work should also study other metacognitive components these levels of granularity and ideally also consider their interplay. Further avenues include testing how findings generalize across different tasks and populations especially from more realistic contexts (Agnoli & Mastria, Citation2023; Beghetto & Mangion, Citation2023; Kaufman, Citation2023).

We observed support for the validity of the new metacognitive control measures and their contribution for DT performance, but the effect sizes were quite modest, which can have different reasons. First, the correlations may have been undermined by the partly modest reliability of the measures. We further need to keep in mind that metacognition only refers to how well people reflect on and regulate their cognition, but not to how effectively they carry out the main task (i.e., core cognition). In fact, encouraging people to use a proven strategy when stuck was shown to benefit only those people with high cognitive ability (Nusbaum & Silvia, Citation2011), suggesting that even the best strategy is only as good as its implementation. A comprehensive prediction of DT performance thus relies on the effects both core and metacognitive processes. We further acknowledge that, although our metacognition measures clearly focused on the task performance at hand, they were not sensitive to the dynamic interplay of metacognitive processes over time. For example, metacognitive control at performance level reflects an adaptive regulation, such as to change strategies when the current approach is no longer effective. Future work thus may consider investigating how accurately people recognize when they get stuck (metacognitive monitoring of performance) and how effectively they regulate the process accordingly, such as by investing time to reconsider the strategy instead of simply trying harder. It was shown that people tend to mistake reduced fluency over time as reduced performance, although the quality of ideas was improving with time (i.e., the creative cliff illusion; Lucas & Nordgren, Citation2020). Future research may thus consider process data and think aloud protocols that enable time-sensitive assessments of metacognitive processes during task performance (Pringle & Sowden, Citation2017; Vieira, Kannengiesser, & Benedek, Citation2022) to unveil the dynamic interplay between core and metacognitive processes at task, performance, and response levels toward a more complete understanding of the role of metacognitive processes in creative performance.

Acknowledgments

This work was supported by the European Union’s Horizon 2020 research and innovation program under the Marie Sklodowska-Curie grant agreement No 896518. The authors acknowledge the financial support by the University of Graz.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Data availability statement

Materials, data, and analysis scripts of this work are provided via the Open Science Framework (https://osf.io/9qpk5/).

Additional information

Funding

The work was supported by the H2020 Marie Skłodowska-Curie Actions [896518].

References

  • Acar, S., Runco, M. A., & Park, H. (2020). What should people be told when they take a divergent thinking test? A meta-analytic review of explicit instructions for divergent thinking. Psychology of Aesthetics, Creativity, and the Arts, 14(1), 39–49. doi:10.1037/aca0000256
  • Agnoli, S., & Mastria, S. (2023). Going deeper into the feelings in creative metacognition: Comment on “A systematic framework of creative metacognition” by I. Lebuda & M. Benedek. Physics of Life Reviews, 47, 170–171. doi:10.1016/j.plrev.2023.10.028
  • Baas, M., Koch, S., Nijstad, B. A., & De Dreu, C. K. W. (2015). Conceiving creativity: The nature and consequences of laypeople’s beliefs about the realization of creativity. Psychology of Aesthetics, Creativity, and the Arts, 9(3), 340–354. doi:10.1037/a0039420
  • Barbot, B. (2018). The dynamics of creative ideation: Introducing a new assessment paradigm. Frontiers in Psychology, 9, 2529. doi:10.3389/fpsyg.2018.02529
  • Beaty, R. E., Benedek, M., Silvia, P. J., & Schacter, D. L. (2016). Creative cognition and brain network dynamics. Trends in Cognitive Sciences, 20(2), 87–95. doi:10.1016/j.tics.2015.10.004
  • Beghetto, R. A., & Mangion, M. (2023). Beyond ‘cold’ creative metacognition: Toward a more integrated framework. Physics of Life Reviews, 47, 200–202. doi:10.1016/j.plrev.2023.10.021
  • Benedek, M. (2024). On the relationship between creative potential and creative achievement: Challenges and future directions. Learning and Individual Differences, 110, 102424. doi:10.1016/j.lindif.2024.102424
  • Benedek, M., Beaty, R. E., Schacter, D. L., & Kenett, Y. N. (2023). The role of memory in creative ideation. Nature Reviews Psychology, 2(4), 246–257. Article 4. doi:10.1038/s44159-023-00158-z
  • Benedek, M., Bruckdorfer, R., & Jauk, E. (2020). Motives for creativity: Exploring the what and why of everyday creativity. The Journal of Creative Behavior, 54(3), 610–625. doi:10.1002/jocb.396
  • Benedek, M., & Jauk, E. (2018). Spontaneous and controlled processes in creative cognition. In K. C. R. Fox & K. Christoff (Eds.), The Oxford handbook of spontaneous thought (pp. 285–298). Oxford, UK: Oxford University Press.
  • Benedek, M., & Jauk, E. (2019). Creativity and cognitive control. In J. C. Kaufman & R. J. Sternberg (Eds.), The Cambridge handbook of creativity (pp. S. 200–223). Cambridge University Press. doi:10.1017/9781316979839.012
  • Benedek, M., Jauk, E., Sommer, M., Arendasy, M., & Neubauer, A. C. (2014). Intelligence, creativity, and cognitive control: The common and differential involvement of executive functions in intelligence and creativity. Intelligence, 46, 73–83. doi:10.1016/j.intell.2014.05.007
  • Benedek, M., Karstendiek, M., Ceh, S. M., Grabner, R. H., Krammer, G. Lebuda, Izabela Silvia, Paul J Cotter, Katherine N Li, Yangping Hu, Weiping & Kaufman, J. C. (2021). Creativity myths: Prevalence and correlates of misconceptions on creativity. Personality and Individual Differences, 182, 111068. doi:10.1016/j.paid.2021.111068
  • Benedek, M., Mühlmann, C., Jauk, E., & Neubauer, A. C. (2013). Assessment of divergent thinking by means of the subjective top-scoring method: Effects of the number of top-ideas and time-on-task on reliability and validity. Psychology of Aesthetics, Creativity, and the Arts, 7(4), 341–349. doi:10.1037/a0033644
  • Benedek, M., Nordtvedt, N., Jauk, E., Koschmieder, C., Pretsch, J., Krammer, G., & Neubauer, A. C. (2016). Assessment of creativity evaluation skills: A psychometric investigation in prospective teachers. Thinking Skills and Creativity, 21, 75–84. doi:10.1016/j.tsc.2016.05.007
  • Ceh, S. M., Edelmann, C., Hofer, G., & Benedek, M. (2022). Assessing raters: What factors predict discernment in novice creativity raters? The Journal of Creative Behavior, 46(1), 41–54. doi:10.1002/jocb.515
  • Chevalier, N., Martis, S. B., Curran, T., & Munakata, Y. (2015). Metacognitive processes in executive control development: The case of reactive and proactive control. Journal of Cognitive Neuroscience, 27(6), 1125–1136. doi:10.1162/jocn_a_00782
  • Chrysikou, E. G. (2018). The costs and benefits of cognitive control for creativity. In R. E. Jung & O. Vartanian (Eds.), The Cambridge handbook of the neuroscience of creativity (pp. S. 299–317). Cambridge University Press. doi:10.1017/9781316556238.018
  • Cropley, A. (2006). In praise of convergent thinking. Creativity Research Journal, 18(3), 391–404. doi:10.1207/s15326934crj1803_13
  • Diedrich, J., Jauk, E., Silvia, P. J., Gredlein, J. M., Neubauer, A. C., & Benedek, M. (2018). Assessment of real-life creativity: The inventory of creative activities and achievements (ICAA). Psychology of Aesthetics, Creativity, and the Arts, 12(3), 304–316. doi:10.1037/aca0000137
  • Eysenck, H. J. (1995). Genius: The natural history of creativity, Cambridge University Press: (p. S. 344.) doi:10.1017/CBO9780511752247
  • Fernandez-Duque, D., Baird, J. A., & Posner, M. I. (2000). Executive attention and metacognitive regulation. Consciousness and Cognition, 9(2), 288–307. doi:10.1006/ccog.2000.0447
  • Finke, R. A. (1996). Imagery, creativity, and emergent structure. Consciousness and Cognition, 5(3), 381–393. doi:10.1006/ccog.1996.0024
  • Fleck, J. I., & Weisberg, R. W. (2004). The use of verbal protocols as data: An analysis of insight in the candle problem. Memory & Cognition, 32(6), 990–1006. doi:10.3758/BF03196876
  • Forthmann, B., Karwowski, M., & Beaty, R. E. 2023. Don’t throw the “bad” ideas away! Multidimensional top scoring increases reliability of divergent thinking tasks. Psychology of Aesthetics, Creativity, and the Arts, No Pagination Specified-No Pagination Specified. doi:10.1037/aca0000571
  • Gable, S. L., Hopper, E. A., & Schooler, J. W. (2019). When the muses strike: Creative ideas of physicists and writers routinely occur during mind wandering. Psychological Science, 30(3), 396–404. doi:10.1177/0956797618820626
  • Gerwig, A., Miroshnik, K., Forthmann, B., Benedek, M., Karwowski, M., & Holling, H. (2021). The relationship between intelligence and divergent thinking—A meta-analytic update. Journal of Intelligence, 9(2), 23. Article 2. doi:10.3390/jintelligence9020023
  • Gilhooly, K. J., & Fioratou, E. (2009). Executive functions in insight versus non-insight problem solving: An individual differences approach. Thinking & Reasoning, 15(4), 355–376. doi:10.1080/13546780903178615
  • Gilhooly, K. J., Fioratou, E., Anthony, S. H., & Wynn, V. (2007). Divergent thinking: Strategies and executive involvement in generating novel uses for familiar objects. British Journal of Psychology, 98(4), 611–625. doi:10.1111/j.2044-8295.2007.tb00467.x
  • Grohman, M., Wodniecka, Z., & Kłusak, M. (2006). Divergent thinking and evaluation skills: Do they always go together? The Journal of Creative Behavior, 40(2), 125–145. doi:10.1002/j.2162-6057.2006.tb01269.x
  • Guilford, J. P. (1967). The nature of human intelligence. New York City, NY: McGraw-Hill.
  • Hart, Y., Goldberg, H., Striem-Amit, E., Mayo, A. E., Noy, L., & Alon, U. (2018). Creative exploration as a scale-invariant search on a meaning landscape. Nature Communications, 9(1), Article 1. doi:10.1038/s41467-018-07715-8
  • Isaksen, S. G., Dorval, K. B., & Treffinger, D. J. (2011). Creative approaches to problem solving: A framework for innovation and change. Thousand Oaks, CA: SAGE.
  • Ivcevic, Z., & Nusbaum, E. C. (2017). Chapter 20 - from having an idea to doing something with it: Self-regulation for creativity. In M. Karwowski & J. C. Kaufman (Eds.), The creative self (pp. S. 343–365). Academic Press. doi:10.1016/B978-0-12-809790-8.00020-0
  • Jankowska, D. M., Czerwonka, M., Lebuda, I., & Karwowski, M. (2018). Exploring the creative process: Integrating psychometric and eye-tracking approaches. Frontiers in Psychology, 9, 9. doi:10.3389/fpsyg.2018.01931
  • Jauk, E., Benedek, M., & Neubauer, A. C. (2014). The road to creative achievement: A latent variable model of ability and personality predictors. European Journal of Personality, 28(1), 95–105. doi:10.1002/per.1941
  • Jia, X., Xu, T., & Zhang, Y. (2022). The role of metacognitive strategy monitoring and control in the relationship between creative mindsets and divergent thinking performance. Jounrla of Intelligence, 10(2), 35. doi:10.3390/jintelligence10020035
  • Karwowski, M., Czerwonka, M., & Kaufman, J. (2020). Does intelligence strengthen creative metacognition? Psychology of Aesthetics Creativity and the ARTS, 14(3), 353–360. doi:10.1037/aca0000208
  • Kaufman, J. C. (2023). Yes, and: Comment on “A systematic framework of creative metacognition” by I. Lebuda & M. Benedek. Physics of Life Reviews, 47, 82–83. doi:10.1016/j.plrev.2023.09.004
  • Kaufman, J. C., & Beghetto, R. A. (2013). In praise of Clark Kent: Creative metacognition and the importance of teaching kids when (not) to be creative. Roeper Review, 35(3), 155–165. doi:10.1080/02783193.2013.799413
  • Kenett, Y. N., Gooz, N., & Ackerman, R. (2023). The role of semantic associations as a metacognitive cue in creative idea generation. Journal of Intelligence, 11(4), 59. Article 4. doi:10.3390/jintelligence11040059
  • Koriat, A., & Levy-Sadot, R. (1999). Processes underlying metacognitive judgments: Information-based and experience-based monitoring of one’s own knowledge. In S. Chaiken &Y. Trope, (Eds.), Dual-process theories in social psychology (pp. 483–502). New York City, NY: The Guilford Press.
  • Lebuda, I., & Benedek, M. (2023). A systematic framework of creative metacognition. Physics of Life Reviews, 46, 161–181. doi:10.1016/j.plrev.2023.07.002
  • Lebuda, I., & Benedek, M. (2024). Contributions of metacognition to creative performance and behavior. Journal of Creative Behavior. doi:10.31219/osf.io/4wutj
  • Lebuda, I., Zielinska, A., & Karwowski, M. (2021). On surface and core predictors of real-life creativity. Thinking Skills and Creativity, 42, 1–15. doi:10.1016/j.tsc.2021.100973
  • Lucas, B. J., & Nordgren, L. F. (2020). The creative cliff illusion. Proceedings of the National Academy of Sciences, 117(33), 19830–19836. doi:10.1073/pnas.2005620117
  • Miroshnik, K. G., Forthmann, B., Karwowski, M., & Benedek, M. (2023). The relationship of divergent thinking with broad retrieval ability and processing speed: A meta-analysis. Intelligence, 98, 101739. doi:10.1016/j.intell.2023.101739
  • Miroshnik, K. G., & Shcherbakova, O. V. (2019). The proportion and creativity of “old” and “new” ideas: Are they related to fluid intelligence? Intelligence, 76, 101384. doi:10.1016/j.intell.2019.101384
  • Mumford, M. D., Medeiros, K. E., & Partlow, P. J. (2012). Creative thinking: Processes, strategies, and knowledge. The Journal of Creative Behavior, 46(1), 30–47. doi:10.1002/jocb.003
  • Nusbaum, E. C., & Silvia, P. J. (2011). Are intelligence and creativity really so different? Fluid intelligence, executive processes, and strategy use in divergent thinking. Intelligence, 39(1), 36–45. doi:10.1016/j.intell.2010.11.002
  • Nusbaum, E. C., Silvia, P. J., & Beaty, R. E. (2014). Ready, set, create: What instructing people to “be creative” reveals about the meaning and mechanisms of divergent thinking. Psychology of Aesthetics, Creativity, and the Arts, 8(4), 423–432. doi:10.1037/a0036549
  • Ovando-Tellez, M., Benedek, M., Kenett, Y. N., Hills, T., Bouanane, S. Bernard, Matthieu Belo, Joan & Bieth, Theophile Volle, E. (2022). An investigation of the cognitive and neural correlates of semantic memory search related to creative ability. Communications Biology, 5(1), Article 1. doi:10.1038/s42003-022-03547-x
  • Paek, S. H., Abdulla Alabbasi, A. M., Acar, S., & Runco, M. A. (2021). Is more time better for divergent thinking? A meta-analysis of the time-on-task effect on divergent thinking. Thinking Skills and Creativity, 41, 100894. doi:10.1016/j.tsc.2021.100894
  • Pesut, D. J. (1990). Creative thinking as a self-regulatory metacognitive process—A model for education, training and further research. The Journal of Creative Behavior, 24(2), 105–110. doi:10.1002/j.2162-6057.1990.tb00532.x
  • Pham, C. T. A., Magistretti, S., & Dell’era, C. (2023). How do you frame ill-defined problems? A study on creative logics in action. Creativity and Innovation Management, 32(3), 493–516. doi:10.1111/caim.12543
  • Plucker, J. A., Runco, M. A., & Lim, W. (2006). Predicting ideational behavior from divergent thinking and discretionary time on task. Creativity Research Journal, 18(1), 55–63. doi:10.1207/s15326934crj1801_7
  • Pringle, A., & Sowden, P. T. (2017). Unearthing the creative thinking process: Fresh insights from a think-aloud study of garden design. Psychology of Aesthetics, Creativity, and the Arts, 11(3), 344–358. doi:10.1037/aca0000144
  • Puente-Díaz, R., Cavazos-Arroyo, J., Puerta-Sierra, L., & Vargas-Barrera, F. (2022). The contribution openness to experience and its two aspects to the explanation of idea generation, evaluation and selection: A metacognitive perspective. Personality and Individual Differences, 185, 111240. doi:10.1016/j.paid.2021.111240
  • Puente-Diaz, R., Cavazos-Arroyo, J., & Vargas-Barrera, F. (2021). Metacognitive feelings as a source of information in the evaluation and selection of creative ideas. Thinking Skills and Creativity, 39, 39. doi:10.1016/j.tsc.2020.100767
  • Puryear, J. S. (2015). Metacognition as a moderator of creative ideation and creative production. Creativity Research Journal, 27(4), 334–341. doi:10.1080/10400419.2015.1087270
  • Puryear, J. S. (2016). Inside the creative sifter: Recognizing metacognition in creativity development. The Journal of Creative Behavior, 50(4), 321–332. doi:10.1002/jocb.80
  • Roebers, C. M. (2017). Executive function and metacognition: Towards a unifying framework of cognitive self-regulation. Developmental Review, 45, 31–51. doi:10.1016/j.dr.2017.04.001
  • Rominger, C., Benedek, M., Lebuda, I., Perchtold-Stefan, C. M., Schwerdtfeger, A. R., Papousek, I., & Fink, A. (2022). Functional brain activation patterns of creative metacognitive monitoring. Neuropsychologia, 177, 108416. doi:10.1016/j.neuropsychologia.2022.108416
  • Runco, M. A., & Acar, S. (2010). Do tests of divergent thinking have an experiential bias? Psychology of Aesthetics, Creativity, and the Arts, 4(3), 144–148. doi:10.1037/a0018969
  • Runco, M. A., & Smith, W. R. (1992). Interpersonal and intrapersonal evaluations of creative ideas. Personality and Individual Differences, 13(3), 295–302. doi:10.1016/0191-8869(92)90105-X
  • Said-Metwaly, S., Taylor, C. L., Camarda, A., & Barbot, B. (2022). Divergent thinking and creative achievement—how strong is the link? An updated meta-analysis. Psychology of Aesthetics, Creativity, and the Arts. doi:10.1037/aca0000507
  • Saretzki, J., Forthmann, B., & Benedek, M. (in press). A systematic quantitative review of divergent thinking assessments. Psychology of Aesthetics, Creativity, and the Arts.
  • Sidi, Y., Torgovitsky, I., Soibelman, D., Miron-Spektor, E., & Ackerman, R. (2020). You may be more original than you think: Predictable biases in self-assessment of originality. Acta Psychologica, 203, 103002. doi:10.1016/j.actpsy.2019.103002
  • Silvia, P. J. (2008). Discernment and creativity: How well can people identify their most creative ideas? Psychology of Aesthetics, Creativity, and the Arts, 2(3), 139–146. doi:10.1037/1931-3896.2.3.139
  • Silvia, P. J. (2015). Intelligence and creativity are pretty similar after all. Educational Psychology Review, 27(4), 599–606. doi:10.1007/s10648-015-9299-1
  • Simonton, D. K. (2011). Creativity and discovery as blind variation: Campbell’s (1960) BVSR model after the half-century mark. Review of General Psychology, 15(2), 158–174. doi:10.1037/a0022912
  • Stanovich, K. E. (2012). On the distinction between rationality and intelligence: Implications for understanding individual differences in reasoning. In K. J. Holyoak & R. G. Morrison (Eds.), The oxford handbook of thinking and reasoning (p. S. 0). Oxford University Press. doi:10.1093/oxfordhb/9780199734689.013.0022
  • Urban, M., & Urban, K. (2021). Unskilled but aware of it? Cluster analysis of creative metacognition from preschool age to early adulthood. The Journal of Creative Behavior, 55(4), 937–945. doi:10.1002/jocb.499
  • Urban, M., & Urban, K. (2023). Do we need metacognition for creativity? A necessary condition analysis of creative metacognitio. Psychology of Aesthetics, Creativity, and the Arts. doi:10.1037/aca0000647
  • Urban, M., & Urban, K. (2024). Does metacognition matter in creative problem-solving? A mixed-methods analysis of writing. The Journal of Creative Behavior. doi:10.1002/jocb.630
  • van Broekhoven, K., Belfi, B., Borghans, L., & Seegers, P. (2021). Creative idea forecasting: The effect of task exposure on idea evaluation. Psychology of Aesthetics, Creativity, and the Arts, No Pagination Specified-No Pagination Specified. 16(3), 519–528. doi:10.1037/aca0000426
  • Vieira, S., Kannengiesser, U., & Benedek, M. (2022). Investigating triple process theory in design protocols. Proceedings of the Design Society, 2, 61–70. doi:10.1017/pds.2022.7
  • Zabelina, D. L., Friedman, N. P., & Andrews-Hanna, J. (2019). Unity and diversity of executive functions in creativity. Consciousness and Cognition, 68, 47–56. doi:10.1016/j.concog.2018.12.005
  • Zepeda, C. D., & Nokes-Malach, T. J. (2021). Metacognitive study strategies in a college course and their relation to exam performance. Memory & Cognition, 49(3), 480–497. doi:10.3758/s13421-020-01106-5
  • Zielińska, A., Lebuda, I., & Karwowski, M. (2023). Dispositional self-regulation strengthens the links between creative activity and creative achievement. Personality and Individual Differences, 200, 111894. doi:10.1016/j.paid.2022.111894