1,106
Views
0
CrossRef citations to date
0
Altmetric
CLINICAL PSYCHOLOGY

Inhibition on irrelevant negative information alleviates the mediating role of psychological distress in the association between trait rumination and symptoms of depression and anxietyOpen Data

ORCID Icon, ORCID Icon & ORCID Icon
Article: 2228556 | Received 26 Jan 2023, Accepted 15 Jun 2023, Published online: 19 Jul 2023

Abstract

This study aims to examine whether psychological distress mediates the association between rumination and symptoms of depression-anxiety, and whether such a mediating role is moderated by the ability to inhibit irrelevant negative information (a moderated-mediation model). On-line questionnaires comprising the Ruminative Response Scale (RRS), Depression, Anxiety, and Stress Scale (DASS-21), and Negative Affective Priming (NAP) Task as a measure of inhibitory control (IC) on negative information were administered to 181 participants (M = 21.57 years old, 80.1% females). The results of the analyses showed (1) a significant negative association between psychological distress and the performance of inhibitory control on negative information, (2) a partial mediating role of psychological distress in the relationship between rumination and symptoms of depression and anxiety, and (3) that the mediating role was moderated by inhibitory control performance. The stronger the inhibitory control, the weaker a relationship between rumination and psychological distress, which is associated with the reduction in the mediating role of psychological distress on the symptoms of depression and anxiety. The implications of our findings will be discussed by considering the systemic dynamic Model for understanding depression and anxiety.

1. Introduction

Mood disorders such as anxiety and depression are major public health problems. According to the World Health Organization (WHO, Citation2017), anxiety affects more than 200 million individuals globally (3.6% of the population). Depression is the most common mood disorder, affecting 322 million people (4.4% of the world’s population), over half of whom are from Southeast Asia. Records from the Ministry of Health of the Republic of Indonesia’s Basic Health Research (Kementerian Kesehatan Republik Indonesia, Citation2018) indicate that among those aged 15 years and older, the incidence of mood disorders increased from 6% in 2013 to 9.8% in 2018. In the same year, 6.1% of the population had experienced depression.

Anxiety and depression disorders often occur together and are classified under a broader group known as internalizing disorders (Kalin, Citation2020). According to a global survey, 45.7% of people with major depressive disorder also had a lifetime history of one or more anxiety disorders (Kessler et al., Citation2015). Depressive disorders, which we refer to as depression, are characterized by persistent sadness, cognitive dysfunction, and somatic symptoms, whereas anxiety disorders involve excessive fear and worry. Depressive disorders are associated with high mortality, much of which is accounted for by suicide; however, it is not the only cause. Individuals frequently present with tearfulness, irritability, brooding, obsessive rumination, anxiety, phobias, excessive worry over physical health, and complaints of pain (e.g., headaches, joint, abdominal, or other pain). Anxiety disorders are often associated with muscle tension and vigilance in preparation for future danger and cautious or avoidant behaviors. However, depression and anxiety also share a number of symptoms such as irritability, difficulty concentrating, rumination, and sleep problems (American Psychiatric Association [APA], Citation2013). Thus it is important to investigate the mechanisms of both symptoms of depression and anxiety in parallel.

2. Rumination, psychological distress, and depression-anxiety

Depression and anxiety, known as “distress disorders,” are characterized by a broad range of negative affect and emotions (as a dimension of psychological distress) such as fear, sadness, anger, guilt, and disgust (Watson, Citation2005). On the other hand, perseverative cognitive processes, including worry and rumination, have also been identified as etiological factors that contribute to the maintenance of symptoms of depression and anxiety (Verkuil et al., Citation2010). According to previous findings from Brosschot et al. (Citation2006), perseverative cognitions or chronic and repeated activations of thoughts of psychological stressors might play an important role in the escalation of negative affect and prolongation of psychological distress. Various additional empirical studies have corroborated Brosschot’s notion that chronic and repeated activation of negative thoughts, also known as rumination, can trigger symptoms of depression or anxiety (McLaughlin & Nolen-Hoeksema, Citation2011; Olatunji et al., Citation2013; Watkins, Citation2009).

Rumination is a common response to stressful situations as individuals attempt to cope with psychological distress (Nolen-Hoeksema, Citation1991). It is considered a maladaptive coping strategy characterized by passive and repetitive thinking about unpleasant memories and feelings, or perseverative cognitions (Nolen-Hoeksema et al., Citation2008). As a part of perseverative cognitionsrumination worsens psychological distress and is recognized as a transdiagnostic factor associated with both depression and anxiety (Watkins & Roberts, Citation2020).

Our study also focuses on psychological distress as a significant risk factor for the development of depression and anxiety, given its well-established connection to scientific literature. Psychological distress, as defined by the American Psychological Association (Citationn.d.) refers to a range of painful mental and physical symptoms associated with normal mood fluctuations experienced by most individuals. It encompasses various negative emotional and mental experiences including symptoms related to anxiety and depression. While the occurrence of psychological distress is quite common among healthy, functioning people, a higher level of persistent psychological distress may be an indicator of mental disorders and may indicate prevalent mental disorders, such as depressive disorder and anxiety disorder (Cuijpers et al., Citation2009; Richter Levin & Xu, Citation2018).

Presently, most theorists posit that depression and anxiety arise from the systemic synchronization of various interoceptive, perceptual, cognitive, and motor components that mutually amplify each other. By adopting such a systemic approach, we can enhance our understanding of anxiety and depression as multi-component and dynamic processes that evolve continuously over time. These conditions are intrinsically interconnected due to their self-organizing and dynamic nature, exhibiting circular causality (Jeronimus, Citation2019). In this study, we adopted systemic dynamic model of depression and anxiety as a theoretical framework.

3. Systemic dynamic model

The systemic dynamic model is a valuable tool for understanding how various causal feedback mechanisms contribute to the development of systemic syndromes with various patient trajectories (Homer & Hirsch, Citation2006). This approach has provided support for understanding the causes of illnesses and associated trends as well as for the design of prevention, treatment, and policy interventions (Homer et al., Citation2016; Thompson et al., Citation2015). According to this model, depression (Jeronimus, Citation2019; Wittenborn et al., Citation2016) and anxiety (Jeronimus, Citation2019; Morris et al., Citation2010) can both be considered systemic syndromes.

Ruscio et al. (Citation2015) proposed that rumination, psychological distress, and depression are closely interconnected. They suggested that rumination indirectly increases susceptibility to depression through its impact on psychological distress. Negative affect during rumination, dysfunctional behaviors (such as social disengagement, inactivity, and behavioral avoidance), and the persistence of memories of past stressors contribute to the link between rumination and psychological distress (Ruscio et al., Citation2015). The study by Lyubomirsky and Nolen-Hoeksema (Citation1993) supports this notion, as dysphoric participants reported a reduced willingness to engage in enjoyable activities after engaging in rumination, despite anticipating pleasure from those activities. Hosseinichimeh et al. (Citation2018) found that higher levels of rumination prolong the retention of stressful memories, leading to increased rumination. Consequently, psychological distress persists longer than necessary. Anxiety, based on research by Morris et al. (Citation2010), can also be viewed as a systemic syndrome. In the current study, based on previous studies (Brosschot et al., Citation2006; Verkuil et al., Citation2010) and the systemic dynamic model (Ruscio et al., Citation2015) as our framework, we hypothesized that the relationship between rumination and symptoms of depression and anxiety is mediated by psychological distress.

Furthermore, Morris et al. (Citation2010) proposed that rumination is a response to stress, which can progressively heighten psychological distress, increase the level of anxiety and disrupt cognitive functions, including inhibitory control. Previous studies have explored the interactions between rumination, psychological distress, depressive symptoms, anxiety symptoms, and the role of working memory. However, the impact of inhibition on negative information, which is linked to the working memory updating process (Joormann, Citation2008; Mayr & Keele, Citation2000), remains unclear within the framework of the systemic dynamic model of depression and anxiety. Consequently, there is still much to learn about the extent to which the inhibition on negative information influences the association strength between rumination, psychological distress, depressive symptoms, and anxiety symptoms.

4. The relationship of rumination, inhibitory control, and psychological distress

Inhibitory control (IC) refers to the internal processes through which individuals inhibit the retrieval of irrelevant information while maintaining relevant information in their working memory (Greiff et al., Citation2015; Valle et al., Citation2019). Joormann and Gotlib (Citation2010) suggested that poor IC on negative information may reduce the use of adaptive emotion regulation strategies such as reappraisal (i.e., suppressing the effect of task-irrelevant emotional information while reappraising a stressful situation; Cohen et al., Citation2014), resulting in maladaptive coping with negative emotions, such as rumination. Other studies have also shown that ruminators struggle to block pertinent information from working memory due to their rigid attentional bias towards negative information (Mayr & Keele, Citation2000). For example, DeJong et al. (Citation2019) found that higher attentional switch costs were linked to more depressed brooding, suggesting that ruminators have a propensity for rigid biased processing of negative stimuli. Such rigidity might occur due to impairments in the attentional disengagement process (Grafton et al., Citation2016) among ruminators. Furthermore, impaired attentional disengagement might reduce the effectiveness of the inhibition process (Crawford et al., Citation2012), specifically in preventing irrelevant negative stimuli from entering working memory.

Based on the aforementioned studies, deficiencies in inhibitory control (IC) regarding negative information have been found to exacerbate attentional bias towards negative stimuli and foster persistent negative thoughts in working memory. Consequently, these factors contribute prolonging of psychological distress (Wittenborn et al., Citation2016). The amplification of negative bias can be attributed to the interplay between rumination tendencies in individuals with depression-anxiety and their poor performance in IC when confronted with negative information. In a similar vein, Hosseinichimeh et al. (Citation2018) proposed that the impact of rumination on the escalation and perpetuation of psychological distress is closely linked to impaired inhibitory control. Therefore, to elucidate the role of inhibitory control within the systemic dynamic model of depression, our investigation sought to determine its significance as an underlying mechanism that moderates the strength of the association between rumination and psychological distress.

We used the Negative Affective Priming (NAP) Task (Joormann, Citation2004, Citation2006) to measure the performance of the inhibition on irrelevant negative stimuli. An NAP Task involves two Valence conditions, namely Positive and Negative. In this task, participants are shown positive and negative words simultaneously as distractors and targets, respectively. Participants are instructed to determine whether the target words are positive or negative while disregarding the distractor words displayed above them. What participants are not aware of is that each Valence condition includes both NAP and Control conditions. Within each NAP and Control condition, a pair of trials, known as prime and probe trials, are presented in sequence. The main distinction between the NAP and Control conditions lies in the relationship between distractors during prime trials and targets during probe trials. In the NAP conditions, the distractors during the prime trials and the targets during the probe trials share the same valence (either positive or negative words). However, under Control conditions, they have opposite valences.

To assess inhibitory control performance, the NAP Effect is calculated, which measures the difference in reaction time between probe trials in the NAP and Control Conditions. A positive NAP Effect indicates good performance, with larger values indicating better performance. The purpose of this calculation is to evaluate the ability to ignore distractor stimuli during the prime trial, which requires the inhibition of cognitive representations associated with the distractor and related words of similar valence in working memory. When the probe trial follows, participants in the NAP condition must respond to the target stimulus that shares the same valence as the previously inhibited distractor. This leads to a slower reaction time for the probe’s target due to the readjustment process required in the selection/inhibition mechanism of working memory. In contrast, the Control condition lacks this readjustment process because the valence of the prime’s distractor and the probe’s target is dissimilar. Consequently, a negative NAP Effect (shorter reaction times for probe trials in the NAP condition) or zero effect (no difference in reaction times between NAP and Control conditions) indicates poor inhibitory performance, indicating that inhibition has not effectively operated in the NAP conditions where a readjustment process would be unnecessary (Frings et al., Citation2015; Joormann, Citation2004).

The NAP task has been widely used, particularly in the study of psychopathology such as depression and schizophrenia (Frings et al., Citation2015; Joormann et al., Citation2007), as well as grief (Delespaux & Zech, Citation2015). As discussed above, inhibition deficits make it harder for depressed ruminators to prevent irrelevant negative information from entering the working memory. Therefore, the strength of the association between rumination and psychological distress may be reduced by a higher ability to control attentional bias to negative information. This aligns with the mechanism of inhibitory control measured using the NAP task.

5. Aims of the study

Examining current components and novel interactions between existing constructs may help us to better understand the processes that underpin depression and anxiety, as there is still some confusion regarding the variables that may explain the dynamics of depression and anxiety. We proposed an explanation for the connection between rumination, psychological distress, inhibitory control, and depression/anxiety using a moderated mediation model (Figure ). According to Jeronimus (Citation2019), the systemic dynamic model and evidence of connections between the aforementioned variables may provide new explanations for the frequent co-occurrence of anxiety and depression. Thus, we assume no differences in the pathways between depression and anxiety. Later in the discussion depression and anxiety were examined separately.

Figure 1. Moderated mediation model of depression-anxiety.

This figure illustrates the moderated mediation model tested in our study. The links between the independent variable (Rumination), the mediator (Inhibitory Control on Negative Stimuli), and the dependent variable (Depression-Anxiety) are represented by solid arrows. Additionally, there is another arrow (A2) representing the interaction effect between the moderator (Inhibitory Control on Negative Stimuli) and the independent variable (Rumination) on the mediator (Psychological Distress). This model hypothesized an indirect link between rumination, psychological distress, and depression-anxiety would be conditional to the level of Inhibitory Control on Negative Stimuli.
Figure 1. Moderated mediation model of depression-anxiety.

Two research questions were addressed in this study: (a) whether rumination and depression or anxiety are related in a way that is indirectly mediated by psychological distress and (b) whether inhibitory control over irrelevant negative stimuli can act as a moderator in the association between rumination and psychological distress.

6. Methods

Approval was granted by the Ethics Committee of the Faculty of Psychology at Universitas Indonesia (093/FPsi.Komite Etik/PDP.04.00/2022). The study was correlational, comprising measures of rumination (independent variable), psychological distress (mediator), inhibitory control (moderator), and depression-anxiety (dependent variable).

6.1. Participants

The data sample was obtained from the general public with a minimum age of 18 years (N = 237). Data collection was carried out using an online survey that had been provided, in which there was an explanation of the research and informed consent that was agreed upon at the beginning. Participants were informed that their participation was confidential and that they were free to withdraw at any time. The average data collection time for each participant was around 25–30 minutes. Incentives were offered to encourage participation in the form of an e-wallet of IDR 25,000.00 (Estimated 1.7 USD).

6.2. Measures

6.2.1. Sociodemographic details

The first section of the questionnaire asked for sociodemographic details such as age, education level, gender, occupation, psychological evaluation history, and domicile. In this research, we use age as a covariate as it is associated with rumination and depression (Tong et al., Citation2021). Studies have shown that rumination tendencies and the prevalence of depression and anxiety can vary across age groups (Nolen-Hoeksema & Watkins, Citation2011). Research has consistently found gender differences in the prevalence, presentation, and symptomatology of psychological distress, depression, and anxiety disorders (Altemus et al., Citation2014; Kuehner, Citation2017). Women tend to experience higher rates of depression and anxiety compared to men. Meanwhile, education level is associated with cognitive abilities and intellectual functioning (Mirowsky & Ross, Citation2017). Higher levels of education are generally linked to improved problem-solving skills, critical thinking abilities, and better cognitive resources. These cognitive factors can influence the way individuals process and cope with rumination, depression, or anxiety.

6.2.2. Rumination

Rumination was measured using the Indonesian version of the Ruminative Response Scale (RRS) (Rahman, Citation2020) which was originally developed by Treynor et al. (Citation2003). Participants were instructed to rate each item on a scale ranging from 1 (almost never) to 4 (almost always). Higher scores indicate greater rumination. Previous research showed that the Cronbach’s Alpha of the items was α = .87 (Rahman, Citation2020). In this study, the reliability of the items was α = .90.

6.2.3. Depression, anxiety, and psychological distress

The third part of the questionnaire measured depression, anxiety, and distress as assessed by the DASS-21 (Depression, Anxiety, Stress Scale-21) translated by Kinanthi et al. (Citation2020), first developed by Lovibond and Lovibond (Citation1995). This 21-item scale is applicable in both clinical and non-clinical settings and has been used to measure the negative emotions of individuals in the most recent week. The DASS is a state measure, not a trait measure (Lovibond & Lovibond, Citation1995). Each subscale contains seven items. Participants were asked to respond on how relatable the item was to them in the past week. Using the Likert four-level scoring system, with 0 to 3 points representing non-conformity (0) to very consistent (3). The higher the score, the higher the level of negative emotion. A Cronbach’s alpha of α = .90 was found in the current study for the overall DASS-21 scale. The Cronbach’s alpha for each subscale was also reported: depression (α = .88), anxiety (α = .75), and stress (α = .76). Psychological distress was measured using the Stress subscale. In addition, the results of testing the validity of the structure through factor analysis using CFA produced a model that is in accordance with Lovibond’s theoretical model and is supported by items representing each DASS-21 dimension, especially in Indonesian population (Arjanto, Citation2022; Nada et al., Citation2022)

6.2.4. Inhibitory control

In this study, the Negative Affective Priming (NAP) Task was employed to measure inhibitory control (IC) on irrelevant positive and negative information. The task was programmed using OpenSesame 3.3.12 software (Mathôt et al., Citation2011) and uploaded to JATOS (a website for online experiments) created by Lange et al. (Citation2015).

Participants were shown two words simultaneously on the upper and lower sides of thescreen. Both words’ positions were in the center of the screen with a distance of 1 cm between the upper-side words and lower-side words. One word had a black background and the other had a white background. We used a Sans-type font with a size of 40px. The participants’ task was to read the two words shown together, followed by judging the valence (positive or negative) of the word with a white background (target) and ignoring the word with a black background (distractor). Participants judged the targets of the displayed target word by pressing the “K” button for negative words and “L” button for positive words. The participants were also asked to respond as quickly and accurately as possible.

For the stimuli of the NAP task, we selected 65 words, each with positive (Wise, Happy) or negative (Envy, Cruel) valence from an Indonesian word norming study (Sianipar et al., Citation2016) and a previous study by Putri et al. (Citation2023). The words were selected based on two requirements: First, they must not differ in terms of length, number of syllables and word familiarity. In this study, the words’ length (t (128) = .88, p > .10), number of syllables (t (128) = 1.24, p > .10), and word familiarity (t (128) = 1.8, p > .05) also did not differ significantly. Second, positive and negative words differ in their valence levels. In this study, the selected words’ valence (Mean positive words = 7.03, mean negative words = 2.96, t (128) = 41.21, p < .001) differed significantly, with positive words showing higher levels of valence in comparison to negative words. The complete list of stimuli can be seen through this link: https://doi.org/10.6084/m9.figshare.21947405

The total number of trials conducted to measure the NAP task was 168, consisting of 8 practice trials (4 prime and 4 probe trials) and 160 main trials (80 prime and 80 probe trials). As with other studies using an NAP task, we created two conditions, namely NAP and Control conditions by pairing prime-probe trials based on the valence level of the distractor in the prime trials and the valence level of the target in the probe trials. Each of the NAP and Control conditions was divided into two groups based on the valence of the target words in the probe trials (positive and negative trials). See Table for task design.

Table 1. Control and NAP conditions in negative affective priming task

In this study, we created a stimulus list consisting of 5 blocks. Each block consisted of 32 trials (16 prime trials and 16 probe trials), comprising 8 prime-probe pairs for the NAP condition and 8 prime-probe pairs for the control condition. Each condition consisted of the same number of positive and negative trials. In each block, the order of the positive and negative trials in the NAP and Control conditions was randomized. The distractor and target were repeated after a minimum of 8 trials, with a maximum of 3 repetitions of the target words in probe trials across the blocks.

We collected the reaction times (RTs in milliseconds) of correct answers for probe trials in the NAP Task. Trials with RTs faster than 250 ms and slower than 3000 ms (Schrobsdorff et al., Citation2012) were removed. There were 39 participants whose data were not used because 30% (maximum 48 trials removed per participant) of their reaction time data were discarded (McLennan et al., Citation2019). There were 17 participants who did not follow the instructions; therefore, so they were not included in the analysis, leading to 181 participants being included in the analysis.

The performance of IC on negative information for each participant was measured using the score of the NAP effect by subtracting the average RTs for Control conditions with RTs for NAP conditions (Joormann, Citation2004) for negative targets. A positive NAP effect would indicate good IC performance, whereby the inhibition of a negative distractor (in prime trials) slows down negative target processing (in probe trials) in NAP conditions, resulting in slower RTs for NAP conditions than those for Control conditions. IC performance was used in the moderated-mediation analysis to test its moderating effect on the relationship between rumination and psychological distress.

6.3. Procedure

Participants were asked to agree and fill out an informed consent to participate in the study, those who were willing to be sent a link to access the first part, which contained the DASS-21 & RRS measuring instrument. A link was distributed to the participants shortly after they completed the RRS and the DASS-21. Participants were instructed to perform the NAP task only on a desktop computer or laptop, and not on a cell phone or tablet. On average, the participants took 20–25 minutes to complete the task. The progress of each participant was monitored intensively to ensure that no participant was working on the first and second parts with a long pause.

6.4. Statistical analysis

This study used SPSS v.26 and PROCESS Hayes v.4 software (Hayes, Citation2022). First, a descriptive analysis (mean and SD) and correlation of each variable (i.e. rumination, depression, anxiety, psychological distress, and inhibitory control to negative information) were conducted. Then, we performed mediation-moderation analyses (PROCESS Model 7) for depression and anxiety as the dependent variables, separately. The direct effect of rumination on depression and anxiety (path c), and the indirect effect of psychological distress (path a and b) will be tested. Sex, age, and education were included as covariates. A bootstrapping technique was used with a value of 5000.

The significance of Model 7 was determined by an index of moderated-mediation, which shows that the confidence interval did not include 0 and the p-value <0.05. In this study, a significant model suggests that the relationship between rumination and depression-anxiety can be mediated by psychological distress, and the mediation effect is also influenced by the individual’s inhibitory control ability.

7. Result

7.1. Sample description

Data were collected to get an overview of the participants in this study. Table summarizes the characteristics of the participants.

Table 2. Sample description (age, gender, and education)

7.2. Bivariate associations

The bivariate correlational analysis showed that rumination was significantly correlated with psychological distress (r = .654, p < .01), anxiety (r = .579, p < .01), and depression (r = .543, p < .01). A significant correlation was also found between psychological distress and anxiety (r = .739, p<.01), depression (r = .617, p < .01), and inhibitory control (r = −.149, p < .05). Anxiety also correlated with depression (r = .598, p < .01). There was no significant relationship between inhibitory control and rumination, anxiety, or depression (see. Table ).

Table 3. Descriptive data and bivariate correlation among variables

7.3. Rumination to psychological distress (Path A1), inhibitory control on negative stimuli to psychological distress, and the interaction effect of inhibitory control on negative stimulus and rumination on psychological distress (Path A2)

As with the bivariate analyses, the regression coefficients for the direct effect of rumination (and covariates) on psychological distress (see. Table ) is significant and positive. In this study, we found that inhibitory control moderated the association between rumination and psychological distress, which supported our hypothesis. As the NAP effect decreased, the relationship between rumination and psychological distress became stronger. The strength of the interaction was indicated by the explained variance rather than the b coefficient (see Figure ). The model explained 46.19% of the variance in psychological distress (F(7,173) = 21.215, p < .001). The interaction between rumination and inhibitory control increased the variance in psychological distress explained by the model(ΔR2 = 1.4%, F(1,173) = 4.45, p < .05).

Figure 2. Psychological distress scores by rumination levels, subject to inhibitory control on negative stimulus.

Figure 2. Psychological distress scores by rumination levels, subject to inhibitory control on negative stimulus.

Table 4. Predictors of psychological distress, with covariates

7.3. Psychological distress to depression and anxiety

Regression coefficients for the mediation of psychological distress on depression and anxiety (see. Table ) is significant and positive. The model explained 41.75% of the variance in depression (F(6,174) = 20.78, p < .001) and 56.35% of the variance in anxiety (F(6,174) = 37.43, p < .001).

Table 5. Predictors of depression and anxiety, with covariates

7.4. The direct effect of rumination on depression and anxiety (Path C’1)

As shown in Table , rumination was directly related to depression and anxiety, indicating that partial mediation applies.

Table 6. Conditional indirect effects of rumination on depression & anxiety through psychological distress, subject to inhibitory control

7.5. Conditional indirect effects (Path C1)

The indirect effects of rumination on depression and anxiety, through psychological distress (path C1), were conditional on the performance of inhibitory control on irrelevant negative stimuli, as shown by the indexes of moderated mediation for depression (b = −.0006, SE = .0003, 95% CIs = −.0013, −.0001) and anxiety (b = −.0007, SE = .0003, 95% CIs = −.0014, −.0001). Thus, it can be concluded that the mediation of psychological distress in the relationship between rumination to depression and anxiety was significantly moderated by inhibitory control. The three conditional indirect effects of rumination on depression and anxiety are summarized in Table .

Figure shows that rumination was positively associated with psychological distress at weak, moderate, and strong levels of NAP Effect/inhibitory control performance. Interestingly, the relationship between rumination and psychological distress strengthened the NAP Effect/inhibitory control performance lowered. The indirect effect (see Table ) shows that higher inhibitory control on irrelevant negative stimuli, rather than increases, the indirect effect of rumination via psychological distress on depression and anxiety.

8. Discussion

In this study, the mechanisms underlying the link between rumination and depression-anxiety were investigated. Psychological distress is hypothesized to be a mediator of this link. We also specifically investigated the role of the inhibition on negative stimuli in determining how strongly rumination and psychological distress are related.

One of our findings suggests that rumination is directly associated with depression and anxiety, in line with previous studies that have shown the same effect on depression (Nolen-Hoeksema et al., Citation2008; Watkins, Citation2009) and anxiety symptoms (Olatunji et al., Citation2013; Watkins, Citation2009). Thus, ruminating may increase an individual’s risk of developing depression or anxiety through the generation of persistent unpleasant feelings and thoughts, which in turn makes rumination more harmful and hinders one’s capacity for problem-solving and adaptive action (McLaughlin et al., Citation2007; Nolen-Hoeksema et al., Citation1999, Citation2008).

Another finding of this study also suggests that psychological distress significantly mediates the associations between rumination and symptoms of depression-anxiety. This finding provides further evidence that supports previous studies suggesting that psychological distress is an important predictor of the symptoms of depression (Cuijpers et al., Citation2009; Richter Levin & Xu, Citation2018) and anxiety (Cuijpers et al., Citation2009). It is noteworthy that the results point to a partial mediation of psychological distress, suggesting that, while rumination can directly predict the probability of depressive and anxious symptoms, it can also predict symptoms via psychological distress.

Our findings are also in line with Wittenborn et al. (Citation2016) and Morris et al’s. (Citation2010) systemic dynamic models of depression and anxiety. According to this model, ruminating may prolong psychological distress. Wittenborn et al. (Citation2016) extensively discussed the impact of persistent activation of negative representations, leading to increased orientation and sustained attention towards negative information. This biased attention and processing of negative stimuli contributes to psychological distress, resulting in unpleasant emotions, such as sadness and biased interpretations aligned with negative mental models (De Raedt & Koster, Citation2010). Negative thoughts and emotions are encoded and retained in the memory, reinforcing existing negative self-referent schemas (De Lissnyder et al., Citation2010). Moreover, the tendency to ruminate intensifies when individuals experience negative emotions and interpretations, exacerbating psychological distress and heightening negative affect (Nolen-Hoeksema & Morrow, Citation1991).

Ruscio et al. (Citation2015) supported this model by explaining the relationship between rumination, psychological distress, depression, and cognitive functions. Their research revealed that rumination prolonged the duration of negative information in an individual’s memory, thereby increasing psychological distress. Additional support for this model is povided by Ruscio et al. (Citation2015) and Hosseinichimeh et al. (Citation2018). These studies collectively suggest that this process enhances the likelihood of experiencing symptoms of depression and anxiety. Our findings also align with the systemic dynamic model proposed by Ruscio et al. (Citation2015), further reinforcing the usefulness of this framework.

The present study also examined the impact of inhibitory control (IC) on negative stimuli and its effect on the association between rumination and psychological distress. Our findings suggest that stronger IC on negative stimuli reduces the strength of the link between rumination and psychological distress, whereas weaker IC strengthens this association. These results are consistent with Joormann’s (Citation2010) research, which indicates that poor ability to inhibit irrelevant negative stimuli increases the accessibility of negative information in working memory, leading to heightened rumination and subsequent psychological distress.

Therefore, our findings underscore the significant moderating role of inhibitory control in the relationship between rumination and psychological distress. Furthermore, we provide evidence highlighting the influence of inhibitory control on negative information in moderating the strength of the association between rumination, psychological distress, and symptoms of depression and anxiety. This evidence contributes to our understanding of depression and anxiety as systemic syndromes, wherein various cognitive, affective, and behavioral components are interconnected and mutually influence one another as stated by Jeronimus (Citation2019).

In conclusion, our findings illustrate the intricate relationship between ruminations and inhibitory control of negative stimuli, highlighting their potential to alleviate psychological distress and alleviate symptoms of anxiety and depression. These results underscore the importance of considering individual differences in inhibitory control and trait rumination in comprehending the emergence of depressive and anxiety symptoms. Future interventions should be designed to target inhibitory performance more accurately, specifically focusing on the capacity to inhibit irrelevant negative information among individuals with a higher propensity for rumination. One effective strategy for mitigating the detrimental effects of rumination is the implementation of Cognitive Bias Modification (CBM). A comprehensive review conducted by Mor and Daches (Citation2015) reveals the efficacy of CBM in training individuals to inhibit their response to negative information. Consequently, CBM can serve as a valuable method for enhancing inhibitory control among individuals with heightened inclination to ruminate.

9. Strength and limitation

This study utilized the Negative Affective Priming (NAP) task to obtain a more objective measure of inhibitory performance. The implementation of an online data acquisition system enabled us to reach a broader audience and increase accessibility without significant resource requirements. The present study may serve as a template for future investigations, particularly those focusing on psychopathology, that utilize online cognitive tasks like the NAP Task.

While the NAP Task has been extensively employed in the field of affective processing and psychopathology in WEIRD (White, Educated, Industrialized, Rich, and Democratic) populations, its utilization in non-WEIRD populations has been limited. Our study stands among the few that has expanded the use of the NAP Task to include Indonesian participants, representing a non-WEIRD population. To our knowledge, our study is also the first attempt to examine the influence of inhibitory control on the association between rumination, psychological distress, and depression-anxiety. This highlights the significance of inhibitory control in processing negative information in the frequent co-occurrence of depression and anxiety symptoms.

This study has several limitations. Given that the population employed is non-clinical and that the sample consisted of more women than men (average age: 21–22 years), a follow-up study is necessary to test our model under more precise and controlled settings (clinical vs. control populations with more gender-balanced samples). The absence of longitudinal measurements in the current study also raises another issue. In addition, according to Ruscio et al. (Citation2015) and Hosseinichimeh et al. (Citation2018), mechanisms involving rumination, psychological distress, depression, and cognitive factors (i.e. Inhibitory control) are a cycle. Hence, we suggest that future studies employ a longitudinal design to better understand this cycle. Finally, many researchers believe that there is still potential to investigate the mechanisms of depression and anxiety using other cognitive tasks, such as the N-back task, which has been linked to rumination (Onraedt et al., Citation2014).

Another limitation is that we discovered that the potential impact of mental fatigue after filling out the questionnaires might have affected participants’ IC performance. This was shown by the number of individuals who were removed from the analysis because their RT data surpassed the cut-off set based on a prior study. Although it has been suggested that a higher percentage of dropouts in online experiments is expected (Mathot & March, Citation2021), we think it is possible to anticipate this problem. In the future, the IC assessment may be carried out at the beginning of the study while the participants are still motivated, or it can be carried out independently with a break of no more than 24 hours after filling out the questionnaires.

10. Implications and recommendations for future studies

Our study concludes that by improving IC performance on negative information (Maraver et al., Citation2016), the negative impact of rumination on mental health via psychological distress may be reduced. According to the perseverative cognition hypothesis proposed by Brosschot et al. (Citation2006), repeated rumination heightens psychological load and prolongs psychological distress, leading ruminators to be more susceptible to the onset of depressive and anxious symptoms, which is in line with our findings. In addition, our study provides evidence supporting the systemic dynamic approach to depression (Wittenborn et al., Citation2016) and anxiety (Morris et al., Citation2010).

In relation to the implications of depression and anxiety, the findings of this study suggest the need for interventions that focus on enhancing inhibitory control (IC) performance specifically for processing negative information. A future objective is to expand these findings by conducting longitudinal studies based on the previously stated hypotheses. According to Wittenborn et al. (Citation2016), a causal loop may provide a better understanding of the dynamics of depression and anxiety symptoms, particularly the causal effect of cognitive functions, such as inhibitory control. Therefore, it is crucial to incorporate IC in a longitudinal study as it plays a significant role in the occurrence of depression and anxiety symptoms.

Although efforts have been made to solicit a representative sample, it is important to replicate these findings using larger and more diverse samples to enhance their generalizability. Our sample consisted mostly of high school and undergraduate students, which may limit the generalizability of the results to other age groups or educational backgrounds. For example, older adults may engage in less self-focused rumination compared to younger adults, which could influence their susceptibility to depression and anxiety (Aldao et al., Citation2010). Furthermore, most of our participants were females, who might have had higher levels of rumination than males (Ando et al., Citation2020). Future research might want to include participants from different age groups, educational levels, cultural backgrounds, and socioeconomic statuse. This will help to determine the extent to which our findings can be applied to broader populations.

Open Scholarship

This article has earned the Center for Open Science badge for Open Data. The data are openly accessible at https://doi.org/10.1080/23311908.2023.2228556.

Ethics approval and consent to participate:

The Committee on Research Ethics at the Faculty of Psychology, Universitas Indonesia, has decided that the aforementioned study complies to the ethical standards in the discipline of psychology, Universitas Indonesia’s Research Ethical Code of Conduct, and the Indonesian Psychology Association’s Ethical Code of Conduct. Ethical approval was given on 10 June 2022 with 093/FPsi.Komite Etik/PDP.04.00/2022. All study participants were informed about the purpose of the study, their right to refuse participation, anonymity, and confidentiality of the information. Written informed consent was also obtained before participation in the study.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Data availability statement

The dataset for this study can be found in the figshare: https://doi.org/10.6084/m9.figshare.21555927 (Dataset) & https://doi.org/10.6084/m9.figshare.21947405 (List of Words for NAP).

Additional information

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Notes on contributors

Kenneth Ananda Putra

Kenneth Ananda Putra is a student at the Faculty of Psychology at Universitas Indonesia, pursuing a Master's degree in Professional Psychology with a specialization in Adult Clinical Psychology. His research interests focus on cognitive process, executive function, mental disorders, and psychological intervention.

Clement Eko Prasetio

Clement Eko Prasetio is a student at the Faculty of Psychology at Universitas Indonesia, pursuing a Master's degree in Professional Psychology with a specialization in Adult Clinical Psychology. His research interests encompass emotion regulation, well-being, common mental disorders, loneliness, and cognitive inhibition.

Agnes Sianipar

Agnes Sianipar is an Assistant Professor in the Faculty of Psychology at Universitas Indonesia. Presently, she holds the position of Head of the Cognition, Affect, and Well-being Lab within the same faculty. Her research focuses on the roles of emotion, language, and cognitive control processes in psychological well-being, technology overuse, and everyday decision-making.

References

  • Aldao, A., Nolen-Hoeksema, S., & Schweizer, S. (2010). Emotion-regulation strategies across psychopathology: A meta-analytic review. Clinical Psychology Review, 30(2), 217–16. https://doi.org/10.1016/j.cpr.2009.11.004
  • Altemus, M., Sarvaiya, N., & Neill Epperson, C. (2014). Sex differences in anxiety and depression clinical perspectives. Frontiers in Neuroendocrinology, 35(3), 320–330. https://doi.org/10.1016/j.yfrne.2014.05.004
  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). https://doi.org/10.1176/appi.books.9780890425596
  • American Psychological Association. (n.d.). Psychological distress. In APA dictionary of psychology. Retrieved June 6, 2023, from https://dictionary.apa.org/psychological-distress
  • Ando, A. M. C., Giromini, L., Ales, F., & Zennaro, A. (2020). A multimethod assessment to study the relationship between rumination and gender differences. Scandinavian Journal of Psychology, 61(6), 740–750. https://doi.org/10.1111/sjop.12666
  • Arjanto, P. (2022). Uji reliabilitas dan validitas depression anxiety stress scales 21 (DASS-21) pada Mahasiswa. Arjanto | Jurnal Psikologi Perseptual. https://jurnal.umk.ac.id/index.php/perseptual/article/view/6196/pdf
  • Brosschot, J. F., Gerin, W., & Thayer, J. F. (2006). The perseverative cognition hypothesis: A review of worry, prolonged stress-related physiological activation, and health. Journal of Psychosomatic Research, 60(2), 113–124. https://doi.org/10.1016/j.jpsychores.2005.06.074
  • Cohen, N., Daches, S., Mor, N., & Henik, A. (2014). Inhibition of negative content - a shared process in rumination and reappraisal. Frontiers in Psychology, 5. https://doi.org/10.3389/fpsyg.2014.00622
  • Crawford, T. J., Higham, S., Mayes, J., Dale, M., Shaunak, S., & Lekwuwa, G. (2012). The role of working memory and attentional disengagement on inhibitory control: Effects of aging and Alzheimer’s disease. AGE, 35(5), 1637–1650. https://doi.org/10.1007/s11357-012-9466-y
  • Cuijpers, P., Smits, N., Donker, T., ten Have, M., & de Graaf, R. (2009). Screening for mood and anxiety disorders with the five-item, the three-item, and the two-item mental health inventory. Psychiatry Research, 168(3), 250–255. https://doi.org/10.1016/j.psychres.2008.05.012
  • DeJong, H., Fox, E., & Stein, A. (2019). Does rumination mediate the relationship between attentional control and symptoms of depression? Journal of Behavior Therapy and Experimental Psychiatry, 63, 28–35. https://doi.org/10.1016/j.jbtep.2018.12.007
  • Delespaux, E., & Zech, E. (2015). Why do bereaved partners experience interfering rumination?: Evidence for deficits in cognitive inhibition. Death Studies, 39(8), 463–472. https://doi.org/10.1080/07481187.2014.958631
  • De Lissnyder, E., Koster, E. H. W., Derakshan, N., & De Raedt, R. (2010). The association between depressive symptoms and executive control impairments in response to emotional and non-emotional information. Cognition & Emotion, 24(2), 264–280. https://doi.org/10.1080/02699930903378354
  • De Raedt, R., & Koster, E. H. (2010). Understanding vulnerability for depression from a cognitive neuroscience perspective: A reappraisal of attentional factors and a new conceptual framework. Cognitive, Affective & Behavioral Neuroscience, 10(1), 50–70. https://doi.org/10.3758/CABN.10.1.50
  • Frings, C., Schneider, K., & Fox, E. (2015). The negative priming paradigm: An update and implications for selective attention. Psychonomic Bulletin & Review, 22(6), 1577–1597. https://doi.org/10.3758/s13423-015-0841-4
  • Grafton, B., Southworth, F., Watkins, E., & MacLeod, C. (2016). Stuck in a sad place: Biased attentional disengagement in rumination. Emotion, 16(1), 63–72. https://doi.org/10.1037/emo0000103
  • Greiff, S., Wüstenberg, S., Goetz, T., Vainikainen, M., Hautamäki, J., & Bornstein, M. H. (2015). A longitudinal study of higher-order thinking skills: Working memory and fluid reasoning in childhood enhance complex problem solving in adolescence. Frontiers in Psychology, 6. https://doi.org/10.3389/fpsyg.2015.01060
  • Hayes, A. F. (2022). Introduction to mediation, moderation, and conditional process analysis: A regression-based approach (methodology in the social sciences). (Third ed.). The Guilford Press.
  • Homer, J. B., & Hirsch, G. B. (2006). System dynamics modeling for public health: background and opportunities. American journal of public health, 96(3), 452–458. https://doi.org/10.2105/AJPH.2005.062059
  • Homer, J., Milstein, B., Hirsch, G. B., & Fisher, E. S. (2016). Combined regional investments could substantially enhance health system performance and be financially affordable. Health Affairs, 35(8), 1435–1443. https://doi.org/10.1377/hlthaff.2015.1043
  • Hosseinichimeh, N., Wittenborn, A. K., Rick, J., Jalali, M. S., Rahmandad, H., & Puebla, I. (2018). Modeling and estimating the feedback mechanisms among depression, rumination, and stressors in adolescents. PLOS ONE, 13(9), e0204389. https://doi.org/10.1371/journal.pone.0204389
  • Jeronimus, B. F. (2019). Dynamic system perspectives on anxiety and depression. Routledge eBooks, 100–126. https://doi.org/10.4324/9781315165844-7
  • Joormann, J. (2004). Attentional bias in dysphoria: The role of inhibitory processes. Cognition & Emotion, 18(1), 125–147. https://doi.org/10.1080/02699930244000480
  • Joormann, J. (2006). Differential effects of rumination and dysphoria on the inhibition of irrelevant emotional material: Evidence from a negative priming task. Cognitive Therapy and Research, 30(2), 149–160. https://doi.org/10.1007/s10608-006-9035-8
  • Joormann, J. (2010). Cognitive inhibition and emotion regulation in depression. Current Directions in Psychological Science, 19(3), 161–166. https://doi.org/10.1177/0963721410370293
  • Joormann, J., & Gotlib, I. H. (2008). Updating the contents of working memory in depression: Interference from irrelevant negative material. Journal of Abnormal Psychology, 117(1), 182–192. https://doi.org/10.1037/0021-843x.117.1.182
  • Joormann, J., & Gotlib, I. H. (2010). Emotion regulation in depression: Relation to cognitive inhibition. Cognition & Emotion, 24(2), 281–298. https://doi.org/10.1080/02699930903407948
  • Joormann, J., Yoon, K. L., & Zetsche, U. (2007). Cognitive inhibition in depression. Applied and Preventive Psychology, 12(3), 128–139. https://doi.org/10.1016/j.appsy.2007.09.002
  • Kalin, N. H. (2020). The critical relationship between anxiety and depression. American Journal of Psychiatry, 177(5), 365–367. https://doi.org/10.1176/appi.ajp.2020.20030305
  • Kementerian Kesehatan Republik Indonesia. (2018). Riset Kesehatan Dasar (Riskesdas) 2018. Kementerian Kesehatan Republik Indonesia.
  • Kessler, R. C., Sampson, N. A., Berglund, P., Gruber, M. J., Al-Hamzawi, A., Andrade, L., Bunting, B., Demyttenaere, K., Florescu, S., de Girolamo, G., Gureje, O., He, Y., Hu, C., Huang, Y., Karam, E., Kovess-Masfety, V., Lee, S., Levinson, D., Wilcox, M. A. (2015). Anxious and non-anxious major depressive disorder in the world health organization world mental health surveys. Epidemiology and Psychiatric Sciences, 24(3), 210–226. https://doi.org/10.1017/S2045796015000189
  • Kinanthi, M. R., Listiyandini, R. A., Amaliah, U. S., & Ramadhanty, R. (2020). Adaptasi Alat Ukur DASS-21 Versi Indonesia Pada Populasi Mahasiswa. Seminar Nasional Psikologi dan Call for Paper UMB Yogyakarta 2020. Universitas Mercu Buana Yogyakarta.
  • Kuehner, C. (2017). Why is depression more common among women than among men? The Lancet Psychiatry, 4(2), 146–158. https://doi.org/10.1016/s2215-03661630263-2
  • Lange, K., Kühn, S., Filevich, E., & Margulies, D. (2015). Just Another Tool for Online Studies (JATOS): An easy solution for setup and management of web servers supporting online studies. PLOS ONE, 10(6), e0130834. https://doi.org/10.1371/journal.pone.0130834
  • Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the depression anxiety stress scales (2nd ed.). Psychology Foundation.
  • Lyubomirsky, S., & Nolen-Hoeksema, S. (1993). Self-perpetuating properties of dysphoric rumination. Journal of Personality and Social Psychology, 65(2), 339–349. https://doi.org/10.1037/0022-3514.65.2.339
  • Maraver, M. J., Bajo, M. T., & Gomez-Ariza, C. J. (2016, November 18). Training on working memory and inhibitory control in young adults. Frontiers in Human Neuroscience, 10, 10. https://doi.org/10.3389/fnhum.2016.00588
  • Mathot, S., & March, J. (2021). Conducting linguistic experiments online with OpenSesame and OSWeb. PsyArXiv. https://doi.org/10.31234/osf.io/wnryc
  • Mathôt, S., Schreij, D., & Theeuwes, J. (2011). OpenSesame: An open-source, graphical experiment builder for the social sciences. Behavior Research Methods, 44(2), 314–324. https://doi.org/10.3758/s13428-011-0168-7
  • Mayr, U., & Keele, S. W. (2000). Changing internal constraints on action: The role of backward inhibition. Journal of Experimental Psychology: General, 129(1), 4–26. https://doi.org/10.1037/0096-3445.129.1.4
  • McLaughlin, K. A., Borkovec, T. D., & Sibrava, N. J. (2007). The effects of worry and rumination on affect states and cognitive activity. Behavior Therapy, 38(1), 23–38. https://doi.org/10.1016/j.beth.2006.03.003
  • McLaughlin, K. A., & Nolen-Hoeksema, S. (2011). Rumination as a transdiagnostic factor in depression and anxiety. Behaviour Research and Therapy, 49(3), 186–193. https://doi.org/10.1016/j.brat.2010.12.006
  • McLennan, K. S., Neumann, E., & Russell, P. N. (2019). Positive and negative priming differences between short-term and long-term identity coding of word-specific attentional priorities. Attention, Perception & Psychophysics, 81(5), 1426–1441. https://doi.org/10.3758/s13414-018-01661-9
  • Mirowsky, J., & Ross, C. L. (2017). Education, social status, and health. In Routledge eBooks. https://doi.org/10.4324/9781351328081
  • Mor, N., & Daches, S. (2015). Ruminative thinking: Lessons learned from cognitive training. Clinical Psychological Science, 3(4), 574–592. https://doi.org/10.1177/2167702615578130
  • Morris, A., Krishna, S. G., & Ulieru, M. (2010). A system dynamics view of stress: Towards human-factor modeling with computer agents. Proceedings of the 2010 IEEE International Conference on Systems, Man and Cybernetics (pp. 4369–4374). https://doi.org/10.1109/icsmc.2010.5642412
  • Nada, Q., Herdiana, I., & Andriani, F. (2022). Testing the validity and reliability of the Depression Anxiety Stress Scale (DASS)-21 instrument for individuals with psychodermatology. Psikohumaniora: Jurnal Penelitian Psikologi, 7(2), 153–168. https://doi.org/10.21580/pjpp.v7i2.11802
  • Nolen-Hoeksema, S. (1991). Responses to depression and their effects on the duration of depressive episodes. Journal of Abnormal Psychology, 100(4), 569–582. https://doi.org/10.1037/0021-843X.100.4.569
  • Nolen-Hoeksema, S., Larson, J., & Grayson, C. (1999). Explaining the gender difference in depressive symptoms. Journal of Personality and Social Psychology, 77(5), 1061–1072. https://doi.org/10.1037/0022-3514.77.5.1061
  • Nolen-Hoeksema, S., & Morrow, J. (1991). A prospective study of depression and posttraumatic stress symptoms after a natural disaster: The 1989 Loma Prieta Earthquake. Journal of Personality and Social Psychology, 61(1), 115–121. https://doi.org/10.1037/0022-3514.61.1.115
  • Nolen-Hoeksema, S., & Watkins, E. R. (2011). A heuristic for developing transdiagnostic models of psychopathology. Perspectives on Psychological Science, 6(6), 589–609. https://doi.org/10.1177/1745691611419672
  • Nolen-Hoeksema, S., Wisco, B. E., & Lyubomirsky, S. (2008). Rethinking rumination. Perspectives on Psychological Science, 3(5), 400–424. https://doi.org/10.1111/j.1745-6924.2008.00088.x
  • Olatunji, B. O., Naragon-Gainey, K., & Wolitzky-Taylor, K. B. (2013). Specificity of rumination in anxiety and depression: A multimodal meta‐analysis. Clinical Psychology: Science & Practice, 20(3), 225–257. https://doi.org/10.1037/h0101719
  • Onraedt, T., Koster, E. H. W., & Aleman, A. (2014). Training working memory to reduce rumination. PLOS ONE, 9(3), e90632. https://doi.org/10.1371/journal.pone.0090632
  • Putri, V. M., Prasetio, C. E., & Sianipar, A. (2023).The relationship between inhibition of irrelevant negative information and happiness with mood as a moderator.
  • Rahman, T. A. (2020). Peranan Rumination Terhadap Pikiran Bunuh Diri Pada Mahasiswa Universitas Padjadjaran [ Undergraduate Thesis]. Universitas Padjadjaran.
  • Richter Levin, G., & Xu, L. (2018). How could stress lead to major depressive disorder? IBRO Reports, 4, 38–43. https://doi.org/10.1016/j.ibror.2018.04.001
  • Ruscio, A. M., Gentes, E. L., Jones, J. D., Hallion, L. S., Coleman, E. S., & Swendsen, J. (2015). Rumination predicts heightened responding to stressful life events in major depressive disorder and generalized anxiety disorder. Journal of Abnormal Psychology, 124(1), 17–26. https://doi.org/10.1037/abn0000025
  • Schrobsdorff, H., Ihrke, M., Behrendt, J., Herrmann, J. M., Hasselhorn, M., & Paterson, K. (2012). Identity negative priming: A phenomenon of perception, recognition or selection? PLOS ONE, 7(3), e0032946. https://doi.org/10.1371/journal.pone.0032946
  • Sianipar, A., van Groenestijn, P., & Dijkstra, T. (2016). Affective meaning, concreteness, and subjective frequency norms for Indonesian words. Frontiers in Psychology, 7, 7. https://doi.org/10.3389/fpsyg.2016.01907
  • Thompson, K. M., Tebbens, R. J. D., Pallansch, M. A., Wassilak, S. G. F., & Cochi, S. L. (2015). Polio eradicators use integrated analytical models to make better decisions. Interfaces, 45(1), 5–25. https://doi.org/10.1287/inte.2014.0769
  • Tong, H., Hou, W. K., Liang, L., Li, T. W., Liu, H., Lee, T. M. C., & Stanley, J. T. (2021, August 29). Age-related differences of rumination on the loneliness–depression relationship: Evidence from a population-representative cohort. Innovation in Aging, 5(4). https://doi.org/10.1093/geroni/igab034.
  • Treynor, W., Gonzalez, R., & Nolen-Hoeksema, S. (2003). Rumination reconsidered: A psychometric analysis. Cognitive Therapy and Research, 27(3), 247–259. https://doi.org/10.1023/A:1023910315561
  • Valle, T. M., Gómez-Ariza, C. J., Bajo, M. T., & Wimber, M. (2019). Inhibitory control during selective retrieval may hinder subsequent analogical thinking. PLOS ONE, 14(2), e0211881. https://doi.org/10.1371/journal.pone.0211881
  • Verkuil, B., Brosschot, J. F., Gebhardt, W. A., & Thayer, J. F. (2010). When worries make you sick: A review of perseverative cognition, the default stress response and somatic health. Journal of Experimental Psychopathology, 1(1), jep.009110. https://doi.org/10.5127/jep.009110
  • Watkins, E. R. (2009). Depressive rumination and co-morbidity: Evidence for brooding as a transdiagnostic process. Journal of Rational-Emotive and Cognitive-Behavior Therapy: RET, 27(3), 160–175. https://doi.org/10.1007/s10942-009-0098-9
  • Watkins, E. R., & Roberts, H. (2020). Reflecting on rumination: Consequences, causes, mechanisms and treatment of rumination. Behaviour Research and Therapy, 127, 103573. https://doi.org/10.1016/j.brat.2020.103573
  • Watson, D. (2005). Rethinking the mood and anxiety disorders: A quantitative hierarchical model for DSM-V. Journal of Abnormal Psychology, 114(4), 522–536. https://doi.org/10.1037/0021-843X.114.4.522
  • Wittenborn, A. K., Rahmandad, H., Rick, J., & Hosseinichimeh, N. (2016). Depression as a systemic syndrome: Mapping the feedback loops of major depressive disorder. Psychological Medicine, 46(3), 551–562. https://doi.org/10.1017/S0033291715002044
  • World Health Organization. (2017). Depression and other common mental disorders: Global health estimates. World Health Organization. https://apps.who.int/iris/handle/10665/254610, License: CC BY-NC-SA 3.0 IGO.