1,073
Views
1
CrossRef citations to date
0
Altmetric
HEALTH PSYCHOLOGY

ACT2COPE: A pilot randomised trial of a brief online acceptance and commitment therapy intervention for people living with chronic health conditions during the COVID-19 pandemic

, , , , & ORCID Icon
Article: 2208916 | Received 19 Jan 2023, Accepted 26 Apr 2023, Published online: 11 May 2023

Abstract

It is well established that the COVID-19 pandemic increased psychological distress in many populations, particularly for people with chronic health conditions (CHCs). Web-based mental health interventions provide a scalable and cost-effective approach to providing psychological support for people disproportionately affected by the COVID-19 pandemic. The current study aimed to explore the feasibility and acceptability of a one-week web-based psychological intervention (ACT2COPE) and explore preliminary effects of the intervention on reducing depression, anxiety, and stress symptoms, and improving wellbeing and psychological flexibility in adults living with CHCs during the COVID-19 pandemic in Aotearoa (New Zealand). A pilot randomised waitlist-controlled trial explored the acceptability and preliminary efficacy of ACT2COPE among 40 participants (n = 20 in the ACT2COPE group and n = 20 in the waitlist control group). Focus groups and open-ended questions explored usability and acceptability of the intervention as well as levels of engagement and adherence to the intervention. Mixed model ANOVAs explored within and between-group differences in psychological outcomes. Qualitative findings suggested that participants found ACT2COPE acceptable and engaging. Depressive symptoms significantly decreased over time compared to the waitlist group at 4-weeks follow-up (p = .012). No other between-group differences were found. The online ACT2COPE intervention presents a promising, scalable intervention that may improve psychological outcomes in adults living with CHCs during the COVID-19 pandemic. Future research is needed to confirm these findings in a larger and more diverse population and over a longer timeframe.

COVID-19 first emerged in China in late 2019 before spreading around the world, causing devastating and lasting impacts; including economic recessions, psychological distress, significant social isolation, and over 6.9 million confirmed deaths worldwide as of April 2023 (Wind et al., Citation2020; World Health Organisation, Citation2023). The COVID-19 pandemic has heightened the need for accessible interventions to support those living with chronic health conditions (CHCs). In Aotearoa (New Zealand), this includes up to 67% of the adult population and 33% of the child population (Ministry of Health, Citation2009), similar to many other developed countries, including the United Kingdom (The King’s Fund, Citation2021). COVID-19 can represent an overwhelming stressor for those living with CHCs, especially considering the increased rates of mental health issues (Ministry of Health, Citation2009), in particular depression (Barnard et al., Citation2006; Liu & Tang, Citation2018; Moussavi et al., Citation2007) and anxiety (Asmundson & Katz, Citation2009; El-Gabalawy et al., Citation2011; Grigsby et al., Citation2002) among people living with CHCs. While the COVID-19 omicron variant constitutes a moderate illness for most people, those with underlying health conditions and older age are at higher risk of serious complications. People with CHCs may also experience increased physical isolation, health anxiety, and interruptions to usual care (Holmes et al., Citation2020). Heightened estimation of the risks of COVID-19, with corresponding poorer health linked to COVID-19-specific health anxiety have also been reported (Mertens et al., Citation2020).

Prolonged isolation and other pandemic-related social, economic, and environmental disruptions have seen significant mental health challenges emerge for individuals living with CHCs. For example, these have included a decline in general health, mood, and activity, and greater psychological distress in women with inflammatory arthritis (Maguire & O’Shea, Citation2021). In a Canadian study, adults with CHCs reported decreased feelings of belonging, greater health anxieties, loneliness, stress, and increased despair (Pettinicchio et al., Citation2021). Negative effects on health outcomes have also been recorded in China, where individuals with type 2 diabetes reported decreased glycaemic control during the initial outbreak of COVID-19, potentially due to fewer opportunities to exercise and lack of access to common foods (Banerjee et al., Citation2020). Delays and reductions in “non-essential” care can also have significant implications for those with CHCs, risking increases in morbidity and mortality (Papautsky et al., Citation2021).

Due to the reductions in contact with healthcare services and the array of new stressors associated with the ongoing COVID-19 pandemic, there is now a greater need for accessible interventions that address coping skills and self-management of CHCs (Pfefferbaum & North, Citation2020). Early indications suggest that digital coping skills interventions may result in long-term positive psychological outcomes comparable to face-to-face therapies (Andersson et al., Citation2014). Importantly, eHealth interventions are not only associated with increased cost- and time-effectiveness, accessibility, and acceptability (Andersson & Titov, Citation2014) but also present a means of safely offering psychological and social support to those who may need to avoid face-to-face contact during COVID-19 outbreaks. Interventions employing eHealth for CHC populations have become more numerous in recent years. For example, these have included approaches such as positive psychology and mindfulness techniques (Mikolasek et al., Citation2018) and acceptance and commitment therapy (ACT) (Dindo et al., Citation2017).

ACT-based interventions seem to be of a strong conceptual fit and of a promising evidence base for people living with CHCs. Interventions utilising multiple components of the ACT methodology have shown improvements in health outcomes, self-management, and mental wellbeing in multiple chronic health conditions, including diabetes, multiple sclerosis, obesity, inflammatory bowel disease, chronic pain, cardiovascular disease (Dindo et al., Citation2017; Dindo, Citation2015; Lillis et al., Citation2009; McCracken et al., Citation2013; Sheppard et al., Citation2010), cancer and acquired immunodeficiency disorder (Bassett et al., Citation2019; Isa et al., Citation2013; Kashani et al., Citation2012; Matchim et al., Citation2011). Systematic reviews and meta-analyses exploring the use of ACT-based interventions for people with CHCs have shown medium effect sizes for reducing pain intensity, depression, and anxiety, along with increased psychological flexibility, self-management, and physical wellbeing (Graham et al., Citation2016). Online adaptions of these ACT interventions have also been demonstrated to be effective in managing depression for those with a CHC (Brown et al., Citation2016; Lappalainen et al., Citation2014).

More specifically, ACT’s emphasis on accepting distressing but realistic, disease-related thoughts or beliefs rather than trying to modify them (Graham et al., Citation2016), may be a suitable approach to thoughts and beliefs surrounding COVID-19. In addition, psychological flexibility, one of the pillars of the ACT modality, has also emerged as a potentially important factor contributing to psychological wellbeing during the pandemic. Observational research in healthy populations has identified positive associations between psychological flexibility and wellbeing and inverse associations with anxiety, depression, and COVID-19-related distress (Dawson & Golijani-Moghaddam, Citation2020). Another study found psychological flexibility mitigated the negative consequences of COVID-19 (Landi et al., Citation2020). These recent studies support ACT as a promising therapeutic approach to improving psychological wellbeing during the COVID-19 pandemic (Kroska et al., Citation2020).

This study sought to build on these promising findings, investigating a brief web-based ACT intervention developed for adults living with a CHC in Aotearoa (New Zealand) during the COVID-19 pandemic. The study aimed to explore usability and acceptability of the intervention and to examine preliminary effects of the intervention on depression, anxiety, stress, psychological flexibility and wellbeing compared to a waitlist control group.

2. Methods

2.1. Study design

This study was a pilot randomised controlled trial (RCT) that compared a waitlist control to a brief web-based Acceptance and Commitment Therapy intervention (ACT2COPE) for improving wellbeing in adults living with a CHC. In addition, two focus groups were conducted after the intervention to explore usability and acceptability of the intervention and participants’ experiences and feedback on the website. This study was granted ethical approval on the 22nd of June 2020 by the Auckland Health Research Ethics Committee (AHREC; reference number: AH1362). Recruitment started on the 23rd of June 2020 and was completed by the 2nd of July 2020. Focus groups were conducted between the 7th and 9th of September. The extended Consolidated Standards of Reporting Trials (CONSORT) (Eldridge et al., Citation2016) and Consolidated Criteria for Reporting Qualitative Research (COREQ) guidelines were adhered to and the trial was prospectively registered on the Australian New Zealand Clinical Trials Registry (ACTRN12620000634976).

2.2. Participants

We aimed to recruit 40 participants with 20 in each treatment arm. This sample size was considered adequate for a pilot RCT design where the focus is on feasibility and acceptability rather than efficacy of the intervention. The inclusion criteria were: (1) a diagnosis of a chronic health condition; (2) at least 18 years of age; (3) living in Aotearoa (New Zealand); (4) access to a computer and WiFi; (5) and ability to understand, read, and write in English. Participants were excluded if they were hospitalised during recruitment, were receiving treatment for a mental health condition, completed regular mindfulness or meditation practice, or were diagnosed with COVID-19. Six participants in the intervention group were also invited to join optional focus groups, a sample size deemed appropriate for evaluating the usability of digital interventions (Bardus et al., Citation2019).

2.3. Procedures

Participants were recruited online through Facebook and Instagram advertisements and support groups, and snowball recruiting was encouraged. Once participants were screened for eligibility and provided informed consent, they were immediately randomised into either the waitlist or intervention group using a web-based protocol of simple randomisation (https://www.randomizer.org/) and given the baseline questionnaire to complete. Participants’ sociodemographic information was collected at baseline only. This included age, ethnicity, sex, living arrangements, marital/relationship status, employment, level of education, diagnosis of CHC, comorbidities, medications, and age when diagnosed. Participants then received an email informing them which treatment condition they were assigned to.

Four weeks after baseline, participants were emailed a link to complete the follow-up questionnaire. Participants received a maximum of two email reminders and three text reminders to complete unfinished questionnaires. Participants were given two $NZD20 vouchers (totaling $NZD40), the first on completion of the intervention and the second on completion of the 4-week questionnaires. Participants in the waitlist-control group also received a link and password to access the ACT2COPE intervention.

In addition, participants allocated to the intervention group were invited to partake in optional 90-minute focus groups using Zoom to further explore their views on the ACT2COPE intervention. Two groups were conducted, with 3 participants per focus group. Both focus groups were facilitated by the first author (KWB), an Aotearoa (New Zealand) European female Master of Health Psychology candidate, and another study author (AB), a female Aotearoa (New Zealand) European female Health Psychology Ph.D. candidate. Both focus group facilitators had experience in facilitating group sessions and focus groups. Participants were informed that KWB was completing the study for her Masters, which involved developing a digital wellbeing intervention for people with CHCs, and had no prior relationship with either facilitator.

The focus groups followed a semi-structured interview schedule devised by KWB and her thesis supervisor (AS). Participants were shown images from the website to refresh their memory and were asked to provide feedback on intervention content, format, acceptability and engagement. After the second focus group, the possibility of data saturation was discussed between KWB, AB, and AS.

2.4. Intervention

The ACT2COPE intervention is based on Acceptance and Commitment Therapy, with modules teaching different skills from the Hexaflex model to improve psychological flexibility (Hayes, Citation2004; R. Harris, Citation2019). By offering the full range of skills from the Hexaflex model and different exercises to build each skill, ACT2COPE accounted for the individual needs of people and what skill or exercise they may find the most helpful. Participants were able to repeat modules as many times as they wanted.

ACT2COPE was designed for use within the COVID-19 pandemic context in Aotearoa (New Zealand). The different exercises and scenarios specifically refer to the pandemic and how participants can cope with stressors related to COVID-19 (e.g., increased isolation or increased health anxiety). Participants could either read the content on the website or listen to an embedded audio recording of the written content to allow for greater accessibility. Each module included a video developed by the research team to consolidate learning and practice ACT-related skills further. See Table for an overview of all the modules. During the 1-week intervention, participants also received an email on days three and five to encourage them to keep using the website. Reminders included messages such as “it’s ok if your thoughts wander, keep practicing” to improve adherence and reduce attrition to the intervention.

Table 1. Outline of each ACT2COPE module

2.5. Outcomes

2.5.1. Feasibility and acceptability of ACT2COPE website

We were interested in exploring engagement and adherence to the intervention, recruitment methods, and lastly retention to the intervention. Regarding engagement and adherence, participants were asked how many modules they completed, with adherence defined a priori as having completed at least four out of the seven modules. All of the participants who completed the ACT2COPE intervention were asked, “do you have any feedback on this module of the intervention?” after each module and “how helpful did you find this module?” with the following multiple choice answers: (1) I found this module very helpful, (2) I found this module somewhat helpful, (3) I found this module only a little bit helpful, (4) I did not find this module helpful. Additionally, the focus groups explored these questions further and probed participants’ experiences using the website and any feedback for improving the content.

For recruitment methods, we recorded how many people we reached through recruiting via social media and how many individuals visited our website, were eligible and lastly consented to be involved in the study. We also kept a record of participants who dropped out of the study.

2.5.2. Depression, anxiety, and stress

Depression, anxiety, and stress were measured by the brief Depression, Anxiety, and Stress Scale (DASS-21) (Lovibond & Lovibond, Citation1995). The DASS-21 is a 21-item self-report scale measuring three subscales; depression, anxiety, and stress, with seven items per subscale. Each item is rated on a Likert scale, where 0= “did not apply to me at all”, and 3= “applied to me very much or most of the time”. For each subscale, scores are totalled and multiplied by two to obtain a score between 0 and 42, with higher scores indicating higher symptom severity. For each subscale, scores were grouped into normal, mild, moderate, severe, and extremely severe (Lovibond & Lovibond, Citation1995). The DASS-21 is reliable and valid in diverse samples, including among people with CHCs, and has been used for ACT-based interventions, with a mean Cronbach’s alpha of 0.91 showing high internal consistency (Antony et al., Citation1998). The Cronbach’s alpha for this present study was 0.89 at baseline.

2.5.3. Wellbeing

Mental wellbeing was measured by the World Health Organisation Wellbeing Index (WHO-5) (World Health Organisation, Citation1998). The WHO-5 is a 5-item positively worded scale on which participants rate their response to five statements (e.g., “I have felt cheerful and in good spirits”) on a 6-point Likert scale ranging from 0= “At no time” to 5= “all of the time”. Scores are added together with a range from 0–25, with 0 reflecting the lowest levels of wellbeing and 25 reflecting the highest levels of wellbeing. The WHO-5 is reliable and valid in a systematic review of varying health conditions with a validity of 0.81 (Topp et al., Citation2015). The Cronbach’s alpha for the present study was 0.74, deemed acceptable for research purposes (Allen & Bennett, Citation2012).

2.5.4. Psychological flexibility

Psychological flexibility was measured using the Acceptance and Action Questionnaire-II (AAQ-II) (Bond et al., Citation2011). The AAQ-II is a 7-item self-report measure in which statements (e.g., “I worry about not being able to control my worries and feelings”) are rated on a 7-point Likert scale ranging from 1= “never true” to 7 = “always true”. Total scores can range from 7–49, with low scores indicating high psychological flexibility and higher scores indicating low psychological flexibility. The AAQ-II has a good test-retest reliability of 0.81 and is reliable across multiple samples, including people living with CHCs (Bond et al., Citation2011). The Cronbach’s alpha for this present study was 0.86.

2.6. Data analyses

2.6.1. Qualitative analysis

The focus groups were recorded and transcribed, and the feedback from the focus groups and module feedback was collated into NVivo (a qualitative analysis software) for coding and analyses (Zamawe, Citation2015). The qualitative data from the module feedback and focus groups were examined using qualitative content analysis, a structured approach of systematically organising qualitative data to find key concepts and patterns in the data using an existing theoretical framework or model which guides the coding (Hsieh & Shannon, Citation2005; Schreier, Citation2012). Deductive content analyses was used to explore participant experiences of the intervention and their views on ACT-related concepts, including what they did and did not like, and what tools they used or planned to use after the intervention ended, as well as, any changes or improvements suggested for future iterations of this intervention, in line with a more positivist/realist epistemology. The analysis aimed to explore four research questions framed around exploring the usability and acceptability of the web-based intervention and ACT-related concepts; (1) “what did participants like about the intervention?”, (2) “what did participants dislike about the intervention?”, (3) “how did participants respond to the tools and activities in the intervention?”, and (4) “what would participants change or like to see in future versions of this intervention?”. KWB and AB co-coded the data and any discrepancies in codes or themes were resolved with the wider research team.

2.6.2. Quantitative analysis to explore preliminary effects of the intervention

Pearson’s correlations explored the relationships between psychosocial measures at baseline. A series of 2 (groups) x 2 (time) mixed-model Analysis of Variance (ANOVAs) were used to assess the differences in psychosocial outcomes between the two treatment groups over time. An additional analysis of covariance test (ANCOVA) was conducted to control for psychological flexibility (due to a trend towards group differences at baseline) and anti-depressant medication at baseline. Means, SDs, and 95% CIs are presented with the analyses. Effect sizes were calculated using partial eta squared (ηp2).

3. Results

3.1. Participant recruitment and demographics

Participants were recruited online through advertising on social media including Facebook and Instagram. The advertising ran for 10 days during June 2020 and reached 2837 people, resulting in 69 visits to the intervention website which contained the Participant Information Sheet and sign up process. From advertising the study on social media, 91 interested individuals completed an online screening questionnaire via a secure research platform (REDCap) to confirm eligibility, of which 40 were eligible and completed the online consent form.

Of the 91 individuals assessed for eligibility, 46 were eligible, 40 completed the consent form and baseline questionnaire and were randomised. Three participants were lost to follow-up (all from the ACT2COPE intervention group). Figure shows the CONSORT diagram representing the flow of participants through the study. The demographic and clinical characteristics of the study population are summarised in Tables . Overall, participants were aged between 18 to 69 years and had a mean age of 39.20 years (SD = 14.77). The majority (87.5%) of the sample was Aotearoa (New Zealand) European, and there were 5% Māori (indigenous New Zealanders), 2.5% Indian, and 5% other ethnicities. Most of the sample was female (97.5%), currently in paid employment (62.5%), living with friends or family (87.5%), and in a relationship (67.5%). Education levels were mixed but the majority had completed tertiary education (60%).

Figure 1. CONSORT diagram and flow of participants through the study.

Figure 1. CONSORT diagram and flow of participants through the study.

Table 2. Demographic Variables at Baseline

Table 3. Clinical Characteristics at Baseline

The age at which participants were diagnosed with their CHC ranged from 1 to 64 years, with a mean age of 27.93 years (SD = 16.25). Medical diagnoses were grouped into five categories, with inflammatory conditions (e.g., inflammatory bowel disease, arthritis) being the most common (42.5%), followed by immune conditions (e.g., coeliac and multiple sclerosis) at 32.5%, pain conditions (e.g., chronic regional pain syndrome and migraines) at 15%, metabolic conditions (e.g., type 2 diabetes and hypothyroidism) at 7.5%, and other conditions (e.g., scoliosis and nephrotic syndrome) at 2.5% of the sample. Most participants (75%) had multiple CHCs with a mean of 3.25 comorbid conditions (SD = 2.17). Despite an exclusion criterion of “currently receiving mental health treatment”, 20% of participants were taking anti-depressants during this study, as anti-depressants are commonly used as part of pain management for many CHCs (Mercier et al., Citation2013). Medications were grouped into six categories: anti-depressants (n = 10), immunosuppressants (n = 19), pain relief (n = 34), asthma (n = 18), cardiovascular (n = 10), and other medications (n = 55). The total number of medications participants were taking ranged from 0 to 17, with a mean of 3.73 medications per participant (SD = 3.88).

Six participants who completed the ACT2COPE intervention also participated in the focus groups, with three participants in each group. Participants were aged between 23 to 64 years and had a mean age of 33.83 years (SD = 15.96). Five out of the six participants were female. Five of the six participants were Aotearoa (New Zealand) European, and one was Indian. Half of the sample had comorbid health conditions, with the number of health conditions ranging from one to six (M = 2.33, SD = 1.97). Inflammatory conditions were the most common (three out of six), followed by immune conditions (two out of six), and other conditions (one out of six).

3.2. Baseline psychological measures

Based on the classifications of the DASS-21, where higher scores indicate higher severity, the total sample had moderate levels of depression (M = 14.75, SD = 9.67) and anxiety (M = 10.85, SD = 6.40) and mild levels of stress (M = 15.85, SD = 8.73) at baseline. The mean wellbeing scores (M = 9.82, SD = 4.17) and psychological flexibility (M = 24.58, SD = 8.60) indicated average levels at baseline.

3.3. Engagement and adherence

Self-reported adherence to the intervention was measured to explore engagement and acceptability, with nearly half (42.5%) of participants reported to have completed all seven modules. Overall, 22 participants (50.5%) met the a priori adherence level of completing at least four modules (See Figure ). Six participants did not complete this question.

Figure 2. Self-reported number of modules completed for each participant at follow-up.

Note. Error bars represent 95% CI.
Figure 2. Self-reported number of modules completed for each participant at follow-up.

3.4. Qualitative analyses exploring usability and acceptability of ACT2COPE

An overview of the qualitative results, differentiating major and minor themes, can be seen in Table . Overall, there was a higher proportion of positive feedback than negative for the ACT2COPE intervention. The findings indicated that the intervention content and ACT-related concepts were generally viewed as acceptable, engaging, and useful. The findings from focus group participants and the open-ended questions on module feedback have also provided important feedback on necessary improvements to the ACT2COPE intervention.

Table 4. Summary of qualitative themes, with example quotations, and their corresponding prevalence in both the focus groups and module feedback responses. Themes are organised by how many focus group participants reported the theme

3.5. Quantitative analyses exploring preliminary effects of ACT2COPE

3.5.1. Correlations between psychological outcomes at baseline

Results demonstrated higher psychological inflexibility scores were positively correlated with increased depression scores at baseline, r(38)= .693, p < .001. Higher anxiety scores were also positively correlated with higher psychological inflexibility scores, r(38)= .455, p = .003. Similarly, higher stress scores were positively correlated with higher psychological inflexibility scores, r(38)= .592, p < .001. Results also demonstrated an association between psychological flexibility and wellbeing scores, r(38)= −.501, p < .001, where higher psychological inflexibility scores were negatively correlated with wellbeing scores. See Table .

Table 5. Pearson’s Correlations of Psychological Outcomes at Baseline

3.5.2. Exploring the effect of ACT2COPE on outcome measures

Three 2 (time: baseline, 4-week follow-up) x 2 (group: intervention, waitlist) mixed ANOVAs were conducted to test whether participants allocated to the intervention group would demonstrate reductions in depression, anxiety, and stress scores, and improvements in wellbeing and psychological flexibility scores from baseline to four-weeks follow-up when compared to the waitlist control group. Results suggested that the intervention significantly improved (i.e., reduced) depression scores (F(1, 35) = 7.00, p = .012, ηp2 = .17) from baseline (M = 15.80, SD = 8.97) to four-week follow-up (M = 8.24, SD = 6.96), relative to the waitlist control group from baseline (M = 13.70, SD = 10.49) to four-weeks follow-up (M = 11.80, SD = 11.24). Anxiety (F(1, 35) = 1.64, p = .209, ηp2 = .05), stress (F(1, 35) = 1.12, p = .297, ηp2 = .03), psychological flexibility (F(1, 35) = 3.47, p = .071, ηp2 = .09), and wellbeing (F(1, 35) = 1.37, p = .250, ηp2 = .04) scores did not significantly improve from baseline to four-week follow-up relative to the waitlist group. The findings did not change after adding anti-depressant use (n = 8) as a covariate or after controlling for psychological flexibility at baseline. See Table .

Table 6. Comparisons between groups in outcome measures over the study period

4. Discussion

The current pilot randomised trial of a brief online ACT-based intervention demonstrates the acceptability and usability of the ACT2COPE intervention for adults living with CHCs during the COVID-19 pandemic, filling a significant gap in the literature. Qualitative results indicated that participants found ACT2COPE engaging and useful, appreciating the helpful and relevant content, brevity and flexibility of modules, the clear layout, and the inclusions of video content. In terms of their experience with tools, participants reported an increase in ACT-based skills, feeling calmer and more relaxed, and an intention to continue using the tools in the future. Reductions in depressive symptoms, even during ongoing COVID-19 restrictions, at four weeks were also evident, demonstrating potential clinical utility of ACT2COPE. However, no significant changes were observed in wellbeing or psychological flexibility. Qualitative results also highlighted areas for future improvement to improve engagement, including different animation styles, slight changes to module content, and options for tailoring and personalisation. Our findings suggest that an online ACT-based intervention is acceptable, conceptually relevant, and demonstrates preliminary efficacy in reducing depressive symptoms for people living with CHCs during the COVID-19 pandemic and times of increased restrictions.

In line with previous research, ACT2COPE supports and provides further evidence that brief ACT-based eHealth interventions can effectively improve mental health outcomes in CHC populations (Graham et al., Citation2016; Köhle et al., Citation2021; Mikolasek et al., Citation2018). These results are encouraging as this format allows for greater accessibility and scalability with less demand on public health resources during times of increased demand and public health restrictions (Andersson & Titov, Citation2014; Wind et al., Citation2020). Previous online ACT interventions vary in length, from 1 day to 12 weeks (Brown et al., Citation2016), with some having a time commitment of a full-day workshop or 60 minutes each week for multiple weeks (Köhle et al., Citation2021; Räsänen et al., Citation2016). Interventions that were similar in length to ACT2COPE did not include all aspects of the ACT Hexaflex model, instead focusing on just one part of the model, such as mindfulness (Cavanagh et al., Citation2013; Howarth et al., Citation2016). Therefore, ACT2COPE is novel in its integration of all six components of the Hexaflex in a brief format.

Improving psychological flexibility is a key goal of any ACT intervention and is associated with improved mental health outcomes and reduced COVID-19 distress (Dawson & Golijani-Moghaddam, Citation2020; Kroska et al., Citation2020; Pakenham et al., Citation2020). Previous studies have found a mediating relationship between psychological flexibility and improved psychological outcomes in ACT interventions (Lin et al., Citation2018; Trompetter et al., Citation2015). However, ACT2COPE did not improve psychological flexibility. Previous studies that did find a mediating relationship included interventions spanning multiple weeks (Lin et al., Citation2018), indicating that the brevity of ACT2COPE may have limited improvements to psychological flexibility. An alternative mediating factor could be increased self-awareness. In the qualitative data, participants reported noticing an increased awareness of their thoughts and emotions after completing ACT2COPE, growing their ACT-based coping tools. Increased self-awareness has been associated with improved mental health outcomes, including depressive symptoms (Gu et al., Citation2015), and thus may be an interesting avenue to explore in future research.

Similarly, the qualitative findings from this study were in line with previous eHealth studies reporting participants’ wishes for tailored intervention content, the ability to set reminders, and mobile accessibility (Boggiss et al., Citation2021; Liverpool et al., Citation2020). Research has also indicated that tailored and personalised interventions may also benefit wellbeing outcomes, such as sleep, stress, and physical symptoms related to somatisation in adult samples (Moe-Byrne et al., Citation2022), highlighting the importance of tailoring content. The current study also meets the needs outlined in previous eHealth studies of having varied activities, a combination of audio, video, and text information, and being shorter in length (Bendelin et al., Citation2011).

Further, the knowledge gained from this study has many promising clinical and theoretical implications. eHealth interventions are known to provide accessible and effective psychological support to many different populations. However, most have focused on being tailored to one patient population per intervention (Beatty & Lambert, Citation2013; Graham et al., Citation2016). ACT2COPE has shown that psychological benefits can occur for people with a diverse range of CHCs from a broad intervention. As ACT is grounded in functional contextualism (David & Mogoase, Citation2015), this study adds to the growing literature that ACT can be an effective treatment modality in a COVID-19 pandemic context for vulnerable populations.

The current study has several strengths. These include incorporating outcomes assessing both feasibility and preliminary efficacy as well as a qualitative element to gather deeper feedback on the ACT2COPE intervention. Other strengths include the intervention’s novelty, brevity, and flexibility. However, several limitations need to be discussed, such as the generalisability of results. Due to the sample having a high proportion of Aotearoa (New Zealand) European women, creating a homogenous sample, the results are disproportionality skewed. This sample skew is typical in studies with chronically ill populations, as females have a higher proportion of CHCs and are more likely to participate in eHealth interventions, creating a self-selection bias (Donkin et al., Citation2012). Another limitation of this study, and many eHealth interventions, is that of self-reported adherence to the intervention. While many eHealth interventions often fail to report adherence (Donkin et al., Citation2011), a systematic review of 48 eHealth interventions found an average adherence rate of 50% (Kelders et al., Citation2012). The current study had an adherence rate of 55%, which is in line with this previous research. However, adherence was self-reported, which is vulnerable to social-desirability bias. Therefore adherence rates in the current study may be inflated (Van de Mortel, Citation2008). In addition, the AAQ-II has shown to have some limitations in its construct and face validity that could have impacted the results of this study (Tyndall et al., Citation2019). Given the short time frame of this study, small sample size and lack of diversity in terms of sex and ethnicity, further research and replication are needed to confirm these findings and determine underlying mechanisms. Future research could include a larger, more diverse sample with a longer follow-up for examining the maintenance of effects. A design that allows for manipulation of intervention length could provide knowledge about the length of intervention required to produce beneficial psychological outcomes.

Overall, ACT2COPE provides a novel and promising mental health intervention for people living with CHCs. This study extends current knowledge and offers further evidence for the feasibility and efficacy of brief online interventions. These interventions have the capacity for more extensive reach and accessibility for many hard-to-reach populations while reducing resource burdens on patient populations. As such, the ACT2COPE intervention is currently being adapted to be tested in a fully powered randomised controlled trial.

Clinical Trial Registration

ACTRN12620000634976

What is already known on the subject?

• For people living with chronic health conditions, the COVID-19 pandemic added barriers to accessing psychological care, and increased isolation and psychological distress.

• Psychological interventions that are scalable, accessible, and cost-effective are needed to support people living with chronic health conditions.

What does this study add?

• Early findings demonstrate ACT2COPE as a promising, acceptable, and scalable intervention.

• A web-based Acceptance and Commitment Therapy intervention (ACT2COPE) reduced depressive symptoms in those living with a chronic health condition, compared to a waitlist control group during the COVID-19 pandemic.

Disclosure statement

No potential conflict of interest was reported by the authors.

Data availability statement

The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.

Additional information

Notes on contributors

Kate Wallace-Boyd

Kate Wallace-Boyd is a Health Psychologist working at the Massey Psychology Clinic in Auckland, New Zealand.

Anna Lynette Boggiss

Dr Anna Boggiss is a postdoctoral researcher and an Intern Psychologist in Health Psychology at the Department of Psychological Medicine, University of Auckland, New Zealand.

Sian Ellett

Sian Ellett is currently completing postgraduate study in Health Psychology at the Department of Psychological Medicine, University of Auckland, New Zealand.

Roger Booth

Associate Professor Roger Booth is an immunologist and teaches in the health psychology and medical postgraduate programmes at the University of Auckland, New Zealand.

Rebecca Slykerman

Dr Rebecca Slykerman is a neuropsychologist and Senior Lecturer at the Department of Psychological Medicine, University of Auckland, New Zealand.

Anna Sofia Serlachius

Dr Anna Serlachius is a Senior Lecturer in Health Psychology at the Department of Psychological Medicine, University of Auckland, New Zealand.

References

  • Allen, P., & Bennett, K. (2012). SPSS statistics-a practical guide. Cengage Learning Australia Pty Ltd.
  • Andersson, G., Cuijpers, P., Carlbring, P., Riper, H., & Hedman, E. (2014). Guided Internet‐based vs. face‐to‐face cognitive behavior therapy for psychiatric and somatic disorders: A systematic review and meta‐analysis. World Psychiatry, 13(3), 288–18. https://doi.org/10.1002/wps.20151
  • Andersson, G., & Titov, N. (2014). Advantages and limitations of Internet‐based interventions for common mental disorders. World Psychiatry, 13(1), 4–11. https://doi.org/10.1002/wps.20083
  • Antony, M. M., Bieling, P. J., Cox, B. J., Enns, M. W., & Swinson, R. P. (1998). Psychometric properties of the 42-item and 21-item versions of the depression anxiety stress scales in clinical groups and a community sample. Psychological Assessment, 10(2), 176. https://doi.org/10.1037/1040-3590.10.2.176
  • Asmundson, G. J., & Katz, J. (2009). Understanding the co‐occurrence of anxiety disorders and chronic pain: State‐of‐the‐art. Depression and Anxiety, 26(10), 888–901. https://doi.org/10.1002/da.20600
  • Banerjee, M., Chakraborty, S., & Pal, R. (2020). Diabetes self-management amid COVID-19 pandemic. Diabetes & Metabolic Syndrome: Clinical Research & Reviews, 14(4), 351–354. https://doi.org/10.1016/j.dsx.2020.04.013
  • Bardus, M., Ali, A., Demachkieh, F., & Hamadeh, G. (2019). Assessing the quality of mobile phone apps for weight management: User-centered study with employees from a Lebanese University. JMIR mHealth and uHealth, 7(1), e9836. https://doi.org/10.2196/mhealth.9836
  • Barnard, K., Skinner, T., & Peveler, R. (2006). The prevalence of co-morbid depression in adults with Type 1 diabetes: Systematic literature review. Diabetic Medicine, 23(4), 445–448. https://doi.org/10.1111/j.1464-5491.2006.01814.x
  • Bassett, S., Cohn, M., Cotten, P., Kwok, I., & Moskowitz, J. (2019). Feasibility and acceptability of an online positive affect intervention for those living with comorbid HIV depression. AIDS and Behaviour, 23(3), 753–764. https://doi.org/10.1007/s10461-019-02412-z
  • Beatty, L., & Lambert, S. (2013). A systematic review of internet-based self-help therapeutic interventions to improve distress and disease-control among adults with chronic health conditions. Clinical Psychology Review, 33(4), 609–622. https://doi.org/10.1016/j.cpr.2013.03.004
  • Bendelin, N., Hesser, H., Dahl, J., Carlbring, P., Nelson, K. Z., & Andersson, G. (2011). Experiences of guided Internet-based cognitive-behavioural treatment for depression: A qualitative study. BMC Psychiatry, 11(1), 1–10. https://doi.org/10.1186/1471-244X-11-107
  • Boggiss, A. L., Consedine, N. S., Schache, K. R., Wallace‐boyd, K., Cao, N., Hofman, P. L., & Serlachius, A. S. (2021). Exploring the views of adolescents with type 1 diabetes on digital mental health interventions: What functionality and content do they want? Diabetic Medicine, 38(11), e14591. https://doi.org/10.1111/dme.14591
  • Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Zettle, R. D. & Zettle, R. D. (2011). Preliminary psychometric properties of the Acceptance and Action Questionnaire–II: A revised measure of psychological inflexibility and experiential avoidance. Behavior Therapy, 42(4), 676–688. https://doi.org/10.1016/j.beth.2011.03.007
  • Brown, M., Glendenning, A. C., Hoon, A. E., & John, A. (2016). Effectiveness of web-delivered acceptance and commitment therapy in relation to mental health and well-being: A systematic review and meta-analysis. Journal of Medical Internet Research, 18(8), e6200. https://doi.org/10.2196/jmir.6200
  • Cavanagh, K., Strauss, C., Cicconi, F., Griffiths, N., Wyper, A., & Jones, F. (2013). A randomised controlled trial of a brief online mindfulness-based intervention. Behaviour Research and Therapy, 51(9), 573–578. https://doi.org/10.1016/j.brat.2013.06.003
  • David, D., & Mogoase, C. (2015). Acceptance and commitment therapy’s philosophical foundation under scrutiny: an in-depth discussion of A-Ontology. Journal of Evidence-Based Psychotherapies, 15(2), 169–177.
  • Dawson, D. L., & Golijani-Moghaddam, N. (2020). COVID-19: Psychological flexibility, coping, mental health, and wellbeing in the UK during the pandemic. Journal of Contextual Behavioral Science, 17, 126–134. https://doi.org/10.1016/j.jcbs.2020.07.010
  • Dindo, L. (2015). One-day Acceptance and Commitment training workshops in medical populations. Current Opinion in Psychology, 2, 38–42. https://doi.org/10.1016/j.copsyc.2015.01.018
  • Dindo, L., Van Liew, J., & Arch, J. (2017). Acceptance and Commitment Therapy: A transdiagnostic behavioral intervention for mental health and medical conditions. Neurotherapeutics, 14(3), 546–553. https://doi.org/10.1007/s13311-017-0521-3
  • Donkin, L., Christensen, H., Naismith, S. L., Neal, B., Hickie, I. B., & Glozier, N. (2011). A systematic review of the impact of adherence on the effectiveness of e-therapies. Journal of Medical Internet Research, 13(3), e1772. https://doi.org/10.2196/jmir.1772
  • Donkin, L., Hickie, I., Christensen, H., Naismith, S., Neal, B., Cockayne, N., & Glozier, N. (2012). Sampling bias in an internet treatment trial for depression. Translational Psychiatry, 2(10), e174. https://doi.org/10.1038/tp.2012.100
  • Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016). CONSORT 2010 statement: Extension to randomised pilot and feasibility trials. The BMJ, 355, i5239. Retrieved from https://www.ncbi.nlm.nih.gov/pubmed/20724399 https://doi.org/10.1136/bmj.i5239
  • El-Gabalawy, R., Mackenzie, C. S., Shooshtari, S., & Sareen, J. (2011). Comorbid physical health conditions and anxiety disorders: A population-based exploration of prevalence and health outcomes among older adults. General Hospital Psychiatry, 33(6), 556–564. https://doi.org/10.1016/j.genhosppsych.2011.07.005
  • Graham, C. D., Gouick, J., Krahe, C., & Gillanders, D. (2016). A systematic review of the use of Acceptance and Commitment Therapy (ACT) in chronic disease and long-term conditions. Clinical Psychology Review, 46, 46–58. https://doi.org/10.1016/j.cpr.2016.04.009
  • Grigsby, A. B., Anderson, R. J., Freedland, K. E., Clouse, R. E., & Lustman, P. J. (2002). Prevalence of anxiety in adults with diabetes: A systematic review. Journal of Psychosomatic Research, 53(6), 1053–1060. https://doi.org/10.1016/S0022-3999(02)00417-8
  • Gu, J., Strauss, C., Bond, R., & Cavanagh, K. (2015). How do mindfulness-based cognitive therapy and mindfulness-based stress reduction improve mental health and wellbeing? A systematic review and meta-analysis of mediation studies. Clinical Psychology Review, 37, 1–12. https://doi.org/10.1016/j.cpr.2015.01.006
  • Harris, R. (2019). ACT made simple: An easy-to-read primer on acceptance and commitment therapy. New Harbinger Publications.
  • Hayes, S. C. (2004). Acceptance and commitment therapy, relational frame theory, and the third wave of behavioral and cognitive therapies. Behavior Therapy, 35(4), 639–665. https://doi.org/10.1016/S0005-7894(04)80013-3
  • Holmes, E. A., O’Connor, R. C., Perry, V. H., Tracey, I., Wessely, S., Arseneault, L., Everall, I. & Everall, I. (2020). Multidisciplinary research priorities for the COVID-19 pandemic: A call for action for mental health science. The Lancet Psychiatry, 7(6), 547–560. https://doi.org/10.1016/S2215-0366(20)30168-1
  • Howarth, A., Perkins-Porras, L., Copland, C., & Ussher, M. (2016). Views on a brief mindfulness intervention among patients with long-term illness. BMC Psychology, 4(1), 1–9. https://doi.org/10.1186/s40359-016-0163-y
  • Hsieh, H. -F., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277–1288. https://doi.org/10.1177/1049732305276687
  • Isa, M., Moy, F., Abdul Razack, A., Zainuddin, Z., & Zainal, N. (2013). Impact of applied progressive deep muscle relaxation training on the level of depression, anxiety and stress among prostate cancer patients: A quasi-experimental study. Asian Pacific Journal of Cancer Prevention, 14(4), 2237–2242. https://doi.org/10.7314/apjcp.2013.14.4.2237
  • Kashani, F., Babaee, S., Bahrami, M., & Valiani, M. (2012). The effects of relaxation on reducing depression, anxiety and stress in women who underwent mastectomy for breast cancer. Iranian Journal of Nursing and Midwifery Research, 17(1), 30–33.
  • Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012). Persuasive system design does matter: A systematic review of adherence to web-based interventions. Journal of Medical Internet Research, 14(6), e2104. https://doi.org/10.2196/jmir.2104
  • The King’s Fund. (2021). Long-term conditions and multi-morbidity. Retrieved from https://www.kingsfund.org.uk/projects/time-think-differently/trends-disease-and-disability-long-term-conditions-multi-morbidity#:~:text=About%2015%20million%20people%20in,pulmonary%20disease%2C%20arthritis%20and%20hypertension.
  • Köhle, N., Drossaert, C. H., Ten Klooster, P. M., Schreurs, K. M., Hagedoorn, M., Uden Kraan, V., Bohlmeijer, E. T. & Bohlmeijer, E. T. (2021). Web-based self-help intervention for partners of cancer patients based on acceptance and commitment therapy and self-compassion training: A randomized controlled trial with automated versus personal feedback. Supportive Care in Cancer, 29(9), 5115–5125. https://doi.org/10.1007/s00520-021-06051-w
  • Kroska, E. B., Roche, A. I., Adamowicz, J. L., & Stegall, M. S. (2020). Psychological flexibility in the context of COVID-19 adversity: Associations with distress. Journal of Contextual Behavioral Science, 18, 28–33. https://doi.org/10.1016/j.jcbs.2020.07.011
  • Landi, G., Pakenham, K. I., Boccolini, G., Grandi, S., & Tossani, E. (2020). Health anxiety and mental health outcome during COVID-19 lockdown in Italy: The mediating and moderating roles of psychological flexibility. Frontiers in Psychology, 11, 2195. https://doi.org/10.3389/fpsyg.2020.02195
  • Lappalainen, P., Granlund, A., Siltanen, S., Ahonen, S., Vitikainen, M., Tolvanen, A., & Lappalainen, R. (2014). ACT Internet-based vs face-to-face? A randomized controlled trial of two ways to deliver Acceptance and Commitment Therapy for depressive symptoms: An 18-month follow-up. Behaviour Research and Therapy, 61, 43–54. https://doi.org/10.1016/j.brat.2014.07.006
  • Lillis, J., Hayes, S. C., Bunting, K., & Masuda, A. (2009). Teaching acceptance and mindfulness to improve the lives of the obese: A preliminary test of a theoretical model. Annals of Behavioral Medicine, 37(1), 58–69. https://doi.org/10.1007/s12160-009-9083-x
  • Lin, J., Klatt, L. -I., McCracken, L. M., & Baumeister, H. (2018). Psychological flexibility mediates the effect of an online-based acceptance and commitment therapy for chronic pain: An investigation of change processes. Pain, 159(4), 663–672. https://doi.org/10.1097/j.pain.0000000000001134
  • Liu, Y., & Tang, X. (2018). Depressive syndromes in autoimmune disorders of the nervous system: Prevalence, etiology, and influence. Frontiers in Psychiatry / Frontiers Research Foundation, 9, 451. https://doi.org/10.3389/fpsyt.2018.00451
  • Liverpool, S., Mota, C. P., Sales, C. M., Čuš, A., Carletto, S., Hancheva, C., Pietrabissa, G. & Pietrabissa, G. (2020). Engaging children and young people in digital mental health interventions: Systematic review of modes of delivery, facilitators, and barriers. Journal of Medical Internet Research, 22(6), e16317. https://doi.org/10.2196/16317
  • Lovibond, P. F., & Lovibond, S. H. (1995). The structure of negative emotional states: Comparison of the depression anxiety stress scales (DASS) with the beck depression and anxiety inventories. Behaviour Research and Therapy, 33(3), 335–343. https://doi.org/10.1016/0005-7967(94)00075-U
  • Maguire, S., & O’Shea, F. (2021). Social isolation due to the COVID-19 pandemic has led to worse outcomes in females with inflammatory arthritis. Irish Journal of Medical Science, 190(1), 33–38. (1971-). https://doi.org/10.1007/s11845-020-02307-2
  • Matchim, Y., Armer, J., & Stewart, B. (2011). Mindfulness-based stress reduction among breast cancer survivors: A literature review and discussion. Oncology Nursing Forum, 38(2), E61–71. https://doi.org/10.1188/11.ONF.E61-E71
  • McCracken, L. M., Sato, A., & Taylor, G. J. (2013). A trial of a brief group-based form of acceptance and commitment therapy (ACT) for chronic pain in general practice: Pilot outcome and process results. The Journal of Pain, 14(11), 1398–1406. https://doi.org/10.1016/j.jpain.2013.06.011
  • Mercier, A., Auger-Aubin, I., Lebeau, J. -P., Schuers, M., Boulet, P., Hermil, J. -L., Peremans, L. & Peremans, L. (2013). Evidence of prescription of antidepressants for non-psychiatric conditions in primary care: An analysis of guidelines and systematic reviews. BMC Family Practice, 14(1), 1–10. https://doi.org/10.1186/1471-2296-14-55
  • Mertens, G., Gerritsen, L., Duijndam, S., Salemink, E., & Engelhard, I. M. (2020). Fear of the coronavirus (COVID-19): Predictors in an online study conducted in March 2020. Journal of Anxiety Disorders, 74, 102258. https://doi.org/10.1016/j.janxdis.2020.102258
  • Mikolasek, M., Berg, J., Witt, C. M., & Barth, J. (2018). Effectiveness of mindfulness-and relaxation-based eHealth interventions for patients with medical conditions: A systematic review and synthesis. International Journal of Behavioral Medicine, 25(1), 1–16. https://doi.org/10.1007/s12529-017-9679-7
  • Ministry of Health. (2009). Report on New Zealand cost-of-illness studies on long-term conditions. Retrieved from https://www.health.govt.nz/system/files/documents/publications:
  • Moe-Byrne, T., Shepherd, J., Merecz-Kot, D., Sinokki, M., Naumanen, P., Hakkaart van Roijen, L., Van Der Feltz-Cornelis, C., & König, L. M. (2022). Effectiveness of tailored digital health interventions for mental health at the workplace: A systematic review of randomised controlled trials. PLOS Digital Health, 1(10), e0000123. https://doi.org/10.1371/journal.pdig.0000123
  • Moussavi, S., Chatterji, S., Verdes, E., Tandon, A., Patel, V., & Ustun, B. (2007). Depression, chronic diseases, and decrements in health: Results from the World Health Surveys. The Lancet, 370(9590), 851–858. https://doi.org/10.1016/s0140-6736(07)61415-9
  • Pakenham, K. I., Landi, G., Boccolini, G., Furlani, A., Grandi, S., & Tossani, E. (2020). The moderating roles of psychological flexibility and inflexibility on the mental health impacts of COVID-19 pandemic and lockdown in Italy. Journal of Contextual Behavioral Science, 17, 109–118. https://doi.org/10.1016/j.jcbs.2020.07.003
  • Papautsky, E. L., Rice, D. R., Ghoneima, H., McKowen, A. L. W., Anderson, N., Wootton, A. R., & Veldhuis, C. (2021). Characterizing health care delays and interruptions in the United States during the COVID-19 pandemic: Internet-based, cross-sectional survey study. Journal of Medical Internet Research, 23(5), e25446. https://doi.org/10.2196/25446
  • Pettinicchio, D., Maroto, M., Chai, L., & Lukk, M. (2021). Findings from an online survey on the mental health effects of COVID-19 on Canadians with disabilities and chronic health conditions. Disability and Health Journal, 14(3), 101085. https://doi.org/10.1016/j.dhjo.2021.101085
  • Pfefferbaum, B., & North, C. S. (2020). Mental health and the Covid-19 pandemic. The New England Journal of Medicine, 383(6), 510–512. https://doi.org/10.1056/NEJMp2008017
  • Räsänen, P., Lappalainen, P., Muotka, J., Tolvanen, A., & Lappalainen, R. (2016). An online guided ACT intervention for enhancing the psychological wellbeing of university students: A randomized controlled clinical trial. Behaviour Research and Therapy, 78, 30–42. https://doi.org/10.1016/j.brat.2016.01.001
  • Schreier, M. (2012). Qualitative content analysis in practice. Sage publications.
  • Sheppard, S. C., Forsyth, J. P., Hickling, E. J., & Bianchi, J. (2010). A novel application of acceptance and commitment therapy for psychosocial problems associated with multiple sclerosis: Results from a half-day workshop intervention. International Journal of MS Care, 12(4), 200–206. https://doi.org/10.7224/1537-2073-12.4.200
  • Topp, C. W., Østergaard, S. D., Søndergaard, S., & Bech, P. (2015). The WHO-5 Well-Being Index: A systematic review of the literature. Psychotherapy and Psychosomatics, 84(3), 167–176. https://doi.org/10.1159/000376585
  • Trompetter, H. R., Bohlmeijer, E. T., Fox, J. -P., & Schreurs, K. M. (2015). Psychological flexibility and catastrophizing as associated change mechanisms during online acceptance & commitment therapy for chronic pain. Behaviour Research and Therapy, 74, 50–59. https://doi.org/10.1016/j.brat.2015.09.001
  • Tyndall, I., Waldeck, D., Pancani, L., Whelan, R., Roche, B., & Dawson, D. L. (2019). The acceptance and action Questionnaire-II (AAQ-II) as a measure of experiential avoidance: Concerns over discriminant validity. Journal of Contextual Behavioral Science, 12, 278–284. https://doi.org/10.1016/jcbs.2018.09.005
  • Van de Mortel, T. F. (2008). Faking it: Social desirability response bias in self-report research. Australian Journal of Advanced Nursing, The, 25(4), 40–48.
  • Wind, T., Rijkeboer, M., Andersson, G., & Riper, H. (2020). The COVID-19 pandemic: The ‘black swan’ for mental health care and a turning point for e-health. Internet Interventions, 20, 100317. https://doi.org/10.1016/j.invent.2020.100317
  • World Health Organisation. (1998). Use of well-being measures in primary health care - the DepCare project health for all. Retrieved from Geneva:
  • World Health Organisation. (2023). WHO Coronavirus (COVID-19) Dashboard. Retrieved from https://covid19.who.int/?mapFilter=deaths
  • Zamawe, F. C. (2015). The implication of using NVivo software in qualitative data analysis: Evidence-based reflections. Malawi Medical Journal, 27(1), 13–15. https://doi.org/10.4314/mmj.v27i1.4