Exacerbations of Chronic Obstructive Pulmonary Disease Tool to assess the efficacy of acute treatment

Abstract

Background and objective

The Exacerbations of Chronic Obstructive Pulmonary Disease Tool-Patient-Reported Outcomes (EXACT-PRO) has been suggested as a reliable and valid measure for early assessment of COPD exacerbations and perceived recovery. However, there has been no evidence for EXACT-PRO efficacy in assessing recovery from treatment in a randomized controlled trial. The study evaluated the reliability, validity, and responsiveness of EXACT-PRO for the evaluation of the efficacy of acute treatment in patients with COPD exacerbation.

Methods

In a Phase III randomized controlled study for assessing the efficacy of antibiotic treatment on COPD exacerbation, EXACT-PRO was evaluated in the responders and non-responders.

Results

A total of 295 patients were analyzed (259 responders and 37 non-responders). Cronbach’s α was 0.96 for EXACT total, 0.96 for the breathlessness domain, 0.89 for the cough and sputum domain, and 0.93 for the chest symptoms domain. The EXACT score correlated with the COPD assessment test (CAT) score (r=0.8, P<0.01). A stronger decrease in the EXACT score was found in the responder group than in the non-responder group from the fifth day after treatment. The difference in the EXACT score from exacerbation onset to recovery was -6.3 in responders and -1.9 in non-responders (P=0.01).

Conclusion

EXACT-PRO is a comprehensive and sensitive method for assessing symptomatic resolution of COPD exacerbations during treatment.

Keywords:

• The Exacerbations of Chronic Obstructive Pulmonary Disease Tool
• EXACT
• Patient-Reported Outcomes
• PRO
• COPD
• exacerbation

Plain language summary

We assessed the usefulness of the Exacerbations of Chronic Obstructive Pulmonary Disease Tool-Patient-Reported Outcomes (EXACT-PRO) during exacerbation and recovery period of COPD. EXACT-PRO score well correlated with treatment outcome. A stronger decrease in the EXACT score was found in the responder group after treatment of COPD exacerbation. EXACT-PRO is a useful tool for assessing COPD exacerbations and recovery.

Introduction

COPD exacerbations are defined as an acute worsening of respiratory symptoms beyond normal day-to-day variability, which need additional therapy and carry the risk of adverse health events that may affect the patient at some point in the future.¹ Many studies have tried to detect exacerbations at the initial phase using clinical or laboratory parameters. Nonetheless, many exacerbation cases are not reported to health care professionals,² and thus, COPD patients need to receive education about exacerbation symptoms and when to visit a health care facility.¹ Standardizing the assessment of COPD exacerbation symptoms using a common tool and metric will promote understanding exacerbations, including the prodromal, acute, and recovery phases, and the effects of treatment.³

The EXACT-PRO instrument designed to directly measure patient-reported symptoms of COPD exacerbation and to standardize the assessment of the patient’s condition in order to capture this dynamic process of exacerbations.^3,4 EXACT is a tool for assessing the frequency, severity, and duration of exacerbations of COPD;^3–5 it is also used in clinical trials to test the efficacy of therapies aimed at alleviating or preventing COPD exacerbations⁶ or treating exacerbations.^3,7 However, to date, there are no data to evaluate the performance of EXACT in a randomized controlled clinical trial that would assess the efficacy of treatment in patients with COPD exacerbation at baseline.³

Elevated white blood cell count and its subtypes are systemic inflammatory markers. The neutrophil-to-lymphocyte ratio (NLR), which calculated from complete blood cell count with differential, is a rapid, inexpensive, and widely available marker of inflammation in clinical practice. We hypothesized that elevated NLR in COPD exacerbations decreases in the recovery phase following treatment.

One aim of the present study was to evaluate the performance of EXACT in the assessment of the efficacy of acute treatment. Second, we planned to validate the Korean version of EXACT-PRO in Korean COPD patients with exacerbations as a sensitive tool to assess recovery from exacerbation. Third, we evaluate NLR changes during recovery according to the treatment response.

Methods

Study design, sample, and procedures

A prospective, multicenter, double-blind, double-dummy, randomized, controlled, parallel-group, Phase III non-inferiority clinical trial designed to compare oral zabofloxacin with moxifloxacin for the treatment of patients with COPD exacerbations was performed between September 2012 and February 2014 in Korea. The study is registered with ClinicalTrials.gov (registration number NCT1658020) and Clinical Research Information Service (KCT000532). The study was approved by independent ethics committees (CNUH 2012-07-013) at each center before study initiation. All patients provided written informed consent. Study design and results on primary outcomes about this study were published in a paper.⁸ A total of 345 COPD patients with exacerbations were enrolled, and all of them received one of the study drugs for seven consecutive days.

Measures

Patient-reported measures

The Korean version of the EXACT-PRO questionnaire was produced from the original English version by following a standard translation and back-translation process. The participating patients recorded the Korean version of the EXACT pen diary booklet on days 1–7 and 36. The participants were instructed to complete the pen diary each evening before bedtime.

EXACT consists of 14 items in three domains as follows: Breathlessness, Cough & Sputum, and Chest Symptoms. The EXACT total score is computed across the 14 items and has an interval-level scale ranging from 0 to 100, with higher scores indicating a more severe condition. The score of each domain also ranges from 0 to 100, with higher scores indicating more severe symptom.³

The COPD assessment test (CAT) questionnaire was administered on days 1–7 and 36 according to study design.

Laboratory measures

Blood test was done on day 1 (visit 1, V1), days 10±3 (visit 3, V3), and days 36±7 (visit 4, V4) and included complete blood cell count with differential count. We calculated the NLR for each day.

Clinical assessment

The patients who improved in terms of dyspnea or sputum purulence or volume on V3 after acute treatment were defined as “responders”, and those who did not were defined as “non-responders”.⁸

Statistical analyses

All statistical analyses were performed using SPSS version 24 (IBM Corporation, Armonk, NY, USA). To compare baseline characteristics between responders and non-responders, a paired t-test (continuous variables) and a chi-squared test were used. To compare the changes in the EXACT score, the CAT score, and the NLR on the treatment each day between responders and non-responders, a paired t-test was used. In the main text, the data are presented as mean ± SD or percentage. In the figures, the data are presented as mean ± standard error of mean. To test the reliability of the Korean version of EXACT questionnaire items, internal consistency was assessed using Cronbach’s α. To test validity, the relationship between EXACT total score and CAT score was assessed using Pearson’s correlation coefficient. The P-values of <0.05 were considered statistically significant.

Results

Patients’ characteristics

In total, 322 patients completed the EXACT pen diary on consecutive days 1–7; among them, 295 patients could be evaluated for the clinical response to the treatment. In total, 287 patients also completed the diary on day 36, and all of them could be evaluated for the clinical response to the treatment. Clinical characteristics at baseline are shown in Table 1. Mean post-bronchodilator FEV₁ was 49.5% of predicted value. Mean EXACT total score on day 1 was 46.1. There were no differences in EXACT total score or three domain scores between responders and non-responders on day 1. Mean NLR on day 1 was 3.9, with a trend toward a lower NLR at baseline in the non-responders (NLR =3.1, 95% CI: 2.75–3.45) compared to responders (NLR =4.1, 95% CI: 3.61–4.59). But there are no statistical differences in NLR between responders and non-responders. The CAT score and the presence of chronic bronchitis were similar in both groups.

Table 1 Baseline characteristics of patients

Characteristics	Total (n=295)	Responders (n=258)	Non-responders (n=37)	P-value
Age, years	70±7.6	69.8±7.5	71±7.5	0.41
Sex, male, n (%)	272 (92)	240 (92.7)	32 (86.5)	0.18
Zabofloxacin, n (%)	152 (51.5)	133 (51.6)	19 (51)	0.98
BMI, kg/mm^2	22.1±3.3	22.1±3.3	22.1±3.6	0.99
Smoking, packs/year	29.5±18.9	28.7±18.6	38.8±21.4	0.21
Exacerbation history, prior 12 months	1±0.1	1±0.1	1±0.0	0.53
Spirometry
FEV1, L	1.4±0.5	1.4±0.5	1.3±0.4	0.31
FEV1 % predicted	49.5±17.7	49.4±17.6	50.1±18.4	0.84
EXACT score, day 1
Total score	46.1±11.0	46.1±11.3	46.4±8.7	0.84
Breathlessness	50.8±19.8	50.6±20.3	52.2±15.9	0.65
Cough and sputum	44.4±16.3	44.8±16.4	41.7±15.3	0.27
Chest symptoms	34.2±19.7	34.1±20.0	35.5±17.6	0.67
CAT score, day 1	23±7.3	22.9±7.4	23.7±6.9	0.54
Chronic bronchitis, n (%)	116 (39.3)	104 (40.3)	12 (32.4)	0.47
White blood cell count/µL	8,620±3,168	8,680±3,263	8,202±2,410	0.39
Neutrophils, %	62.6±16.7	62.8±17.2	61.1±12.7	0.57
Lymphocytes, %	22.4±10.3	22.1±10.5	24.1±8.5	0.26
NLR	3.9±3.8	4.1±4.0	3.1±1.8	0.145

Note: All values are presented as mean ± SD except where indicated.

Abbreviations: BMI, body mass index; CAT, COPD assessment test; EXACT, Exacerbations of Chronic Pulmonary Disease Tool; NLR, neutrophil/lymphocyte ratio.

Patients with chronic bronchitis showed higher EXACT and CAT scores than patients without chronic bronchitis (Table 2).

Table 2 Symptom score according to chronic bronchitis in patients with COPD exacerbation

EXACT or CAT score	Chronic bronchitis		Mean difference (95% CI)	P-value
	No (n=179)	Yes (n=115)
EXACT score
Day 1	44.4±9.9	48.9±12.1	4.5 (3.47–5.53)	<0.01
Day 7	39.0±10.8	42.4±11.9	3.4 (2.24–4.56)	0.01
CAT score
Day 1	21.2±6.8	25.8±7.3	4.6 (4.32–4.88)	<0.01
Day 7	18.0±7.6	21.8±7.5	3.8 (3.45–4.15)	<0.01

Note: Data are mean ± SD.

Abbreviations: CAT, COPD assessment test; EXACT, Exacerbations of Chronic Pulmonary Disease Tool.

Reliability of EXACT

Internal consistency of Cronbach’s α for the EXACT total score, breathlessness domain, and chest symptoms domain exceeded 0.9 (Table 3). These data suggested that the EXACT questionnaire items had good internal consistency and were reliable.

Table 3 Reliability: internal consistency in patients with acute exacerbations

EXACT score	Internal consistency (n=295)
	Cronbach’s α
Total score	0.96
Breathlessness	0.96
Cough and sputum	0.89
Chest symptoms	0.93

Abbreviation: EXACT, Exacerbations of Chronic Pulmonary Disease Tool.

Validity of EXACT

Correlations between the EXACT scores and the CAT score are presented in Table 4. The EXACT total score, breathlessness domain score, and chest symptoms domain score were significantly related to the CAT score on day 1 (Pearson correlation coefficient, r=0.80, 0.71, 0.61, respectively; all P<0.01). The EXACT total score and CAT score on days 7 and 36 showed strong relationship (r=0.79, 0.80, respectively; P<0.01). The cough and sputum domain score and the CAT score showed a moderate relationship on days 1, 7, and 36.

Table 4 Validity: correlation between EXACT scores and CAT scores on days 1, 7, and 36

EXACT score	Coefficients
	Day 1	Day 7	Day 36
Total score	0.80	0.79	0.80
Breathlessness	0.71	0.71	0.70
Cough and sputum	0.50	0.47	0.49
Chest symptoms	0.61	0.64	0.68

Notes: Pearson’s correlation coefficients between EXACT scores and CAT scores were determined on day 1, day 7, and day 36. All P-values <0.01.

Abbreviations: CAT, COPD assessment test; EXACT, Exacerbations of Chronic Pulmonary Disease Tool.

FEV₁% predicted showed a weak inverse relationship with the EXACT total score and the CAT score on day 1 (r=−0.19, r=−0.25, respectively; both P<0.01). The breathlessness domain score on day 1 showed the strong inverse relationship with FEV₁% predicted (r=−0.26, P<0.01) among EXACT domains (Table 5).

Table 5 Correlations between the EXACT score, CAT score, NLR, and FEV₁% predicted on day 1

	Coefficients (95% CI)
	FEV1% predicted	NLR
EXACT total score	−0.19a	0.16c
CAT total score	−0.25b	0.16d

Notes: Pearson’s correlation coefficients between:

a EXACT scores and FEV₁% predicted;

b CAT scores and FEV₁% predicted;

c EXACT scores and NLR; and

d CAT scores and NLR. All P-values <0.05.

Abbreviations: CAT, COPD assessment test; EXACT, Exacerbations of Chronic Pulmonary Disease Tool; NLR, neutrophil/lymphocyte ratio.

Responsiveness of EXACT

There were significant differences in EXACT scores between responders and non-responders from day 5 after the beginning of the treatment (41.4±11.2 vs 45.4±10.5; P=0.03), on day 6 (40.7±11.4 vs 45.0±10.2; P=0.03), and on day 7 (39.7±11.3 vs 44.5±11.1; P=0.01; Figure 1).

Figure 1 Serial changes in EXACT total scores of responders and non-responders during acute treatment of COPD exacerbations.

Notes: From day 5 of treatment, EXACT total score was significantly different between the two groups. *P<0.05.
Abbreviations: D, day; EXACT, Exacerbations of Chronic Pulmonary Disease Tool.

Mean differences in EXACT total scores from day 1 to 7 were −6.3 in responders and −1.9 in non-responders (P<0.01; Figure 2A). The breathlessness domain score showed a significantly stronger reduction in responders than in non-responders on day 7 (−8.6 vs −2.0; P=0.03), but the cough and sputum domain (−13.4 vs −8.4; P=0.09) and the chest symptoms domain (−6.9 vs −2.4; P=0.16) did not show significant differences between responders and non-responders on day 7 (Figure 2B).

Figure 2 (A) Mean changes in EXACT total scores between days 1 and 7 showed a significant reduction in responders but not in non-responders. (B) Reduction in the breathlessness score from day 1 to 7 was significant.

Notes: The reduction in the cough and sputum domain scores and that in the chest symptoms domain score were not significant. *P<0.05 and **P<0.01.
Abbreviation: EXACT, Exacerbations of Chronic Pulmonary Disease Tool.

Changes in NLR

Mean changes in NLR during treatment from V1 to V3 were −0.34 in responders and 1.31 in non-responders (P<0.01; Figure 3). NLR values were significantly decreased from V1 to V3 after antibiotics treatment in responders but not in non-responders.

Figure 3 Mean changes in the NLR from V1 to V3.

Notes: The NLR decreased significantly in non-responders. **P<0.01. V1, baseline visit; V3, visit on day 7±3.
Abbreviation: NLR, neutrophil/lymphocyte ratio.

The NLR showed weak relationship with EXACT total score (r=0.16; P<0.01) and CAT score (r=0.16; P<0.01) on day 1. There was a weak inverse relationship between the NLR and FEV₁% predicted (r=−0.19; P<0.01; Table 5).

Discussion

Despite the efforts to prevent or at least reduce COPD exacerbations, there has been no standardized, reliable, and valid method for quantifying exacerbations. Clinical studies have used two different definitions of COPD exacerbations as follows: event-based and symptom-based. Event-based exacerbation frequency is defined on the basis of health care use with systemic steroid or antibiotics treatment;⁹ this definition has been used most frequently in clinical studies. However, event-based definition fails to account for unreported events and to standardize the change in symptoms from normal day-to-day variability.² The symptom-based definition assesses this change using a patient-completed symptom diary card.⁹

Initial symptoms and patient-reported signs of exacerbation should be captured by a well-defined and reliable PRO instrument. Exacerbations that are not reported when using the event-based definition are expected to be reported when using the symptom-based definition, to be perceived earlier, and to provide an objective outcome measure for frequency, severity, and duration of and recovery from exacerbation. PRO needs to detect and quantify COPD exacerbations. The EXACT-PRO tool was developed to standardize the symptomatic assessment of exacerbations by including unreported events.⁴ The original English version of EXACT-PRO is a self-administered daily e-diary to be completed by respondents each evening just before the bedtime while reflecting on their symptoms today. Changes in the total score are used to define onset and resolution from an exacerbation event and the magnitude of that event.³

Standardized PRO provides an objective outcome measure for frequency, severity, and duration of exacerbations that can be used in clinical trials.³ Daily administration of EXACT-PRO is essential for capturing changes in the patient’s condition over time, including worsening, improvement, and stabilization. The EXACT tool identified more frequent unreported exacerbations than did event-based identification. It is important because unreported exacerbation events have a similar impact on health status to the reported events.¹⁰

Previous clinical trials suggest that EXACT-PRO is a standardized, reliable, valid tool for assessing frequency, severity, and duration of exacerbations.^5–7 It is also sensitive to changes during recovery from exacerbations.⁷ However, all the previous studies have been performed in the Western countries.

This is the first study to use EXACT to assess recovery from exacerbations in a randomized clinical trial that evaluated the effects of treatment on COPD patients enrolled in a state of clinical exacerbation at baseline. Some of the results of this study have been previously reported in the form of an abstract.¹¹

In a previous study, the EXACT scores differentiated responders and non-responders on day 7 following exacerbation treatment.⁷ Our study supports the previous result that the EXACT instrument is sensitive to changes during recovery from exacerbations. In our study, the EXACT scores differentiated responders and non-responders on the fifth day following treatment: the decreases in the EXACT total score and especially the decrease in the breathless domain score from exacerbation to recovery were higher in responders than in non-responders. The EXACT is reliable and valid for assessing the severity, frequency, and duration of exacerbations.^5–7,12,13 This study adds the responsiveness to recovery from exacerbations to the previously reported characteristics of EXACT. Leidy et al⁷ first reported the sensitivity to improvement in patients with a medically confirmed exacerbation of COPD. Our study is the first report to verify sensitivity to improvement in a Phase III clinical trial. We suggest that the EXACT measure is suitable for clinical trials as a PRO for differentiation of treatment efficacy.

The Cronbach’s α value of EXACT total was 0.96 in this study. This is similar to that reported in the original validation study by Leidy et al⁷ and is higher than the recommended 0.90 threshold.¹⁴

The CAT is currently recommended for assessing the symptoms and health status of COPD patients¹ and has shown good measurement properties with good reliability and validity.¹⁵ The CAT is sensitive to changes in health status¹⁶ and in systemic inflammation¹⁷ during COPD exacerbations. The CAT is a useful instrument to assess the efficacy of treatments following COPD exacerbations.¹⁷ In the first validation study of the EXACT-PRO, the EXACT score was correlated with the St George’s Respiratory Questionnaire score (r=0.64).⁷ In our study, the EXACT scores were significantly correlated with the CAT score. We suggest the usefulness of EXACT-PRO for capturing the initial symptoms of exacerbation and assessment of the recovery from exacerbation.

Chronic bronchitis, a type of COPD that is defined by productive cough for at least 3 months in at least two consecutive years,¹⁸ often can be a target of antibiotics for acute exacerbations. In this study, the EXACT scores were significantly higher in patients with chronic bronchitis. It suggests that COPD patients with chronic bronchitis may suffer from more severe symptoms than patients without chronic bronchitis.

We investigated NLR as a responsiveness marker during recovery from exacerbations after treatment. NLR is a good laboratory inflammatory marker, because it is cost-effective, rapid, easily available worldwide.^19,20 NLR values were significantly higher in patients with COPD exacerbations than in stable COPD patients and controls^19,20 and were significantly decreased during the convalescent period in patients with COPD exacerbations.²⁰ In this study, NLR decreased in responders and increased in non-responders. Taylan et al¹⁹ suggested that NLR can be a marker for the early detection of exacerbations. We consider that NLR changes can be a sensitive laboratory measure for the assessment of recovery from exacerbations.

This study has several limitations. First, we did not enroll patients with unreported exacerbations; thus, the impact of EXACT on unreported exacerbations was not investigated. Many exacerbations are not reported² and many patients suffer from worsening of unreported exacerbations and are treated late. Second, unfortunately, we did not collect baseline EXACT scores at the stable state before exacerbations, although we collected the EXACT scores on day 36 after recovery. Thus, we could not evaluate the relationship among the EXACT scores at baseline at the stable state, during exacerbation, and after recovery. Third, this study was performed in patients with mild-to-moderate exacerbations at outpatient clinic, not in admitted patients with severe exacerbations. Fourth, EXACT was designed and tested as an eDiary on a handheld device, and there are no available data on the performance characteristics of EXACT in the form of a paper–pen diary;³ however, we used a paper–pen diary booklet. Limitations of paper–pen diaries are the inability to determine subjects’ compliance with daily data entry, to track subjects’ entries or compliance in real time, and to prevent skipping items or marking >1 response for the same question.³

Nonetheless, to the best our knowledge, this study is the first report to measure EXACT scores from exacerbation onset to recovery after treatment with antibiotics in COPD patients in a Phase III randomized controlled clinical trial. Furthermore, this is the first report to use the Korean version of EXACT-PRO to assess treatment responsiveness following COPD exacerbations in Korea.

Conclusion

This study shows that the EXACT scores had good internal consistency; decreased significantly after therapy in responders; were significantly correlated with the CAT score; were significantly higher in patients with chronic bronchitis; and in addition, we found that NLR decreased during recovery from exacerbations. Furthermore, we showed that the Korean version EXACT-PRO is valid, reliable, and sensitive to changes during recovery from exacerbations. We suggest the use of EXACT-PRO in patients with COPD exacerbations to assess the efficacy of acute treatment.

Ethics approval and informed consent

This study was approved by all Institutional Review Boards (IRBs) of participating hospitals, including Chungnam National University Hospital IRB. This study was registered with ClinicalTrials.gov number NCT1658020 and Clinical Research Information Service registry number KCT000532. In Korea, there is no main approval IRB system in the case of multicenter study. Each participating hospital needs its own IRB approval. Therefore, this study protocol was approved by the individual IRBs of each hospital enrolling patients. All IRB names are listed as follows: Chungnam National University Hospital IRB, Chonbuk National University Hospital IRB, Chosun University Hospital IRB, CHA Bundang Medical Center IRB, Chungbuk National University Hospital IRB, Kangdong Sacred Heart Hospital IRB, Hanyang University Guri Hospital IRB, Asan Medical Center IRB, Gachon University Gil Medical Center IRB, Catholic University of Korea, Seoul ST Mary’s Hospital IRB, Konyang University Hospital IRB, Gangneung Asan Hospital IRB, Kangwon National University Hospital IRB, Gyeongsang National University Hospital IRB, Kyunghee University Hospital IRB, Korea University Medical Center IRB, Dongguk University Gyeongju Hospital IRB, and Soonchunhyang University Hospital IRB. CNU-IRB file number is 2012-07-013. All patients provided written informed consent. All procedures performed in this study involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.

Data sharing statement

We shall make data available to the scientific community with as few restrictions as feasible, while retaining exclusive use until the publication of major outputs. All available data can be obtained by contacting the corresponding author. Proposals should be directed to [email protected]. To gain access, data requestors will need to sign a data access agreement. Individual participant data that underlie the results reported in this article, after deidentification (text, tables, figures, and appendices), will be made available. Other study-related documents (study protocol, statistical analysis plan, and analytic code) will be made available. Data sharing will be held beginning 9 months and ending 36 months following article publication.

Disclosure

The authors report no conflicts of interest in this work.