752
Views
0
CrossRef citations to date
0
Altmetric
Clinical / Regulatory

“Direct and indirect impacts of the COVID-19 pandemic on operational conduct of pediatric vaccine clinical trials”

, , , , , , , , , , , & show all
Article: 2272535 | Received 08 Jun 2023, Accepted 15 Oct 2023, Published online: 09 Nov 2023

ABSTRACT

The coronavirus 2019 (COVID-19) pandemic, as well as the resulting public health measures, impacted many aspects of society. The conduct of important pediatric vaccine trials was among these. Analyzing data from six ongoing non-COVID-19 pediatric vaccine trials we aimed to assess the operational impact of the COVID-19 pandemic using descriptive analyses. We identified multiple operational disruptions in trial conduct. Additionally, we identified higher percentages of missed routine vaccinations than investigational vaccines throughout the observation period. Overall, the impact of the COVID-19 pandemic was most apparent early in the pandemic period while adaptations to the pandemic were developed; however, some disruptions persisted throughout the observation period. Pediatric vaccine clinical trials are critical to developing new and/or improved vaccines for the pediatric population. Continued evaluation of the impacts of COVID-19 on pediatric vaccine clinical trials is warranted.

Introduction

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), the etiologic agent of coronavirus disease 2019 (COVID-19), began causing widespread infections throughout the world in January 2020, resulting in the declaration of a global pandemic by the World Health Organization (WHO) on 11 March 2020.Citation1 Many countries instituted government-mandated public health measures, including lockdowns, that had broad impacts on society. These impacts included disruption of clinical trials.Citation2–6 Despite regulatory guidelines instructing the pharmaceutical industry to collect data to evaluate the impact of COVID-19 on the conduct of clinical trials,Citation7 much remains to be learned. Using data from six ongoing pediatric vaccine clinical trials whose conduct bridged the pre-pandemic and pandemic periods, we investigated the potential impact of the COVID-19 pandemic on operational aspects.

Participants and methods

Participants

We evaluated the impact of the COVID-19 pandemic on operational aspects of six ongoing pediatric phase III vaccine trials conducted in infants and toddlers in multiple geographic regions initiated before the declaration of the COVID-19 pandemic in March 2020 (). All six studies were randomized-controlled trials. Study 5 was open label, while the remaining five studies were blinded. Data were collected from the pre-pandemic period, 11 March 2019 to 10 March 2020, through the pandemic period, 11 March 2020 to 27 April 2022 and described by quarter (). The baseline demographics of trial participants, by trial and overall, are described in . Overall, there was an even distribution between males and females. Age at enrollment ranged from 2 to 609 days based on study designs. Most participants were white (82.9%) and not Hispanic or Latino (67.4%). All trials were approved by local Ethics Committees/Institutional Review Boards and conducted in accordance with the Helsinki Declaration of 1975.

Table 1. Trials included in the analyses.

Table 2. Dates for pre-pandemic and pandemic periods.

Table 3. Demographics of trial participants.

Statistical methods

All statistical analyses were descriptive. The impact of COVID−19 on trial conduct were presented by trial, overall (pooled data from the six ongoing studies), and by region (EU, US, UK, and other countries). Categorical variables were summarized and presented by frequency counts and percentages with 95% confidence intervals (CIs). The CIs for the single proportion were calculated using the exact binomial method (Clopper–Pearson method, quoted by NewcombeCitation8).

Results

Overview of COVID-19 pandemic on operational endpoints

We collected data from six ongoing pediatric trials before and during the COVID-19 pandemic. The impact of the COVID-19 pandemic on trial conduct was summarized through the influence on visit procedures, trial completion, and major/critical deviations due to COVID-19 (). Out of a total of 9225 participants with a case report form (CRF), 273 (3%) were diagnosed with COVID-19 during the period from 11 March 2020 to the end of data collection on 27 April 2022. Most participant diagnoses of COVID-19 occurred in Trials 1 (116 participants, 4.1%) and 2 (95 participants, 3.6%). One hundred fourteen participants (1.2%) were impacted by the COVID-19 pandemic with Trials 2 and 5 reporting the highest percentages of participants impacted by the COVID-19 pandemic (2.1% and 2.3% respectively). Furthermore, 93 participants (1.0%) had at least one major/critical protocol deviation due to COVID-19 ().

Table 4. Overview of COVID-19 impact on endpoints.

We further divided the impact on operations into early terminations due to the COVID-19 pandemic, visits not done, visits partially done, participants with at last one procedure out of time window, no procedure done on site, at least one procedure done by phone, and at least one procedure done at participant home ().

Overall, 61 participants terminated the trial early due to the COVID-19 pandemic. This represented 5.4% of total early terminations from all trials. Most COVID-19-associated early terminations were withdrawal by participant’s parent/legally appointed representative (4.7%), followed by protocol deviations (0.6%), and lost to follow up (<0.1%) ().

There were 111 (1.2%) visits not done and 103 (1.1%) visits partially done specifically due to the COVID-19 pandemic. Visits partially done included lack of blood sampling in 41 participants (0.4%) all of whom were from Trial 5. This was, at least partially, due to reallocation of the pediatric phlebotomist to COVID-19-related duties. Vaccinations were not performed for 3 participants (<0.1%), and no solicited safety information was available for 4 participants (<0.1%), which also contributed to partially done visits ().

The COVID-19 pandemic also led to the performance of trial procedures outside protocol-defined time windows. At least one procedure was performed outside of the time window for 324 participants (3.5%), the majority of which were caused by the visit date being out of window for 284 participants (3.1%). Vaccinations were out of time window for 173 participants (1.9%), followed by blood sample out of time window in 115 participants (1.2%). Additionally, due to constraints associated with the COVID-19 pandemic some procedures were performed by phone or at the participant’s home ().

In general, operational aspects of these six ongoing pediatric Phase III vaccine trials were adversely impacted by the COVID-19 pandemic in multiple ways. The extent of operational disruption varied by trial.

Quarterly impact of the COVID-19 pandemic on key operational endpoints

In addition to the overall impact on operations, we investigated the impact of COVID-19 on 5 key endpoints by quarter: 1) percentage of participants diagnosed with COVID-19, 2) percentage of early terminations, 3) percentage of visits not done, 4) percentage of visits only partially done, 5) percentage of participants with at least 1 procedure out of window. The periods of the pandemic quarters Q5-Q13 are defined in . These endpoints varied by quarter. These parameters also varied by trial ().

Figure 1. Overview of COVID impact on endpoints by Quarter. See for dates of quarters (a) percentage of participants diagnosed with COVID-19 (b) percentage of early terminations due to COVID-19 out of total trial early terminations (c) percentage of visits not done due to COVID-19 (d) percentage of visits only partially done due to COVID-19 (e) percentage of participants with at least 1 procedure out of window.

Figure 1. Overview of COVID impact on endpoints by Quarter. See Table 2 for dates of quarters (a) percentage of participants diagnosed with COVID-19 (b) percentage of early terminations due to COVID-19 out of total trial early terminations (c) percentage of visits not done due to COVID-19 (d) percentage of visits only partially done due to COVID-19 (e) percentage of participants with at least 1 procedure out of window.

The highest percentage of participants diagnosed with COVID-19 occurred during quarter Q12, corresponding to the period between 11 December 2021 to 10 March 2022. Trial 1 had the highest percentage of participants diagnosed with COVID-19 during this quarter (1.6%), followed by Trial 4 (1%), Trial 2 (0.9%), Trial 5 (0.6%), and Trial 3 (0.2%). Trial 6 had no participant diagnoses of COVID-19 during this period ().

Early terminations due to the COVID-19 pandemic were highest immediately after the declaration of the global pandemic (quarter 5, 11 March 2020 to 10 June 2020). These occurred at a higher percentage in Trial 5 (7.7%), compared to Trial 1 (1.8%) and Trial 2 (0.9%), while Trials 3, 4, and 6 had no COVID-19-associated early terminations during quarter 5 (). Although Trial 3 had no early terminations due to COVID-19 during quarter 5, it had the highest percentages of COVID-19-associated early terminations for quarters 6–10, ranging from 0.7% to 5.2% (). Of note, there were no early terminations due to the COVID-19 pandemic reported in quarters 11–13 ().

The percentage of visits not performed due to COVID-19 was highest during quarter 8, corresponding to the period from 11 December 2020 to 10 March 2021. During this period 1.4% of participants in Trial 3 missed a visit. Trial 3 also had the highest percentage of visits not performed due to COVID-19 during quarters 6, 7, 9, 10, and 11, while Trial 2 had the highest percentage (0.7%) of visits not done during quarter 5. There were no visits not performed due to COVID-19 during quarters 12 and 13 ().

Most visits partially done due to COVID-19 occurred in Trial 5, ranging from 0.4% to 2.5%. As seen with early terminations and visits not performed, there were no visits partially performed due to COVID-19 during quarters 12 and 13 ().

The percentage of participants with at least 1 procedure out of protocol-defined window was highest during quarter 5 and varied among trials (). Overall, the highest percentage of participants with at least 1 procedure out of protocol-defined window was seen in Trial 3 (6.1%), followed by Trial 2 (5.1%) (). However, they were distributed among quarters 5–11 ().

Throughout the pandemic period, the impact of the COVID-19 pandemic on key operational endpoints varied by quarter and trial. Interestingly, there was limited impact during the latest pandemic periods captured (quarters 12 and 13).

Impact of the COVID-19 pandemic on key operational endpoints by region

We next investigated potential regional differences in the impact of the COVID-19 pandemic on key operational endpoints including, rate of blood draws out of protocol-defined window, rate of vaccinations skipped, rate of vaccinations given out of protocol-defined window, and rate of visits canceled or delayed. In the United States of America (USA – includes Puerto Rico), the rate of blood draws and vaccinations out of protocol-defined window and the rate of visits delayed or canceled were significantly higher in the pandemic period (quarters 5–13), while there was a trend for lower number of vaccinations skipped in the pandemic period (). In contrast the European Union (EU – includes Czech Republic, Finland, Italy, Poland, Romania, Spain, and Sweden), demonstrated no significant difference in the rate of blood draws or vaccinations out of protocol-defined window. However, there was a significant increase in rate of vaccinations skipped and visits canceled or delayed during the pandemic (). The pattern in the United Kingdom (UK) was more like that of the USA with significant increase in the rates of out of window blood draws and vaccinations and rate of visits canceled or delayed, but no significant difference in the rate of vaccinations skipped (). The “Other” region which includes Mexico and Russia demonstrated a significant increase in the rate of blood draws out of protocol-defined window and a significant decrease in the rate of vaccinations skipped in the pandemic period. These changes were likely the result of technical discrepancies with no relationship to the pandemic. There was no significant difference in either the rate of vaccinations out of window or the rate of canceled or delayed visits ().

Figure 2. Pre- and post-COVID operations by region. Green = pre-COVID-19 pandemic, purple = during COVID-19 pandemic. X represents rate, boxes are 95% confidence intervals. (a, e, i, & m) rate of blood draws out of protocol-defined window. (b, f, j, & n) rate of vaccinations skipped. (c, g, k, & o) rate of vaccinations given outside of protocol-defined window. (d, h, l, & p) rate of trial visits canceled or delayed. Regions: United States (US – includes Puerto Rico) A-D. European Union (EU – includes Czech Republic, Finland, Italy, Poland, Romania, Spain, & Sweden) E-H. United Kingdom (UK) I-L. Other (includes Russia & Mexico) M-P.

Figure 2. Pre- and post-COVID operations by region. Green = pre-COVID-19 pandemic, purple = during COVID-19 pandemic. X represents rate, boxes are 95% confidence intervals. (a, e, i, & m) rate of blood draws out of protocol-defined window. (b, f, j, & n) rate of vaccinations skipped. (c, g, k, & o) rate of vaccinations given outside of protocol-defined window. (d, h, l, & p) rate of trial visits canceled or delayed. Regions: United States (US – includes Puerto Rico) A-D. European Union (EU – includes Czech Republic, Finland, Italy, Poland, Romania, Spain, & Sweden) E-H. United Kingdom (UK) I-L. Other (includes Russia & Mexico) M-P.

There were different regional patterns of operational disruption in the pandemic period. However, there were some similarities, particularly between the USA and UK. Notably, the significant decrease in the rate of vaccinations skipped in the pandemic period in the “Other” region is likely due to the higher-than-expected rates of skipped vaccinations during the pre-pandemic period.

Impact on both investigational and routine immunizations by the COVID-19 pandemic

Potential differences between the percent of routine immunizations (non-investigational products) and trial vaccines (investigational products) were also examined. Although the rates of vaccinations skipped varied by Trial, all trials demonstrated equal or higher rates of skipped routine immunizations compared to investigational vaccines (). In Trial 4, there were higher percentages of vaccinations skipped during the pandemic period, mostly consisting of routine immunizations (). Trial 4 corresponds to the EU region in which a significant increase in the rate of vaccinations skipped in the pandemic period was observed (). Importantly, these figures do not include those routine immunizations that may have been performed by the participants’ general practitioner rather than the trial site.

Figure 3. Investigational and routine vaccinations skipped by quarter pre-pandemic and during the pandemic. (a) Trial 1, (b) Trial 2, (c) Trial 3, (d) Trial 4, (e) Trial 5, (f) Trial 6.

Figure 3. Investigational and routine vaccinations skipped by quarter pre-pandemic and during the pandemic. (a) Trial 1, (b) Trial 2, (c) Trial 3, (d) Trial 4, (e) Trial 5, (f) Trial 6.

Overall, the percentages of vaccinations skipped was only higher during the pandemic period in Trial 4, while Trials 1–3 and 5 demonstrated fluctuations throughout the observed time frame. The extremely high percentage of skipped routine immunizations in Trial 6 could not be explained by COVID-19 disruptions.

Effects of public health measures in the UK associated with the COVID-19 pandemic on trial operations

The UK instituted public health measures, including three government-mandated lockdowns, at multiple well-defined times following the declaration of the COVID-19 pandemic ().Citation9 Thus, for Trial 5, we were able to align the timing of trial operation disruptions with the government-mandated lockdowns (). The first lockdown in March 2020 aligned with quarter 5, the second lockdown in November 2020 occurred during quarter 7, and the third lockdown in January of 2021 occurred during quarter 8 (). While trial enrollment began in 2018, enrollment was ongoing at the time data collection commenced until 31 December 2021 (last participant enrolled November 2021). There was a decrease in the number of participants enrolled during the first two pandemic quarters; however, this did not strictly align with the timing of the government-mandated lockdown as the lockdown was in effect during quarter 5 but not quarter 6. Furthermore, there was a resurgence of enrollment during the second government-mandated lockdown occurring during quarter 7, which reached pre-pandemic enrollment numbers (). The other key operational endpoints that were measured in relationship to the government-mandated lockdowns included percentage blood draws out of protocol-defined window, percentage of vaccinations skipped, percentage of vaccinations performed out of protocol-defined window, and percentage of visits canceled or delayed ().

Figure 4. Effects of UK lockdowns on protocol deviations in study 5. (a) timeline of COVID-19 pandemic lockdown measures in the UK. (b) number of participants enrolled through the end of enrollment 31Dec2021. (c) percentage of blood draws out of window. (d) percentage of vaccinations skipped. (e) percentage of vaccinations out of window. (f) percentage of visits canceled or out of window. Yellow line = start of COVID-19 pandemic shaded red boxes = COVID-19 lockdowns in UK.

Figure 4. Effects of UK lockdowns on protocol deviations in study 5. (a) timeline of COVID-19 pandemic lockdown measures in the UK. (b) number of participants enrolled through the end of enrollment 31Dec2021. (c) percentage of blood draws out of window. (d) percentage of vaccinations skipped. (e) percentage of vaccinations out of window. (f) percentage of visits canceled or out of window. Yellow line = start of COVID-19 pandemic shaded red boxes = COVID-19 lockdowns in UK.

While there were significant clinical trial operational disruptions during the pandemic in the UK (), there were no clear associations between lockdown measures in the UK and operational disruptions in Trial 5. It is important to note that only country-wide government-mandated lockdowns were included in this timeline, not accounting for local restrictions that may have been in place during varying periods affecting individual sites.

Discussion

The declaration of the COVID-19 pandemic by the World Health Organization (WHO) occurred on 11 March 2020.Citation1 There were many necessary public health measures, including lockdowns, which resulted in numerous downstream effects. Among these were operational challenges during clinical trials.Citation2,Citation3 Here, we report the results of this analysis of the operational outcomes of multiple randomized studies, specifically the impact of the COVID-19 pandemic on key operational endpoints in six ongoing pediatric non-COVID-19 Phase III vaccine clinical trials in various parts of the world.

Despite high levels of SARS-CoV-2 circulation during the pandemic period, only 3% of trial participants were diagnosed with COVID-19 during the period of data collection. This may represent under-reporting in the pediatric population due to fewer, less severe symptoms or lack of test availability early in the pandemic.Citation10,Citation11 Smit, et al., noted a poor correlation between SARS-CoV-2 symptoms and RT-PCR positivity in children screened in 2020.Citation11 In fact, in this study only 5.6% of children, with or without symptoms, tested positive for SARS-CoV-2 by RT-PCR, while SARS-CoV-2 positivity was 15.5% in asymptomatic caregivers.Citation11 Interestingly, the highest percentage of participants diagnosed with COVID-19, for most trials, occurred during quarter 12 followed by quarter 8 (), which correspond to the emergence of the omicron and delta variant, respectively.Citation1,Citation10 The delta and omicron variants demonstrated higher numbers of cases in children than previous variants.Citation10 Thus, the percentages of participants with diagnosed COVID-19 may reflect the dynamics of circulating variants at the time of data collection.

Bakouny, et al., identified differences in COVID-19 disruptions that were more apparent in academically sponsored oncology trials compared with industry sponsored trials.Citation3 We found no reports of COVID-19 disruptions on vaccine trials by sponsor type. In line with other reports, we demonstrated that the impact of the COVID-19 pandemic on operational endpoints was more notable during the earlier pandemic period.Citation3 This is not surprising given the availability of vaccines against SARS-CoV-2 and reduced restrictive public health measures during the later pandemic period. Operational disruptions following the COVID-19 pandemic were multiple and the relative impact on specific operational endpoints varied by region. This may reflect differences in public health measures, including lockdowns, mask mandates, and social distancing requirements. Alternatively, this may represent differences in risk mitigation strategies instituted by the individual trials.

It is important to consider not only the impact of COVID-19 on the conduct of pediatric vaccine clinical trials, but also the important effects the pandemic had on routine immunization rates.Citation12 We identified higher percentages of missed routine vaccinations than investigational vaccines throughout the observation period; however, an increase following the onset of the pandemic was only obvious in Trial 4. Critically, these data do not include routine immunizations that may have been received at a general practitioner’s office rather than at the trial site. Thus, while there was likely an effect of the COVID-19 pandemic on administration of routine pediatric vaccines, particularly early in the pandemic period, ultimately, in most regions, this effect was not large.

We specifically looked at the potential association of public health mitigation strategies in the UK and operational disruptions of pediatric vaccine clinical trials. As did many countries, the UK instituted government-mandated lockdowns during different phases of the pandemic.Citation9 We selected the UK for these observations due to well documented country-wide lockdowns. Although we did not identify specific associations among national lockdowns and operational disruption, it is important to consider the potential lag in effects between public health mitigation measures and their outcomes, as well as the potential contributions of local/regional government-mandated lockdowns.

Due to the obvious difficulties associated with the major global disruptions from COVID-19 ongoing pediatric clinical vaccine trials have been impacted. The magnitude of the impact was no doubt affected by mitigation strategies developed throughout the pandemic. Critical impacts of this analysis and learning points for the future, includeCitation1 the need for a flexible approach when faced with such unexpected situations,Citation2 working closely with ethics committees and regulators,Citation3 maintenance of open communication with investigators, encouraging them to maintain an open line of communication with study participants, andCitation4 the importance of closely monitoring critical operational parameters during the study recruitment and follow-up phases of the studies allowing the teams to respond early to disruptions. Importantly, during the COVID-19 period, regulators appreciated that disruptions occurred and have been accommodating in working with trial sponsors to modify analysis plans appropriately.

Limitations

Some of the limitations of this analysis include the fact that data were extracted while the trials were ongoing, thus these do not represent the final trial data after database lock. Additionally, the reporting of participants impacted by the COVID-19 pandemic required the sites to appropriately complete an additional form in the CRF potentially resulting in under-reporting. For analysis of the impact on routine immunizations, we are inferring from participants in clinical trials potential impacts on non-participants. Additionally, we were unable to account for routine immunizations that may have been received at locations other than the trial sites.

Conclusions

Although there were many operational challenges associated with the COVID-19 pandemic in ongoing pediatric vaccine clinical trials, the majority of these occurred early in the pandemic period and subsequently resolved. Furthermore, impacts were regional and varied by trial. However, the current analyses did not identify a clear association with specific government-mandated lockdown measures. Through coordinated efforts by the Sponsor, Investigators, and site staff, these studies continued despite the operational challenges imposed by the COVID-19 pandemic, a testament to the hard work and dedication of the teams. The unique assessment of differences in disruption of investigational and non-investigational vaccines contributes to the importance of this manuscript. Additionally, Study 5, conducted only in the UK, allowed examination of the impact of government-mandated lockdowns on pediatric clinical trial conduct.

Disclosure statement

No additional potential conflcit of interest was reported by the author(s).

Additional information

Funding

All the studies described in the manuscript were funded by Sanofi. All the authors are current or ex-employees of Sanofi and may hold shares and/or stock options in the company.

References