1,646
Views
2
CrossRef citations to date
0
Altmetric
Research Paper

Vaccination induced complacency in adherence to COVID-19 precautionary measures among oral health care professionals in India and the United States: a retrospective pretest-posttest design

ORCID Icon, ORCID Icon, ORCID Icon & ORCID Icon
Pages 5105-5113 | Received 26 May 2021, Accepted 02 Sep 2021, Published online: 06 Oct 2021

ABSTRACT

In the context of the COVID-19 pandemic, vaccination-induced behavioral complacency in adherence to COVID-19 appropriate behavior emerged as a significant concern. This study was conducted among a convenience sample of 540 oral health care professionals in India and the United States. This was a retrospective pretest-post-test design, a choice to eliminate response-shift bias, where the participants responded online on their adherence or otherwise to COVID-19 precautionary measures before and after vaccination. The difference between post-test and retrospective pretest scores was used in assessing the magnitude of complacency demonstrated by the individual as a function of getting vaccinated, and the process was validated using exploratory factor analysis (EFA) with principal axis factoring and confirmatory factor analysis (CFA) on two randomly split subsets of the overall sample. It was observed that there had been a decline in the adherence to all the considered COVID-19 precautionary measures from the time before vaccination to the time of achievement of the fully vaccinated status. EFA performed on the randomly split sub sample of 240 subjects returned a two factor solution with five items in factor 1 and seven items in factor 2. Items in both the factors demonstrated adequate internal consistency in reliability analysis (Cronbach’s alpha 0.84 and 0.82, respectively). The two factor solution obtained in EFA demonstrated good model fit in CFA [RMSEA (90%CI) – 0.077 (0.063–0.092); TLI – 0.872; CFI – 0.897; SRMR – 0.056]. These results highlight the vaccination-induced complacency in observing COVID-19 appropriate behavior among oral health professionals in India and the United States.

Introduction

Since the initial reports of novel human pneumonia outbreak in Wuhan, China in December 2019, which was termed as Wuhan pneumonia,Citation1 basing on the symptomatology and the place of outbreak, the world has witnessed 190.16 million confirmed COVID-19 cases as of 20th July 2021.Citation2 Though the 7-day moving average time series forecasting models predict a downward trend in daily incidence of COVID-19 cases in India and the United States, the magnitude of daily incidence remains an area of significant concern.Citation3 Under these circumstances of increasing transmission and also in light of the possible difficulties for many nations worldwide, on the financial front, to continue implementing non-pharmaceutical interventions such as strict lockdown, vaccination against COVID-19 appears to be quintessential in controlling the infection by generating vaccinal herd immunity.Citation4 Few vaccines have been approved worldwide and a few are under development.Citation5 In the United States, three vaccines have been authorized as on April 7, 2021: Pfizer-BioNTech [BNT162b2/COMIRNATY Tozinameran (INN)]; Moderna [mRNA-1273]; Johnson & Johnson/Janssen [Ad26.COV2.S].Citation6 In India, the Central Drugs Standard Control Organization (CDSCO) authorized Serum Institute of India’s Covishield (ChAdOx1_nCoV19) and Bharat Biotech Limited’s Covaxin for emergency use.Citation7 As of July 27, 2021, 163.2 million people (49.1% of the US population) got fully vaccinated in the United States compared to 94.66 million (6.49% of the Indian population) who completed receiving the second dose of the vaccine.Citation8,Citation9

Despite the assurance on the safety of COVID-19 vaccines being provided by the World Health Organization and various national authorities, vaccine hesitancy remains an area of concern amidst the uncertainties surrounding COVID-19 vaccination such as the possibility of a fully vaccinated individual communicating the infection and the duration for which the vaccine offers protection against SARS-CoV-2.Citation10 However, increasing number of people may get vaccinated in the days to come as suggested by the vaccination trends.Citation8,Citation9 At this juncture, it is important to underscore the fact that the uncertainties regarding COVID-19 vaccination among general public may lead to complacency in the practice of precautionary measures post vaccination. There are various possible endpoints for an efficacious vaccine, which include the reduced likelihood of getting infected, increased chances of being asymptomatic, reduced probability of hospital admissions and subsequent need for intensive care, curtailed incidence of mortality, and downsized transmission rate. If people get too invested into the idea of vaccines being efficacious at any or all of the aforementioned endpoints, the likelihood of vaccinated people following suggested precautionary measures decreases as a function of their belief that the vaccine would offer protection even in case of SARS-CoV-2 exposure; such reduced adherence to COVID-19 precautionary measures among vaccinated people is referred to as vaccination-induced complacency in this paper. As suggested by Su Z et al., vaccine is not yet a silver bullet and safety measures must be followed with extreme caution so as to control COVID-19 transmission.Citation11 As to our knowledge, there were no previous reports on the behavioral changes with regard to COVID-19 precautionary measures among vaccinated people as a function of vaccination. Discerning vaccination-induced complacency at population level is very important in formulating directions for the vaccinated people that are empirically informed. With this background, the primary objective of this study was to document vaccination-induced complacency in adherence to COVID-19 precautionary measures among fully vaccinated oral health care professionals in India and the United States. A secondary objective was to perform initial validation of the COVID-19 vaccination-induced complacency scale.

Materials and methods

Study design

Unlike the conventional pretest and post-test designs, where the study participants are required to respond to a questionnaire before the administration of an intervention or prior to experiencing an event and respond to the same questionnaire after the intervention/experience, a retrospective pretest-post-test design was adopted in this study. In a retrospective pretest-post-test design, the pretest questionnaire is also administered at the same time as the post-test questionnaire. Here, the expression ‘retrospective pretest’ refers to the participants consciously reflecting back to their behavior/attitudes/opinions prior to the occurrence of the event or administration of an intervention. This choice was made to prevent the potential response-shift bias.Citation12,Citation13 Response-shift bias has its roots in the ideological notion that the frame of reference from which the participants respond is dynamic and changes from pretest to post-test. This change in the internal axis of reference from pretest to post-test makes it inappropriate to compare the within subject self-reports in the conventional pretest and post-test designs.Citation14,Citation15 To be more specific, the retrospective pretest questionnaires in this study were administered immediately after the post-test questionnaires, making this a ‘retrospective post-then-pre design.’

Study sample and data collection

This study was conducted in the months of March and April 2021 on a convenience sample of 540 oral health care professionals in India and the United States. Only oral health care professionals who received the second dose of their vaccine for vaccines with two dose series or who received a single dose vaccine (Janssen) at least 2 weeks before participation in this study were included. Ethical approval for the study was obtained from the institutional review board of Sibar Institute of Dental Sciences. The participants’ adherence to COVID-19 precautionary measures was assessed using a 12-item questionnaire administered online. Consent was obtained from the study participants before they could access the study survey form. This questionnaire was developed basing on the recommendations toward protection from COVID-19 made by the World Health Organization.Citation16 An initial set of 18 items was developed to be included in the questionnaire besides demographic data, which was reduced to 12 items after a two round Delphi iteration process with six experts from the disciplines of psychology and community medicine. All the items were administered on a five point semantic differential scale with few items having positive semantic differentials to the left and a few having negative semantic differentials to this end (Annexure 1). However, reverse coding was performed during analysis to transform the data in such a manner that all the positive semantics were to the left, indicating that higher scores represent better adherence.

Estimating behavioral complacency

For each individual, the difference between item-level scores in the post-test and retrospective pretest was identified as the item-level complacency in adherence of the subjects. The item-level complacency scores range from −4 to +4, with −4 indicating extreme complacency post vaccination, +4 indicating thorough caution post vaccination, and zero indicating no change in adherence to COVID-19 precautionary measures with vaccination. For example, a subject who reports that he/she is not at all reluctant to shake hands with others (score 1) post-vaccination, but was extremely reluctant (score 5) before the vaccination receives an item-level complacency score of −4 (post-test score – retrospective pretest score) indicating extreme complacency. Thus the subject-level complacency scores for the 12-item questionnaire ranging from −48 to +48, with ‘extreme complacency’ and ‘thorough caution’ on either ends of the negative to positive spectrum, respectively. Along with the 12-item questionnaire, a single self-rated COVID-19 safety behavior question was administered in both the post-test and retrospective pretest instances.

Study size and statistical analysis

The hypothesis (HA) in this study was that the mean of difference between post-test scores and the retrospective pretest scores of the study participants would differ from zero. If the null hypothesis (H0) was to be true, the mean of difference between individuals’ post-test adherence scores and retrospective pretest adherence scores would be zero. The required sample size was estimated to be 449 using G*power 3.1.9.4 software with an estimated effect size of 0.2, at 1% significance level, and a power of 95%. The sample size of 540 considered in this study is also adequate to perform exploratory and confirmatory factor analyses.Citation17 As suggested by MacCallum RC et al., the final sample was randomly divided into two unequal subsets of 240 and 300 for performing exploratory factor analysis (EFA) and confirmatory factor analysis (CFA), respectively.Citation18 For EFA and CFA, item level complacency scores of the corresponding sub sample of subjects were the input variables. Data were analyzed using IBM SPSS Version 20 software and free software program Classical and Bayesian Instrument Development (CBID) which utilizes the R package lavaan.Citation19 Descriptive statistics, one sample t test to check the null hypothesis that the mean complacency score of the study sample is zero, independent samples t tests for comparing the mean complacency scores based on background characteristics, dependent samples t tests for assessing the item level mean difference between post-test and the retrospective pretest, EFA with principal axis factoring for determining the factor structure, CFA using goodness of fit indices for assessing the construct validity of COVID-19 vaccination induced complacency scale, and multiple linear regression analysis to assess the amount of variance in vaccination-induced complacency scores explained by the participants’ background characteristics were performed to analyze the study data.

Results

The mean age of the study sample was 37.02 ± 11.02 years and the sample consisted of nearly equal number of males (49.82%) and females (50.18%). While majority of the study subjects were oral health care professionals residing in India, nearly one-fifth were oral health care professionals residing in the United States of America. presents the descriptive statistics of the responses provided by the study subjects in the post-test and the retrospective pretest questionnaires. It was observed that there had been a decline in the adherence to COVID-19 precautionary measures from the time before vaccination to the time of achievement of the fully vaccinated status. shows the item level mean complacency scores of the study subjects. The item level mean complacency score was highest for the item ‘coming in close proximity with others.’ The 12-item scale level mean complacency score was −5.79 ± 8.11 (95% CI −6.48 – −5.1; p < .001 one sample t test).

Table 1. Descriptive statistics of the posttest and the retrospective pretest responses (n = 540)

Table 2. Item level complacence scores (n = 540)

In the exploratory factor analysis (EFA) performed on the randomly split sub sample of 240 subjects, the Kaiser-Meyer-Olkin measure of sampling adequacy was 0.894 suggestive of sampling adequacy. Significant results were obtained from the Bartlett’s test of sphericity underscoring the correlation between items included in EFA. shows the screen plot with factors having eigen values >1. Given the cross-loadings demonstrated by few items, promax rotation was employed to delineate the items in a manner that the factors are easily interpreted. presents the pattern matrix of the two factor solution obtained from exploratory factor analysis using promax rotation with Kiaser normalization. All the items demonstrated factor loadings >0.4 (). The two factors were labeled as: ‘Maintenance of and hygiene related to consumable resources’; ‘Interpersonal communication, personal & surface hygiene, and environmental considerations.’ Items loaded into each of the two factors demonstrated good inter-item correlations, which were evident from the Cronbach’s alpha values of 0.849 and 0.82 for factors 1 and 2, respectively. shows the corrected item-total correlations and the internal consistency reliability values for both the factors extracted in EFA. In confirmatory factor analysis (CFA), the factor loadings of the scale items ranged between 0.41 and 0.78. presents the factor loadings of the items in CFA performed using CBID that utilizes the R package lavaan. shows the model fit indices of the CFA model tested. The two factor solution obtained in EFA demonstrated good model fit in CFA performed on a randomly split sub sample of 300 subjects with good internal consistency reliability (Cronbach’s alpha: overall 0.832; factor-1 0.745; factor-2 0.744). The overall scale scores were obtained for all the 540 study participants and differences in scale scores based on gender, previous COVID-19 infection, and country of residence were examined. While there were no significant differences based on gender and previous exposure to COVID-19, subjects living in the United States had a significantly higher complacency score compared to those residing in India (). However, the difference in the complacency scores between oral health care professionals from India and the United States was only marginally significant in multiple linear regression analysis after adjusting for participants’ gender and previous history of COVID-19 infection (). The overall scale score showed significant moderately strong positive correlation with the single self-rated question on COVID-19-related safety behavior (r = 0.506; p < .001).

Table 3. Pattern matrix of the exploratory factor analysis with item-level complacence scores as the items (n = 240)

Table 4. Factor-wise reliability analysis showing corrected item-total correlations and internal consistency reliability values (n = 240)

Table 5. Standardized estimates from classic confirmatory factor analysis (n = 300)

Table 6. Model fit indices of confirmatory factor analysis (n = 300)

Table 7. Differences in overall scale scores based on gender, previous COVID-19 infection, and country of residence (n = 540)

Table 8. Multiple linear regression analysis with COVICD-19 vaccination-induced complacency scale score as the dependent variable

Figure 1. Scree plot showing two factors with Eigen values >1.

Figure 1. Scree plot showing two factors with Eigen values >1.

Discussion

The present study demonstrates the emergence of behavioral complacency in adherence to COVID-19 precautionary measures among oral health care professionals in India and the United States from the time prior to vaccination to the time of achievement of fully vaccinated status. The mean complacency score of the study sample was −5.79 ± 8.11 (95% CI −6.48 – −5.1), and hence the null hypothesis can be rejected in favor of HA. Given the uncertain nature of the disease and the equivocal nature of results on vaccine effectiveness,Citation20 it is imperative that all the WHO suggested precautionary measures be followed religiously in order to contain the COVID-19 transmission. Previously, vaccination complacency was studied on numerous occasions; however, the expression referred to complacency in not getting vaccinated and as one of the fundamental reasons for stagnation in global vaccination rates.Citation21–24 On the contrary, the present study documented behavioral complacency which is supposedly induced by vaccination against COVID-19. Such use of the expression complacency with regard to vaccination was made in the editorial ‘COVID-19 vaccines: no time for complacency’ published by The Lancet in late 2020.Citation25 To our knowledge, this is the first time behavioral complacency has been studied as a function of vaccination. However, it is important to underscore the fact that there could be other factors which are influential on the level of adherence to COVID-19 precautionary measures such as trends in daily incidence of COVID-19 confirmed cases in the corresponding geographies and previous history of successful recovery from COVID-19 which may affect the subject’s fear of the infection and consequently his/her compliance with COVID-19 appropriate behavior. Though the shorter duration of this study does not allow us to account for trends in daily incidence of COVID-19 cases while studying vaccination-induced complacency, the previous history of COVID-19 infection was considered in this study so as to verify the differences in adherence to COVID-19 appropriate behavior between those with and without the previous history of COVID-19 infection. Furthermore, epidemiological data suggest that the daily incidence of COVID-19 cases was on a rise during the study period which rules out the attribution of reduced complacency with precautionary measures to trends in daily incidence. Unlike the previous reports which emphasized on lower compliance with precautionary measures among males,Citation26 the present study showed no differences based on gender in the overall complacency scores. The possible reason for this observation could be that all the participants in the present study are working professionals which necessitates the female participants to assume similar professional roles as males, whereas in the study conducted by Nivette A et al., the participants were only 22 years old with potential gender wise differences in social roles that need to be assumed. However, it is imperative to highlight at this juncture the fact that compliance with suggested precautionary measures and complacency demonstrated over time studied as a function of vaccination are not equivalent constructs. It is also important to discuss the vaccination distrust prevalent in the USA and the anti-vaccine movement being studied.Citation27Amidst these observations, those people who got vaccinated are more likely to endorse the pro-vaccine attitudes and believe in the effectiveness of vaccines more thoroughly. This partly explains the reason why overall complacency scores were higher among participants from USA compared to those from India where people are relatively less choosy about getting vaccinated or otherwise. While this study includes oral health professionals residing in India and the United States who were fully vaccinated by the time they took part, it would have been more interesting had the professionals who rejected vaccination been included in the study too for comparative evaluation. Considerable level of vaccine hesitancy and rejection among dentists is the reason why such comparison would add more value to the proposed hypothesis of behavioral complacency being induced by vaccination.Citation28,Citation29

The 12-item scale evaluated in this study showed adequate psychometric properties. It is to be underscored here that each of these items is an outcome of the difference between post-test and the retrospective pretest scores of the participants, which was termed as item-level complacency. The two factors extracted from EFA were labeled as ‘Maintenance of and hygiene related to consumable resources’ (5 items), ‘Interpersonal communication, personal & surface hygiene, and environmental considerations’ (7 items). Conduct of CFA with this predetermined factor structure showed good model fit indices. Noar SMCitation30 suggested 2-index fit strategy to be reflective of a good model, nevertheless, all the five model fit indices (model chi square, CFI, TLI, RMSEA, SRMR) evaluated in this study suggested a good model fit, which is reflective of the construct validity of the COVID-19 vaccination-induced complacency scale. These model fit indices were reported in accordance with the recommendations made by Kline RB in reporting CFA.Citation31 The overall scale and the individual factors also demonstrated good internal consistency reliability in both the sub samples. Moderately strong positive correlation demonstrated by the scale scores obtained by the individuals with single self-rated COVID-19 safety behavior question is also an indication for the construct validity of the scale. Regardless of the vaccination status, adherence to precautionary measures is quintessential in containing the COVID-19 pandemic. It is time that policy makers and professional bodies underscore the imminent danger that could potentially be posed by the vaccine availability with which COVID-19 susceptibility may get ignored by the virtue of the oversize exuberance surrounding COVID-19 vaccines.

This study indicates the potential for vaccination-induced complacency in compliance to COVID-19 appropriate safety behavior, which gives a heads up on the need to articulate health education materials addressing this issue and the strategic dissemination of the same. The 12-item COVID-19 vaccination-induced complacency scale validated in this study forms an effective tool in the identification of the vaccination-induced complacency, and the use of this scale among communities in order to identify safety measures that are more vulnerable to neglect post vaccination helps the administrators in drafting custom-made educational programs aimed at dismantling the emergence of complacency.

The retrospective pretest – post-test design adopted in this study is postulated to be meritorious over the conventional pretest and post-test designs in preventing response shift bias and obtaining responses from the participants on both the occasions without a shift in the internal axis of reference.Citation14,Citation15 However, this design is not without limitations; memory distortion and social desirability have been discussed to be the limitations associated with response style in retrospective pretest designs.Citation12 Another limitation of this study is that a convenience sample was considered. This may limit the generalizability of the study findings to all the oral health care professionals in India and the United States. Also, the response rate and reasons for nonparticipation could not be elicited owing to the online administration of the survey form among this convenience sample. Nevertheless, in view of the study objectives, we opine that the nature of sampling should not pose a significant threat to the validity of the results. Furthermore, the convenience sample considered in this study could more specifically be termed as a homogenous convenience sample, where, unlike the conventional convenience sample, the sampling was restrained to oral health care professionals with an additional condition of fully vaccinated status with regard to COVID-19.Citation32

Conclusion

Within the limitations of this study, we conclude that behavioral complacency in adhering to COVID-19 precautionary measures as a function of vaccination against COVID-19 has been emerging as a significant concern among oral health care professionals in India and United States. Though these results could not be extrapolated to the general public, there lies a possibility for the manifestation of behavioral complacency post-vaccination among general public as well. This requires immediate attention from the policy makers and the professional bodies and measures should be taken to indoctrinate among oral health care professionals the necessity to carefully adhere to COVID-19 appropriate behavior in spite of vaccination against COVID-19.

Disclosure of potential conflicts of interest

No potential conflict of interest was reported by the author(s).

Supplemental material

Supplemental Material

Download ()

Acknowledgments

The authors sincerely acknowledge the assistance offered by Dr. Vikramsimha Bommireddy., MDS in data collection and the statistical assistance rendered by Mr. N. Hanumanth., M.Sc.,(M.Phil).

Supplementary material

Supplemental data for this article can be accessed on the publisher’s website at https://doi.org/10.1080/21645515.2021.1978794.

Additional information

Funding

The authors did not receive any financial support for this study.

References

Annexure 1.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.