1,619
Views
1
CrossRef citations to date
0
Altmetric
Vaccine Safety

Assessment of adherence to pre-vaccination precautions and AEFI reporting practices during BCG vaccination in 4 hospitals in Ghana

ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon &
Article: 2199654 | Received 27 Oct 2022, Accepted 31 Mar 2023, Published online: 01 May 2023

ABSTRACT

The BCG vaccine, like all other vaccines, is associated with adverse events following immunization (AEFI). Reducing the incidence of AEFI is crucial in reposing confidence in BCG vaccination and reducing hesitancy associated with the vaccine. This requires safety precautions before and during vaccinations, as well as reporting AEFIs after vaccination. This study assessed the adherence of health-care professionals to pre-vaccination precautions and adverse events following immunization (AEFI) reporting practices during BCG vaccination in four hospitals in Ghana. It is hoped that the findings of the study will serve as a baseline to identify gaps for further studies to generate a stronger evidence for policy formulation aimed at improving BCG vaccine safety in Ghana and other tuberculosis endemic countries. A cross-sectional study design was employed, and Statistical Package for Social Sciences, IBM® SPSS version 25 (SPSS Inc. USA) software was used for analysis. Chi-square and binary logistic regression tests were used to test the association between categorical variables and predictors of adherence to pre-BCG vaccination precautions, respectively, and a p-value of <.05 was considered statistically significant. The AEFIs commonly reported by mothers included abscess, injection site pain, injection site redness, fever, rash, muscle weakness, diarrhea, vomiting, coughing and rhinitis. Ninety-three participants (73.2%) were adherent to pre-BCG vaccination precautions. Ninety-two participants (72.4%) informed mothers to report all AEFIs encountered. Adherence to pre-BCG vaccination precautions and AEFI reporting were generally good; however, there is still room for improvement.

This article is part of the following collections:
BCG Revaccination

Introduction

One of the major vaccines administered to children less than 5 years of age is the Bacillus Calmette Guḕrin (BCG) vaccine and it is given as soon as possible after birth and considered to be the most widely used vaccine globally. The use of the BCG vaccine is particularly high in poverty-stricken regions of the world where the incidence of tuberculosis is relatively high.Citation1 The BCG vaccine has been used for the immunoprophylaxis of tuberculosis since 1921 and it is prepared from live-attenuated Mycobacterium bovis, a bacterium closely related to Mycobacterium tuberculosis which causes tuberculosis.Citation2 The BCG vaccine induces T-cells and innate immune response against Mycobacterium tuberculosis and other organisms such as Candida albicans and Staphylococcus aureus.Citation3

Several studies have demonstrated that the BCG vaccine is associated with serious adverse events following immunization (AEFI) such as erythema, keloid formation, non-suppurative lymphadenitis and skin ulcers and minor AEFI such as swelling, pruritus, pain, fever, weakness, arthralgia, headache, myalgia, nausea, extranodal injection site abscess and suppurative lymphadenitis.Citation4–6 Aside from these AEFI, one other rare but serious unexpected adverse event associated with the BCG vaccine is anaphylaxis. Anaphylaxis requires immediate management because it is very life-threatening.Citation7 Reducing the incidence of AEFI is crucial in reposing confidence in BCG vaccination and reducing hesitancy associated with the vaccine. This requires safety precautions before and during vaccinations, as well as reporting AEFIs after vaccination.

For this reason, the WHO has set AEFI reporting targets for countries to help in generating vaccine safety signals.Citation8 Risk-benefit analyses following signal generation from AEFI reports could inform decisions aimed at protecting vaccine recipients such as the withdrawal of vaccines or vaccine batches with serious causal AEFI associations. Furthermore, records of vaccine recipients with previous serious AEFIs such as erythema multiforme, Stevens-Johnson syndrome and toxic epidermal necrolysis (TEN) kept for future reference can minimize the probability of recurrence of AEFI.Citation9–13

It has been shown that complications of BCG vaccine especially disseminated infection and its most severe forms are known to occur in immunodeficient vaccine recipients, particularly in Severe Combined Immunodeficiency (SCID). Thus, a carefully taken family history before BCG vaccination as well as delaying vaccination if primary immunodeficiency is suspected could be a simple and effective method to avoid inappropriate vaccination of an immunodeficient baby in some cases until the prospect of newborn screening for SCID has been fully developed.Citation14 A systematic review conducted by Yamoah et al. in 2020 on the safety of vaccines used in routine immunization in Africa showed that there was a high strength of association between BCG vaccine-related AEFI and the BCG vaccine using the Agency for Healthcare Research and Quality guidelines.Citation15 HCPs involved in BCG vaccination could be instrumental in minimizing the incidence of BCG vaccine-related AEFI and treating life threatening outcomes like anaphylaxis while reporting any observed AEFI in a timely manner for causality assessment. This study therefore assessed the adherence of HCPs to pre-vaccination precautions and AEFI reporting practices during BCG vaccination in four hospitals in Ghana. The specific objectives of the study were to determine the level of adherence of HCPs to pre-vaccination precautions, the AEFIs commonly reported after BCG vaccination, the association between study participant characteristics and adherence to pre-vaccination precautions as well as predictors of adherence to pre-BCG vaccination precautions.

It is hoped that the findings of the study will serve as a baseline to identify gaps for further studies to generate a stronger evidence for policy formulation aimed at improving BCG vaccine safety in Ghana and other tuberculosis endemic countries.

Methods

Study design

This study was conducted from 1 July, 2017 to 31 December, 2017 and was cross-sectional in design using a paper-based structured questionnaire.

Study settings

The study was conducted in four hospitals in Ghana with a blend of the levels of healthcare (i.e. primary, secondary and tertiary) located in the middle and southern sectors of the country. The hospitals in the middle sector were the Komfo Anokye Teaching Hospital (KATH), a 1200 bed tertiary health-care facility in Kumasi and the Agogo Presbyterian Hospital (APH), a 200 bed secondary health-care facility, both in the Ashanti region, whereas those in the southern belt were the Tema General Hospital (TGH), a 300 bed secondary health-care facility in the Greater Accra region and the Nagel Hospital (NH), a 70 bed primary health-care facility in the Sekondi-Takoradi metropolis of the western region. KATH serves as a referral center for hospitals in the Ashanti region, the entire northern belt and other neighboring West African countries. The APH is located in the capital town of Ashanti-Akim North Municipal and also serves as the major health-care facility in Agogo as well as a referral center for clinics located in the adjoining towns and villages. It is also one of the vaccine clinical trial sites of Ghana. NH is a mission facility that has been adopted by the government to support the other hospitals where minor medical and surgical cases in the Western region are treated. TGH serves the Tema communities and other surrounding towns in the Greater Accra and Volta regions of Ghana. These sites were selected purposively because of established adverse drug reaction (ADR) and AEFI reporting systems and collaboration with the National Pharmacovigilance Center of the Food and Drugs Authority of Ghana.

Participants

Participants were HCPs at vaccination centers of the selected hospitals were the participants in this study.

Inclusion/exclusion criteria

Vaccination center staff and interns who had been at post for at least 6 months in the various hospitals and consented to partake in the study were recruited. All other HCPs apart from these categories were excluded from the study.

Study sample

The study sample was drawn from four districts in four regions of Ghana. The total population of HCPs involved in vaccination in these four districts at the time of the study were 342. Assuming a margin of error of 5%, a confidence level of 95% and a response distribution of 50% for best responses, a sample size of 182 was estimated for the 368 study population using the online raosoft sample size calculator.Citation16 There were 133 eligible participants for the study based on records from the human resource departments of the various study sites. All these participants were contacted for informed consent.

Data collection tool

A paper-based structured questionnaire was the data collection tool for the study. The tool was prepared by the principal investigator, co-investigators and a public health physician at the vaccination center of one of the study sites, KATH. This tool was prepared after an extensive search of the literature for a standardized data collection tool for collecting information on knowledge, perceptions and practice of AEFI reporting from HCPs. After the search, no standardized data collection tool was found and therefore, reference was made to the portion of the data collection tool assessing HCPs on BCG vaccination practices in a similar study conducted by Masika et al., 2016, in the design of the questionnaire for the current study.Citation17 A seven-stage process was used to validate the questionnaire as follows: initial design of tool, face validity testing, content validity testing, criterion validity testing, development of a yardstick for the tool, assessment of inter- and intra-rater reliability of tool and assessment of inter-rater reliability in situ. A 2 member panel that included a public health physician and a public health nurse assessed the questionnaire for face validity. They were asked to comment in writing on the suitability of the questionnaire while providing any alterations needed to improve its quality. The same panel was asked to assess the content and criterion of the questionnaire using the Delphi techniquesCitation18,Citation19 to avoid the need of panel members to have a face-to-face meeting during the assessment process. Furthermore, another panel of three eminent academic researchers were sought to develop a yardstick to assist in the assessment of reliability of the questionnaire after which two knowledgeable and independent pharmacovigilance professionals were asked to rate the questionnaire by filling a form. After filling the form, the intra-rater reliability indicated a 94% agreement in the reliability of the questionnaire. Lastly, three public health nurses with some basic knowledge in vaccine pharmacovigilance were randomly selected from each study site to try the questionnaire in situ after receiving a 15 minute briefing about the content of the questionnaire by the principal investigator. To minimize bias, total independence was maintained between these raters. An inter-rater questionnaire reliability of 96% was obtained after the exercise. Altman provides a scale of acceptance levels of reliability scores for medical research and reports that an agreement of 80% or more represents a high level of reliability.Citation20 With reference to this scale, the data collection tool was deemed to be suitable for the study.

Data collection

Data was collected by one assigned research assistant with no laboral relationships with the HCPs in each of the hospitals. Prospective participants were contacted by the research assistants at the vaccination centers during working hours (8am–5pm), from Monday to Friday throughout the study period. The questionnaires were then administered to the participants to complete immediately after informed consent. All questionnaires were received on the same day of obtaining consent from participants.

Details of collected data

The questionnaire consisted of 19 questions and was divided into 3 sections. The first section consisted of five questions and was designed to collect socio-demographic data. The second portion which ascertained the adherence to pre-BCG vaccination practices consisted of eight questions, whereas the third section consisted of six questions on AEFI encounter and AEFI training received within the past year.

Data analysis

Collected data were entered periodically into Statistical Package for Social Sciences, IBM® SPSS version 25 (SPSS Inc., USA) software for cleaning and analysis. Descriptive statistical analysis was conducted to generate frequencies, mean and standard deviation. A mark of 1 was allotted for each “yes” response to the eight questions assessing the pre-vaccination precautions taken by staff of the vaccination centers. Thus, a total maximum score of 8 was expected for participants who adhered to all the precautions and 0 for participants who adhered to none of the precautions. The average score was computed, and all participants scoring below the average score were deemed to exhibit an overall non-adherence to pre-vaccination precautions.

A chi-square test was used for tests of association between adherence to pre-BCG vaccination precautions and categorical variables and a p-value of <.05 was considered statistically significant. Binary logistic regression was used to determine the predictors of adherence to pre-BCG vaccination practices using odds ratio at a confidence interval of 95% and a p-value of <.05 was considered significant. All results are summarized in tables.

Ethical considerations

Ethical approval was sought from the Committee on Human Research Publication and Ethics (CHRPE) of the School of Medical Sciences, Kwame Nkrumah University of Science and Technology (KNUST) before the commencement of the study (Reference number: CHRPE/AP/220/17). Before administering the questionnaires, each prospective study participant was given a participant information and consent (PIC) form to complete.

Results

Socio-demographic characteristics of study participants

Out of 133 prospective participants, 127 (95.5%) consented to partake in the study. The mean age of recruited subjects was 28.6 years (SD = 4.20 years) with minimum and maximum ages of 20 years and 51 years, respectively. Moreover, the mean number of years of practicing was 7.9 (SD = 1.4 years) with minimum and maximum years of practice of 1 and 28 years, respectively. There were 18 (14.2%) males and 109 (85.2%) females. Also, there were 76 (59.8%) public health nurses, 28 (22.1%) disease control officers and 23 (18.1%) interns. summarizes the socio-demographic characteristics of study participants.

Table 1. Socio-demographic characteristics of study participants.

Table 2. AEFI reporting practices.

AEFI reporting practices of HCPs

Ninety-one (71.7%) study participants had ever encountered an AEFI in their practice. However, only 64 out of this number (70.3%) had ever reported an AEFI. A total of 11 types of AEFIs yielding a cumulative number of 384 were encountered out of which the highest number of AEFIs was attributed to fever, whereas the lowest was rhinitis. is a detailed description of AEFI reporting practices among study participants.

Table 3. “Yes” responses to pre-BCG vaccination precautions.

Table 4. Relationship between participant characteristics and adherence to pre-vaccination precautions.

Pre-BCG vaccination precautions

The highest pre-vaccination precaution taken was recording of vaccine batch numbers (96.9%) and expiry dates before administration, whereas the lowest was informing parents about the common AEFIs to expect (30.7%). Fifty-two (40.9%) ensured that BCG vaccines were maintained within the cold chain temperature range of 2–8 degree Celsius, 121 (95.3%) checked the expiry dates of BCG vaccines before administration, 62 (48.8%) ensured that the BCG vaccine solution was clear in its ampoule with no color change before administration, 74 (58.3%) ruled out contraindications of the BCG vaccine before administration and 43 (33.9%) ensured the availability of adrenaline anaphylactic pack before BCG vaccine administration. Over 70% of study participants were adherent to pre-vaccination precautions. The highest and lowest pre-vaccination precaution scores were 8 and 3, respectively, with a mean score of 4.7 (SD = 1.6). Details of pre-vaccination precautions are presented in .

Chi-square test of associations

From the chi-square test of associations, the relationship between work location, work experience and the number of trainings on vaccines per year and adherence to pre-vaccination precautions were statistically significant. However, the relationship between age, gender and profession were not statistically significant. Detailed results of the chi-square test of association between participant characteristics and pre-vaccination precautions are as shown in .

Bivariate analysis

Binary logistic regression revealed that work location, age, work experience and the number of vaccination trainings in a year were independent predictors of adherence to pre-BCG vaccination precautions, whereas gender and profession were not. Results of the bivariate analysis are presented in .

Table 5. Bivariate analysis of independent predictors of pre-BCG vaccination precautions.

Discussion

To the best of our knowledge, this is the first study being conducted in Ghana to ascertain whether HCPs involved in BCG vaccination adhere to precautions related to BCG vaccination. The study also assessed BCG vaccine-related AEFI reporting in the same population. According to the WHO, AEFI could be caused by vaccine products.Citation21 Vaccine product integrity after regulatory approval largely depends on cold chain storage since vaccine products are biologic in nature. Vaccine storage outside the optimal range of 2–8 degree Celsius results in irreversible loss to potency and efficiency.Citation22 For this reason, the availability of functional refrigerators and proper cold chain storage systems must always be ensured by HCPs in vaccination centers. In most LMICs, rampant electrical power outages can cause refrigerators to malfunction which may affect cold chain storage of vaccines. As a result, stand-by generators are of the essence in such jurisdictions. Moreover, thermometers in refrigerators must be ensured to be functional at all times. It was observed in this study that about two-thirds of study participants ensured that refrigerators in which vaccines are kept are functional, whereas two-fifths checked whether cold chain temperatures were maintained before administering vaccines. These findings are similar to those of a similar study conducted at primary health-care facilities in Dalocha District in Ethiopia, East Africa, which concluded that there was a gap in vaccine cold chain management among the primary HCPs.Citation23

Checking the expiry dates as well as the color of vaccines before administration are critical activities that safeguard the integrity and potency of vaccines and reduce the incidence of AEFI. Expired or unwholesome vaccines may have a color change that must be carefully examined by HCP administering them. Inadvertently administering expired vaccines could lead to life-threatening AEFI. Moreover, the vaccine recipient risks getting infected with the disease being vaccinated against and spreading it due to lack of protection resulting from impotent vaccine. These effects are not only limited to the BCG vaccine. A July 2018-March 2019 report from the United States Vaccine Adverse Event Reporting System (VAERS) observed that expired injectable influenza vaccines were inadvertently administered to 192 vaccine recipients, which led to 125 AEFI highlighting the need to check vaccine expiry dates before administration.Citation24 In the current study, however, it was observed that more than 95% of the study participants checked the expiry dates of the BCG vaccine before administration which is commendable.

Checking the batch number of BCG vaccines before administration is a very important precaution in identifying batches that may have defects in manufacturing and contamination leading to adverse events. About 97% of the participants in this study checked the batch numbers of the BCG vaccine before administration. This high figure could be explained by the fact that recording the batch number is mandatory in vaccination schedule booklet for infants.

Assessing the immune function of infants before BCG vaccine administration is very crucial because the vaccine strain could replicate abnormally to cause tuberculosis in immuno-compromised infants such as low-birth weight infants, pre-term infants and infants with SCID.Citation14,Citation25 This assessment requires collaboration with the mothers and their gynecologists. It must be emphasized that ruling out contraindications of vaccines could sometimes be laborious as not all past untoward events associated with vaccines may prove beneficial. For example, in infants who are prone to developing an auto-immune disease after vaccination based on a history of BCG vaccination-related AEFI of the parents, past records of its occurrence alone may not be sufficient as autoimmunity may have resulted from a family history of autoimmunity or autoimmune antibodies resulting from a genetic predisposition.Citation26 This shows that genetics has a link with vaccine adverse events and therefore experts in genetics could play a significant role in ruling out possible contraindications of vaccines before administration. There is a growing vaccine pharmacovigilance field called Adversomics which studies the linkage between vaccine adverse events and genetics and this may mark a new paradigm for vaccine safety and design. Developing this area could lead to personalized vaccine design through genetic profiling of the population. Such products are currently being used in the field of oncology and are safer and cheaper.Citation27,Citation28 In the current study, almost two-thirds of the participants assessed the immune function of infants before BCG vaccine administration, which requires significant improvement.

Ensuring the availability of anaphylactic pack including adrenaline during BCG vaccination is a precaution that must not be overlooked by HCPs. In the current study, just a third of the participants took this caution before BCG vaccination. Even though anaphylaxis following BCG vaccination has been found to be rare, its life-threatening potential makes it imperative to prevent it.Citation7

AEFI reporting is important in post-market surveillance of vaccines. Reporting by patients and HCPs is a passive AEFI surveillance approach that seeks to generate more safety information on vaccines even though it is associated with underestimation of actual AEFI.Citation29 Mothers of children who receive BCG vaccines must observe their babies closely and report AEFI promptly to HCPs for causality assessment to be undertaken on those that are severe and life-threatening. According to the WHO, the BCG vaccine could cause BCG immune reconstitution syndrome (IRIS) and eye problems including uveitis, optic neuritis and lupus vulgaris particularly in vaccine recipients with primary immune deficiency syndromes.Citation30 These and other serious BCG-related AEFI have been shown to be associated with the switching of the BCG vaccine and the vaccine manufacturing process. Low AEFI reporting is a problem in most LMICs leading to scanty safety information on vaccines that affects the quality of causality assessment reports.Citation31 HCPs at vaccination centers have the responsibility of educating mothers about both the common and self-limiting AEFIs as well as rare and unexpected ones while urging them to report. In the current study, about 70% of the participants did not inform mothers of infants who received the BCG vaccine and this requires significant improvement.

The number of respondents who had ever reported an AEFI to authorities for further investigation is comparable to that in similar studies conducted in Nigeria and Albania.Citation32,Citation33 However, the AEFI reporting in the current study was higher than that of other similar studies conducted in Kenya and USA.Citation22,Citation34 This shows that poor AEFI reporting is not limited to LMICs. A global systematic review has observed that AEFI surveillance is feasible in both high income and LMICs and can be improved by sharing vital vaccine safety information between these two regions if barriers to surveillance are removed.Citation18 Several studies have identified the barriers of AEFI reporting and these include HCPs considering most AEFIs as irrelevant or unserious, forgetfulness, unavailability of AEFI reporting forms, unfamiliarity with reporting system and time and resource constraints.Citation35–37

Overall, about three-quarters of the study participants were adherent to pre-BCG vaccination precautions. It was observed in the current study that the relationship between work location, work experience and the number of trainings on vaccines per year and adherence to pre-BCG vaccination precautions were statistically significant. This was corroborated by the bivariate analysis that showed that HCPs who received at least three trainings on vaccine safety and surveillance within a year were about five times more likely to adhere to the pre-BCG vaccination precautions than those who received no training at all. Moreover, HCPs working at the highest level of care (KATH) were about 8 times more likely to adhere to these precautions than those working at TGH, a lower level of care. It is therefore imperative for the Expanded Program on Immunization to intensify training on vaccine safety and surveillance across all vaccination centers, particularly in the lower levels of healthcare across Ghana. The frequency of trainings may have to be increased particularly for HCPs with one to 5 years of work experience, as those within this bracket were least likely to adhere to the precaution.

Study limitation

The main limitation of the study is the relatively small sample size that may have affected the sizes of effects measured in the study. A larger study involving many study sites may portray a clearer picture of adherence to pre-BCG precautions and AEFI reporting habits by HCPs. Additionally, due to the inaccessibility of vaccination data such as recorded cold chain temperatures and reported AEFIs associated with the BCG vaccine, information was obtained directly from HCPs. This may have resulted in response bias leading to false positives as HCPs are more likely to report positive outcomes than negative outcomes.

Conclusions

Adherence to pre-BCG vaccination precautions and AEFI reporting were generally good; however, there is still room for improvement. This improvement could be achieved by providing anaphylactic packs with adrenaline in BCG vaccine injection rooms, ensuring that mothers report AEFI after BCG vaccination while intensifying training of HCPs on BCG vaccination and AEFI surveillance.

Transparency declaration

The authors affirm that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as originally planned have been explained.

Acknowledgments

We wish to acknowledge the WHO Collaborating Centre for Advocacy and Training in Pharmacovigilance in Ghana for providing valuable information on vaccine pharmacovigilance in Africa and the world at large.

Disclosure statement

No potential conflict of interest was reported by the authors.

Data availability statement

The datasets generated and/or analyzed during the current study are not publicly available due to confidentiality issues but are available from corresponding author upon reasonable request.

Additional information

Funding

The authors declare that no funding was received to conduct this study.

References

  • Venkataraman A, Yusuff M, Liebeschuetz S, Riddell A, Prendergast AJ. Management and outcome of bacille Calmette Guerin vaccine adverse reactions. Vaccine. 2015;33:5470–8. doi:10.1016/j.vaccine.2015.07.103.
  • Lauring AS, Jones JO, Andino R. Rationalizing the development of live attenuated virus vaccines. Nat Biotechnol. 2010;28(6):573–9. doi:10.1038/nbt.1635.
  • Covian C, Fernandez-Fierro A, Retamal-Diaz A, Diaz FE, Vasquez AE, Lay MK, Riedel CA, Gonzalez PA, Bueno SM, Kalergis AM. BCG-induced cross protection and development of trained immunity: implications for vaccine design. Front Immunol. 2019;10:2806. doi:10.3389/fimmu.2019.02806.
  • Jeena PM, Chagan MK, Topley J, Coovadia HM. Safety of the intradermal Copenhagen 1331 BCG vaccine in neonates in Durban, South Africa. Bull World Health Organizan. 2001;79:337–43.
  • Sellami K, Amouri M, Kmiha S, Bahloul E, Aloulou H, Sfaihi L, Guirat R, Mseddi M, Kamoun T, Hachicha M, et al. Adverse reactions due to the bacillus Calmette-Guerin Vaccine: twenty Tunisian cases. Indian J Dermatol. 2018;63(1):62–5. doi:10.4103/ijd.IJD_327_17.
  • Goraya J, Virdi V. Bacille Calmette-Guerin lymphadenitis. Postgrad Med J. 2002;78(920):327–9. doi:10.1136/pmj.78.920.327.
  • McNeil MM, Weintraub ES, Duffy J, Sukumaran L, Jacobsen SJ, Klein NP, Hambidge SJ, Lee GM, Jackson LA, Irvin SA, et al. Risk of anaphylaxis after vaccination in children and adults. J Allergy Clin Immunol. 2016;137(3):868–78. doi:10.1016/j.jaci.2015.07.048.
  • Lei J, Balakrishnan MR, Gidudu JF, Zuber PLF. Use of a new global indicator for vaccine safety surveillance and trends in adverse events following immunization reporting 2000–2015. Vaccine. 2018;36(12):1577–82. doi:10.1016/j.vaccine.2018.02.012.
  • Cabral D. A guide to contraindications to childhood vaccinations. Can J Infect Dis. 2000;11:13–14.
  • Chahal D, Aleshin M, Turegano M, Chiu M, Worswick S. Vaccine-induced toxic epidermal necrolysis: a case and systematic review. Dermatol Online J. 2018;24:13030/QN5268s.
  • Arvas A. Vaccination in patients with immunosuppression. Turk Pediatri Ars. 2014;49(3):181–5. doi:10.5152/tpa.2014.2206.
  • Hawkridge T, Scriba TJ, Gelderbloem S, Smit E, Tameris M, Moyo S, Smit E, Tameris M, Moyo S, Lang T, et al. Safety and immunogenicity of a new tuberculosis vaccine, MVA85A, in healthy adults in South Africa. J Infect Dis. 2008;198:544–52. doi:10.1086/590185.
  • Jeena PM, Chhagan MK, Topley J, Coovadia HM. Safety of the intradermal Copenhagen 1331 BCG vaccine in neonates in Durban, South Africa. Bull World Health Organ. 2001;79:337–43.
  • Roxo-Junior, Silva J, Andrea M, Oliveria L, Ramalho F, Bezerra T. A family history of serious complications due to BCG vaccination is a tool for the early diagnosis of primary immunodeficiency. Ital J Pediatr. 2013;39:54. doi:10.1186/1824-7288-39-54.
  • Yamoah P, Bangalee V, Oosthuizen F. A review of the safety of vaccines used in routine immunization in Africa. Afr Health Sci. 2020;20(1):227–37. doi:10.4314/ahs.v20i1.28.
  • Raosoft sample size calculator by Raosoft, Inc. http://www.raosoft.com/samplesize.html
  • Masika CW, Atieli H, Were T. Knowledge, perceptions, and practice of nurses on surveillance of adverse events following childhood immunization in Nairobi, Kenya. Biomed Res Int. 2016;2016:3745298. doi:10.1155/2016/3745298.
  • Akins RB, Tolson H, Cole BR. Stability of response characteristics of a Delphi panel: application of bootstrap data expansion. BMC Med Res Methodol. 2005;5:37. doi:10.1186/1471-2288-5-37.
  • deMeyrick J. The Delphi method and health research. Health Educ. 2003;103(1):7–16. doi:10.1108/09654280310459112.
  • Altman DG. Practical statistics for medical research. London: Chapman & Hall; 1991.
  • World Health Organization. Global manual on surveillance of adverse events following immunization [Internet]. Geneva: WHO. 2016 http://apps.who.int/iris/bitstream/10665/206144/1/9789241507769.
  • Piot P, Larson HJ, O’Brien KL, N’kengasong J, Ng E, Sow S, Kampmann B. Immunization: vital progress, unfinished agenda. Nature. 2019;575(7781):119–29. doi:10.1038/s41586-019-1656-7.
  • Feyisa D, Ejeta F, Aferu T, Kebede O. Adherence to WHO vaccine storage codes and vaccine cold chain management practices at primary healthcare facilities in Dalocha District of Silt’e Zone, Ethiopia. Trop Dis Travel Med Vaccines. 2022;8:10. doi:10.1186/s40794-022-00167-5.
  • Hesse EM, Hibbs BF, Cano MV. Notes from the Field: administration of expired injectable influenza vaccines reported to the vaccine adverse event reporting system-United States, July 2018-March 2019. MMWR. 2019;68(23):529–30. doi:10.15585/mmwr.mm6823a3.
  • Biering-Sorensen S, Andersen A, Ravn H, Monterio I, Aaby P, Benn CS. Early BCG vaccine to low birth in infants and the effects on growth in the first year of life: a randomized controlled trial. BMC Pediatr. 2015;15:37. doi:10.1186/s12887-015-0452-2.
  • Vadalà M, Poddighe D, Laurino C, Palmieri B. Vaccination and autoimmune diseases: is prevention of adverse health effects on the horizon? Epma J. 2017;8(3):295–311. doi:10.1007/s13167-017-0101-y.
  • Whitaker JA, Ovsyannikova IG, Poland GA. Adversomics: a new paradigm for vaccine safety and design. Expert Rev Vaccines. 2015;14(7):935–47. doi:10.1586/14760584.2015.1038249.
  • Poland GA, Ovsyannikova IG, Jacobson RM. Adversomics: the emerging field of vaccine adverse event immunogenetics. Pediatr Infect Dis J. 2009;28(5):431–2. doi:10.1097/INF.0b013e3181a6a511.
  • Hu Y, Li Q, Lin L, Chen E, Chen Y, Qi X. Surveillance of adverse events following immunization from 2008 to 2011 in Zhejiang province, China. Clini Vaccine Immunol. 2013;20(2):211–7. doi:10.1128/CVI.00541-12.
  • World Health Organization. Safety of BCG Vaccines. Extract from report of GACVS meeting of 7-8 June 2017, published in the WHO weekly Epidemiological record of 14 July 2017. https://www.who.int/groups/global-advisory-committee-on-vaccine-safety/topics/bcg-vaccines.
  • Laryea EB, Frimpong JA, Noora CL, Tengey J, Bandoh D, Sabblah G, Ameme D, Kenu E, Amponsa-Achiano K. Evaluation of the adverse events following immunization surveillance in Ghana, 2019. Plos One. 2022;17(3):e0264697. doi:10.1371/journal.pone.0264697.
  • Mohammed LA, Aliyu AA, Maiha BB, Isa A. Knowledge, perceptions and reporting attitude of adverse effects following immunization among primary healthcare workers in Sabon Gari local government area Zaria, Kaduna State, Nigeria. Niger J Basic Clin Sci. 2018;15:81–6. doi:10.4103/njbcs.njbcs_18_17.
  • Mehmeti I, Nelaj E, Simaku A, Tomini E, Bino S. Knowledge, practice and approaches of health professionals to adverse events following immunization and their reporting in Albania. Heliyon. 2017;3:e00331. doi:10.1016/j.heliyon.2017.e00331.
  • Hutchinson P, Nelson M, Hill S, Duran L, Engler R. Knowledge, attitude and beliefs (KAB) regarding reporting of adverse events following immunization (AEFI). J Allergy Clin Immunol. 2007;119:S96. doi:10.1016/j.jaci.2006.11.594.
  • Cassidy C, MacDonald NE, Steenbeek A, Ortiz JR, Zuber PL, Top KA. A global survey of adverse event following immunization surveillance systems for pregnant women and their infants. Hum Vaccines Immunother. 2016;12(8):2010–6. doi:10.1080/21645515.2016.1175697.
  • Parrella A, BraunackMayer A, Gold M, Marshall H, Baghurst P. Health care providers’ knowledge, experience and challenges of reporting adverse events following immunization: a qualitative study. BMC Health Serv Res. 2013;13:313. doi:10.1186/1472-6963-13-313.
  • Musa OI, Parakoyi DB, Akanbi AA. Evaluation of health education intervention on safe immunization injection among health workers in Ilorin, Nigeria. Ann Afr Med. 2006;5:122128.