Performance evaluation on vaccination rates monitoring report system of Shenzhen, China

ABSTRACT

To evaluate the performance of “Vaccination Rates Monitoring Report System” implemented by Shenzhen CDC, we conducted an analysis of the data quality and identify key areas for system improvement. Following evaluation guidelines provided by WHO and United States CDC, we established six evaluation attributes: representativeness, simplicity, acceptability, data reliability, stability and timeliness. In eastern, central and western regions of Shenzhen, we selected one district from each region, of which the local CDC and ten CHSCs under jurisdiction were chosen for evaluation. On-site inspections, questionnaires survey and interviews were utilized for data collection, while the Likert scale method was used for attributes rating evaluation. A total of 70 participants were surveyed, consisting of 60 CHSCs and 10 CDCs staff. The gender ratio was 1:2.5 (males to females), with the majority falling within the 25–34 age range (46%). Most participants held full-time positions (80%) and had more than 5 years of work experience (62%). The system achieved 100% coverage of all CHSCs and CDCs (100%). The cumulative percentage scores for the overall favorable options of simplicity, acceptability, data reliability, stability, and timeliness were 79%, 85%, 73%, 50%, and 71% respectively. The system operates normally with strong representativeness. Acceptability was rated as “good.” Simplicity, data reliability, and system timeliness were rated as “average,” while system stability was rated as “poor.” Based on these survey results, developers should urgently investigate reasons for poor stability, particularly addressing concerns from CHSCs users. Additionally, the issues and shortcomings identified in other attributes should also be gradually improved.

KEYWORDS:

• Vaccination rates monitoring report system
• system evaluation
• vaccine
• Likert scale
• Shenzhen

Acknowledgments

Linxiang Chen, Ziqi Wang, and Lina Duan contributed to the questionnaire and study design, data collection and analysis, data interpretation, and manuscript writing. Xiaojun Zheng helped in revising and improving writing. FangFang Lu and Huawei Xiong helped develop the study. Data were collected by Jin Liao, Chunmiao Peng, Kangming Chen, and Wenli Zhang. The original draft was written by Linxiang Chen and Ziqi Wang. The article’s final version has been approved by all writers. We expressed our gratitude to immunization clinics for their unwavering assistance with the questionnaire survey. We thanked Mr Yucheng Xu for his assistance with data analysis.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This study was funded by the Science and Technology Planning Project of Shenzhen City, Guangdong Province, China [grant no. JCYJ20210324132003011].