Program evaluation 
Updates on the polio surveillance action plan's key performance indicators: East and Southern African countries (January 2022 to December 2023)
Updates on the polio surveillance action plan's key performance indicators: East and Southern African countries (January 2022 to December 2023)
Daudi Manyanga1,&,
Charles Byabamazima1, Brine Masvikeni1, Sarah Wanyoike1
&Corresponding author
The Global Polio Eradication Initiative (GPEI) partners are closely monitoring the progress of the implementation of key strategic activities of the polio eradication strategy for the years 2022-2026. This is being done using the Global Polio Surveillance Action Plan 2022-2024, which includes a set of indicators to track progress. All countries in the ESA sub-region have been informed about these key performance indicators, and the World Health Organization (WHO) is keeping a weekly eye on their implementation. We conducted a descriptive secondary analysis of field Acute Flaccid Paralysis (AFP) surveillance data compiled from 19 countries of East and Southern Africa for the period of January 2022 to December 2023. During the period, Seychelles did not report any AFP case and therefore the country is excluded from the final analysis. A total of 18,078 AFP cases were detected, reported, and verified from nineteen countries in ESA, and we found 8,049 females (44.5%) and males 10,029 (55.5%). This shows a male child was more likely to get AFP compared to a female child (11% difference, p < 0.0001). We noticed a significant increase in prompt AFP cases detection of 4% and an increased number of cases investigated within 11 days from the date of onset of paralysis from 7,790 (89%) in 2022 to 8,246 (91%) in 2023 (2% change, p < 0.0001). The two AFP surveillance quality indicators in the study period rose from 4.4 in 2022 to 4.7 in 2023 (0.3 increase, p < 0.0001). Of the 8,964 AFP stool samples assessed in 2023, 53% were delivered to the national polio laboratories within 72 hours compared to 52% of 8,666 AFP stool samples in 2022 (1% difference, p-value of 0.1838). There is an overall improvement in the Global Polio Surveillance Action Plan (GPSAP) indicators in the ESA subregion for the period of 1 January 2022 to 31 December 2023. We recommend utilizing innovative methods to improve case detections, providing tailored surveillance training to lower levels, and enhancing sample shipment and capacities to process samples timely.
Poliomyelitis is one of the vaccine-preventable diseases affecting mostly children under-fives years of age and the disease was selected for global eradication [1,2]. Since the World Health Assembly (WHA) meeting in 1948 that resolved global polio eradication, several steps and strategies have been implemented so far [3]. The initial strategy was the formation of the Global Polio Eradication Initiative (GPEI) in 1988 and the development of polio eradication strategy from 1988 to 2000 with the goal of eradicating the disease by 2000 [4]. By the end of the first strategy in 2000, a dramatic 99% decline in wild polio cases was observed from over 350,000 cases in 1988 to less than 3500 (2000) in addition to the reduction of polio-endemic countries from 125 (1988) to only 20 by the year 2000 [5]. Among the challenges that were reported to delay the achievement of the planned target were suboptimal vaccination campaign quality, inadequate polio surveillance structures, and routine vaccination coverage. After that, six specific period strategic plans to eradicate polio were developed for 2001-2005, 2004-2008, 2010-2012, 2013-2018, 2019-2023 and the current one of 2022 to 2026 being implemented to address the remaining challenges of polio eradication. Among the major achievements of the global polio eradication initiative was the certification of the WHO African Region on 20 August 2022, as free of the indigenous wild poliovirus in spite of the COVID-19 pandemic disruptions [6]. Nevertheless, the struggle to eradicate polio globally with refined strategies, structures, and systems discussed widely continues to have hurdles towards achieving the global polio eradication goals. Some of the commonly documented challenges include suboptimal immunogenicity of Oral Polio Vaccine (OPV) in certain high-risk settings that are inaccessible, biological risk and genetic instability, lack of political support in certain countries, social conflicts and anti-OPV rumors, challenges in introducing the Inactivated Polio Vaccine (IPV), polio transition challenges, and vaccine supply related challenges [7-10].
At the beginning of 2022, globally only two countries remained endemic to wild poliovirus (Afghanistan and Pakistan) but there was an importation of WPV1 into Malawi and Mozambique [11]. Also, an increased spread of circulating vaccine-derived poliovirus (cVDPV) was reported in three of the six WHO regions and this resulted in the alignment of the polio eradication strategy 2022-2026 into two separate goals, one for the endemic countries and the other to stop cVDPV transmission. This alignment streamlined the focus and targets in better-refined ways compared to the previous strategic plans [12].
The GPEI partners track the implementation of the polio eradication strategy by developing the Global Polio Surveillance Action Plan (GPSAP) 2022-2024 with a set of indicators to monitor progress [13]. The GPSAP comprises six overarching objectives and a set of indicators to monitor timeliness in rapidly detecting any WPV or cVDPV from Acute Flaccid Paralysis cases or environmental samples, rapidly processing the samples to generate prompt results for rapid outbreak response. In addition, environmental surveillance is also implemented in most of the WHO African countries to supplement AFP surveillance [14]. All countries in the ESA subregion were oriented on the GPSAP 2022-2024 key performance indicators in 2022 and the WHO in the subregion is monitoring their implementation every week.
This publication aimed to document the progress of the field polio surveillance using GPSAP indicators in the ESA countries for the period of January 2022 to December 2023. In addition, it provides an opportunity to show and discuss key areas that may need immediate attention to complete the longstanding task of GPEI to eradicate poliomyelitis.
Study design: we conducted a descriptive secondary analysis of field AFP surveillance data compiled from twenty countries of East and Southern Africa (Botswana, Comoros, Eritrea, Eswatini, Ethiopia, Lesotho, Kenya, Madagascar, Malawi, Mauritius, Mozambique, Namibia, Rwanda, Seychelles, South Africa, South Sudan, Tanzania, Uganda, Zambia, and Zimbabwe) for the period of January 2022 to December 2023. In the period, Seychelles did not report any AFP case and therefore is excluded from the analysis.
Variables and measurement: all variables used were obtained from the GPSAP 2022-2024 which were referred to as standard indicators. The following indicators were used to measure country performances: the NP-AFP rate, percentage of stool adequacy, percentage of districts achieved core indicators, and, timeliness in notification, investigation, field activities, and shipment of stool samples to the respective laboratories. Statistical tests were applied to evaluate the levels of statistical significance in performance improvement of the key GPSAP indicators.
Data collection and statistical analysis: the secondary data was collected from the AFP field database, which was shared weekly in Microsoft Access format by the data managers of countries in the ESA-Subregion. Epi Info version 3.5.4 software was used to run queries on the data, eliminate duplicate reported cases, and analyze key variables such as the country of origin, date of onset of paralysis, date of specimen collection (first and second stool samples), date of investigation, date of notification, date of receipt of stool samples at national levels and at the respective polio laboratories, and the condition of the samples received by the laboratory (good or not good).
From the primary variables mentioned secondary variables were computed and summarized in tables of results, these were the NP-AFP rate, percentage of stool adequacy, percentage of districts achieved core indicators, and timeliness in the notification, investigation, field activities, and shipment of stool samples to the respective laboratories. The Statistical Package for Social Science (SPSS) version 16 was deployed to assess the association between each variable´s performances for a similar period January to December 2022 and January to December 2023 and tested for statistical significance at a 95% confidence interval.
Inclusion criteria for study cases: all validated AFP cases that met the WHO standard case definition that had onset of paralysis from 1 January 2022 to 31 December 2023 and were included in the study [2]. The data source was the field AFP database for the 20 ESA countries shared on a weekly basis. A similar information may be retrieved in the polio database Polis.
Exclusion criteria for study cases: any other cases that are not AFP in the database or paralyzed before or after the study period, 1 January 2022 to 31 December 2023. All AFP cases and those with missing key information, for example, the date of notification, were regarded as “missing” while populating and excluded from the AFP notification tables.
A total of 18,078 AFP cases were detected, reported, and verified from nineteen countries involved in the study (Botswana, Comoro, Eswatini, Eritrea, Ethiopia, Lesotho, Kenya Madagascar, Malawi, Mauritius, Mozambique, Namibia, Rwanda, South Africa, South Sudan, Tanzania, Uganda, Zambia, and Zimbabwe) for the period 1 January 2022 to 31 December 2023. Most of the reported AFP cases, 11,141 (62%), were aged less than five years, with a median age of four years. Of the total reported AFP cases, 8,049 (44.5%) were females and 10,029 (55.5%) were males. This indicates that a male child was more likely to get AFP compared to a female child (11% difference, p < 0.0001, 95% CI ranges from 9.54% to 12.45%).
Timeliness of notification: we observed that out of all reported AFP cases for the two years, 11, 416 (66%) were notified within 7 days of onset of paralysis. An increase in notifications was observed from 5,452 (64%) in 2022 to 5,664 (68%) in 2023 (Table 1). This constituted an increase of 4% which was statistically significant with a p < 0.0001 (95% CI ranges from 2.59% to 5.41%). Eleven (57.9%) of countries in the ESA sub-region showed a performance improvement in early case detection (within 7 days), and these included Botswana, Eritrea, Ethiopia, Kenya, Malawi, Mozambique, South Sudan, Rwanda, Tanzania, Uganda, and Zambia. High achievements were noted in Malawi (16%), Zambia (14%), and Ethiopia (8%), while the least achievement was made in Eritrea which shows a 1% increment from 2022 to 2023. Also, we noted country variation where seven countries (Comoros, Eswatini, Lesotho, Madagascar, Namibia, South Africa, and Zimbabwe) presented a decline in performance ranging from 1% (Zimbabwe) to 20% (Comoros) for the study period. In terms of quarterly performances, an achievement of 7% increase was seen in the first quarter of 2023 when compared to the same quarter in 2022 (Table 1).
Timeliness of investigation: we observed that in 2023, 92% of the AFP-reported cases were investigated within 48 hours of notification. However, this indicates a 1% decline when compared to 93% in 2022. This decline is statistically significant with a p-value of 0.0129 (95% CI ranges from 0.21% to 1.79%) and a Chi-square value of 6.178. We also noted country-specific variations in timely investigation, with Eswatini, Malawi, Eritrea, Namibia, Mozambique, Madagascar, and Kenya performing well. On the other hand, delays in investigation after notification were mostly observed in Zambia, Botswana, Mauritius, and Ethiopia when compared to data from 2022 (Table 2).
Timeliness of field activities: a total of 16,036 (90%) AFP cases had two stool specimens collected within 24 hours apart and within 11 days of onset from January 1, 2022 to December 31, 2023. For this performance indicator, we noted a 2% increase from 7,790 (89%) in 2022 to 8,246 (91%) in 2023. It shows a 2% change, p < 0.0001 (95% CI ranges from 1.12% to 2.88%), and is statistically significant. Major achievements in terms of percentage increase in 2023 compared to 2022 were observed in Malawi (17%), Zambia (11%), Eswatini (10%), and Mozambique (6%). Other countries with a relative increase in achievement were Botswana, Ethiopia, South Sudan, and Rwanda. Declined performances were seen in Eritrea, Madagascar, Namibia, South Africa, Tanzania, Uganda, and Zimbabwe. The worst decline of 4% was observed in Namibia in 2023 when compared to 2022 performance, while the rest of the countries mostly had a 1% decline. No percentage changes were noted in terms of indicator performance in Comoros, Kenya, and Lesotho (Table 3).
Core indicators on acute flaccid paralysis surveillance quality: regarding the two AFP surveillance quality indicators in the study period, the average non-polio AFP rate in the ESA subregion rose from 4.4 in 2022 to 4.7 in 2023 (Table 4). This represents a statistically significant change of 0.3, p < 0.0001 (95% CI ranges from 0.234 to 0.366), and a t-statistic value of 8.880. Variation between countries exists whereby performance increment was observed from nine (47.37%) countries: Kenya, Botswana, Zambia, Tanzania, Malawi, Rwanda, Comoros, Mauritius, and Madagascar. On the other side, a decline in performance was noted in Eritrea, Ethiopia, Eswatini, Lesotho, Mozambique, Namibia, South Sudan, Uganda and Zimbabwe. Also, we noted the proportion of districts (or the first subnational levels in Botswana, Comoros, Eritrea, and Mauritius) with populations over 100,000 under fifteen years old children raised from 82% in 2022 to 83% in 2023. This indicates a one percentage change but was not statistically significant, with a p-value of 0.0847 (95% CI ranges from -0.137% to 2.138%) and a chi-square value of 2.972. Major improvements in terms of geographical improvement were observed in Zambia, Zimbabwe, Kenya, Rwanda, South Africa, Mozambique, and Madagascar while a decline was noted in Namibia, Eswatini, Lesotho, Eritrea, Ethiopia, and Uganda.
The percentage of stool adequacy during the study period increased from 89% in 2022 to 90% in 2023 in the ESA subregional average (Table 4). This indicates a statistically significant change of one percentage point, with a p-value of 0.0326 (95% CI ranges from 0.083% to 1.918%) and a Chi-square value of 4.567. We noted country variations, where Botswana, Comoros, Ethiopia, Kenya, Malawi, Mozambique, Rwanda, South Sudan, and Zambia showed improvement in the percentage of stool adequacy upon arrival into the laboratories. However, Namibia, Eswatini, Madagascar, South Africa, Eritrea, Zimbabwe, Uganda, and Tanzania indicated a decline in stool adequacy over the study period.
Regarding subnational performance evaluation of stool adequacy, we noted no variation for the two years of 2022 and 2023 at the ESA sub-regional level. However, variations exist between countries, with increased performance observed in Malawi, Comoros, Botswana, Zambia, Mozambique, South Sudan, and Ethiopia, while a decline was observed in Namibia, Eritrea, Zimbabwe, Uganda, Madagascar, Tanzania, Kenya, and South Africa (Table 4).
Timeliness of stool specimen shipment: a total of 17,630 AFP cases stool samples were assessed and we noted that 53% were delivered to the national polio laboratories within 72 hours during the study period. We noted an increase in the proportion of stool samples that were delivered within 72 hours to the polio laboratories from 52% in 2022 to 53% in 2023 (Table 5). This shows a one percentage change which is not statistically significant, with a p-value of 0.1838 (95% CI ranges from -0.474% to 2.474%) and a Chi-square value of 1.767.
It was observed that there were differences in the way shipments were being handled across various countries. Improvements were made in the shipment process in Rwanda, Mozambique, Malawi, Kenya, Tanzania, and South Africa, while the shipment process declined in Ethiopia, Namibia, Zambia, Mauritius, Botswana, Uganda, Madagascar, and Lesotho. Additionally, it was noted that there were quarterly variations, where most stool samples arrived beyond 72 hours in the respective polio laboratories during the second quarter in 2023 and the third quarter in 2022 (Table 5).
In our study, we noted that in some countries, delayed notification contributed to the delays of the entire field surveillance timeliness and quality indicators. The previous studies in the ESA sub-region indicated improvement in the core quality surveillance indicators over the period before the COVID-19 pandemic and declined performance in 2020 in the COVID-19 pandemic peak seasons [15,16]. We noted that the countries that were performing well before the COVID-19 pandemic, during the pandemic, and after post-pandemic continue to be the same. Also, countries with outbreaks such as Malawi, Botswana, Zambia, Mozambique, and Rwanda had shown the impact of the surge support in the period while Madagascar, Tanzania, and Zimbabwe had not shown a relativity of performance improvement in GPSAP indicators. We also noted a dramatic performance decline in Namibia, Eritrea, Uganda, and South Africa over the study period, and therefore a special intervention would be advisable to accelerate the reversal of the adverse trend among these countries.
We have observed an improvement in the timely notification of cases, which is a positive development towards achieving the key indicators of the GPSAP 2022-2024. This improvement helps in detecting and investigating cases promptly, with stool samples collected for confirmation and response, as necessary. Countries with weaker surveillance structures and systems require interventions such as community sensitization and engagement, including community-based healthcare service delivery points. In countries facing civil unrest or instability, the use of community informants may be an innovative way to increase and sustain the AFP case detection rates.
Also, we noted that the improvement of field surveillance timeliness in the subregion was an achievement attributable to the various trainings, weekly performance feedback, and support given by the polio surge teams in some countries with outbreaks. We suggest a critical review to document the impact of availing and removing polio surge support before and after outbreak response in countries to contribute towards the sustainable strategic approaches of the achievements made at the heightened support. The observation for field surveillance timeliness in good and sub-optimally performing countries showed similar findings. Nonetheless, we also noted the need for cascading initiatives applied to countries at national levels to the subnational levels since a sizable number of countries that showed good performances at national averages also had performance gaps at subnational levels.
In the last quarter of 2023, almost all indicators showed improvement, which could be attributed to the physical, face-to-face capacity building conducted at the sub-regional and regional levels. Due to the COVID-19 pandemic, virtual training was mostly used for capacity building, including GPSAP orientation. Previous studies have suggested that virtual realities are as effective as physical realities in training and simulations, especially in low-resourced countries that may be used in the last miles for the polio eradication [17]. These findings seem to be more conclusive if applied in a controlled setting, such as with medical students, where long-term memory retention has been observed to be reliable. However, for adults, individual motivation and perceived value of the training remain questionable due to divided attention while attending virtual meetings [18,19]. In this regard, a mix of face-to-face and virtual reality may be an option for capacity building for vaccine-preventable diseases (VPDs) to see sustained impact towards and after the eradication goal achievement.
Study limitations: we were not able to predict some indicators in countries where the dates were missing in the shared database. In addition, any information on AFP cases delayed being reported by 31 January 2024 was not included in the study. We did not cover the laboratory and ES indicators, a substantial proportion of results for 2023 were still in the laboratory, and by 31 January 2024, the available data could not be sufficient to reflect the reality of the year. Also, in Botswana, Comoros, Eritrea, and Mauritius because of the low population at the lowest administrative levels, we used the first subnational level for calculating quality indicators for geographical distribution. Countries have recovered from the effects of the COVID-19 pandemic with different support mechanisms - and these are not well known.
There is an overall improvement in the GPSAP performance indicators in the ESA subregion for the period of 1 January 2022 to 31 December 2023. There is also performance improvement in the early detection of AFP cases within 7 days of onset of paralysis, timely investigation after notification, timeliness of AFP surveillance activities within 11 days of onset of paralysis in the ESA sub-region, and shipment of stool specimens within 72 hours. We noted countries' variations and suggested the use of innovations in AFP case detections, cascading surveillance training to lower levels, and improved shipment of samples by increasing the number of polio laboratories with capacities to process stool samples. We also noted gaps in some countries especially at subnational levels and advice on the critical surveillance structures reviews to determine and mitigate identified issues. More efforts are needed to ensure all key field performance indicators are achieved in the highlighted countries and maintained towards polio eradication and beyond.
The authors declare no competing interests.
Daudi Manyanga conceptualized and designed the study, and constructed the background information, study analysis, interpretation, discussion, critical review, and organization of the entire manuscript for publication; Charles Byabamazima participated in the study analysis, interpretation, discussion, and critical review of the manuscript for publication; Sarah Wanyoike participated in the study analysis, interpretation, discussion, and review of the manuscript; Brine Masvikeni compiled the data and participated in the data analysis. All the authors read and approved the final version of this manuscript.
We acknowledge efforts made by all surveillance officers and data managers from Ministries of Health, WHO, and other partners in the ESA countries for their untiring efforts till polio is eradicated.
Table 1: distribution of the reported acute flaccid paralysis cases within 7 days of onset of paralysis by country in the ESA subregion from January 2022 to December 2023 (n=17,290)
Table 2: distribution of the acute flaccid paralysis cases investigated within 48 hours of notification by country in the ESA subregion from January 2022 to December 2023 (n=17,161)
Table 3: distribution of the reported acute flaccid paralysis cases with two-stool specimens collected within 24 hours apart and within 11 days of onset by country in the ESA subregion from January 2022 to December 2023 (n=17,756)
Table 4: the pattern of the non-Polio acute flaccid paralysis rate, percentage of stool adequacy, and proportion of districts achieved the quality indicators' targets by country in the ESA subregion from January 2022 to December 2023 (n=18,078)
Table 5: analytical summary of stool specimens from acute flaccid paralysis (AFP) cases collected within the three days following the collection, to WHO-accredited laboratories by country in the ESA sub-region, from January 2022 to December 2023 (n=17,630)
- Centers for Disease Control and Prevention. Epidemiology and Prevention of Vaccine-Preventable Disease. Washington, DC Public Health Foundation. 2021;14:275-286. Accessed January 2, 2024.
- World Health Organization. Polio: Vaccine Preventable Diseases Surveillance Standards. 2018:1-16.
- Aylward B, Tangermann R. The global polio eradication initiative: lessons learned and prospects for success. Vaccine. 2011 Dec 30;29 Suppl 4:D80-5. PubMed | Google Scholar
- Wright PF, Kim-Farley RJ, de Quadros CA, Robertson SE, Scott RM, Ward NA et al. Strategies for the global eradication of poliomyelitis by the year 2000. N Engl J Med. 1991 Dec 19;325(25):1774-9. PubMed | Google Scholar
- World Health Organization. Progress towards the global eradication of poliomyelitis, 2001. Wkly Epidemiol Rec. 2002 Mar 29;77(13):98-107. PubMed | Google Scholar
- Africa Regional Commission for the Certification of Poliomyelitis Eradication. Certifying the interruption of wild poliovirus transmission in the WHO African region on the turbulent journey to a polio-free world. Lancet Glob Health. 2020 Oct;8(10):e1345-e1351. PubMed | Google Scholar
- Kew O. Reaching the last one per cent: progress and challenges in global polio eradication. Curr Opin Virol. 2012 Apr;2(2):188-98. PubMed | Google Scholar
- Kew O, Pallansch M. Breaking the Last Chains of Poliovirus Transmission: Progress and Challenges in Global Polio Eradication. Annu Rev Virol. 2018 Sep 29;5(1):427-451. PubMed | Google Scholar
- Patel M, Cochi S. Addressing the Challenges and Opportunities of the Polio Endgame: Lessons for the Future. J Infect Dis. 2017 Jul 1;216(suppl_1):S1-S8. PubMed | Google Scholar
- Alonge O. What can over 30 years of efforts to eradicate polio teach us about global health. BMC Public Health. 2020 Aug 12;20(Suppl 2):1177. PubMed | Google Scholar
- Lee SE, Greene SA, Burns CC, Tallis G, Wassilak SGF, Bolu O. Progress Toward Poliomyelitis Eradication - Worldwide, January 2021-March 2023. MMWR Morb Mortal Wkly Rep. 2023 May 12;72(19):517-522. PubMed | Google Scholar
- World Health Organisation. Polio Eradication Strategy 2022-2026: Delivering on a promise. Geneva: World Health Organization. 2021;7-28.
- World Health Organization. Global Polio Surveillance Action Plan 2022-2024. Geneva: World Health Organization. 2022. Google Scholar
- Global Polio Eradication Initiative. Guidelines on Environmental Surveillance for Detection of Polioviruses no. 2015;1-4. Google Scholar
- Manyanga D, Byabamazima C, Masvikeni B, Daniel F. Assessment of acute flaccid paralysis surveillance performance in East and Southern African countries 2012 - 2019. Pan African Medical Journal. 2020 Jun 8;36:71. PubMed | Google Scholar
- Manyanga D, Masvikeni B, Kuloba M, Byabamazima C, Daniel F. Early effects of the COVID-19 pandemic on the acute flaccid paralysis surveillance in East and Southern African countries. Pan African Medical Journal. 2021 Jun 24;39:147. PubMed | Google Scholar
- Javaid M, Haleem A. Virtual reality applications toward medical field. Clin Epidemiol Glob Heal. 2020;8(2):600-605. Google Scholar
- Olivet J, Zerger S, Greene RN, Kenney RR, Herman DB. Online Versus Face-To-Face Training of Critical Time Intervention: A Matching Cluster Randomized Trial. Am J Distance Educ. 2016;30(4):237-249. PubMed | Google Scholar
- Bertram J, Moskaliuk J, Cress U. Virtual training: Making reality work? Computers in Human Behavior. 2015;43:284-292. Google Scholar