Improving Nigerian health policymakers’ capacity to access and utilize policy relevant evidence: outcome of information and communication technology training workshop

Improving Nigerian health policymakers’ capacity to access and utilize policy relevant evidence: outcome of information and communication technology training workshop

 

Chigozie Jesse Uneke^1,2,&, Abel Ebeh Ezeoha^2,3, Henry Uro-Chukwu^2,4, Chinonyelum Thecla Ezeonu^2,5, Ogbonnaya Ogbu^1,6, Friday Onwe^2,7, Chima Edoga^2,8

 

¹Department of Medical Microbiology/Parasitology, Faculty of Clinical Medicine, Ebonyi State University Abakaliki, Nigeria, ²Health Policy & systems Research Project (Knowledge Translation Platform), Ebonyi State University Abakaliki, Nigeria, ³Department of Banking & Finance, Ebonyi State University Abakaliki, Nigeria, ⁴National Obstetrics Fistula Centre, Abakaliki, Nigeria, ⁵Department of Paediatrics, Ebonyi State University Abakaliki, Nigeria, ⁶Department of Applied Microbiology, Ebonyi State University Abakaliki, Nigeria, ⁷Department of Sociology/Anthropology, Ebonyi State University Abakaliki, Nigeria, ⁸Catholic Relief Services (Nigeria Program), Abakaliki, Nigeria

 

 

^&Corresponding author
Chigozie Jesse Uneke, Health Policy & Systems Research Project (Knowledge Translation Platform), Ebonyi State University, Abakaliki, Nigeria

 

 

 

 

All over the world, there is increasing recognition of importance of making health policies with best available evidence. The process which is known as evidence-informed health policymaking is characterized by the systematic and transparent access to, and appraisal of, evidence as an input into policymaking [1]. According to Bowen and Zwi [2], evidence encompasses research, opinion and views of individuals or groups, results of consultative processes and published reports and documents; facts which may be actual or asserted which may be known through experience or observation. However, numerous reports have consistently indicated that evidence from research is among the most reliable category of evidence and can greatly enhance health policy development [3-6]. One of the most challenging aspects of evidence-to-policy link especially in developing countries is the capacity constraints of policymakers to access, synthesize, adapt and utilize available research evidence [7,8]. Studies have shown that one of the major areas of policymakers' capacity constraints in developing world is in the use information and communication technology (ICT) [9]. ICTs have been defined as "tools that facilitate communication and the processing and transmission of information and the sharing of knowledge by electronic means encompassing the full range of electronic digital and analogue ICTs" (9). ICTs have been reported to have greatly improved access to health information, research, literature and training materials, thereby supporting the health research enterprise and enabling comprehensive, evidence-based policymaking [10]. In Nigeria, the lack of adequate knowledge and capacity on the use of ICT by health sector policymakers constitute a major impediment to the uptake of research evidence into the policymaking process [11-13]. Gething and colleagues [14], had observed in their report that in most African setting, there is a paucity of ICT-related knowledge and skills limiting capacities of national health management information systems (HMIS) to generate, analyze and disseminate information for use in decision-making. The United Nations Economic commission for Africa (UNECA) recognized the importance of ICT in the improvement of the health sector in the African region. According to the UNECA report, ICTs have a crucial role to play in improving the effectiveness of the health sector by maximizing the use of scarce knowledge and limited resources as well as bringing life-enhancing knowledge to people in ways they can use, when and where they need it [15]. A number of previous published works have suggested that a relationship exists between effective job performance of a health sector stakeholder (policymaker or service provider) and ICT use [9,10,15]. Therefore to address the competency problem in ICT use by health sector policymakers, there is a dire need for a capacity enhancement training activity for policymakers. This is supported by Peizer [16] who in a paper on strategies to bridge the digital divide, made a case for a significant time and resource commitment to invest in training to enhance ICT competence of those involved in making health policy.

 

 

Aim of the Workshop

 

The aim of this study is to improve the knowledge and capacity of Nigerian policymakers to access and utilize policy relevant evidence via an ICT training workshop. In this workshop, a modified "before and after" intervention study design was used in which outcomes were measured on the eligible population (target participants) both before the programme (intervention) is implemented and after [17]. The difference between the before and after measurements was taken to be the impact of the intervention. (In this instance, the "before"- or "baseline"- measurements served as the control measurements).

 

Study area and participants

 

This research was a sub-national study and participants consisted of individuals whose geographical area of operation is south-eastern Nigeria, with emphasis on Ebonyi State. The target participants were the career health policy makers, this category of policymakers included: health professionals in charge of the health systems; regional, state and local government directors of the health ministry; directors of primary health care at the local government level; health professionals working with specific programmes in the health ministry; staff and consultants involved in public health issues within the health ministry; programme/project managers under the health ministry; chief executive officers of civil society groups, including non-governmental organizations; leaders of national health-based associations (for example, Nigerian Medical Association; National Association of Nigeria Nurses and Midwives; and Pharmaceutical Association of Nigeria). This category of policymakers were selected as key participants in this study because findings from our previous studies [7,18,19] clearly indicate that at the State and Local Government levels, they play the most vital role in "evidence-to-policy" making process. They are the principal actors involved in the generation, collection and assembling of policy relevant information, and processing of data and reports on health-related issues from the different sectors of the health system. They also prepare these into forms that can be submitted for the drafting of policy documents.

 

Ethical consideration

 

Approval for this study was obtained from the Directorate of Research, Innovation & Commercialization (DRIC), Ebonyi State University, Abakaliki Nigeria. The approval was based on the agreement that participation in the research was voluntary following informed consent; that participants' anonymity would be maintained; and that every finding would be treated with utmost confidentiality and for the purpose of this research. These were adhered to in this study.

 

Facilitators

 

A total of five facilitators were engaged in the workshop based on their expertise in the training contents. The facilitators included four senior academics from Ebonyi State University Abakaliki Nigeria and a senior director from the Ministry of Health. The academics included a Professor of infectious diseases and epidemiology with vast experience in intersectoral partnership/ collaboration in health policymaking; the remaining three senior academics have vast experience in evidence-informed policy making and knowledge translation in the Nigeria context. The only policymaker facilitator has vast experience working with the government in the formulation of policy in the south eastern Nigeria.

 

Pre-Workshop tasks

 

A total of 70 policymakers were mapped out for this study. The mapped out participants were divided into two batches of 35 persons each. We organized a two-day intensive health-policy based ICT training workshop at the Ebonyi State University, Information and Communication Technology (ICT) (E-Library) Centre Abakaliki Nigeria, for the policymakers. All the policymakers were invited to the workshop by invitation letters which were sent 2 weeks before the event and was followed-up with a text message reminder to their mobile phones a day before the programme.

 

Programme

 

The first batch of policymakers had their workshop in April 2014, while the second batch had theirs in May 2014. The duration of the workshop each day was five hours from 10am-3pm (with a break between 12:30pm-1pm). A pre-workshop assessment questionnaire (developed in a 4-point likert scale according to the degree of adequacy; 1 = grossly inadequate, 4 = very adequate), was administered prior to actual training to assess the level of knowledge and capacity of the participants on the specific topics to be covered within the theme of the workshop. After the administration of the pre-workshop questionnaire the training commenced and was facilitated by four resource persons (three senior researchers from Ebonyi State University and one senior director from the health ministry). The workshop covered the following topics: (i). Need for intersectoral partnership/ collaboration in health policymaking in Ebonyi State; (ii). Benefits of engaging ICT in evidence-informed policy making for control of infectious diseases of poverty and running the health sector; (iii). Introduction to use of ICT for evidence synthesis;(iv) Development of the capacity of the policymakers on the use of computer, internet and other ICT the following: (a). The search protocol for health information and policy relevant research evidence; (b). Identification of and search strategies for evidence of a wide range of electronic resources, in addition to the traditional scientific and clinical databases (eg., MEDLINE, EMBASE, Cochrane Database, Allied and Complementary Medicine, British Nursing Index, Social Policy and Practice etc); (c). Information/evidence audit to accompany search strategies.

 

All teaching sessions were done using power-point presentation and handouts on each topic were produced and distributed to all participants. It was made mandatory for all lectures to be delivered in simplified, practical and easily comprehensible patterns, with little or no emphasis on complex mathematical or scientific computations/models for the benefit of non-specialists who constituted the majority of the participants. Practical sessions were held during the workshop in which each participant was able to use an internet connected computer to practice the acquisition of research evidence from relevant electronic databases. At the end of the workshop, a post-workshop assessment questionnaire was administered to the participants to evaluate the impact of the workshop.

 

Evaluation

 

The data collected via the questionnaire (developed in a likert scale format) was analyzed using the methods developed at McMaster University Canada by Johnson and Lavis [20]. The analysis is based on mean rating (MNR), median rating (MDR) and range. For instance the figures represent Likert rating scale of 1-4 points, where 1 point=grossly inadequate; 2 points=inadequate; 3 points=fairly adequate; and 4 points=very adequate. In terms of analysis, values ranging from 1.00-2.49 points are considered low, whereas values ranging from 2.50-4.00 points considered high. The Pre-ICT means was compared to the Post-ICT means. The EPi-info software was used for the performance of the data analysis.

 

Outcomes

 

Out of the 70 policymakers and stakeholders invited for the workshop, a total of 52 individuals attended. The official designation attributes as indicated in Table 1 included the following: Programme Officer/Project Secretaries (28.8%); Managers/Heads of Departments (30.8%); Directors/Presidents/Chairpersons (40.4%). A total of 34.6% of the participants have direct influence on the policymaking process, with 51.9% and 30.8% possessing Bachelors and Masters Degrees as highest academic qualifications respectively. The outcome of PRE-ICT knowledge and skill assessment is presented in Table 2, while the POST-ICT knowledge and skill assessment is presented in Table 3. The outcome of the assessment of the impact of the training workshop with the comparison of the PRE-ICT mean and POST-ICT mean is presented in Table 4.

 

Result showed a progressive increase in the POST-ICT mean over the PRE-ICT mean. In terms of the "intersectoral partnership/ collaboration in health policymaking", the PRE-ICT mean ranged from 2.99-3.05, while the POST-ICT mean ranged from 3.37-3.67, with the percentage increase ranging from 14.3%-22.6%. In terms of "engaging ICT in evidence-informed policy making for control of infectious diseases of poverty and in running the health", the PRE-ICT mean ranged from 2.26-2.55, while the POST-ICT mean ranged from 3.14-3.41, with the percentage increase ranging from 25.1%-39.1%. In terms of "knowledge & application of information/communication technology for Internet use", the PRE-ICT mean ranged from 2.21-3.03, while the POST-ICT mean ranged from 2.69-3.51, with the percentage increase ranging from 8.3%-24.1%. Concerning the "use of ICT for evidence synthesis", the PRE-ICT mean ranged from 2.19-2.49, while the POST-ICT mean ranged from 2.67-3.08, with the percentage increase ranging from 16.6%-32.8% (Table 4).

 

Discussion and conclusion

 

The result of this study clearly showed a notable improvement in the knowledge and capacity of the participants regarding the use of ICT to access, synthesize and apply relevant evidence in policymaking. This notable improvement is demonstrated by the tremendous increase in the POST-ICT mean of knowledge/skill over that of the PRE-ICT mean in all the subject areas covered at the training workshop. This outcome suggests that the training workshop strategy we employed in the study, appeared to produce the desired capacity enhancement among the participating policymakers. Evidence that emerged from this study suggests that an ICT training workshop can serve as an intervention mechanism towards improving the ability of policymakers and other stakeholders to use ICT. We observed a similar trend in our previous study [13]. The report of HIFA [21] highlighted the many strategic benefits of training workshops (when used as in-service training) to include: presenting new information to groups of people, practicing new skills and allowing health workers to share experiences and insights. Furthermore HIFA [21] noted that teaching delivered to groups is often thought to be economical and another advantage is that it is thought that adults learn best by sharing of experience, discussion and doing. Gates [22] had earlier indicated that using training workshop a significant impact on skill difference was gained on providers' skills in assessing and managing HIV/AIDS patients. Methods used in the workshops such as the administration of pre-workshop questionnaire and post-workshop questionnaire; general discussions; group works and short presentations have been shown to be very effective in capacity enhancement [23]. The ICT capacity enhancement training workshop was conducted as part of the strategies designed to improve the ability of the policymakers to be able to acquire and assess policy relevant information. The result of our study indicated that "Knowledge about the use of ICT for accessing information for policy making" and "Knowledge about how to address challenges and improve the use of ICT in the health sector" were among the capacity issues that recorded the highest percentage improvement (32.8% and 38.9% respectively) (Table 4). We focused on the improvement of the capacity and skill to use ICT in the health policymaking process because ICTs have been noted to have the potential to make a major contribution to improving access and quality of services while containing costs [9], and could provide fast, efficient and relatively cheap access to information leading to dramatic improvements in access to advice and care [10]. Reports by UNESCO [24] and WHO [25] noted that we are living in what are increasingly referred to as "knowledge societies" which are able to harness the huge amount of information that modern technology such as computers and the Internet allow us to manipulate, store, transmit and share. According to Green and Bennett [26], the skill, therefore, lies in turning all this information into knowledge; and the great challenge is to then use that knowledge-to put it into practice. We designed the ICT training workshop content as a comprehensive capacity enhancement mechanism based on topics that we are convinced have potential to improve the evidence-to-policy link. The topics including engaging ICT in evidence-informed policy making and in running the health sector; knowledge & application of ICT for Internet use, information literacy; defining information problem; searching for information online; and evaluating information have been described as areas requiring capacity strengthening for policy makers in low-income settings [9].

 

In the present study, it is worthy of note that the knowledge of the use of ICT for evidence synthesis improved considerably among the policymakers after the training workshop. The percentage increase ranged from 16.6% to as high as 32.8%. The implication of this is that the policymakers have acquired some abilities to use of ICT for accessing policy relevant information; know the sources of evidence and electronic databases relevant for evidence in policy making; and to search and identify existing research evidence in policy making context; as well as assess the authenticity, validity, reliability, high quality of research evidence. There are numerous reports including randomized controlled trials that have demonstrated considerable improvement in the capacity of health professionals to use ICT effectively to improve healthcare capacity following training/instructional programme/workshops [27-31]. It is based on this premise that a number of international agencies including the United Nations Asian and Pacific Training Centre for Information and Communication Technology for Development's (UN-APCICT) are promoting capacity enhancement on ICT among policymakers [32]. The UN-APCICT has undertaken training workshops for policymakers in a number of countries in Asia and noted that such training programmes can equip government officials with the knowledge and skills they need to fully utilize the potential of ICTs to achieve national development goals and bridge the digital divide [32-35]. Our expectation from this study therefore, is that the enhanced capacity that policymakers have acquired from the training workshop will enable them to seek, advocate for and use available research evidence in the policymaking process. In an earlier report Daly [36], had argued that with enhanced ICT capacity and given the right policies, organization, resources and institutions, ICTs can be powerful tools in the hands of those who make health policy and those working to improve health.

 

 

It is pertinent to state that although notable improvement in knowledge and skill was witnessed in this study among the participants, the study was not without a number of limitations. First, the ICT training workshop lasted only two days. This could be considered rather too short a time duration to assess the real impact of the training. Furthermore the post-workshop assessment that was conducted may not have been very adequate to evaluate the impact of the training skills acquired. A follow-up of participants to see how far they are able to use the skill acquired in the policymaking process would have provided a more excellent evaluation as we observed in our previous study [13]. The findings of this study notwithstanding these limitations have demonstrated that policymakers' ICT competence can be enhanced through training workshops as demonstrated in this study in Ebonyi State Nigeria.

 

 

Authors declare no competing interests.

 

 

CJU & AEE conceived the idea; all authors participated in the development of the idea, project implementation/execution, data collection and analysis. CJU drafted the manuscript; all authors approved the manuscript for publication.

 

 

This investigation received financial support from the UNCICEF/UNDP/World Bank/WHO Special Programme for Research and Training in Tropical Diseases (WHO/TDR), (Reference 2014/397653-0).

 

 

Table 1: attributes of the participants during the ICT Training for the Research Capacity Strengthening and Knowledge Management for policymakers in Ebonyi State Nigeria

Table 2: the Pre-ICT knowledge/skill assessment of participants at the ICT Training for the Research Capacity Strengthening and Knowledge Management for policymakers in Ebonyi State Nigeria

Table 3: the POST-ICT knowledge/skill assessment of participants at the ICT Training for the Research Capacity Strengthening and Knowledge Management for policymakers in Ebonyi State Nigeria

Table 4: comparison of the Pre-ICT and Post-ICT knowledge/skill assessment of participants at the ICT Training for the Research Capacity Strengthening and Knowledge Management for policymakers in Ebonyi State Nigeria

 

 

1. Oxman AD, Lavis JN, Lewin S, Fretheim A. Support Tools for evidence-informed health Policymaking (STP), What is evidence-informed policymaking? Health Res Policy Syst. 2009; 7(Suppl 1); S1. Google Scholar


2. Bowen S, Zwi AB. Pathways to "evidence-informed" policy and practice: a framework for action. PLoS Med. 2005; 2(7):e166. PubMed | Google Scholar


3. Campbell DM, Redman S, Jorm L, Cooke M, Wi AB, Rychetnik L. Increasing the use of evidence in health policy: practice and views of policy makers and researchers. Aust New Zealand Health Policy. 2009; 6: 21. PubMed | Google Scholar


4. Dobrow MJ, Goel V, Upshur REG. Evidence-based health policy: context and utilisation. Soc Sci Med. 2004; 58: 207-217. PubMed | Google Scholar


5. Hanney SR, Gonzalez-Block MA, Buxton MJ, Kogan M. The utilization of health research in policy-making: concepts, examples and methods of assessment. Health Res Policy Syst. 2003; 1: 2-29. PubMed | Google Scholar


6. Innvær S, Vist G, Trommald M, Oxman A. Health policy-makers' perceptions of their use of evidence: a systematic review'. J Health Serv Res Policy. 2002; 7: 239-244. PubMed | Google Scholar


7. Uneke CJ, Ezeoha A, Ndukwe CD, Oyibo PG, Onwe F, Igbinedion EB, Chukwu PN. Individual and organizational capacity for evidence use in policy making in Nigeria: an exploratory study of the perceptions of Nigeria health policy makers. Evid Policy. 2011; 7(3): 251-276(26). PubMed | Google Scholar


8. González-Block MA and Mills A. Assessing capacity for health policy and systems research in low and middle income countries. Health Res Policy Syst. 2003; 1(1): 1. PubMed | Google Scholar


9. Chetley A. Improving Health, Connecting People: the Role of ICTs in the Health Sector of Developing Countries. A Framework Paper: Information for Development Program (Infodev) (2006). Working paper No. 7. Available at: http://www.eldis.org/cf/rdr/rdr.cfm?doc=DOC22557 (Accessed February 19, 2015). Google Scholar


10. Dzenowagis J. Bridging the digital divide: linking health and ICT policy. International development research centre, 2009. Available at: http://www.idrc.ca/en/ev-137417-201-1-DO_TOPIC.html (Accessed February 19, 2015). Google Scholar


11. Alabi GA. Case Study Effectiveness of Informatics Policy Instruments in Africa: Nigeria, Economic Commission for Africa (ECA), 1994. Available at: http://www.uneca.org/aisi/nigeria.htm (Accessed February 19, 2015). Google Scholar


12. Akande JO, Jegede PO. Andragogy and Computer Literacy: The Nigerian Perspective. The African Symposium. 2004; 4; 2. Google Scholar


13. Uneke CJ, Ezeoha AE, Ndukwe CD, Oyibo PG, Onwe F. Enhancing health policymakers' capacity to use information and communication technology in Nigeria. J Health Inform Dev Countr. 2011; 5(2): 228-246. PubMed | Google Scholar


14. Gething PW, Noor AM, Gikandi PW, Ogara E, Hay SI, Nixon MS, Snow RW, Atkinson PM. Improving imperfect data from health management information systems in Africa using space-time geostatistics. PLoS Medicine. 2006; 3; e271. PubMed | Google Scholar


15. United Nations Economic commission for Africa. The African development forum '99: Post ADF summit. Information and communication technology for health sector. 1999. Available at: http://www.uneca.org/adf99/adf99health.htm (Accessed February 19, 2015). Google Scholar


16. Peizer, J. Bridging the digital divide: first you need the bridge. 2000. https://www.socialtext.net/m/page/ourmedia/bridging_the_digital_divide (Accessed February 19, 2015). Google Scholar


17. Purdon S, Lessof C, Woodfield K, Bryson C. 'Research Methods for Policy Evaluation', DWP Social Research Division Working Paper 2 http://research.dwp.gov.uk/asd/asd5/WP2.pdf (Accessed February 19, 2015). Google Scholar


18. Uneke CJ, Ezeoha AE, Ndukwe CD, Oyibo PG, Onwe F. Promotion of evidence-informed health policymaking in Nigeria: bridging the gap between researchers and policymakers. Global Pub Health. 2012; 7(7):750-765. PubMed | Google Scholar


19. Uneke CJ, Ezeoha A, Ndukwe CD, Oyibo PG, Onwe F. Development of Health Policy and Systems Research in Nigeria: Lessons for Developing Countries' Evidence-Based Health Policy Making Process and Practice. Healthc Policy. 2010; 6(1):48-65. PubMed | Google Scholar


20. Johnson NA, Lavis JN. Procedures Manual for the "Evaluating Knowledge-Translation Platforms in Low- and Middle-Income Countries" Study. Hamilton, Canada: McMaster University Program in Policy Decision-Making. 17 June 2009. PubMed | Google Scholar


21. Healthcare for all (HIFA) CHILD2015 Summary: Are workshops effective? 2008. Available at: http://www.hifa2015.org/wp-content/uploads/2008/09/training_workshops_are_they_effective.pdf (Accessed February 19, 2015). Google Scholar


22. Gates JD. Comparison of three types of training on providers skills in assessing and managing HIV/AIDS patients. Int Conf AIDS. 2002 Jul 7-12; 14: abstract no MoPeB3160. PubMed | Google Scholar


23. Poulos RG, Zwi AB, Lord SR. Towards enhancing national capacity for evidence informed policy and practice in falls management: a role for a "Translation Task Group". Aust New Zealand Health Policy. 2007; 4:6. Google Scholar


24. United Nations Educational, Scientific and Cultural organization (UNESCO). Towards knowledge societies. Paris: United Nations Educational, Scientific and Cultural Organization. 2005. Google Scholar


25. World Health Organization. Knowledge translation in global health. Bull World Health Organ. 2006; 84:589-684. PubMed | Google Scholar


26. Green A, Bennett S (editors). Sound choices: enhancing capacity for evidence-informed health policy. Geneva: World Health Organization. 2007. Google Scholar


27. Bradley DR, Rana GK, Martin PW, Schumacher RE. Real-time, evidence-based medicine instruction: a randomized controlled trial in a neonatal intensive care unit. J Med Libr Assoc. 2002;90(2):194-201. PubMed | Google Scholar


28. Cheng GY. Educational workshop improved information-seeking skills, knowledge, attitudes and the search outcome of hospital clinicians: a randomised controlled trial. Health Info Libr J. 2003;20(Suppl 1):22-33. PubMed | Google Scholar


29. Haynes RB, Holland J, Cotoi C, McKinlay RJ, Wilczynski NL, Walters LA, Jedras D, Parrish R, McKibbon KA, Garg A, Walter SD. McMaster PLUS: a cluster randomized clinical trial of an intervention to accelerate clinical use of evidence-based information from digital libraries. J Am Med Inform Assoc. 2006;13(6):593-600. PubMed | Google Scholar


30. Katz SJ, Moyer CA, Cox DT, Stern DT. Effect of a triage-based E-mail system on clinic resource use and patient and physician satisfaction in primary care: a randomized controlled trial. J Gen Intern Med. 2003;18(9):736-744. PubMed | Google Scholar


31. Magrabi F, Westbrook JI, Coiera EW. What factors are associated with the integration of evidence retrieval technology into routine general practice settings? Int J Med Inform. 2007;76(10):701-709. Google Scholar


32. Asian and Pacific Training Centre for Information and Communication Technology for Development (APCICT). UN-APCICT Conducts Training to Strengthen Capacity of South East Asian Policy Makers on ICT for Social and Economic Development. 2010. Available at: http://www.unapcict.org/news/academy-tot-sea (Accessed February 19, 2015). Google Scholar


33. Asian and Pacific Training Centre for Information and Communication Technology for Development (APCICT). Academy of ICT Essentials for Government Leaders: Sub Regional Training of Trainers Workshop- South Asia. 2010. Available at: http://www.unapcict.org/news/events/academy-tot-sa/ (Accessed February 19, 2015). Google Scholar


34. Asian and Pacific Training Centre for Information and Communication Technology for Development (APCICT). Academy of ICT Essentials for Government Leaders: Sub-Regional Training of Trainers Workshop - Western and Central Asia. 2010. Available at: http://www.unapcict.org/news/events/academy-tot-wca/ (Accessed February 19, 2015). Google Scholar


35. Asian and Pacific Training Centre for Information and Communication Technology for Development (APCICT). Academy of ICT Essentials for Government Leaders: Sub-Regional Training of Trainers Workshop- South-East Asia. 2010. Available at: http://www.unapcict.org/news/events/academy-tot-sea/ (Accessed February 19, 2015). Google Scholar


36. Daly J. Information and Communications Technology Applied to the Millennium Development Goals. 2003. http://topics.developmentgateway.org/ict/sdm/previewDocument.do~activeDocumentId=840982 (Accessed February 19, 2015). Google Scholar