WHO has estimated that 29% of under-five deaths could be prevented with existing vaccines, averting between 2 and 3 million deaths each year globally [1]. Worldwide immunisation coverage showed improvement in the past years; however, the validity of the data for measuring change over time has been questioned [2]. Therefore, accurate immunisation information is essential for decision-makers of the Expanded Program on Immunization (EPI) to track and improve programme performance [3].
Over the past two decades, the government of Ethiopia has invested heavily in health system strengthening, which helped the country remarkably achieve most of the Millennium Development Goal targets. Among the notable achievements, Millennium Development Goal 4 was achieved with a 67% drop in under-five mortality from the 1990 estimate, contributing to an increase in average life expectancy at birth from 45 years in 1990 to 64 years in 2014 [4]. Currently, under the Sustainable Development Goals call to action, Ethiopia agreed to end preventable deaths of newborns and children with the aim to reduce under-five mortality to at least as low as 25 per 1000 live births by 2030 [5].
Ethiopia has a decentralised, three-tier system comprising primary, secondary and tertiary levels of care. The primary healthcare unit, through the health extension programme, which is an innovative community based strategy to deliver preventive and promotive services at community level, is the backbone of the routine immunisation programme [6, 7]. According to the Ethiopian Demographic and Health Survey 2016 report [8], complete immunisation coverage was 38.5% at the national level and 45.8% in the Amhara region. Further, this data generally showed vaccination coverage to be lower than that obtained from the routine service statistics of the Ministry of Health, raising questions of data quality and reporting barriers in the health system. Further, a comparative analysis performed by USAID on immunisation data indicated a 12% disparity in complete vaccination coverage between routine Health Management Information System and survey coverage data, showing data quality problems [9]. Programme data showed the presence of fabricated reports in some facilities due to incentive needs. At district level, the most common challenge was the reporting of data to the next level without or with minimal use or processing [8, 10, 11], with the main implementation barriers being individual and technical level constraints [9].
Ensuring well-coordinated activities to foster high immunisation coverage is dependent on the availability of timely, accurate and complete information pertaining to vaccinations. Thus, the need for multidimensional, accurate and timely information is high in order to address issues related to quality and equity in the health sector. Our argument is that the quality of data and, consequently, that of the information system must be assessed with a broader perspective, focusing on support mechanisms [12, 13] as well as on technicalities (data collection tools and the reporting system).
With this in mind and under the health sector transformation plan, Ethiopia set an ‘information revolution’ as a priority agenda to bring fundamental cultural and attitudinal change regarding the perceived value and practical use of information. However, the prevailing practice in terms of effectively utilising information remains unsatisfactory and the quality of information an unsolved problem in the health sector [14]. Additionally, there is also weak use of data, mostly attributed to the high degrees of fragmentation across multiple parallel information subsystems, a lack of community engagement and severely constrained information system infrastructure and human resources. With the availability of complete and accurate data, data use for evidence-informed decisions could improve data quality [14]. However, the practical utility of health information, as well as how often and how effectively data is used or not, is determined by multiple factors, which can be categorised into three general categories, namely the attitudes and actions of people who produce or use data, the technical aspects of data processes and tools, and the organisational context that supports data processes [15].
Recent studies reported inconsistencies in data reporting as well as poor support mechanisms to ensure data quality at the district level [16]. For example, a study in Nepal found that lower volumes of data were obtained from the facility registers compared to data volumes reported at the district level [17], showing a tendency of over-reporting at higher levels. Other studies showed that errors in reporting were due to a lack of supervision and feedback from the superior levels as well as inadequate incentives to health workers [18, 19]. Further, a study from Uganda showed that there was low information use (24%), which was consistent with the observed limited skills level to interpret (41%) and use information (44%) [20].
A study on the health information system in Ethiopia has shown that data management and use for decision-making were not adequate at lower health system levels, and that data quality assurance and feedback mechanisms were weak [21, 22]. Another study on data verification also revealed that there were incomplete and poor-quality reports across different programmes, compromising decisions and allocation of already scarce resources [11]. A data quality and information use assessment in Ethiopia showed a limited culture of using information for decision-making, where only 37% of the facilities exercised discussion and made decisions using findings from routine health information [12]. Similarly, there was also inadequate supervision and feedback from senior levels to address problems of inadequate documentation, late and incomplete reporting, and inaccurate reporting [12]. In Ethiopia, there have been significant recent investments in establishing and expanding information systems in recognition of the significant role data availability and use play in improving health service delivery. While some of these systems have contributed to the strides made in Ethiopia’s health sector, multiple systems remain fragmented, with highly variable data quality and uneven implementation [23].
The effective use of the data flowing through these systems has not been institutionalised at all levels of the health system and the Federal Ministry of Health’s ability to direct the development of improved functionality is limited. Good health information systems are crucial for addressing health challenges and improving health service delivery in developing countries. In addition, the value of health information is determined by its utilisation in decision-making. However, the quality of the data produced by such systems is often poor and the data are not used effectively for decision-making [24]. In Ethiopia, data quality and utilisation of health information remains weak, particularly at primary healthcare facilities and district levels [25].
The efficient use of health data for decisions and actions to improve the quality of health services and achieve performance goals is the vital ingredient of shared accountability [26]. Among possible organisational and behavioural determinants, decisions based on supervisor directives and managers seeking feedback were found to be determinant factors for data quality [27]. Even though there is existing knowledge of the poor quality of immunisation data and inconsistencies in reporting, to our knowledge, there is not enough comprehensive evidence on how to increase data use in order to improve data quality and enhance accountability.
In this research project, our hypothesis is that low data quality and inconsistent reporting might be due to the low level of data use at each level of the health system. If all those involved in the health system hierarchy use and evaluate the data, data quality might improve. Thus, our overall theory is that increased data use will increase data quality and, in turn, improve accountability in immunisation programme data management. We know from existing evidence that data quality is low, but we do not know the role of data use in evidence-based decision-making as a strategy to alleviate data quality issues not only in immunisation but also in other programmes.
To fill this knowledge gap, we will conduct an implementation science study to identify organisational, technical and individual level factors affecting data use, which in turn affects data quality. The main knowledge needed is the perception and level of use of data for decision-making, data users and producers perceptions, and practice about data use and the role of supervision and community leaders in increasing data use at the community level.
Research question
How can the use of data within the immunisation programme be increased in order to improve data quality and ensure greater accountability?
Objectives
-
1.
To explore how immunisation data is reported and used for decision-making to improve immunisation services.
-
2.
To assess the role of supervisory visits to increase data use, improve data quality and ensure accountability in immunisation programmes.
-
3.
To explore interaction and feedback mechanisms within the health information system actors at district, facility and community level.
-
4.
To explore existing community level engagement approaches that can be leveraged to increase data use, improve data quality and ensure accountability in immunisation programmes.
