Skip to main content
Download PDF
Download ePub

Assessing the usefulness of policy brief and policy dialogue as knowledge translation tools towards contextualizing the accountability framework for routine immunization at a subnational level in Nigeria

Health Research Policy and Systems volume 19, Article number: 154 (2021) Cite this article

Abstract

Background

Evidence suggests that implementing an accountability mechanism such as the accountability framework for routine immunization in Nigeria (AFRIN) will improve routine immunization (RI) performance. The fact that the AFRIN, which was developed in 2012, still had not been operationalized at the subnational level (Ebonyi State) by 2018 may in part account for the poor RI coverage (33%) in 2017. Knowledge translation (KT) is defined as the methods for closing the gaps from knowledge to practice. Policy briefs (useful in communicating research findings to policy-makers) and policy dialogues (that enable stakeholders to understand research evidence and create context-resonant implementation plans) are two KT tools. This study evaluated their usefulness in enabling policy-makers to contextualize AFRIN in Ebonyi State, Nigeria.

Methods

The study design was cross-sectional descriptive with mixed-methods data collection. A policy brief developed from AFRIN guided deliberations in a 1-day multi-stakeholder policy dialogue by 30 policy actors. The usefulness of the KT tools in contextualizing policy recommendations in the AFRIN was assessed using validated questionnaires developed at McMaster University, Canada.

Results

At the end of the policy dialogue, the policy options in the policy brief were accepted but their implementation strategies were altered to suit the local context. The respondents’ mean ratings (MNR) of the overall usefulness of the policy brief and the policy dialogue in contextualizing the implementation strategies were 6.39 and 6.67, respectively, on a seven-point Likert scale (very useful). The MNR of the different dimensions of the policy brief and policy dialogue ranged from 6.17 to 6.60 and from 6.10 to 6.83, respectively (i.e. moderately helpful to very helpful).

Conclusion

The participants perceived the KT tools (policy brief and policy dialogue) as being very useful in contextualizing policy recommendations in a national policy document into state context-resonant implementable recommendations. We recommend the use of these KT tools in operationalizing AFRIN at the subnational level in Nigeria.

Peer Review reports

Background

Routine immunization (RI) remains one of the “best buys” in public health interventions. It is a very cost-effective intervention in preventing child death and eradicating or reducing causes of childhood morbidity [1,2,3]. According to Liu et al., vaccine-preventable diseases constitute almost one third (29%) of all deaths among under-5-year-old children globally [4]. World Health Organisation (WHO) estimates that immunization prevents 2–3 million deaths every year mainly from diphtheria, pertussis, tuberculosis and measles [5]. Nigeria has the third highest infant and under-5 child mortality rates (70/1000 and 120/1000 live births, respectively) in the world, contributing nearly 10% of the total global burden of child mortality [6]. Research evidence confirms that states and regions of the country with the lowest RI coverage have the highest infant and under-5 mortality rates [7,8,9,10,11]. In Ebonyi State, the infant mortality rate is 67/1000 live births, while the under-5-year mortality rate is 132/1000 live births [11].

Several recent studies have identified lack of accountability and weak governance as an overarching bottleneck contributing to the poor RI performance observed in Nigeria [12,13,14,15]. These manifest in ineffective supply chain and logistics, poor service delivery, inadequate human resources, poor data quality, weak demand and funding constraints.

In response to the need for an accountability framework for results-based performance monitoring in RI, the accountability framework for RI in Nigeria (AFRIN) was developed by the Federal Ministry of Health in 2012. This framework was to be adopted and operationalized by the states at the subnational level. The document clearly identified roles and specified who does what in RI management, both across levels of government and within an administrative level. It also specified sanctions and incentives to help enforce the framework. It is envisaged that effective implementation of this framework, especially at the subnational level, will improve RI coverage and lead to better maternal and child health indices in Nigeria. To the best of our knowledge, since the framework was developed, there has been limited operationalization at the subnational level in Nigeria. Anecdotal evidence suggests that the delayed operationalization may have been due to political factors and donor-driven programming of immunization activities.

Knowledge translation (KT) is a process whereby stakeholders are made aware of research evidence and use it to inform decision-making [16]. KT tools such as policy briefs and dialogues have been shown to be useful in facilitating evidence-informed policy development and implementation [17, 18]. Policy briefs are short documents that are used to present the findings and recommendations of a study to readers who area non-specialists [19]. These briefs are recommended mostly as a means of communicating research findings to policy-makers [19]. Policy dialogue in particular is useful in achieving stakeholder understanding of research evidence and drafting of implementation plans. [17].

In initiating the operationalization of AFRIN in Ebonyi State, Nigeria, a policy dialogue structured around a policy brief developed from the AFRIN was convened.

The aim of this study was to evaluate the use of a policy brief and dialogue as KT tools towards contextualizing the AFRIN in Ebonyi.

Methods

Description of study area

This study was conducted in Abakaliki, the capital of Ebonyi State, which is one of the five states in the South East geopolitical zone in Nigeria. The state has total land area of 5536 km2, with a population in 2017 of 2 943 233, projected from the 2006 census of 2 176 943 at an annual growth rate of 3.2%. With a population density of 390/km2, it is one of the most densely populated states in the country. As evidenced by a gross domestic product (GDP) of US $2.732 billion as of 2010 [20], Ebonyi State has made tremendous progress in all aspects of its economy in recent times.

Study population

The participants included key stakeholders (policy actors) in the RI programme in Ebonyi State. The target group for this study comprised career health policy-makers [21], political (appointed and elected) health policy-makers, state coordinators/heads of United Nations (UN) agencies and other development partners responsible for immunization, health policy and systems researchers from the African Institute for Health Policy & Health Systems, and chief executive officers of member organizations of the Association of Civil Society Organizations for Malaria, Immunization and Nutrition (ACOMIN).

Study design

This was a cross-sectional descriptive study [22] implemented in two phases:

  1. 1.

    Developing a KT tool (policy brief) from a national policy document—the National Routine Immunization Strategic Plan 2013-2015 (NRISP) containing the AFRIN—and convening a policy dialogue structured on the policy brief to align the policy recommendations in AFRIN to the context of Ebonyi State.

  2. 2.

    Evaluating the usefulness of the KT tools in contextualizing the recommendations in the national policy document.

Sample size and sampling technique

The study included 30 participants. These were identified and recruited purposively through stakeholder mapping and consultation with key stakeholders in the state RI landscape. Consultations were done using physical visits and phone calls. Although 45 potential participants were identified and invited during the consultation, only 30 participated in the policy dialogue and answered the questionnaire.

Development of the policy brief

Possible policy options to enhance accountability in RI implementation as enumerated in the NRISP [23] were identified, and a literature review was carried out to evaluate these options and identify which ones were sufficiently supported by evidence.

The options found to be viable were selected and used to draft the policy brief using the standard techniques for the preparation of policy briefs, meeting the following criteria [19, 24]: provided a persuasive argument, had audience-context specificity, contained actionable recommendations, presented evidence-informed opinions and was written in clear, unambiguous language.

The resulting policy brief, titled “Operationalizing the Accountability Framework for Routine Immunization in Nigeria for Ebonyi State”, recommended eight policy options and implementation strategies (Table 1).

Table 1 Policy recommendations in the policy brief titled Operationalizing the Accountability Framework for Routine Immunization in Nigeria for Ebonyi State
Full size table

Convening the policy dialogue

The policy dialogue was held on 6 March 2018 in a hotel conference hall. The event commenced at 10:30 and ended by 15:30. After registration, the programme for the dialogue event and a fresh copy of the policy brief were distributed to each participant. The policy brief had also been sent to the participants 1 week prior to the session to allow them to familiarize themselves with the policy issue, policy options and the implementation strategies recommended.

The policy dialogue centred on and was guided by the policy brief document. The dialogue process was conducted using the process adopted from Lavis et al. [24], as follows:

  1. (i)

    Participants were seated at a U-shaped table so each could see the others well and to de-emphasize hierarchy and protocol.

  2. (ii)

    A welcome address provided the background to the study (lack of accountability in RI programme implementation in the state leading to poor coverage) and the purpose of the policy dialogue (which was to critique and align the recommended policy options and implementation strategies within the context of the state using the participants’ wealth of knowledge in policy-making and tacit knowledge of the state’s cultural and contextual milieu).

  3. (iii)

    Self-introduction of participants indicating name, organization represented and position in the organization.

  4. (iv)

    Subdivision of the participants into four groups (ensuring a good mixture of policy-maker, policy implementer, policy researcher, civil society organization activist and development partner official in each group) and assignment of two policy options and their implementation strategies to each group for dialogue in order to identify the best context-sensitive recommendation. The groups reserved the right to adopt all, some or none of the policy recommendations, and were at liberty to appropriately modify the implementation strategies in order to make them “context-sensitive”.

  5. (v)

    A facilitator with dialogue skills from the African Institute of Health Policy & Health Systems was assigned to each group to moderate the discussion. Each policy option and the implementation strategies were exhaustively deliberated upon.

The small group dialogue sessions lasted for about 2 hours. At the end, participants reconvened in plenary where each group presented their recommendations using flip charts. These were further deliberated upon by the whole house and input received from all other participants. After the presentations, the flip charts were collected from the presenters.

To enhance participants’ capacity to effectively engage in the policy dialogue, a capacity-enhancing session with the theme “the role of policy dialogue in evidence-informed policy-making for RI” was conducted for the 30 participants prior to the commencement of the policy dialogue. This lasted for about 1 hour. There is evidence that skill in policy dialogue participation is enhanced through such capacity-enhancing exercises [25,26,27].

Outcome of the policy dialogue

The participants in the policy dialogue adopted all eight policy options recommended in the policy brief and modified the implementation strategies through insightful inputs received during the dialogue. These recommendations, which made the resulting implementation strategies more contextually resonant, are shown in Table 2. For example, participants accepted that government should increase funding for RI but suggested that the Federal Ministry of Health should produce a well-costed annual plan as a basis for evidence-based budgeting, since an evidence-based budget request can hardly be turned down. Participants also adopted the recommendation that government should recruit more skilled staff, but in the interim, human resources for health in the state could be shored up by (i) encouraging volunteerism through mobilizing, incentivizing, training and using educated retired civil servants in their localities for RI services delivery, (ii) refraining from frequent transfers of skilled health workers away from the rural areas, and (iii) providing non-monetary incentives to health workers for work well done, especially those serving in the rural areas. The groups also accepted the need to clearly define and enforce integrated and complementary roles and responsibilities for all stakeholders in the RI sector, including the government, and apply sanctions where any partner failed to perform the assigned roles. They recommended transforming the multi-stakeholder group that participated in the policy dialogue into an accountability “watchdog” group, as only such a group could objectively apply such sanctions without witch-hunting of civil servants (Table 2).

Table 2 Comparison of policy options and implementation strategies in the policy brief versus the policy dialogue
Full size table

Evaluation of the usefulness of the policy brief and policy dialogue

The policy brief and the policy dialogue process were evaluated using the process adopted from Lavis et al. [24].

The policy brief assessment was conducted before the commencement of the policy dialogue. On arrival, the participants were given 45 minutes to read and acquaint themselves with the discussion points and the objectives of the dialogue, after which they were provided a copy of the policy brief assessment questionnaire to assess the quality of the policy brief document and the relevance of the policy options and implementation strategies recommended for addressing the policy issue at stake.

Similarly, at the end of the policy dialogue, they were provided with the policy dialogue assessment questionnaire to assess the usefulness of the policy dialogue in making the policy recommendations and the implementation strategies in the policy brief context-resonant and therefore implementable.

Data collection

Data were collected using the policy brief and policy dialogue assessment questionnaires developed by Johnson and Lavis [28]. The quantitative data consisted of response items to the seven-point Likert scale questions. The qualitative data consisted of responses to the open-ended questions in the questionnaire. The questionnaire was divided into three sections, A–C. Section A elicited information on the participants’ profiles including gender, age category, marital status, official designation attributes, educational qualification and level of operation. Section B elicited information on participants’ perceptions of the usefulness of the policy brief and the policy dialogue process. Section C contained the open-ended questions that elicited qualitative data regarding the participants’ views on what could be done better or differently next time and one important action that could be done better or differently to address future policy briefs on the same policy issue.

Data analysis

The data were analysed using the methods developed at McMaster University, Canada, by Johnson and Lavis [28], based on mean rating (MNR), median rating (MDR) and range (R). The response items in the questionnaire represent a Likert rating scale of 1–7 points, where 1 = very unhelpful, 2 = unhelpful, 3 = slightly unhelpful, 4 = neutral, 5 = slightly helpful, 6  = helpful and 7 = very helpful. The MNR, MDR and R values were rated as follows: 1.00–3.99 was considered low, 4.00–4.49 was considered the natural neutral point and 4.50–7.00 was considered high. The Statistical Package for the Social Sciences (SPSS) version 22 software was used for the data analysis.

Results

Forty-five policy-makers were mapped for this study, but only 30 (66.67%) attended and participated in the event.

Profile of participants at the policy dialogue

The results show that a majority (56.7%) of the participants were male, slightly more than half (53.3%) were aged ≥ 45 years and a majority (86.6%) had at least a bachelor’s degree.

The institutions that participated in the policy dialogue included the Ebonyi State Primary Health Care Development Agency, State Ministry of Finance and Economic Development, Ebonyi State House of Assembly–House Committee on Health, development partners, civil society organizations, media organizations and the African Institute for Health Policy & Health Systems Studies. The official designations of the respondents included executive secretaries, directors and heads of units in immunization-related parastatals, legislators, zonal and state team leads of development partner agencies, media representatives and health policy and systems researchers. The mean duration in designated position was 4.98 ± 4.10 years, and 30.0% had a direct influence on policy-making (Table 3).

Table 3 Profile of participants at the policy dialogue
Full size table

Perception of the respondents on the usefulness of the policy brief

The most highly rated aspects of the policy brief by the respondents were the proper description of the context of the issue being addressed (MNR = 6.60) and considerations for quality when discussing the research evidence (MNR = 6.50). The lowest rated were the policy brief not concluding with particular recommendations (MNR = 5.43) and the policy brief including a graded-entry format (5.89) (Table 4).

Table 4 Participants’ view on policy brief design and production
Full size table

Perceptions of the respondents on the usefulness of the policy dialogue in addressing issues highlighted in the policy brief

The policy dialogue was considered a highly useful approach for discussing a high-priority issue (MNR 6.80) and generating at least three options for solving the problem. All other parameters assessed had MNR of > 6 (Table 5).

Table 5 Usefulness of the policy dialogue in addressing issues highlighted in the policy brief
Full size table

Participants’ views on how to improve future policy briefs

  1. (i)

    What needs to be retained: The two commonest features participants wanted retained in future policy briefs were taking cognizance of the local context by 26.32% and the systematic transparent method employed in identifying, selecting and assessing synthesized research evidence by 21% of the respondents. Other features they wished to retain are shown in Table 6.

  2. (ii)

    What should be changed: The majority (88.9%) suggested nothing to be changed, while 5.6% wanted the policy brief to be shorter to make for easier reading and wanted more local literature incorporated into the evidence synthesis.

  3. (iii)

    One important action that could be done better or differently to address the featured policy issue: Of the responses to this question, 25% said they would circulate the policy brief much earlier, get input from local researchers in developing the policy brief, make specific recommendations in the policy brief and ensure that more political policy-makers participated in the “merit” review.

Table 6 Participants’ views on how to improve future policy brief development and policy dialogue on the same policy issue in the future
Full size table

Participants’ views on how to improve future policy dialogues

  1. (i)

    What to retain: The features participants most commonly wanted retained in future policy dialogues included the participatory and interactive engagement which gave room for each participant to make useful contributions (25%), the involvement of all stakeholders in the policy dialogue (20%) and the fair representation of stakeholders in the various subgroups during the deliberations (15%).

  2. (ii)

    What should be changed: Although the largest share (36.4%) were satisfied with the way and manner the policy dialogue was conducted and suggested no changes, 27.3% wanted participation by the political policy-makers made mandatory.

  3. (iii)

    Important actions that participants were personally willing to do better or differently: Of the eight persons who responded to this question, the largest share (37.5%) committed to collating and disseminating relevant and complete RI data in a timely manner, 25% committed to taking ownership of their work and implementing cost-effective methods of cold chain maintenance, and 12.5% committed to facilitating the “push” programme of vaccine and commodity distribution from the state straight to health facilities (Table 6).

Discussion

This study evaluated the usefulness of KT tools (policy brief and policy dialogue) in enabling policy-makers in Ebonyi State to contextualize and operationalize a national policy document (AFRIN).

The approach used was informed from the 2018 report of the Global HIV/AIDS Initiatives Nigeria, which recommended that policy briefs be included as part of any comprehensive communication strategy and used for engaging both policy-makers and researchers at the subnational and national levels towards contextualization and operationalization. A key reflection on the role of the policy dialogue in contextualizing the policy options created by the policy brief is seen in the outcome of the policy dialogue, where the stakeholders recommended volunteerism instead of recruitment of skilled workers, nonmonetary compensation of health workers serving in rural communities (such as through conferment of state honours and chieftaincy titles by communities they have served well), optimal use of available solar freezers and other cold chain equipment instead of buying and installing new equipment, and refraining from frequent transfer of skilled health workers away from rural areas by making it statutory that every such worker would have served for at least 3 years before such transfer. These decisions were taken bearing in mind certain realities of the state. First was the financial constraints the state faces as one of the states receiving the smallest allocations from the monthly Federal Account Allocation Committee (FAAC) meeting. This committee decides the amount of funds that each of the 36 states of Nigeria receives from the federal account based on certain fixed criteria. This is compounded by the fact that the state has low internally generated revenue as a result of a weak tax base due to the near absence of industry and other commercial ventures. Second, the health sector both nationally and in the state faces chronic under-funding. The state has never achieved the recommendation of the Abuja Declaration in 2001 by African heads of government that every country should allocate a minimum of 15% of their annual budget to the health sector [29]. Finally, there has been no recruitment of staff into the health sector for about 10 years despite the fact that workers have been retiring from service and dying, so there is an acute shortage of skilled manpower sector-wide.

The use of the policy brief in this study allowed career policy-makers, researchers and other stakeholders in the RI programme to identify the most feasible policy options of the AFRIN for implementation in Ebonyi State. Studies have demonstrated the usefulness of policy briefs and policy dialogue in policy-maker and researcher engagement [26].

Our study is similar to that of Yehia et al. [30], which evaluated the usefulness of KT tools (policy brief and policy dialogue) in the development of mental health policy in Lebanon. In that study, a policy brief developed from a comprehensive evidence synthesis and findings from key informant interviews of 10 policy-makers and key informants defined the problem and suggested three policy options as solutions. This policy brief guided a policy dialogue on mental health services development in Lebanon. Evaluation of the policy dialogue showed that integrating mental health services into primary healthcare was the option most frequently suggested by the 24 participants, thus validating the evidence in the policy brief. A post-dialogue survey conducted 6 months later showed that stakeholders had undertaken many implementation steps including the establishment of a national task force on mental health, training primary healthcare staff on mental health services and updating the national essential drug list to include psychiatric medicines. They concluded that the use of KT tools to help generate evidence-informed programmes was promising in Lebanon.

Johnson et al. [31] reported on the lessons learned from an initiative called Nigeria Research Days (NRD), using policy dialogue in supporting the use of evidence for establishing maternal, newborn and child health policy. The paper described the conceptualization, implementation and conduct of the first edition of the NRD policy dialogue framework. The framework for KT in that study was “the knowledge value chain” framework, a nonlinear concept based on the management of five dyadic capabilities: knowledge mapping and acquisition, knowledge creation and destruction, knowledge integration and sharing/transfer, knowledge replication and protection, and knowledge performance and innovation. The Department of Family Health of the Nigerian Federal Ministry of Health initiated and organized the NRD to serve as a platform for exchange between researchers and policy-makers for improving maternal, newborn and child health. In the first edition of the NRD, a cross-sectional study was designed to assess the effectiveness of a policy dialogue during the NRD. A descriptive analysis of the data collected from the workshop evaluation survey showed that the participants rated the content and format of the meeting positively and made suggestions for improvement. They were willing to implement the recommendations of the final communiqué and concluded that the lessons learned from this first edition would be used to improve future editions. However, unlike in our study, that study did not employ the use of a policy brief; rather, researchers who were implementing grants from the Canadian initiative Innovating for Mother and Child Health in Africa (IMCHA) were mapped and invited to present the outcomes of their studies to the audience of researchers, policy-makers and non-state actors involved in maternal and child health.

Unlike a previous policy dialogue on the control of infectious diseases of poverty in Ebonyi State [26], which involved participation from two institutions, the present study had an interesting feature of having participation from across many sectors. All of the participants were mid-level to senior officers in their respective organizations (career policy-makers), with 86.7% directly or indirectly influencing the policy-making process. As envisaged by Bammers et al. [21], deliberate targeting of such career policy-makers through the kind of enterprise employed in this study will help in bridging the “know–do gap”, as many career civil servants neither recognize nor accept their roles in policy-making. This is despite the high level of influence on policy-making reported by these participants. Anecdotal evidence suggests that career policy-makers, in contrast to their elected and appointed counterparts, tend to be well versed and familiar with routine decision-making processes given their length of time in service, experience, cross-sectoral exposure and continuity in office across various political regimes. This highlights the need for more focus on engaging these career policy-makers on policy-related issues. It is anticipated that with the additional skill enhancement through the workshop on policy dialogue they received, they will realize that they are policy-makers and thereafter play a greater role, both directly and indirectly, in policy-making.

The quality and relevance of the policy brief developed for this study was rated very highly (moderately useful to very useful), which is similar to the finding reported by Uneke et al. [25]. This is probably because similar methods for policy brief preparation as recommended by Lavis et al. and Jones and Walsh [19, 24] were utilized in both studies. Likewise, the participants considered the policy dialogue process and brief to be very useful. Again, this can be explained by the fact that well-established guidelines [24, 32, 33] for the conduct of policy dialogues were followed.

This research compared the policy options in AFRIN as stated in the policy brief and the context-driven suggestions provided by the participants. The key implementation strategies listed centred on supply and logistics, proper budgeting and funding, human resource management, and intersectoral/organizational collaboration and creation of accountability interest/advocacy groups. Proper budgeting and availability of funds has a role in effective implementation of policies/programmes. Regarding human resource management, the gap can be bridged by considering task-shifting, which is less expensive and can contribute to better implementation. Studies have shown the value of task-shifting and equitable urban–rural distribution of health workers in various aspects of health programmes [34].

Policy dialogues provide the much-needed opportunity for policy-makers to review suggested policy directions and proffer revisions and implementation considerations relevant to the particular context. The contextualization of policy options stated in the policy brief during the policy dialogue is an invaluable takeaway from the policy dialogue, as demonstrated in our study. Evidence has shown the usefulness of policy dialogues in promoting stakeholder involvement in translating evidence to policy [17, 18, 35, 36].

To improve future policy dialogues, the participants recommended retention of some features. In descending order of importance, these were the participatory and interactive engagement, involvement of all stakeholders, fair representation of stakeholders in the various subgroups during the deliberations, and well-itemized problems and policy recommendations. This differs from the findings of Lavis et al. [24], where the design features to be retained were, in descending order, skilled facilitation using an outside agent, bringing together all parties who could be affected by the outcome (as it allowed for a variety of perspectives and open dialogue), pre-circulation of packaged evidence summaries, alternative ways of addressing a policy issue, and the adoption of the Chatham House Rule. However, in a study by Boyko et al. [37], participants wanted all the design features in the deliberative dialogue retained in future dialogues.

With regard to what should change in future policy dialogues on the same issue, the most frequently demanded design feature change was the nonparticipation by the apex (political) policy-makers in the ministries such as the commissioners and permanent secretaries. Participants suggested that the participation of such political policy-makers should be made mandatory.

It is possible that this group of stakeholders could not attend the dialogue due to low prioritization of RI in the state and busy schedules. This is cause for concern considering the fact that the apex policy-makers are often too busy with other political engagements, making it difficult for them to sit in for such activities, and even when they attend they are distracted with many calls. One of the strategies used to ensure good attendance was early notification of the meeting followed by frequent calls and reminders. This highlights the need for continued advocacy to policy-makers to ensure they fully understand the importance of these KT processes.

As Boyko et al. [37] suggested, “fair representation among policy makers, managers, stakeholders and researchers” is a challenge for deliberative dialogues that address low-priority policy issues (i.e. those that are not on the “radar” of government decision-makers). For political officeholders, gains in RI may be considered as non-vote-catching given its nonphysical form compared to huge, more visible works like roads, bridges and buildings. This in turn could pose an implementation barrier to the policy at hand.

Participants’ written comments on important action they would personally do better or differently to address the featured policy issue reflects their different roles in the policy process but can be summarized to mean that they intend to use what they learned during the dialogue to improve RI service delivery. This is similar to the findings of other studies [37]. For example, some frontline health workers were willing to improve supportive supervision for the immunization programmes, civil society organizations suggested optimizing community resources and advocacy for RI, and the media committed to placing RI in the public domain. Thus the policy dialogue was an effective KT vehicle enabling policy actors to take responsibility to improve accountability in RI service delivery. This interesting finding highlights the value of personal responsibility in implementation of health programmes. Furthermore, the dialogue could potentially enhance evidence uptake, as has been demonstrated and advocated for by previous studies [25, 26, 38].

It is worth noting that these comments demonstrate the key roles of civil society organizations and the media in improving public policy, as has been described previously [39, 40].

Another interesting finding was that stakeholders wanted the brief circulated further in advance. This is surprising because, in our context, people do not tend to read materials sent to them in advance.

A major misgiving about implementing AFRIN in the state that was expressed by the health worker participants in this study was health worker-specific sanctions for poor RI performance without considering the failure of the government to budget for and/or release funds for RI services in a timely manner. They also wondered who would sanction the government when it defaults on its own responsibility. Research evidence has shown that non-budgeting and/or non-release of budgeted RI funds have been the most difficult bottleneck in RI service delivery in states and local government areas in Nigeria [2, 12, 13]. To mitigate this issue, the stakeholders suggested transforming the multi-stakeholder group into an RI “ombudsman”, in addition to prioritizing effective RI coverage as a political campaign issue in future elections.

Conclusion

This study initiated the process of contextualizing to Ebonyi State the realities of the AFRIN national health policy document. It utilized a policy brief developed from a national document as a KT tool to convene a multi-stakeholder policy dialogue. Overall, the participants considered the policy brief to be of good quality and the dialogue useful for addressing a high-priority policy issue.

This study promoted an evidence-to-policy link by furnishing contextualized locally relevant evidence to policy-makers, who committed to incorporating them in the state’s RI accountability framework. To improve RI at the subnational level in Nigeria using the AFRIN framework, it is recommended that KT tools such as policy briefs and dialogue be deployed for multi-stakeholder engagement and advocacy.

Limitations of this study include limited generalizability to other contexts and the self-reported responses. However, this is one of the few studies in the African region assessing the use of KT tools and methods in engaging policy-makers towards operationalization of national policies at the subnational level.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

RI:

Routine immunization

AFRIN:

Accountability framework for routine immunization in Nigeria

UN:

United Nations

References

  1. Remy V, Largeron N, Quilici S, Carroll S. The economic value of vaccination: why prevention is wealth. J Mark Access Health Policy. 2015;3:7–11.

  2. Kabaniha G, Zikusooka CM, Guthrie T. Financing for Immunization at sub-national levels: a systematic literature review. 2014. Available at http://www.unicef.org/health/files/GAVI_LitReview_050814_ForProduction_a.pdf. Accessed March 2021.

  3. Pickering LK, Baker CJ, Freed GL, Gall SA, Grogg SE, Poland GA, et al. Immunization programs for infants, children, adolescents, and adults: clinical practice guidelines by the Infectious Diseases Society of America. Clin Infect Dis. 2009;49(6):817–40.

    Article  Google Scholar 

  4. Liu L, Johnson H, Cousens S, Perin J, Scott S, Lawn J, et al. Child Health Epidemiology Reference Group of WHO and UNICEF. Global, regional, and national causes of child mortality: an updated systematic analysis for 2010 with time trends since 2000. Lancet. 2012;379(9832):2151–61.

  5. World Health Organization. Health topics: immunization [Internet]. 2013 [cited 2018 Feb 16]. Available from http://www.who.int/topics/immunization/en/.

  6. World Health Organization. United Nations Inter-agency Group for Child Mortality Estimation (UN IGME), Levels & Trends in Child Mortality: Report 2017, Estimates Developed by the UN Inter-agency Group for Child Mortality Estimation [Internet]. New York; 2017 [cited 2018 Apr 18]. Available from http://www.who.int/maternal_child_adolescent/documents/levels_trends_child_mortality_2017/en/.

  7. Adedini SA, Odimegwu CO, Ononokpono D, Ibisomi L, Elwange BC, Imasiku E. Regional inequalities in under-five mortality in Nigeria: a multilevel analysis [Internet]. 2012 [cited 2018 Apr 20]. Available from http://paa2012.princeton.edu/papers/120262.

  8. Aigbe GO, Zannu AE. Differentials in infant and child mortality rates in Nigeria: evidence from the six geopolitical zones. Int J Humanit Soc Sci. 2012;2(16):206–14.

    Google Scholar 

  9. Anyamele OD, Akanegbu BN, Ukawuilulu JO. Trends and disparities in infant and child mortality in Nigeria using pooled 2003 and 2008 demographic and health survey data. SAGE Open. 2015;5(4):1–13.

    Article  Google Scholar 

  10. Yaya S, Ekholuenetale M, Tudeme G, Vaibhav S, Bishwajit G, Kadio B. Prevalence and determinants of childhood mortality in Nigeria. BMC Public Health. 2017;17:485.

    Article  Google Scholar 

  11. National Population Commission. Nigerian demographic and health survey 2018. Available at https://www.dhsprogram.com/. Accessed January 2021.

  12. Wonodi C, Stokes-prindle C, Aina M, Oni G, Olukowi T, Pate MA, et al. Landscape analysis of routine immunization in Nigeria. International Vaccine Access Center (IVAC). Johns Hopkins Bloomberg School of Public Health, 2012;30(6):2008–11.

  13. Uzochukwu BSC, Chukwuogo O, Onwujekwe O. Financing Immunization for results in Nigeria: who funds, who disburses, who utilizes, who accounts? Financing bottlenecks and accountability challenges. Afr J Health Econ. 2014;2(2):20–34.

    Google Scholar 

  14. George AS, Erchick DJ, Zubairu MM, Barau IY, Wonodi C. Sparking, supporting and steering change: grounding an accountability framework with viewpoints from Nigerian routine immunization and primary health care government officials. Health Policy Plan. 2016;31(9):1326–32.

    Article  Google Scholar 

  15. Erchick DJ, George AS, Umeh C, Wonodi C. Understanding internal accountability in Nigeria’s routine immunization system: perspectives from government officials at the national, state, and local levels. Int J Health Policy Manag. 2017;6(7):403–12.

  16. Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7:50.

    Article  Google Scholar 

  17. Fusheini A, Marnoch G. Dialogue as a tool for improving policy implementation: lessons from Ghana Dialogue as a tool for improving policy implementation: lessons from Ghana. Policy Des Pract. 2020;3(4):387–400. https://doi.org/10.1080/25741292.2020.1796204.

    Article  Google Scholar 

  18. Damani Z, Mackean G, Bohm E, Demone B, Wright B, Noseworthy T, et al. The use of a policy dialogue to facilitate evidence-informed policy development for improved access to care: the case of the Winnipeg Central Intake Service (WCIS). Health Res Policy Syst. 2016. https://doi.org/10.1186/s12961-016-0149-5.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Jones N, Walsh C. Policy briefs as a communication tool for development research [Internet]. Overseas Development Institute. 2008. Available from https://www.odi.org/sites/odi.org.uk/files/odi-assets/publications-opinion-files/594.pdf.

  20. C-GIDD (Canback Global Income Distribution Database). List of Nigerian states by GDP [Internet]. 2010 [cited 2017 Nov 7]. Available from https://en.wikipedia.org/wiki/List_of_Nigerian_states_by_GDP.

  21. Bammers G, Strazdins L, McDonald D, Berry H, Ritter A, Deane P, van Kerkhoff L. Expanding the deliberations about the research-policy gap: useful lessons from the literature. In: Bammer G, Michaux A, Sanson A, editors. Bridging the “know-do” gap: knowledge brokering to improve child wellbeing. 2nd ed. Canberra: ANU ePress; 2010. p. 135–55.

    Google Scholar 

  22. Purdon S, Lessof C, Woodfield K, Bryson C. Research methods for policy evaluation. 2001. Available from https://www.academia.edu/1967742/Research_methods_for_policy_evaluation. Accessed January 2021.

  23. National Routine Immunization Strategic Plan (NRISP, 2013–2015) [Internet]. 2013. Available from https://silo.tips/download/nigerian-national-routine-immunization-strategic-plan.

  24. Lavis JN, Boyko JA, Oxman AD, Lewin S, Fretheim A. Support tools for evidence-informed health Policymaking (STP) 14: organising and using policy dialogues to support evidence-informed policymaking. Health Res Policy Syst. 2009. https://doi.org/10.1186/1478-4505-7-S1-S14.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Uneke CJ, Ezeoha AE, Uro-Chukwu H, Ezeonu CT, Ogbu O, Onwe F, et al. Enhancing the capacity of policy-makers to develop evidence-informed policy brief on infectious diseases of poverty in Nigeria. Int J Health Policy Manag. 2015;4(9):599–610.

  26. Uneke CJ, Ezeoha AE, Uro-Chukwu H, Ezeonu CT, Ogbu O, Onwe F, et al. Promoting evidence to policy link on the control of infectious diseases of poverty in Nigeria: outcome of a multi-stakeholders policy dialogue. Health Promot Perspect. 2015;5(2):104–15.

    Article  Google Scholar 

  27. Uneke CJ, Ezeoha AE, Uro-Chukwu HC, Ezeonu CT, Igboji J. Promoting researchers and policy-makers collaboration in evidence-informed policy-making in Nigeria: outcome of a two-way secondment model between University and Health Ministry. Int J Health Policy Manag. 2018;7(6):522–31.

    Article  Google Scholar 

  28. Johnson NA, Lavis JN. Procedures manual for the “Evaluating Knowledge-Translation Platforms in Low- and Middle-Income Countries” study. Hamilton: McMaster University Program in Policy Decision-Making; 2010.

    Google Scholar 

  29. WHO. The Abuja Declaration: ten years on. The World Health Organization. Retrieved from https://www.who.int/healthsystems/Publications/Abuja10.pdf. Accessed 2 Dec 2021.

  30. Yehia F, El JF. Applying knowledge translation tools to inform policy: the case of mental health in Lebanon. Health Res Policy Syst. 2015;13:29.

    Article  Google Scholar 

  31. Johnson EAK, Sombié I, Uzochukwu BSC, Uneke JC, Moukaïla Amadou AA, Adebimpi A, et al. Policy dialogue to support maternal newborn child health evidence use in policymaking: the lessons learnt from the Nigeria research days first edition. Afr J Reprod Health. 2020;24(4):109–21.

  32. Lomas J, Culyer T, McCutcheon C, McAuley L, Law S. Conceptualizing and combining evidence for health system guidance. Ottawa: Canadian Health Services Research Foundation; 2005.

    Google Scholar 

  33. Abelson J, Forest PG, Eyles J, Smith P, Martin E, Gauvin FP. Deliberations about deliberative methods: issues in the design and evaluation of public participation processes. Soc Sci Med. 2003;57:239–51.

    Article  Google Scholar 

  34. Fulton BD, Scheffler RM, Sparkes SP, Auh EY, Vujicic M, Soucat A. Health workforce skill mix and task shifting in low income countries: a review of recent evidence. Hum Resour Health. 2011;9:1.

    Article  Google Scholar 

  35. Robert E, Rajan D, Koch K, Weaver AM, Porignon D, Ridde V. Policy dialogue as a collaborative tool for multistakeholder health governance: a scoping study. BMJ Glob Health. 2020. https://doi.org/10.1136/bmjgh-2019-002161.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Nabyonga-orem J, Ousman K, Estrelli Y, Rene AKM, Yakouba Z. Perspectives on health policy dialogue: definition, perceived importance and coordination. BMC Health Serv Res. 2016. https://doi.org/10.1186/s12913-016-1451-1.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Boyko J, Lavis J, Abelson J, Dobbins M. Deliberative dialogue as a mechanism for knowledge translation and exchange in health systems decision making. Soc Sci Med. 2012;75(11):1938–45.

    Article  Google Scholar 

  38. World Health Organization. EVIPNet in action: 10 years, 10 stories. Geneva: WHO/HIS/IER/REK/16.02. 2016.

  39. Warren Krafchik. Can civil society add value to budget decision-making? A description of civil society budget work. International Budget Project. Available from https://www.internationalbudget.org/wp-content/uploads/Can-Civil-Society-Add-Value-to-Budget-Decision-Making-A-Description-of-Civil-Society-Budget-Work.pdf. Accessed March 2021.

  40. Okonjo-Iweala N, Osafo-Kwaako P. the role of civil society organizations in supporting fiscal transparency in African countries: background note for discussion [Internet]. 2013. Available from https://www.r4d.org/wp-content/uploads/Ngozi-CSO_Paper_Revised_Version.pdf.

Download references

Acknowledgements

We are grateful to the African Institute for Health Policy & Health Systems, Ebonyi State University, Abakaliki, Nigeria, for their support.

Author information

Authors and Affiliations

  1. African Institute for Health Policy and Health Systems, Ebonyi State University, Abakaliki, Nigeria

    Lawrence Ulu Ogbonnaya, Ijeoma Nkem Okedo-Alex, Ifeyinwa Chizoba Akamike, Benedict Azuogu, Henry Urochukwu, Ogbonnaya Ogbu & Chigozie Jesse Uneke

  2. Department of Community Medicine, Faculty of Clinical Medicine College of Health Sciences, Ebonyi State University, Abakaliki, Nigeria

    Lawrence Ulu Ogbonnaya, Benedict Azuogu & Henry Urochukwu

  3. National Obstetric Fistula Centre (NOFIC), Abakaliki, Nigeria

    Henry Urochukwu

  4. Department of Applied Microbiology, Faculty of Science, Ebonyi State University, Abakaliki, Nigeria

    Ogbonnaya Ogbu

  5. Department of Medical Microbiology, Faculty of Clinical Medicine, College of Health Sciences, Ebonyi State University, Abakaliki, Nigeria

    Chigozie Jesse Uneke

  6. Department of Community Medicine, Alex Ekwueme Federal University Teaching Hospital, Abakaliki, Nigeria

    Lawrence Ulu Ogbonnaya, Ijeoma Nkem Okedo-Alex, Ifeyinwa Chizoba Akamike & Benedict Azuogu

Authors
  1. Lawrence Ulu Ogbonnaya
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ijeoma Nkem Okedo-Alex
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ifeyinwa Chizoba Akamike
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Benedict Azuogu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Henry Urochukwu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ogbonnaya Ogbu
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Chigozie Jesse Uneke
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

LUO conceived the study, developed the protocol and supervised the implementation of the study, and developed the first draft of the manuscript. All authors participated in data acquisition, analysis and interpretation. IJN, ICA and LUO participated in the revisions of the manuscript. OO and CJU provided critical supervision throughout the study and development of the manuscript. All authors agreed on the journal to which the article has been submitted, and agree to be accountable for all aspects of the work. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Ifeyinwa Chizoba Akamike.

Ethics declarations

Ethics approval and consent to participate

Ethics approval for this study was obtained from Ebonyi State University Research Ethics Committee (EBSU-REC), and the study was conducted based on international ethical best principles. Informed written consent was obtained from participants before enrolment. Participation was voluntary and confidentiality was ensured.

Consent for publication

Not applicable.

Competing interests

Authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ogbonnaya, L.U., Okedo-Alex, I.N., Akamike, I.C. et al. Assessing the usefulness of policy brief and policy dialogue as knowledge translation tools towards contextualizing the accountability framework for routine immunization at a subnational level in Nigeria. Health Res Policy Sys 19, 154 (2021). https://doi.org/10.1186/s12961-021-00804-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12961-021-00804-z

Keywords

Health Research Policy and Systems

ISSN: 1478-4505

Contact us