- Open Access
SUPPORT Tools for evidence-informed health Policymaking (STP) 3: Setting priorities for supporting evidence-informed policymaking
Health Research Policy and Systemsvolume 7, Article number: S3 (2009)
This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers.
Policymakers have limited resources for developing – or supporting the development of – evidence-informed policies and programmes. These required resources include staff time, staff infrastructural needs (such as access to a librarian or journal article purchasing), and ongoing professional development. They may therefore prefer instead to contract out such work to independent units with more suitably skilled staff and appropriate infrastructure. However, policymakers may only have limited financial resources to do so. Regardless of whether the support for evidence-informed policymaking is provided in-house or contracted out, or whether it is centralised or decentralised, resources always need to be used wisely in order to maximise their impact. Examples of undesirable practices in a priority-setting approach include timelines to support evidence-informed policymaking being negotiated on a case-by-case basis (instead of having clear norms about the level of support that can be provided for each timeline), implicit (rather than explicit) criteria for setting priorities, ad hoc (rather than systematic and explicit) priority-setting process, and the absence of both a communications plan and a monitoring and evaluation plan. In this article, we suggest questions that can guide those setting priorities for finding and using research evidence to support evidence-informed policymaking. These are: 1. Does the approach to prioritisation make clear the timelines that have been set for addressing high-priority issues in different ways? 2. Does the approach incorporate explicit criteria for determining priorities? 3. Does the approach incorporate an explicit process for determining priorities? 4. Does the approach incorporate a communications strategy and a monitoring and evaluation plan?
This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers. The series is intended to help such people to ensure that their decisions are well-informed by the best available research evidence. The SUPPORT tools and the ways in which they can be used are described in more detail in the Introduction to this series . A glossary for the entire series is attached to each article (see Additional File 1). Links to Spanish, Portuguese, French and Chinese translations of this series can be found on the SUPPORT website (). Feedback about how to improve this tool and others in this series is welcome, and should be sent to:http://STP@nokc.no.http://www.support-collaboration.org
Scenario 1: You are a senior civil servant and will be submitting a plan to the Minister about how to allocate staff and other resources in order to ensure that existing programmes are well administered, emerging issues are responded to appropriately, and that evidence-informed policymaking is well supported on high-priority issues. In the past, you have found that programme administration and reactive issue management have crowded out proactive efforts to support evidence-informed policymaking. In the plan, you want to include an approach to priority setting that will support evidence-informed policymaking.
Scenario 2: You work in the Ministry of Health and are preparing a brief report about how the Ministry’s decision support unit will serve other Ministry staff. This support ranges from providing fast-turnaround requests for the best available synthesised evidence about particular issues, through to more comprehensive evidence-informed problem assessments, options to address problems, and implementation considerations that may take several weeks or months. The report will consider how the unit will prioritise which issues will get particular types of support.
Scenario 3: You work in an independent unit that supports the Ministry of Health in its use of evidence in policymaking. You are preparing a detailed proposal for the Ministry of Health about how the unit will prioritise those issues requiring policy briefs and policy dialogues to support evidence-informed policymaking (both these issues are the focus of the SUPPORT tools discussed in Articles 13  and 14 ).
Policymakers and stakeholders have limited resources available for developing – or supporting the development of – evidence-informed policies and programmes. Such resource constraints include staff time but there are also constraints in terms of the capacity of those who are able to support policymakers. This means that only a limited amount of skilled-staff time can be allocated to finding and using research evidence to clarify a problem, frame options to address a problem, and address how an option will be implemented (these issues are the focus of the SUPPORT tools discussed in Articles 4-6 in this series [4–6]), or to other efforts to support evidence-informed policymaking. The bulk of skilled staff time needs to be allocated to administering existing programmes and to responding to emerging issues in other ways. Resource limitations may also extend to staff infrastructural needs (such as access to a librarian or journal article purchasing), and to their continuing professional development.
Working within such resource constraints, policymakers and other stakeholders may choose to group together all staff who support evidence-informed policymaking, or else to spread them out within programme areas. Figure 1 provides a visual depiction of both a centralised approach and a decentralised approach to supporting evidence-informed policymaking. A centralised approach can facilitate the development of a common approach to priority-setting and common procedures, but it requires strong linkages with programme staff who know the issues and context well (this can be achieved potentially through the use of time-limited steering groups to oversee particular assessments of the available research evidence). A decentralised approach can facilitate the development of a culture of evidence-informed policymaking within each programme, but will require similarly strong linkages between the decision-support staff who perform similar functions in other programmes.
Policymakers and stakeholders may also choose to contract out some or all of the work to independent units with skilled staff and appropriate infrastructure. But such options also may be limited by the financial resources available. As with a centralised ‘in-house’ approach, external contracts require strong linkages with policymakers and stakeholders who know the issues and context, using possible mechanisms such as time-limited steering groups.
Whether support for evidence-informed policymaking is provided in-house or contracted out to independent units, or whether the support is centralised or decentralised, resources always need to be used wisely in order to maximise their impact. Only a very limited number of issues can be subjected to a comprehensive assessment of the available research evidence. It is important to note, too, that resource limitations also come into play when deciding which policy or programme option to pursue, or which implementation strategy to pursue (these issues are the focus of Articles 5  and 6  in this series). In this article, the focus is on using resources wisely to find and use research evidence to support evidence-informed policymaking.
In Figure 2, the second column shows examples of possible undesirable practices which may be used in a priority-setting approach. For example, if timelines to support evidence-informed policymaking are negotiated on a case-by-case basis, policymakers will be unable to match the time constraints they face (e.g. a half-day, five-day or two-month period) to the support they could receive (a targeted search for a systematic review or a comprehensive assessment of the available research evidence). When implicit criteria are used to set priorities or the priority-setting process is ad hoc, those policymakers whose needs for research evidence are not being met may become demoralised by the lack of attention to their programme or disillusioned with the rhetoric of evidence-informed policymaking. And without either a communications plan or a monitoring and evaluation plan, policymakers will not know why their evidence needs are or aren’t being met, and be unable to learn whether and how the their existing approaches can be improved.
Policymakers and stakeholders charged with developing a priority-setting approach to support evidence-informed policymaking, face difficult challenges.
They have to combine a proactive approach to priority setting (e.g. what priority should an issue be given in a national strategic plan for the health sector?) together with a reactive approach that can respond to the pressing issues of the day (e.g. what priority should an issue receive when it appears on the front page of a newspaper or is discussed in the legislature?). A priority-setting approach needs to contribute to future plans while responding to existing potentially difficult circumstances
Policymakers have to balance a disease or illness orientation (e.g. what priority should be given to HIV/AIDS or diabetes?), a programme, service and drug orientation (e.g. what priority should be given to a screening programme, a counselling service or a new class of drugs?), and a health system arrangements orientation (e.g. what priority should be given to a regulatory change in the scope of the practice of nurses, or to a change in the financial arrangements that determine how doctors are paid, or to a change in the delivery arrangements that determine whether some forms of care are provided only in high-volume facilities?). A priority-setting approach needs to function with multiple, often interacting, orientations at the same time
They have to balance shorter-term confidentiality issues with longer-term commitments to transparency and public accountability. This is particularly true for policymakers who typically rely heavily on civil servants to assess issues for them. Strict confidentiality provisions are often set to ensure that issues are not discussed before they have been vetted by policymakers. This is important given that policymakers are accountable in a very public way (through periodic elections) for the decisions they make. A priority-setting approach – at least one based within government – needs to accommodate a mix of confidentiality and transparency provisions
Some desirable practices used in a priority-setting approach for evidence-informed policymaking are derived from available tools and resources used to support priority setting in other domains. These tools and resources can be divided into three key types:
Most tools and resources focus on how to prioritise programmes, services and drugs that are targeted at illnesses and injuries, or at ill health more generally. Many of these tools and resources focus both on data on prevalence or incidence, and on research evidence about the effectiveness or cost-effectiveness of prevention and treatment options [11–13]. Few deal with a broader set of criteria or have a more holistic approach to setting priorities [14–16]
Almost no tools and resources address the issue of how to prioritise health system arrangements (or changes to health system arrangements) that support the provision of cost-effective programmes, services and drugs,  or how to prioritise actions to address the social determinants of health
Tools and resources are also available to support priority setting for both primary research and systematic reviews in the research sector [18–22] as well as for recommendations for the health sector (e.g. clinical practice guidelines) .
Elements of the tools and resources discussed above can be used to help to shape an approach to priority setting for those issues that will be the focus of evidence-informed policymaking. For example, burden-of-disease data may be used to inform assessments of the contribution of a particular disease to the overall burden of ill health. Research evidence about the effectiveness of programmes, services and drugs needs, can help to inform assessments of options to address ill health. Similarly, approaches to priority setting for basic research (which may use a 5-25 year time horizon), applied primary research (which may use a 2-5 year time horizon), and for systematic reviews (which may use a 6-18 month time horizon) can all provide insights into priority setting for policy briefs that are produced within a 1-6 month time horizon. (Article 13 of this series addresses the preparation and use of policy briefs in further detail) . Approaches to priority setting for recommendations can also give insights into priorities for finding and using research evidence to support evidence-informed policymaking. However, a recent review of priority setting for recommendations concluded that there was “little empirical evidence to guide the choice of criteria and processes for establishing priorities” .
Table 1 provides examples of organisations in which a priority-setting approach can be beneficial.
Questions to consider
The following questions can guide how to set priorities for finding and using research evidence to support evidence-informed policymaking:
Does the approach to prioritisation make clear the timelines that have been set for addressing high-priority issues in different ways?
Does the approach incorporate explicit criteria for determining priorities?
Does the approach incorporate an explicit process for determining priorities?
Does the approach incorporate a communications strategy and a monitoring and evaluation plan?
1. Does the approach to prioritisation make clear the timelines that have been set for addressing high-priority issues in different ways?
Policymaking processes may play out over days, weeks, or even years. Systematic and explicit priority-setting processes aren’t typically appropriate for very short timelines (i.e. hours and days) because the priority-setting process could take longer than the time in which a decision needs to be made. However, explicit criteria can still help to inform judgements about which issues require an all-hands-on-deck approach to finding and using research evidence (e.g. for those moments when a Minister says “We need it now!”). Conversely, they also help to identify which issues could be dealt with over a longer time period or should be put aside entirely, and determining which issues fall somewhere in-between.
For policymaking processes that play out over weeks or months, explicit priority setting criteria and systematic and explicit priority-setting processes can offer value. This is particularly true if there is receptivity on the part of policymakers and stakeholders to seeking an independent assessment of the research evidence (such as a policy brief) (see Article 13 for further discussion of preparing and using policy briefs to support evidence-informed policymaking) or to seeking the evidence-informed input of stakeholders through a policy dialogue (Article 14 in this series discusses how to organise and use dialogues to support evidence-informed policymaking) [2, 3]. Such a priority-setting process would need to be dynamic and have revisions done every few weeks or months, if it is to provide a meaningful balance of proactive and reactive approaches.
For ‘perennial’ policy issues, and those policymaking processes that play out over many months or even years, policymakers and other stakeholders can embrace a more strategic approach to priority setting. This could include commissioning researchers to conduct a systematic review of the research literature on a specific policy or programme question, or conducting an impact evaluation of a policy or programme (this topic is the focus of Article 18 in this series) .
An approach to prioritisation would ideally make clear the timelines that have been set for addressing high-priority issues in different ways. Policymakers and stakeholders could then match the time constraint that they’re working under (a half-day, five-day or two-month period) to the kind of support they could receive, such as:
A search for systematic reviews that address an issue
A summary of the take-home messages from quality-appraised systematic reviews addressing many facets of an issue, or
A comprehensive assessment of the research evidence available that will clarify a problem, frame options to address it, and address how an option will be implemented (i.e. a policy brief, as described in Article 13 )
The final column of Figure 2 highlights desirable practices that can be applied in a priority-setting approach, including the use of norms about timelines for different types of support. The other practices highlighted in this figure form the focus of Questions 2-4 below. Table 2 provides an example of timelines for (and capacity to provide) different types of support, as well as applications of the insights from questions 2-4, to the priority-setting approach used in a Ministry of Health.
2. Does the process incorporate explicit criteria for determining priorities?
Explicit criteria can help to guide those involved in a priority-setting process and, if confidentiality restrictions permit, in communicating the rationale for decisions about priorities to other policymakers and stakeholders. Three possible criteria for prioritising a given issue include:
The underlying problem(s), if properly addressed, could lead to health benefits, improvements in health equity or other positive impacts, now or in the future
Viable options, if properly implemented, could affect the underlying problem(s), and hence lead to health benefits, improvements in health equity or other positive impacts, or could lead to reductions in harms, cost savings or increased value for money, and
Political events could open (or political events may already have opened) ‘windows of opportunity’ for change. For example, in 1993 Taiwan’s President submitted a national health insurance bill to Parliament in order to pre-empt a challenge by an opposition party . The pending challenge opened a significant window of opportunity for change, and for finding and using research evidence to support policymaking about national health insurance
The application of these criteria requires readily available data and research evidence, as well as collective judgement (based on these and other considerations) about whether an issue warrants prioritisation. A thorough assessment would only be needed for a limited range of issues considered to be of higher priority.
The first criterion listed above relates, in part, to concerns such as the burden of illness and the likely severity of new or emerging illnesses. But it also relates to judgements about how likely it is that the underlying problem(s) can be addressed. These underlying problem(s) may vary in scope, ranging from a narrow focus on the specific characteristics of particular illnesses and injuries, through to the programmes, services and drugs used to prevent or treat these illnesses and injuries, and/or the health system arrangements that support the provision of programmes, services or drugs. Given that data and research evidence about underlying problem(s) may not be readily available or may be lacking entirely, other considerations may need to be introduced. (Article 4 in this series provides an overview of the processes involved in using research evidence to clarify problems) .
The second criterion requires judgement about how likely it is that options will have acceptable costs and desired consequences (i.e. how likely it is that they would be considered viable). Framing options to address a problem – the focus of Article 5 in this series – requires systematic reviews of studies to examine the benefits and harms of options, as well as data or research evidence about costs and cost-effectiveness . Two recent developments, namely the growth of databases containing systematic reviews and the growing availability of policymaker-friendly summaries of systematic reviews that can be linked to from these databases (which are the focus of Article 7), have made preliminary assessments of this type increasingly feasible . However, where research evidence about the viability of options is not readily available, other considerations will need to be introduced.
The third criterion requires judgement about whether a window of opportunity for action could open, or has opened . As we review further in Article 4, such opportunities can occur because of the attention that is given to a problem at particular moments in time . Significant media coverage, for example, may be given to documented cases of significant gaps in quality and access in cancer care delivery. These windows, however, can close equally fast because media attention tends to move on quickly. Windows of opportunity may also be opened by political events, such as, for example, the formation of a coalition of stakeholders who have chosen to take action on a particular issue, or when a politician with a personal interest in an issue is appointed as a Minister of Health. Some events related to problems or politics can be predicted, such as the publication of periodic reports by national statistical agencies, the development of a national health sector strategic plan, and the setting of annual budgets, as well as elections. But often the specific nature of the opportunity can’t be.
3. Does the process incorporate an explicit process for determining priorities?
Explicit criteria do not make decisions – people do. And a systematic and explicit process can help them to make decisions in a defensible way. Four possible desirable features of a priority-setting process include:
It is informed by a pre-circulated summary of available data and evidence and by a discussion about the application of explicit criteria to issues that are considered for prioritisation
It ensures fair representation of those involved in, or affected by, future decisions about the issues that are considered for prioritisation
A facilitator is engaged who uses well-constructed questions to elicit views about the priority that should be accorded to issues as well as the rationale for their prioritisation, and
An experienced team of policymakers and researchers is engaged to turn high-priority issues into clearly defined problem(s) and viable options that will be the focus of more detailed assessments
The preparation of a pre-circulated summary of available data and evidence about possible priority issues is a highly efficient way of preparing participants for a priority-setting process. Gaps in the data and research evidence can be as important to describe as what is available. Such summaries can provide common ground for discussions.
A priority-setting process would ideally bring together the many parties involved in, or affected by, any future decisions related to the issues that are under consideration as possible priorities. Doing this requires careful mapping of the full range of stakeholders and then selecting appropriate individuals from different stakeholder groups of. Confidentiality provisions may be particularly challenging in this process if they preclude the involvement of those who will be affected by any future decisions related to the issues concerned. Civil servants, and especially politicians, may then be required to participate on their behalf.
A skilled, knowledgeable and neutral facilitator is required to ensure that a priority-setting process runs well. In Article 14 in this series, we describe the rationale for this combination of attributes . For a priority-setting process that is entirely internal to government, it may be ideal if the facilitator is drawn from a decision-support unit, rather than from divisions in charge of particular policy domains (e.g. human resources policy) or particular programmes (e.g. diabetes care).
An experienced team of policymakers and researchers is required to turn high-priority issues into clearly defined problem(s) as well as viable options that will form the focus of more detailed assessments. The team would ideally establish clear timelines for each issue that needs to be addressed. The team could also provide guidance about which issues could be addressed in-house, and which could be contracted out. If certain issues are deemed confidential, these too could either be dealt with in-house or contracted out with clearly stated confidentiality clauses in the work contracts.
While this process may sound complex, as described in Table 2, it can be operationalised in a very practical way in a given setting.
4. Does the process incorporate a communications strategy and a monitoring and evaluation plan?
A communications strategy is needed to ensure that policymakers and stakeholders are informed of the high-priority issues so that they can prepare input into the further clarification of the problems, the framing of options, and addressing how an option will be implemented. Ideally, a range of materials, fine-tuned for different stakeholders, would be produced as part of the communications strategy. However, in some contexts or for some issues, confidentiality provisions may not permit communication with certain stakeholders.
Even the best communications strategy will not reach everyone and it may not elicit the desired commitment to address the high-priority issues. A monitoring plan can help to address this by identifying when high-priority issues are not being addressed within the established timeframe. An accompanying evaluation plan can be used to examine particular issues in a more systematic way, such as the impacts of the priority-setting process on the policymaking process, and how and why stakeholders respond to the priorities identified.
Setting priorities for finding and using research evidence to support evidence-informed policymaking can all too easily be skipped over entirely or done too rapidly or in too cursory a way. Moreover, the selected approach to priority setting may not be implemented or it may not be implemented fully. It may also not possible to repeat a particular approach periodically given that windows of opportunity may open and close at different times. Any such failures in priority setting may mean that significant opportunities to support evidence-informed policymaking are missed and that the culture of evidence-informed policymaking is eroded. Close attention should therefore be paid to whether timelines for addressing high-priority issues in different ways are realistic and are being met, whether the criteria and process chosen for determining priorities are realistic and being used, and whether a communications strategy and monitoring and evaluation plan have been developed and are being implemented. Even in highly resource-constrained environments, attention to such issues is likely to ensure that existing resources to support evidence-informed policymaking are directed to where they can have the biggest impact.
Useful documents and further reading
Healy J, Maxwell J, Hong PK, Lin V: Responding to Requests for Information on Health Systems from Policy Makers in Asian Countries. Geneva, Switzerland: Alliance for Health Policy and Systems Research, World Health Organization; 2007 . – Source of lessons learned about organisations that support evidence-informed policymaking, but with little attention given to how priorities are set by these organisations (http://www.who.int/alliance-hpsr/RespondingRequests_HS_AsianCountries_Healy.pdf)
Nolte E, Ettelt S, Thomson S, Mays N: Learning from other countries: An on-call facility for health care policy. Journal of Health Services Research and Policy 2008, 13 (supp 2): 58-64 . – Source of lessons learned by an independent organisation that supports evidence-informed policymaking, with some attention given to how priorities are set by the organisation
Links to websites
Global burden of disease: http://www.who.int/topics/global_burden_of_disease/en – Source of data and research evidence about the global burden of disease. This information can be one input among many in priority setting for evidence-informed policymaking.
Disease Control Priorities Project: http://www.dcp2.org/main/Home.html – Source of research evidence and recommendations about the programmes, services and drugs that should be prioritised in different types of countries. This information can be one input among many in priority setting for evidence-informed policymaking.
CHOosing Interventions that are Cost-Effective (CHOICE): http://www.who.int/choice/en – Source of data, research evidence and a tool about the programmes, services and drugs that should be prioritised in different regions and countries. This information can be one input among many in priority setting for evidence-informed policymaking.
Canadian Priority Setting Research Network: http://www.canadianprioritysetting.ca – Source of published articles about priority-setting in healthcare, which may provide lessons for priority setting for evidence-informed policymaking.
Lavis JN, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). Introduction. Health Res Policy Syst. 2009, 7 (Suppl 1): I1-10.1186/1478-4505-7-S1-I1.
Lavis JN, Permanand G, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 13. Preparing and using policy briefs to support evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S13-10.1186/1478-4505-7-S1-S13.
Lavis JN, Boyko J, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 14. Organising and using policy dialogues to support evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S14-10.1186/1478-4505-7-S1-S14.
Lavis JN, Wilson MG, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 4. Using research evidence to clarify a problem. Health Res Policy Syst. 2009, 7 (Suppl 1): S4-10.1186/1478-4505-7-S1-S4.
Lavis JN, Wilson MG, Oxman AD, Grimshaw J, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 5. Using research evidence to frame options to address a problem. Health Res Policy Syst. 2009, 7 (Suppl 1): S5-10.1186/1478-4505-7-S1-S5.
Fretheim A, Munabi-Babigumira S, Oxman AD, Lavis JN, Lewin S: SUPPORT Tools for evidence-informed health Policymaking (STP). 6. Using research evidence to address how an option will be implemented. Health Res Policy Syst. 2009, 7 (Suppl 1): S6-10.1186/1478-4505-7-S1-S6.
Abegunde DO, Mathers CD, Adam T, Ortegon M, Strong K: The burden and costs of chronic diseases in low-income and middle-income countries. Lancet. 2007, 370: 1929-38. 10.1016/S0140-6736(07)61696-1.
DeSavigny D, Kasale H, Mbuya C, Reid G: In Focus: Fixing Health Systems. 2004, International Development Research Centre, [http://www.idrc.ca/openebooks/411-6/]
Rudan I, Lawn J, Cousens S, Rowe AK, Boschi-Pinto C, Tomaskovic L, Mendoza W, Lanata CF, Roca-Feltrer A, Caneiro I: Gaps in policy-relevant information on burden of disease in children: a systematic review. Lancet. 2005, 365: 2031-40. 10.1016/S0140-6736(05)66697-4.
Stuckler D, King L, Robinson H, McKee M: WHO's budgetary allocations and burden of disease: a comparative analysis. Lancet. 2008, 372: 1563-9. 10.1016/S0140-6736(08)61656-6.
Hutubessy R, Chisholm D, Edejer TT: Generalized cost-effectiveness analysis for national-level priority-setting in the health sector. Cost Eff Resour Alloc. 2003, 1: 8-10.1186/1478-7547-1-8.
Laxminarayan R, Mills AJ, Breman JG, Measham AR, Alleyne G, Claeson M, Jha P, Musgrove P, Chow J, Shahid-Salles S: Advancement of global health: key messages from the Disease Control Priorities Project. Lancet. 2006, 367: 1193-208. 10.1016/S0140-6736(06)68440-7.
Mitton C, Donaldson C: Health care priority setting: principles, practice and challenges. Cost Eff Resour Alloc . 2004, 2: 3-10.1186/1478-7547-2-3.
Daniels N, Sabin J: Setting limits fairly. Can we learn to share scarce medical resources?. 2002, Oxford University Press
Gibson JL, Martin DK, Singer PA: Evidence, economics and ethics: resource allocation in health services organizations. Healthc Q. 2005, 8: 50-9, 4.
Kapiriri L, Norheim OF, Heggenhougen K: Using burden of disease information for health planning in developing countries: the experience from Uganda. Soc Sci Med. 2003, 56: 2433-41. 10.1016/S0277-9536(02)00246-0.
Kapiriri L, Norheim OF, Martin DK: Priority setting at the micro-, meso- and macro-levels in Canada, Norway and Uganda. Health Policy. 2007, 82: 78-94. 10.1016/j.healthpol.2006.09.001.
Ali N, Bhutta ZA, Bruce N, de Francisco A, Ghaffar A, Gulbinat W: The Combined Approach Matrix: A Priority-Setting Tool for Health Research. 2004, Global Forum for Health Research, http://www.google.ca/search?sourceid=navclient&ie=UTF-8&rlz=1T4GGLL_enCA333CA338&q=o+Ali+N%2c+Bhutta+ZA%2c+Bruce+N%2c+de+Francisco+A%2c+Ghaffar+A%2c+Gulbinat+W%2c+et+al.%3a+The+Combined+Approach+Matrix%3a+A+Priority-Setting+Tool+for+Health+Research.+Global+Forum+for+Health+Research%3b+2004
Gross CP, Anderson GF, Powe NR: The relation between funding by the National Institutes of Health and the burden of disease. N Engl J Med. 1999, 340: 1881-7. 10.1056/NEJM199906173402406.
Lomas J, Fulop N, Gagnon D, Allen P: On being a good listener: setting priorities for applied health services research. Milbank Q. 2003, 81: 363-88. 10.1111/1468-0009.t01-1-00060.
Nuyens Y: Setting priorities for health research: lessons from low- and middle-income countries. Bull World Health Organ. 2007, 85: 319-21. 10.2471/BLT.06.032375.
The Working Group on Priority Setting: Priority setting for health research: lessons from developing countries. The Working Group on Priority Setting. Health Policy Plan. 2000, 15: 130-6. 10.1093/heapol/15.2.130.
Oxman AD, Schunemann HJ, Fretheim A: Improving the use of research evidence in guideline development: 2. Priority setting. Health Res Policy Syst. 2006, 4: 14-10.1186/1478-4505-4-14.
Fretheim A, Oxman AD, Lavis JN, Lewin S: SUPPORT Tools for evidence-informed health Policymaking (STP). 18. Planning monitoring and evaluation of policies. Health Res Policy Syst. 2009, 7 (Suppl 1): S18-10.1186/1478-4505-7-S1-S18.
Cheng TM: Taiwan's new national health insurance program: genesis and experience so far. Health Aff (Millwood). 2003, 22: 61-76. 10.1377/hlthaff.22.3.61.
Lavis JN, Oxman AD, Grimshaw J, Johansen M, Boyko JA, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 7. Finding systematic reviews. Health Res Policy Syst. 2009, 7 (Suppl 1): S7-10.1186/1478-4505-7-S1-S7.
Kingdon JW: Agendas, Alternatives, and Public Policies. 2003, Longman, 2nd
Healy J, Maxwell J, Hong PK, Lin V: Responding to Requests for Information on Health Systems from Policy Makers in Asian Countries. 2007, Alliance for Health Policy and Systems Research, World Health Organization, [http://www.who.int/alliance-hpsr/RespondingRequests_HS_AsianCountries_Healy.pdf]
Nolte E, Ettelt S, Thomson S, Mays N: Learning from other countries: an on-call facility for health care policy. J Health Serv Res Policy. 2008, 13 (Suppl 2): 58-64. 10.1258/jhsrp.2007.007146. [http://jhsrp.rsmjournals.com/cgi/reprint/13/suppl_2/58?maxtoshow=%26HITS=10%26hits=10%26RESULTFORMAT=%26fulltext=nolte%26searchid=1%26FIRSTINDEX=0%26sortspec=relevance%26resourcetype=HWCIT]
Please see the Introduction to this series for acknowledgements of funders and contributors. In addition, we would like to acknowledge Bob Nakagawa, Duff Montgomerie, Kent Ranson, Knut-Inge Klepp, Wija Oortwijn, Martin McKee, and Ole Frithjof Norheim for helpful comments on an earlier version of this article.
This article has been published as part of Health Research Policy and Systems Volume 7 Supplement 1, 2009: SUPPORT Tools for evidence-informed health Policymaking (STP). The full contents of the supplement are available online at http://www.health-policy-systems.com/content/7/S1.
The authors declare that they have no competing interests.
JNL prepared the first draft of this article. ADO, SL and AF contributed to drafting and revising it.