- Open Access
SUPPORT Tools for evidence-informed health Policymaking (STP) 13: Preparing and using policy briefs to support evidence-informed policymaking
Health Research Policy and Systemsvolume 7, Article number: S13 (2009)
This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers.
Policy briefs are a relatively new approach to packaging research evidence for policymakers. The first step in a policy brief is to prioritise a policy issue. Once an issue is prioritised, the focus then turns to mobilising the full range of research evidence relevant to the various features of the issue. Drawing on available systematic reviews makes the process of mobilising evidence feasible in a way that would not otherwise be possible if individual relevant studies had to be identified and synthesised for every feature of the issue under consideration. In this article, we suggest questions that can be used to guide those preparing and using policy briefs to support evidence-informed policymaking. These are: 1. Does the policy brief address a high-priority issue and describe the relevant context of the issue being addressed? 2. Does the policy brief describe the problem, costs and consequences of options to address the problem, and the key implementation considerations? 3. Does the policy brief employ systematic and transparent methods to identify, select, and assess synthesised research evidence? 4. Does the policy brief take quality, local applicability, and equity considerations into account when discussing the synthesised research evidence? 5. Does the policy brief employ a graded-entry format? 6. Was the policy brief reviewed for both scientific quality and system relevance?
This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers. The series is intended to help such people ensure that their decisions are well-informed by the best available research evidence. The SUPPORT tools and the ways in which they can be used are described in more detail in the Introduction to this series . A glossary for the entire series is attached to each article (see Additional File 1). Links to Spanish, Portuguese, French and Chinese translations of this series can be found on the SUPPORT website . Feedback about how to improve the tools in this series is welcome and should be sent to: STP@nokc.nohttp://www.support-collaboration.org.
Scenario 1: You are a senior civil servant and have been sent a policy brief that describes the research evidence about an issue that is of growing concern to the Minister. You are responsible for ensuring that the policy brief profiles research evidence in a way that informs different elements of the issue and recognises the importance of drawing on both local and global evidence. You want to ensure that the policy brief won't place the Minister in an awkward position by making a recommendation that is not politically or economically feasible.
Scenario 2: You work in the Ministry of Health and have been given a few hours to prepare an assessment of a policy brief that has been sent to the Ministry on a high-priority issue. All that you have been told is that this policy brief is different in a number of ways to the type of policy brief that you have produced in the past including the way in which it profiles research evidence about a problem, the options and implementation considerations, and the fact that it does not conclude with a specific recommendation.
Scenario 3: You work in an independent unit that supports the Ministry of Health in its use of research evidence in policymaking. You are preparing a policy brief for both the Ministry and key stakeholders to profile what is known and not known about a problem, options for addressing it, and implementation considerations. You have been told to prepare the brief in a systematic way and to report the methods and findings in a transparent and readily understandable way, but you want guidance on how to be both thorough and efficient in your work.
For policymakers (Scenario 1), this article suggests a number of questions that they might ask themselves or their staff to consider when assessing a policy brief. For those who support policymakers (Scenarios 2 and 3), this article suggests a number of questions to guide the assessment of a policy brief or the preparation of one.
Three major shifts have occurred recently in the focus of many efforts to package research evidence for policymakers. Firstly, there has been a shift from packaging single studies to packaging systematic reviews of studies that address typical policy-relevant questions. A number of research groups, including the SUPPORT collaboration http://www.support-collaboration.org/, now produce policymaker-friendly summaries of systematic reviews. These summaries always highlight the key messages from the review but some of them, like SUPPORT summaries, also address considerations related to quality, local applicability, and equity . This shift has made it easier for policymakers to scan broadly across large bodies of research evidence. And it has also enabled them to extract what they need to know easily from particular systematic reviews that directly address key features of any policy issue of interest.
Secondly, there have been more recent complementary efforts to package systematic reviews (together with local research evidence) in the form of a new product - the policy brief - which mobilises the best available research evidence on high-priority issues . For policy briefs, the starting point is the issue and not the related research evidence that has been produced or identified. Once an issue is prioritised, the focus then turns to mobilising the full range of research evidence addressing the different features of the issue concerned. These include the underlying problem, options to address the problem, and key implementation considerations. Drawing on available systematic reviews makes the process of evidence mobilisation feasible in a way that would not otherwise be possible if single studies had to be identified and synthesised for all the features of the issue. In this article, we have restricted our use of the term 'policy brief' to those products matching this description exactly. But the term has also been applied elsewhere to many other types of products prepared by those supporting policymakers. The appropriation of this term by those involved in producing and supporting the use of research evidence reflects perhaps their increasing orientation to the needs and contexts of policymakers.
Evidence-packaging mechanisms and policy briefs in particular have been developed largely as a response to the findings of systematic reviews of factors influencing the use of research evidence in policymaking [4, 5]. Three factors in particular have emerged as significant. These are: 1. Timing or timeliness, 2. Accordance between the research evidence and the beliefs, values, interests, or political goals and strategies of policymakers and stakeholders, and 3. Interactions between researchers and policymakers.
Having access to both a stock of the summaries of systematic reviews and policy briefs helps to address the need that policymakers have for timely inputs to policymaking processes . Review summaries and policy briefs can typically be produced in days and weeks rather than the months or years required to prepare a systematic review from scratch. Undertaking primary research (i.e. original studies) can be similarly and often more time intensive. Evidence-packaging mechanisms, and policy briefs in particular, can also make it easier for policymakers and other stakeholders to determine whether and how the available research evidence accords with their own beliefs, values, interests, or political goals and strategies. With a problem clarified, what is known and not known about the options clearly described, and key implementation considerations clearly flagged, policymakers may be more readily able to identify viable ways forward.
Thirdly, changes have occurred in the purpose for which packaged research evidence has typically been produced. Policy briefs are increasingly used as an input into policy dialogues involving individuals drawn from those who will be involved in, or affected by, decisions about a particular issue. These dialogues provide the opportunity for greater interaction between researchers and policymakers. Dialogues in which research evidence is just one input in a policy discussion form the focus of Article 14 in this series .
The formats used for evidence-packaging have often been developed in response to the few available empirical studies of the preferences of health policymakers for different kinds of mechanisms (and not their usage or effects, which typically have not been evaluated) [4, 8]. These studies have revealed a need amongst policymakers to have formats that both provide graded entry to the full details of a review and facilitate assessment of decision-relevant information . A graded-entry format of one page of take-home messages, a three-page executive summary that summarises the full report, and a 25-page report (i.e. a 1:3:25 format) has shown to be particularly promising . Presumably, either the one- or three-page summary should follow a structured format . Structured abstracts have been found to have an effect on intermediate outcomes such as searchability, readability and recall among healthcare providers. However, no studies have compared full text to structured abstracts and no studies have examined the impact of format features on policymakers . Decision-relevant information can include the important impacts (both benefits and harms) and costs (i.e. resources used) of policy and programme options, as well as local applicability and equity considerations .
Questions to consider
The following questions can be used to guide the preparation and use of policy briefs to support evidence-informed policymaking:
Does the policy brief address a high-priority issue and describe the relevant context of the issue being addressed?
Does the policy brief describe the problem, costs and consequences of options to address the problem, and the key implementation considerations?
Does the policy brief employ systematic and transparent methods to identify, select, and assess synthesised research evidence?
Does the policy brief take quality, local applicability, and equity considerations into account when discussing the research evidence?
Does the policy brief employ a graded-entry format?
Was the policy brief reviewed for both scientific quality and system relevance?
1. Does the policy brief address a high-priority issue and describe the relevant context of the issue being addressed?
Policy briefs are distinguished most clearly from other packaged evidence summaries by the fact that they begin with the explicit identification of a high-priority issue. In instances where an issue has been on the agenda of key stakeholders for some time, policy briefs may act as a way to spur progress. This is highlighted in the example shown in Table 1 of low coverage rates for artemisinin-based combination therapies (ACT) to treat uncomplicated falciparum malaria in sub-Saharan African countries. Alternatively, if the issue is relatively new, the policy brief may play an agenda-setting role. Either way, it is critical that the issue is deemed a priority by at least some key stakeholders. Ideally the prioritisation process should also be systematic and transparent and Article 3 in this series outlines an approach for achieving this .
A second key feature of policy briefs is that they are typically context-specific. Describing the key features of a context in the policy brief is important as a way of creating a level playing field among policy brief readers. Table 2 highlights issues related to limited or inequitable access to sustainable, high-quality community-based primary healthcare in Canada. There, as the policy brief explained, the issue could only be understood in the context of the particular features of Canadian primary healthcare and the existence of 'private delivery/public payment' arrangements with physicians. These are of particular importance in this context for they have meant historically that most primary healthcare in Canada is delivered by physicians working in private practice with first-dollar, public (typically fee-for-service) payment . Improving access in creative ways, including the use of collaborative practice models, requires an understanding that: 1. Physicians tend to be wary of potential infringements on their professional and commercial autonomy, 2. No other healthcare providers at this time can secure the public payment required to function independently as primary healthcare providers on a viable scale, and 3. Many forms of care (including prescription drugs and home care services) would still not be covered .
2. Does the policy brief describe the problem, costs and consequences of options to address the problem, and the key implementation considerations?
A policy brief would ideally describe different features of a problem, what is known (and not known) about the costs and consequences of options for addressing the problem, and key implementation considerations. As outlined in Article 4, a problem can be understood in one or more of the following terms :
The nature and burden of the actual common diseases and injuries that the healthcare system must prevent or treat
The cost-effective programmes, services and drugs that are needed for prevention and treatment, and
The broader health system arrangements that determine access to, and the use of, cost-effective programmes, services and drugs, including how they affect particular groups.
A policy brief would help to clarify the problem by diagnosing it in one or more of these terms.
Ideally, the number of options described in a brief that is to be presented to senior policymakers would conform to local document conventions. Three-option models, for instance, are familiar to many policymakers. But regardless of the number selected, each option in the policy brief can be characterised in terms of:
The benefits of each option
The harms of each option
The costs of each option or their relative cost-effectiveness (if possible)
The degree of uncertainty related to these costs and consequences (so that monitoring and evaluation can focus on particular areas of uncertainty if any given option is pursued)
Key elements of the policy option if it has been tried elsewhere and adaptation is being considered, and
Stakeholder views about and experiences with each option
A policy brief would help to make clear the trade-offs involved in selecting one option over others. If the options are not designed to be mutually exclusive, a policy brief would also help to make clear the benefits of combining particular elements of the different options and which combination of options might bring about positive synergies. Alternatively, the elements from one or more individual options could be presented first, followed by 'bundles' of options combining different elements in various ways.
Barriers to implementation (outlined in further detail in Article 6 in this series) are located at different levels, ranging from the consumer (citizen or healthcare recipient) level through to healthcare providers, organisations, and broader systems . Policy briefs would help to identify these barriers and describe what can reasonably be expected (again, in terms of benefits, harms, and costs) as a result of pursuing alternative implementation strategies to address these barriers. A policy brief could also identify considerations related to the preparation of a monitoring and evaluation plan. Table 3 provides a possible outline for a policy brief.
3. Does the policy brief employ systematic and transparent methods to identify, select, and assess synthesised research evidence?
Policymakers and a wide range of stakeholders who will be involved in or affected by a decision, are the main audience of a policy brief. Research language should therefore be kept to a minimum as most people will be unfamiliar with it. A policy brief, nevertheless, should still ideally describe how synthesised research evidence was identified, selected and assessed in ways that are easily understood. This objective can be achieved by using techniques such as explanatory 'boxes' within the brief to clarify or highlight particular concepts, or through the inclusion of additional appendices. The methods, too, should be systematic in nature and reported in a transparent yet understandable way. For example, users could be provided with a description of how systematic reviews addressing the benefits and harms of particular health system arrangements were identified through a search of continuously updated databases containing reviews in particular domains. This could provide significant reassurance to readers that most, if not all, key reviews had been found and that few, if any, key reviews had been missed.
4. Does the policy brief take quality, local applicability, and equity considerations into account when discussing the research evidence?
Systematic reviews may be of high or low quality, their findings may be highly applicable to a given policymaker's setting or of very limited applicability, and they may or may not give consideration to the impacts an option is likely to have on disadvantaged groups, and on equity in a specific setting. Ideally, a policy brief would flag such variations for policymakers and other readers. As outlined in Article 8, explicit criteria are available to assist with quality assessments . Importantly, some databases of systematic reviews, such as Rx for Change http://www.rxforchange.ca, provide quality ratings for all reviews contained in the database. If possible, a policy brief would provide a quality review for all systematic reviews from which key messages have been extracted. Explicit criteria are also available to assist with local applicability assessments and these are outlined in further detail in Article 9 . Given that policy briefs are typically context-specific, a policy brief would also ideally comment on the local applicability of the findings of any systematic reviews that are critical to an understanding of the impacts of any options being considered. Equity considerations can also be addressed using explicit criteria (see Article 10) . A policy brief should also note in its introduction whether any groups have been given particular attention in the brief. Group-specific key messages could be added to the overall key messages in each section.
5. Does the policy brief employ a graded-entry format?
A policy brief would ideally allow busy policymakers and other readers to scan the key messages quickly in order to determine whether these corresponded sufficiently closely to their key issue of concern and context to warrant reading the entire document. A graded-entry format could take a number of forms. These could be achieved, for example, through a 1:3:25 format - i.e. one page of take-home messages, a three-page executive summary, and a 25 page report . Or a brief may take the form of a 1:12 format, with one page of take-home messages followed by a 12-page report. Whatever form is chosen, the minimum that a policy brief should contain is a list of key messages, a report, and a reference list for those who wish to read more. The key messages would range from the identification of the problem through what is known about the options, and the key considerations for implementation.
A number of other features of a policy brief could engage potential readers and facilitate assessments of who was involved in preparing, informing and funding it. The title of a policy brief could be worded in a way that would engage policymakers and other stakeholders. This could be achieved, for example, by using a compelling question as a title. The cover and/or the acknowledgements section of a policy brief could provide a list of authors and their affiliations. It could also include a list of those involved in establishing the terms of reference of the policy brief, a list of the key informants contacted for additional perspectives on the issue and to identify relevant data and research evidence, and their affiliations. A list of funders for both the organisation producing the policy brief and the policy brief itself, and a statement about any conflicts of interest among authors could also form part of the policy brief document.
6. Was the policy brief reviewed for both scientific quality and system relevance?
Policy briefs need to meet two standards: scientific quality and system relevance. To ensure this, the review process could involve at least one policymaker, at least one other stakeholder, and at least one researcher. This so-called merit review process differs from a typical peer review process that would typically only involve researchers in the review process, and hence focus primarily on scientific quality. Involving policymakers and other stakeholders can help to ensure the brief's relevance to the health system.
Policy briefs are a new approach to supporting evidence-informed policymaking. Their preparation and use continues to evolve through practical experience. Evaluations of this new approach are needed in order to improve our understanding of which particular design features are well received for particular types of issues and in particular contexts. Describing the different features of a problem may, for example, be perceived as being particularly important for highly politicised topics where the very nature of the problem is contentious. Taking equity considerations into account through a focus on only one group may be perceived as inappropriate in political systems that may have a long tradition of either addressing all major ethnocultural groups in policy documents or perhaps of focusing on no groups in particular. Evaluations are also necessary as a way of improving our understanding of whether, and how, policy briefs influence policymaking. Table 4 provides a description of one approach to the formative evaluation of policy briefs.
Useful documents and further reading
Research Matters. Knowledge Translation: A 'Research Matters' Toolkit. Ottawa, Canada: International Development Research Centre: http://www.idrc.ca/research-matters/ev-128908-201-1-DO_TOPIC.html - Source of additional examples of policy briefs (Chapter 8) and, most importantly, guidance about effective communication (Chapters 6 and 7)
Canadian Health Services Research Foundation. Communication Notes: Reader-Friendly Writing - 1:3:25. Ottawa, Canada: Canadian Health Services Research Foundation: http://www.chsrf.ca/knowledge_transfer/pdf/cn-1325_e.pdf - Source of advice about writing for an audience of policymakers and other stakeholders
Lavis JN, Boyko JA: Evidence Brief: Improving Access to Primary Healthcare in Canada. Hamilton, Canada: McMaster Health Forum; 2009  - Example of a policy brief for a specific country (Canada)
Oxman AD, Bjorndal A, Flottorp SA, Lewin S, Lindahl AK: Integrated Health Care for People with Chronic Conditions. Oslo, Norway: Norwegian Knowledge Centre for the Health Services; 2008 : http://www.kunnskapssenteret.no/Publikasjoner/5114.cms?threepage=1 - Example of a policy brief that provides an exhaustive review of the potential elements of policy options before bundling them together into three viable options for a specific country (Norway)
Links to websites
Health Evidence Network/European Observatory on Health Systems and Policies: http://www.euro.who.int/hen/policybriefs/20070327_1 - Source of policy briefs targeted at policymakers in the World Health Organization's European Region
Program in Policy Decision-Making (PPD)/Canadian Cochrane Network and Centre (CCNC) database: http://www.researchtopolicy.ca/search/reviews.aspx - Source of policy briefs as well as systematic reviews and overviews of systematic reviews (with links to policymaker-friendly summaries of systematic reviews and overviews of systematic reviews)
SUPPORT Collaboration: http://www.support-collaboration.org - Example of a source of policymaker-friendly summaries of systematic reviews relevant to low- and middleincome countries
Lavis JN, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). Introduction. Health Res Policy Syst. 2009, 7 (Suppl 1): I1-10.1186/1478-4505-7-S1-I1.
Rosenbaum SE, Glenton C, Oxman A, Members of the SUPPORT Collaboration: Evidence Summaries Tailored for Health Policy Makers in Low- and Middle-Income Countries. 2009, Oslo, Norwegian Knowledge Centre for the Health Services
Colby DC, Quinn BC, Williams CH, Bilheimer LT, Goodell S: Research glut and information famine: making research evidence more useful for policymakers. Health Aff (Millwood). 2008, 27: 1177-82. 10.1377/hlthaff.27.4.1177.
Lavis JN, Davies HTO, Oxman A, Denis JL, Golden-Biddle K, Ferlie E: Towards systematic reviews that inform healthcare management and policymaking. J Health Serv Res Policy. 2005, 10: 35-48. 10.1258/1355819054308549.
Lavis JN, Hammill A, Gildiner A, McDonagh RJ, Wilson MG, Ross SE, Ouimet M, Stoddart GL: A Systematic Review of the Factors that Influence the Use of Research Evidence by Public Policymakers. Final Report Submitted to the Canadian Population Health Initiative. 2005, Hamilton, Canada, McMaster University Program in Policy Decision-Making
Lavis JN, Davies HT, Gruen RL, Walshe K, Farquhar CM: Working within and beyond the Cochrane Collaboration to make systematic reviews more useful to healthcare managers and policy makers. Healthc Policy. 2006, 1: 21-33.
Lavis JN, Boyko J, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 14. Organising and using policy dialogues to support evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S14-10.1186/1478-4505-7-S1-S14.
Lavis JN, Wilson MG, Grimshaw J, Haynes RB, Ouimet M, Raina P, Gruen R, Graham I: Towards Optimally Packaged and Relevance Assessed Health Technology Assessments: Report Submitted to the Canadian Agency for Drugs and Therapeutics in Healthcare. 2007, Hamilton, Canada, McMaster University Program in Policy Decision-Making
The Canadian Health Services Research Foundation (CHSRF): Communication Notes: Reader-Friendly Writing - 1:3:25. 2009, Ottawa, Canadian Health Services Research Foundation, [http://www.chsrf.ca/knowledge_transfer/pdf/cn-1325_e.pdf]
Haynes RB, Mulrow CD, Huth EJ, Altman DG, Gardner MJ: More informative abstracts revisited. Ann Intern Med. 1990, 113: 69-76.
Hartley J: Current findings from research on structured abstracts. J Med Libr Assoc. 2004, 92: 368-71.
Lavis JN, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 3. Setting priorities for supporting evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S3-10.1186/1478-4505-7-S1-S3.
Lavis JN: Political elites and their influence on health care reform in Canada. The Governance of Health Care in Canada. Edited by: McIntoch T, Forest P-G, Marchildon GP. 2004, Toronto: University of Toronto Press Incorporated, 257-79.
Lavis JN, Boyko J: Evidence Brief: Improving Access to Primary Healthcare in Canada. 2009, Hamilton, Canada: McMaster Health Forum
Lavis JN, Wilson M, Oxman AD, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 4. Using research evidence to clarify a problem. Health Res Policy Syst. 2009, 7 (Suppl 1): S4-10.1186/1478-4505-7-S1-S4.
Fretheim A, Munabi-Babigumira S, Oxman AD, Lavis JN, Lewin S: SUPPORT Tools for evidence-informed health Policymaking (STP). 6. Using research evidence to address how an option will be implemented. Health Res Policy Syst. 2009, 7 (Suppl 1): S6-10.1186/1478-4505-7-S1-S6.
Lewin S, Oxman AD, Lavis JN, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 8. Deciding how much confidence to place in a systematic review. Health Res Policy Syst. 2009, 7 (Suppl 1): S8-10.1186/1478-4505-7-S1-S8.
Lavis JN, Oxman AD, Souza NM, Lewin S, Gruen RL, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 9. Assessing the applicability of the findings of a systematic review. Health Res Policy Syst. 2009, 7 (Suppl 1): S9-10.1186/1478-4505-7-S1-S9.
Oxman AD, Lavis JN, Lewin S, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP). 10. Taking equity into consideration when assessing the findings of a systematic review. Health Res Policy Syst. 2009, 7 (Suppl 1): S10-10.1186/1478-4505-7-S1-S10.
Oxman AD, Bjorndal A, Flottorp S, Lewin S, Lindahl AK: Integrated Health Care for People with Chronic Conditions. 2008, Oslo, Norwegian Knowledge Centre for the Health Services, [http://www.kunnskapssenteret.no/Publikasjoner/5114.cms?threepage=1]
Wagner EH, Austin BT, Von Korff M: Organizing care for patients with chronic illness. Milbank Q. 1996, 74: 511-44. 10.2307/3350391.
Please see the Introduction to this series for acknowledgements of funders and contributors. In addition, we would like to acknowledge Sandy Campbell and staff in the Ontario Ministry of Health and Long-Term Care (MoHLTC) Planning Unit for helpful comments on an earlier version of this Article.
This article has been published as part of Health Research Policy and Systems Volume 7 Supplement 1, 2009: SUPPORT Tools for evidence-informed health Policymaking (STP). The full contents of the supplement are available online at http://www.health-policy-systems.com/content/7/S1.
The authors declare that they have no competing interests.
JNL prepared the first draft of this article. GP, ADO, SL and AF contributed to drafting and revising it.