Skip to main content
Download PDF

Knowledge translation for realist reviews: a participatory approach for a review on scaling up complex interventions

Health Research Policy and Systems volume 16, Article number: 101 (2018) Cite this article

Abstract

Background

Knowledge syntheses that use a realist methodology are gaining popularity. Yet, there are few reports in the literature that describe how results are summarised, shared and used. This paper aims to inform knowledge translation (KT) for realist reviews by describing the process of developing a KT strategy for a review on pathways for scaling up complex public health interventions.

Methods

The participatory approach used for the realist review was also used to develop the KT strategy. The approach included three main steps, namely (1) an international meeting focused on interpreting preliminary findings from the realist review and seeking input on KT activities; (2) a targeted literature review on KT for realist reviews; and (3) consultations with primary knowledge users of the review.

Results

The international meeting identified a general preference among knowledge users for findings from the review that are action oriented. A need was also identified for understanding how to tailor findings for specific knowledge user groups in relation to their needs. The literature review identified four papers that included brief descriptions of planned or actual KT activities for specific research studies; however, information was minimal on what KT activities or products work for whom, under what conditions and why. The consultations revealed that KT for realist reviews should consider the following: (1) activities closely aligned with the preferences of specific knowledge user groups; (2) key findings that are sensitive to factors within the knowledge user’s context; and (3) actionable statements that can advance KT goals, activities or products. The KT strategy derived from the three activities includes a planning framework and tailored KT activities that address preferences of knowledge users for findings that are action oriented and context relevant.

Conclusions

This paper provides an example of a KT strategy for realist reviews that blends theoretical and practical insights. Evaluation of the strategy’s implementation will provide useful insights on its effectiveness and potential for broader application.

Peer Review reports

Background

Knowledge created through application of the scientific method requires effort to translate into action. This process, which involves identifying who (e.g. healthcare providers, public health professionals, government decision-makers) potential knowledge users might be and how they might be involved in the process, is referred to as knowledge translation (KT). A commonly cited definition of KT is “a dynamic and iterative process that includes synthesis, dissemination, exchange and ethically-sound application of knowledge to improve health, provide more effective health services and products, and strengthen the health care system” [1]. The science of KT has developed significantly over the past two decades in response to growing demand for ensuring research findings are used to inform decision-making in clinical, organisational and policy contexts [2]. Theoretical frameworks exist that help to explain the knowledge-to-action process [3, 4] and applied research has been performed to understand the most effective ways to achieve desired KT outcomes in public health [5], healthcare [6, 7] and public policy [8].

A key part of KT that has been studied is knowledge synthesis or “the contextualization and integration of research findings of individual research studies within the larger body of knowledge on the topic” [1]. Although most syntheses will proceed through similar stages (e.g. form review team, formulate question, search and screen evidence, etc.), specific methods and data will be used depending on the research questions and intended use [9, 10]. For example, aggregative reviews may collect and combine quantitative data from primary studies in order to test hypotheses and make cause and effect statements about intervention effectiveness (i.e. what is the effect of X on Y?) [10]. Configurative reviews may collect, organise and interpret different types of data (qualitative, quantitative) in order to answer questions that help understand experiences and meanings, and generate theory about the world (i.e. what do we know about X and Y?) [10]. Realist reviews may aggregate and configure data to offer explanations about how an intervention works in particular contexts (i.e. what works for whom, in what circumstances, in what respects and how?) [10, 11]. Realist reviews, in particular, can be used by decision-makers to gain deep understanding about complex social interventions that can be used when planning and implementing national, regional or local level programmes [11]. To do so, realist approaches focus on understanding the contexts (i.e. circumstances that surround the implementation of a given intervention or phenomena), mechanisms (i.e. underlying processes that are sensitive to context and influence outcomes) and outcomes (i.e. effects that occur over time) [11,12,13,14]. Context, mechanism and outcome (CMO) configurations explain how specific actions interact with context, which in turn activate specific mechanisms and lead to specific outcomes.

The availability of findings from realist reviews, or any type of knowledge synthesis, does not assure that the intended benefits will be achieved or that knowledge-users will use the findings [15, 16]. Researchers employing co-creation approaches (e.g. integrated knowledge translation, community-based participatory research) report that research is more likely to be used in health systems by knowledge users [17]. However, the empirical knowledge base does not offer any clear guidance about the extent to which use extends beyond those involved in co-production processes, how knowledge users are actively engaged in dissemination planning, or the extent to which engagement actually leads to use. Strategies are required to address barriers to research use, such as access, timeliness, user-friendliness and relevance of evidence [8, 18], faced by decision-makers. In order to overcome such barriers, researchers have examined ways to effectively package the results from systematic reviews of intervention effectiveness to meet the needs of patients [19,20,21], healthcare professionals [22,23,24] and policy-makers [25]. For example, decision support aids and plain language summaries have been found to support the uptake of systematic review findings by patients and providers, respectively [21]. Similarly, we know that health system managers and policy-makers prefer to receive the findings of systematic reviews in the form of evidence briefs that present key messages and findings up front [26].

In general, there is some empirical evidence to guide decisions about the KT strategy for systematic reviews of effectiveness targeting healthcare professionals, policy-makers and senior managers [27]. This evidence includes understanding about who the knowledge should be transferred to, by whom, how, and with what effect [27]. This understanding can inform the development of any KT strategy. However, the literature is silent on whether or how to tailor such guidance for different types of reviews and on the influence of tailoring on use. Reviews differ from one another in terms of purpose, methods and nature of findings. Realist reviews are unique in that the aim is to develop explanatory insight (i.e. theory) to explain how an intervention works in practice, for whom and in what contexts [10, 11]. The broad scope of realist reviews will often require describing, analysing and synthesising a diverse and expansive range of document types (e.g. peer-reviewed research, administrative data, annual reports, legislative documents, transcripts) [28]. Although quality standards for reporting realist review findings are available [14], these standards do not explain how to translate theory-based findings for knowledge users. This paper aims to inform the development of KT for realist reviews, especially in supporting the intended influence on policy and practice. Members of the authorship team (CW, BR, LS) completed a realist review on pathways for scaling up complex public health interventions [29], and expanded the study by developing a KT strategy for the review. Discussion about KT took place early on in the review process. However, as findings started to emerge, it became clear that (1) the participatory approach was not sufficient to support use, and (2) existing KT frameworks did not provide sufficient guidance for tailoring the results. A strategy was needed to translate the findings of the realist review for use by different knowledge user groups. The focus of this paper is on the KT strategy – both the development process and the products.

Realist review on scaling up

Despite much success, many public health interventions fail to reach those most in need. This is particularly so for complex public health interventions, including in chronic disease prevention, that involve multi-component and multi-level efforts tailored to the contexts in which they are delivered [30]. A realist review was undertaken to understand how and under what conditions complex public health interventions may be scaled up to benefit more people and populations [29]. Scaling up refers to the process of improving coverage of and equitable access to innovations with demonstrated effectiveness on a smaller scale [30, 31]. The realist review focused on three cases of successfully scaled up interventions in order to understand pathways for scaling up. A systematic search for published and grey literature related to each case was carried out. Relevant literature informed the creation of CMO configurations, which were then compared, contrasted and interpreted alongside the review’s programme theory and diffusion of innovation theory. The synthesis process was highly participatory, engaging knowledge users and those with content and methods expertise. Engagement strategies with experts and knowledge users involved ongoing email communications and periodic teleconferences over the course of the study, and an in-person workshop.

The review found that four core mechanisms are commonly activated when scaling up complex public health interventions, namely awareness, commitment, confidence and trust. The mechanisms were activated by actions to renew and regenerate interventions, and documenting success. Specific actions included building partnerships, conducting evaluations, engaging political support and adapting funding models, all of which interact with contextual conditions. Resulting scaling up outcomes were the engagement of new communities, new or amended legislation, or adding new funding partners. Figure 1 is an example of one CMO configuration that also highlights the complexity of realist review findings. The example illustrates how the mechanism of commitment was activated by efforts to design a community succession plan within a context of long-standing poverty and high rates of high-school non-completion, eventually leading to a project focused on renewing and regenerating the community. The realist review advances understanding of the practice and theory of scaling up complex interventions by demonstrating that practitioners may benefit from a number of coordinated efforts, including conducting or commissioning evaluations at strategic moments, mobilising local and political support through relevant partnerships, and promoting ongoing knowledge exchange in peer-learning networks.

Fig. 1
figure 1

Context, mechanism and outcome (CMO) configuration to illustrate how commitment may be activated to renew and regenerate a complex community initiative

Full size image

Methods

Description of KT strategy development

Figure 2 illustrates the approach to KT strategy development. It was highly participatory, with members of the realist review’s knowledge user panel working closely with the research team to complete the three main activities, and translate them into the two components of the KT strategy. The approach was also informed by a subset of KT frameworks with relevance to public health [32,33,34,35,36,37,38]. Common elements among these frameworks (e.g. the importance of considering context given that specific factors can support or work against knowledge to action processes in different settings or circumstances) are reflected in the activities and components described below.

Fig. 2
figure 2

Approach used to develop the knowledge translation (KT) strategy

Full size image

International meeting

The initial step was an international meeting held in Toronto, Canada, that focused on scaling up cancer and chronic disease prevention interventions for population health impact. The idea for the in-person meeting came from knowledge users participating in the realist review who were interested in learning from each other about scaling up through practical examples. The objectives were to (1) compare and contrast preliminary findings from the review with knowledge user experiences; (2) refine KT plans for study findings (i.e. the focus of this paper); and (3) identify additional scaling up initiatives that may be promising to study as natural experiments.

A strategic mix of Canadian and international research, policy and practice leaders, with diverse experiences in scaling up cancer and chronic disease interventions were invited to participate in the meeting. Twenty-four individuals participated, including knowledge users with interest in the realist review results (n = 10), academics with expertise in scaling up and/or realist review methods (n = 8), and review team members (n = 6). Four international participants attended via videoconference. The 1-day meeting agenda (Additional file 1) included a panel discussion, presentations, small group work and facilitated large group discussions. A more detailed description of the international meeting is available in the full meeting report [39].

Literature review

A targeted review of the literature was carried out following the meeting. The goal was to identify at least a subset of papers that focused specifically on understanding how to optimise the impact of realist reviews. Keyword searches were conducted in Scopus, Web of Science and PubMed. Searches combined terms related to KT (“knowledge utilization/uptake/exchange/implementation”, “use of research findings”, “research utilization”) and realist reviews (“realist synthesis/evaluation”, “rapid realist review”). Members of the research team also nominated papers. Relevant papers were considered those that identified and described specific strategies (products, activities, approaches) used (or proposed) to translate realist review findings into action. One team member screened titles and abstracts as searches were completed. A different team member retrieved the full text for 33 articles and assessed them for relevance. Four articles were deemed relevant and, from these, data were extracted on details related to KT strategy.

Consultations with knowledge users

Discussion from the international meeting and findings from the literature review informed consultations with knowledge users to learn more about their KT needs and preferences. The interviews did not explore views about the KT strategy for realist reviews more generally. Three individuals that attended the international meeting and that represented key knowledge user organisations were invited and participated. The consultations were semi-structured and took place on the telephone. Topics explored included (1) primary audiences for the realist review within their organisation and findings most pertinent to them; (2) key factors (e.g. individual characteristics, organisational conditions) that might influence use of the review results; (3) preferences for KT activities; and (4) use of realist methodology to explore patterns and pathways for scaling up population interventions. The full set of questions is available in Additional file 1. One member of the research team conducted the consultations and made extensive notes during each call. The consultations were not audio-recorded or transcribed. Instead, a summary of each consultation was completed and sent to each consultee to confirm that their ideas were captured accurately.

Results

Contributions to the KT strategy from each activity in the planning process are summarised below. The KT strategy, which includes a planning framework and KT activities tailored to meet the needs of specific knowledge user groups, is also described.

International meeting

The meeting discussion pertaining to KT plans for the realist review on scaling up reflected four main areas. First, different knowledge user groups that were represented at the meeting (e.g. government and non-government organisations) were interested in different findings from the review. For example, one organisation was particularly interested in discussion about how to make scale up happen given their mandate to fund projects that might be scaled up. Another organisation expressed interest in learning about the role of networks within communities engaged in scale up initiatives. Second, knowledge users expressed interest in learning about the findings of the review through a KT strategy tailored to their needs and preferences. Several potential target audiences for the review’s results were identified (beyond the knowledge users in attendance at the meeting), including specific characteristics of each audience helpful in tailoring KT to meet their needs. These characteristics include preferences for specific KT activities, appropriate engagement strategies and timing of dissemination efforts, as well as value placed on establishing personal relationships with intended knowledge users. Third, there was acknowledgement among meeting participants (researchers and knowledge users) that KT for realist reviews is not well understood, and could be advanced by sharing the experience of developing a KT strategy for the realist review with others. Fourth, actions arising from the meeting included seeking further understanding about KT strategies for realist reviews from published literature as well as the KT needs and preferences of potential knowledge users.

Review of the literature

Of the four papers reviewed in-depth, two were realist reviews, one was a protocol for a realist review, and another focussed on describing rapid realist reviews (i.e. a realist approach to knowledge synthesis that emphasises producing a time-sensitive product responsive to policy-makers’ information needs). Specific types of KT activities identified in the papers included healthcare planning frameworks and tools to support decision-makers [40, 41], publications for academic and lay audiences [41], conference presentations [41], tailored workshops and presentations for knowledge users (e.g. policy-makers) [41, 42], and knowledge brokering to understand policy and academic perspectives and develop recommendations that are sensitive to local contexts [43]. Consistent with realist methodology, each paper described knowledge user engagement throughout the review process. The included papers articulated the aim of the KT strategy in different ways. Two papers indicated that their KT efforts would help them achieve goals related to the purpose of the research [41, 43]. One paper was more specific in how their findings would be used, stating that findings would inform the development of a new intervention [40]. The methodological paper identified several practical considerations for enabling KT for realist reviews such as engaging knowledge users with demanding time constraints (e.g. agency or government staff) in a reference group rather than an active member of the synthesis team [43]. Data extraction from the four papers is available in Additional file 1.

Consultations with primary knowledge users

The input received from knowledge users provided specific guidance for developing tailored KT activities for the scaling up review and preferences for KT associated with realist reviews in general. A focus on learning about key findings related to context was a common theme across the consultations. This includes identifying challenges (e.g. poverty, labour disruptions) that different groups may face when implementing programmes and recognising that these challenges may overshadow mechanisms. One knowledge user specifically noted the importance of identifying the preferences of senior managers in light of contextual factors that may impede the usability of the results. This could include preferences for when to disseminate results to avoid peak organisational times (e.g. fiscal year end) or what key messages to relay in order to emphasise how the results could further action and policy.

Another common theme across the consultations was the preference for findings that are action oriented. The knowledge users expressed interest in receiving review findings in the form of actions they can take to advance specific goals in a scaling up process. They expressed keen interest in the actions outlined in the realist review and not the mechanisms that relate to underlying processes. Actions were considered practical and could be used to inform their investments and planning. Examples of actions from the review included commissioning external evaluations, adapting a funding model to engage community-based organisations, and developing mergers between existing organisations with shared objectives.

Input received from knowledge users about tailoring KT activities included preference for evidence briefs as a KT product, particularly in contexts with high staff turnover and where practical guidance was valued. Other preferences included facilitated group discussions or presentations that describe study findings and provide opportunity for programme staff and managers to ask questions. Combining a presentation with an evidence brief was suggested as being particularly useful.

Knowledge users also explained that the realist methodology and terminology may not be well understood by practitioners and should be avoided in dissemination efforts. A suggestion to address this was providing a rubric with key terms along with any results.

KT strategy

Results from the three activities described above were integrated into a KT strategy for the realist review on scaling up. The KT strategy has two components, namely a planning framework and a set of KT activities tailored to knowledge user needs. The KT planning framework is presented in Box 1; it includes a set of KT principles and components intended to support the development of tailored KT activities that meet the needs of specific knowledge user groups.

Initial priority for using the framework was with three knowledge users who were most actively engaged in the realist review and the KT planning process. Table 1 represents an illustrative example of how this was done for one knowledge user group by using the input received during their consultation. The example highlights how tailored KT activities address the needs of three particular audiences with whom the knowledge user interacts. The planning framework helped the knowledge users identify the potential target audiences for the review’s findings, as well as key messages and KT products most appropriate for each.

Table 1 Use of the knowledge translation (KT) planning framework to develop tailored products or activities
Full size table

Discussion

We described development of a KT strategy for a realist review on scaling up complex public health interventions. Our approach to developing the strategy, as well as the strategy itself, was an extension of the original study and emerged as the study team learned about the knowledge needs and learning preferences of different knowledge user groups. The process included three main activities, namely an international meeting, a literature review and consultations with knowledge users. Insight gained from each of these activities culminated into a KT strategy consisting of a planning framework to support development of tailored KT activities that meet the needs of different knowledge user groups. The experience we document and share through this paper represents a practical contribution to the field of KT. Most notably, our experience highlights the importance of making KT explicit and the value of participatory approaches in KT planning. This paper also provides guidance about how to tailor findings from realist reviews to specific knowledge users.

Not necessarily unique to realist reviews, our experience demonstrates the importance of making KT planning tasks explicit from the outset, while maintaining openness to adapting plans [44]. Early discussions about KT helped elicit rich perspectives from both researchers and knowledge users about the KT strategy. As the review progressed and findings emerged, the KT strategy became formalised. It helped to have distinct steps that drew in practical experience (e.g. international meeting, consultations with knowledge users), and information from the KT literature. Our experience is consistent with other literature that found integrating and translating the insights from specific planning steps helped produce practical output [40,41,42,43] such as the KT planning framework and its application in the table of tailored KT products and activities.

The value of participatory approaches in KT planning is also apparent from our experience. This insight emerged through a series of interactions with knowledge users, throughout the completion of the realist review itself, and the KT planning process. The ability of knowledge users to identify such diverse and nuanced needs seemed to grow as engagement progressed. It may be that synergy accumulated among the research team through on-going successful collaboration, thus increasing the quality of outputs and outcomes of engagement over time [17]. While the use and benefits of participatory processes in health research are well-known [45, 46], the added value of engagement in specific stages of completing a realist review, including KT strategy development, are not specifically addressed in the research literature. Research related to the qualities of collaborative working (e.g. reciprocity, equality of partners) in co-produced research studies that support knowledge generation and translation may be a helpful starting point [47, 48].

More specific to realist reviews, we learned that findings need extensive tailoring, not only for different organisations, but also for different audiences within each organisation. For example, one organisation’s preferences for tailoring results included ensuring key messages ‘stick’ within the organisation amidst high staff turnover by embedding key messages in new staff training. Another organisation preferred that KT messages be tailored by keeping in mind a recent organisational shift from knowledge generation to better utilisation of existing evidence. Programme staff from knowledge user organisations would benefit from findings to support them in implementing or evaluating efforts to scale up knowledge gained from past complex initiatives, whereas senior managers would benefit more from learning about policy implications. The detailed and diverse needs expressed by our knowledge users may also be a result of the nature of findings from realist reviews. The complexity of realist review findings prompted considerable thought about what was needed, by whom, when and why.

Also specific to realist reviews was a very strong preference for action-oriented findings. We learned from the meeting and interviews that knowledge users are not interested in the theory building that is central to realist reviews. It became clear that a KT strategy should focus on findings that guide actions of knowledge users, including the contextual conditions under which actions are likely to be most successful [42, 43]. The specific mechanisms triggered by actions and changes in context were not considered as useful to the knowledge users involved in the realist review. Technical or realist jargon must also be avoided in messages. These findings reinforce what is known about effective KT [49, 50], extending insights to realist reviews.

Limitations

This paper draws on the experience of one research team in integrating different forms of knowledge to create a KT strategy for a realist review. While it is well known that knowledge user differences need to be borne in mind when planning KT, this paper provides a practical example of how this can be done. The approach was applied to a realist review on scaling up complex interventions; using the approach with other topics would help to discern its transferability. Implementing and evaluating the influence of the KT activities is also needed to understand the effectiveness of the approach to KT planning.

Conclusion

This paper begins to fill a gap in knowledge about KT for realist reviews and provides practical guidance for those engaged in scaling up complex interventions in public health. Future research might build on this work and explore the usefulness of realist reviews, including preferences of specific knowledge user groups (e.g. government policy-makers) for receiving the findings. Additional application and adaptation of our approach with other topic areas, by different teams, and in different contexts will help to discern its utility. An important next step is implementation and evaluation of the KT strategy.

Abbreviations

CMO:

Context, mechanism and outcome

KT:

Knowledge translation

References

  1. Canadian Institute for Health Research. About Knowledge Translation. http://www.cihr-irsc.gc.ca/e/29418.html. Accessed 13 Sept 2018.

  2. Almeida C, Báscolo E. Use of research results in policy decision-making, formulation, and implementation: a review of the literature. Cad Saude Publica. 2006;22:S7–19.

    Article  Google Scholar 

  3. Davison CM, Ndumbe-Eyoh S, Clement C. Critical examination of knowledge to action models and implications for promoting health equity. Int J Equity Health. 2015;14(1):49.

    Article  Google Scholar 

  4. Tabak RG, Khoong EC, Chambers D, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43(3):337–50.

    Article  Google Scholar 

  5. LaRocca R, Yost J, Dobbins M, Ciliska D, Butt M. The effectiveness of knowledge translation strategies used in public health: a systematic review. BMC Public Health. 2012;12:751.

    Article  Google Scholar 

  6. Gagliardi AR, Berta W, Kothari A, Boyko J, Urquhart R. Integrated knowledge translation (IKT) in health care: a scoping review. Implement Sci. 2016;11:38.

    Article  Google Scholar 

  7. Scott SD, Albrecht L, O’Leary K, Ball GD, Hartling L, Hofmeyer A, et al. Systematic review of knowledge translation strategies in the allied health professions. Implement Sci. 2012;7:70.

    Article  Google Scholar 

  8. Oliver K, Innvar S, Lorenc T, Woodman J, Thomas J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014;14(1):2.

    Article  Google Scholar 

  9. Tricco AC, Tetzlaff J, Moher D. The art and science of knowledge synthesis. J Clin Epidemiol. 2011;64(1):11–20.

    Article  Google Scholar 

  10. Gough D, Thomas J, Oliver S. Clarifying differences between review designs and methods. Syst Rev. 2012;1(1):28.

    Article  Google Scholar 

  11. Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review--a new method of systematic review designed for complex policy interventions. J Health Serv Res. 2005;10(Suppl 1):21–34.

    Article  Google Scholar 

  12. Astbury B, Leeuw FL. Unpacking black boxes: mechanisms and theory building in evaluation. Am J Eval. 2010;31(3):363–81.

    Article  Google Scholar 

  13. Hedstrom P, Ylikoski P. Causal mechanisms in the social sciences. Annu Rev Sociol. 2010;36:49–67.

    Article  Google Scholar 

  14. Wong G, Greenhalgh T, Westhorp G, Pawson R. Development of methodological guidance, publication standards and training materials for realist and meta-narrative reviews: the RAMESES (Realist And Meta-narrative Evidence Syntheses – Evolving Standards) project. Health Services and Delivery Research. Southampton: NIHR Journals Library; 2014;2(30).

    Article  Google Scholar 

  15. Centre for Reviews and Dissemination. Systematic Reviews: CRDs Guidance for Undertaking Reviews in Health Care. York: Centre for Reviews and Dissemination, University of York; 2008.

    Google Scholar 

  16. Chambers D, Wilson PM, Thompson CA, Hanbury A, Farley K, Light K. Maximizing the impact of systematic reviews in health care decision making: a systematic scoping review of knowledge-translation resources. Milbank Q. 2011;89(1):131–56.

    Article  Google Scholar 

  17. Jagosh J, Macaulay AC, Pluye P, Salsberg J, Bush PL, Henderson J, et al. Uncovering the benefits of participatory research: implications of a realist review for health research and practice. Milbank Q. 2012;90(2):311–46.

    Article  Google Scholar 

  18. Wallace J, Nwosu B, Clarke M. Barriers to the uptake of evidence from systematic reviews and meta-analyses: a systematic review of decision makers’ perceptions. BMJ Open 2012;2(5): pii: e001220.

    Article  Google Scholar 

  19. Brehaut JC, Eva KW. Building theories of knowledge translation interventions: Use the entire menu of constructs. Implement Sci. 2012;7:114.

    Article  Google Scholar 

  20. Santesso N, Rader T, Nilsen ES, Glenton C, Rosenbaum S, Ciapponi A, et al. A summary to communicate evidence from systematic reviews to the public improved understanding and accessibility of information: a randomized controlled trial. J Clin Epidemiol. 2015;68(2):182–90.

    Article  Google Scholar 

  21. Rader T, Pardo Pardo J, Stacey D, Ghogomu E, Maxwell LJ, Welch VA, et al. Update of strategies to translate evidence from cochrane musculoskeletal group systematic reviews for use by various audiences. J Rheumatol. 2014;41(2):206–15.

    Article  Google Scholar 

  22. Perrier L, Persaud N, Thorpe KE, Straus SE. Using a systematic review in clinical decision-making: a pilot parallel, randomized controlled trial. Implement Sci. 2015;10:118.

    Article  Google Scholar 

  23. Rosenbaum SE, Glenton C, Nylund HK, Oxman AD. User testing and stakeholder feedback contributed to the development of understandable and useful summary of findings tables for Cochrane reviews. J Clin Epidemiol. 2010;63(6):607–19.

    Article  Google Scholar 

  24. Maguire LK, Clarke M. How much do you need: a randomised experiment of whether readers can understand the key messages from summaries of Cochrane Reviews without reading the full review. J R Soc Med. 2014;107(11):444–9.

    Article  Google Scholar 

  25. Petkovic J, Welch V, Tugwell P. Do evidence summaries increase policy-makers’ use of evidence from systematic reviews: a systematic review protocol. Syst Rev. 2015;4:122.

    Article  Google Scholar 

  26. Ellen ME, Lavis JN, Wilson Michael G, Grimshaw J, Haynes RB, Ouimet M, Raina P, et al. Health system decision makers’ feedback on summaries and tools supporting the use of systematic reviews: a qualitative study. Evid Policy A J Res Debate Pract. 2014;10(3):337–59.

    Article  Google Scholar 

  27. Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7:50.

    Article  Google Scholar 

  28. Berg R, Nanavati J. Realist review: current practice and future prospects. J Res Pract. 2016;12(1):Berg.

    Google Scholar 

  29. Willis CD, Riley BL, Stockton L, Abramowicz A, Zummach D, Wong G, et al. Scaling up complex interventions: insights from a realist synthesis. Health Res Policy Syst. 2016;14:88.

    Article  Google Scholar 

  30. Edwards N. Scaling up health innovations and interventions in public health: a brief review of the current state of the science. Washington, DC: Conference to Advance the State of the Science and Practice on Scale-up and Spread of Effective Health Programs; 2010. http://www.ihi.org/education/Documents/ProgramMaterials/ScaleUpBlog/7a_Commissioned_Paper2_Public_Health.doc. Accessed 13 Sept 2018.

  31. Mangham LJ, Hanson K. Scaling up in international health: what are the key issues? Health Policy Plan. 2010;25(2):85–96.

    Article  Google Scholar 

  32. Butler H, Bowes G, Drew S, Glover S, Godfrey C, Patton G, et al. Harnessing complexity: taking advantage of context and relationships in dissemination of school-based interventions. Health Promot Pract. 2010;11(2):259–67.

    Article  Google Scholar 

  33. Lavis JN, Lomas J, Hamid M, Sewankambo NK. Assessing country-level efforts to link research to action. Bull World Health Organ. 2006;84(8):620–8.

    Article  Google Scholar 

  34. Lavis JN, Robertson D, Woodside JM, McLeod CB, Abelson J. How can research organizations more effectively transfer research knowledge to decisionmakers? Milbank Q 2003;81(2):221–48, 171–2.

    Article  Google Scholar 

  35. Ward V, House A, Hamer S. Developing a framework for transferring knowledge into action: a thematic analysis of the literature. J Health Serv Res Policy. 2009;14(3):156–64.

    Article  Google Scholar 

  36. Kitson AL. The need for systems change: reflections on knowledge translation and organizational change. J Adv Nurs. 2009;65(1):217–28.

    Article  Google Scholar 

  37. Davison CM. Knowledge translation: implications for evaluation. New Dir Eval. 2009;124:75–87.

    Article  Google Scholar 

  38. Court J, Young J. Bridging research and policy in international development: an analytical and practical framework. Dev Pract. 2006;16(1):85–90.

    Article  Google Scholar 

  39. Stockton L, Riley B, Willis C, Zummach D. Scaling up cancer and chronic disease prevention interventions for population health impact: report on a planning meeting. Waterloo; 2015. https://uwaterloo.ca/propel/sites/ca.propel/files/uploads/files/scaling-up_meetingreport_accessible_noappendices.pdf. Accessed 13 Sept 2018.

  40. Pearson M, Brand SL, Quinn C, Shaw J, Maguire M, Michie S, et al. Using realist review to inform intervention development: methodological illustration and conceptual platform for collaborative care in offender mental health. Implement Sci. 2015;10:134.

    Article  CAS  Google Scholar 

  41. Kastner M, Perrier L, Hamid J, Tricco AC, Cardoso R, Ivers NM, et al. Effectiveness of knowledge translation tools addressing multiple high-burden chronic diseases affecting older adults: protocol for a systematic review alongside a realist review. BMJ Open. 2015;5(2):e007640.

    Article  Google Scholar 

  42. Saul JE, Willis CD, Bitz J, Best A. A time-responsive tool for informing policy making: rapid realist review. Implement Sci. 2013;8(1):103.

    Article  Google Scholar 

  43. Carrey NJ, Curran JA, Greene R, Nolan A, McLuckie A. Embedding mental health interventions in early childhood education systems for at-risk preschoolers: an evidence to policy realist review. Syst Rev. 2014;3:84.

    Article  Google Scholar 

  44. Tchameni Ngamo S, Souffez K, Lord C, Dagenais C. Do knowledge translation (KT) plans help to structure KT practices? Health Res Policy Syst. 2016;14:46.

    Article  Google Scholar 

  45. Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, et al. Mapping the impact of patient and public involvement on health and social care research: a systematic review. Health Expect. 2014;17(5):637–50.

    Article  Google Scholar 

  46. Rycroft-Malone J, Burton CR, Bucknall T, Graham ID, Hutchinson AM, Stacey D. Collaboration and co-production of knowledge in healthcare: opportunities and challenges. Int J Health Policy Manag. 2016;5(4):221–3.

    Article  Google Scholar 

  47. Heaton J, Day J, Britten N. Collaborative research and the co-production of knowledge for practice: an illustrative case study. Implement Sci. 2016;11:20.

    Article  Google Scholar 

  48. Voorberg WH, Bekkers VJJM, Tummers LG. A Systematic review of co-creation and co-production: embarking on the social innovation journey. Public Manag Rev. 2015;17(9):1333–57.

    Article  Google Scholar 

  49. Bowen SJ, Graham ID. From knowledge translation to engaged scholarship: promoting research relevance and utilization. Arch Phys Med Rehabil. 2013;94(1 Suppl):S3–8.

    Article  Google Scholar 

  50. Armstrong R, Waters E, Crockett B, Keleher H. The nature of evidence resources and knowledge translation for health promotion practitioners. Health Promot Int. 2007;22(3):254–60.

    Article  Google Scholar 

Download references

Funding

Funding was provided through a Canadian Institutes of Health Research – Institute of Cancer Research Planning and Dissemination Grant (CIHR PCS-138841), with additional support from the Canadian Partnership Against Cancer (CPAC), and the Canadian Cancer Society [2011–701019] grant to the Propel Centre for Population Health Impact.

Availability of data and materials

Data sharing is not applicable to this article as no datasets were generated or analysed during the current study.

Author information

Authors and Affiliations

  1. Propel Centre for Population Health Impact, University of Waterloo, 200 University Ave West, Waterloo, ON, N2L 3G1, Canada

    Jennifer A. Boyko, Barbara L. Riley, Lisa Stockton & Dana Zummach

  2. Movember Foundation, P.O. Box 60, East Melbourne, VIC, 8002, Australia

    Cameron D. Willis

  3. Canadian Partnership Against Cancer, 145 King Street West Suite 900, Toronto, ON, M5H 1J8, Canada

    Jon Kerner

  4. Public Health Agency of Canada, 130 Colonnade Road A.L. 6501H, Ottawa, ON, K1A 0K9, Canada

    Kerry Robinson & Marie Chia

  5. Faculty of Health, Arts and Design, Swinburne University of Technology, John Street, Hawthorn, VIC, 3122, Australia

    Cameron D. Willis

Authors
  1. Jennifer A. Boyko
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Barbara L. Riley
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Cameron D. Willis
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lisa Stockton
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Dana Zummach
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jon Kerner
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Kerry Robinson
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Marie Chia
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JAB participated in data analysis/interpretation, drafted initial manuscript, co-led manuscript preparation and gave final approval of the manuscript. BLR participated in study conception and design, co-led the writing of the manuscript, and gave final approval of the manuscript. CDW participated in the conception and design of the study, critical revisions to the manuscript, and in final approval of the manuscript. LS was involved in project administration, data collection, critical revision of the manuscript, and final approval of the manuscript. DZ participated in data collection and final approval of the manuscript. JK, KR and MC contributed as knowledge users to the data collected, reviewed and contributed editorial suggestions for manuscript drafts, and provided final approval of the manuscript.

Corresponding author

Correspondence to Jennifer A. Boyko.

Ethics declarations

Ethics approval and consent to participate

The procedures undertaken in this study did not require ethical review by the University of Waterloo.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

International meeting agenda. Questions from consultations with knowledge users. Summary of papers considered relevant to understanding the knowledge translation (KT) strategy for realist reviews. (DOCX 30 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Boyko, J.A., Riley, B.L., Willis, C.D. et al. Knowledge translation for realist reviews: a participatory approach for a review on scaling up complex interventions. Health Res Policy Sys 16, 101 (2018). https://doi.org/10.1186/s12961-018-0374-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12961-018-0374-1

Keywords

Health Research Policy and Systems

ISSN: 1478-4505

Contact us