Skip to main content

Integrated knowledge translation guidelines for trainees in health research: an environmental scan

Abstract

Background

Collaborative health research, such as integrated knowledge translation (IKT), requires researchers to have specific knowledge and skills in working in partnership with knowledge users. Graduate students are often not provided with the opportunity to learn skills in how to establish collaborative relationships with knowledge users in the health system or communities, despite its importance in research. The objective of this environmental scan is to identify available guidelines for graduate trainees to use an IKT approach in their research.

Methods

We conducted an environmental scan with three separate systematic searches to identify guidelines available to support graduate students in engaging in an IKT approach to research: (i) a customized Google search; (ii) a targeted Canadian university website search; and (iii) emails to administrators of graduate studies programmes asking for available guidelines and documents designed for graduate students. Data were extracted using a standardized data extraction tool and analysed using a directed content analysis approach. Due to the minimal results included based on the a priori eligibility criteria, we returned to the excluded records to further review the current state of the environment on trainee support for IKT research.

Results

Our search strategy yielded 22 900 items, and after a two-step screening process with strict inclusion criteria three documents met the eligibility criteria. All three documents highlighted the need for an IKT plan for knowledge user involvement throughout the research process. Furthermore, documents emphasized the need for tangible steps to guide graduate students to engage in effective communication with knowledge users. Due to the lack of documents retrieved, we conducted a post hoc content analysis of relevant IKT documents excluded and identified five themes demonstrating increased education and engagement in an IKT approach at an interpersonal and organizational level.

Conclusion

We identified three documents providing guidance to trainees using a collaborative approach in their health research. This scan highlighted two key findings including the importance of supporting trainees to engage knowledge users in research and preparing an IKT plan alongside a research plan. Further research is needed to co-design guidelines to support graduate students and trainees in engaging in an IKT approach.

Peer Review reports

Introduction

Collaborative research approaches, such as co-production, co-design, engaged scholarship and integrated knowledge translation (IKT), aim to bridge the evidence to practice gap, and subsequent policy gaps [1]. IKT, specifically, is defined by Kothari and colleagues as “a model of collaborative research, where researchers work with knowledge users (i.e. patients, families, clinicians, decision-makers) who identify a problem and have the authority to implement the research recommendations (p. 299)”[2]. IKT has the potential to improve the quality of research completed [3], enhance the value of the research for decision-makers [4], improve the capacity of key knowledge users to engage meaningfully in research [4,5,6] and yield more useful results that provide greater impact to those affected [7,8,9,10].

Despite efforts to promote collaborative research approaches, most health research continues to operate independently from the health care system [11]. Key knowledge users, decision makers and other individuals impacted by research evidence are often left out of the research process. This fragmented and disconnected approach to research has led to challenges in ensuring successful completion of research projects, and implementation of meaningful changes based on research findings [11]. Several barriers to collaborative health research have been reported at the individual, interpersonal and organizational levels[12]. At the individual level, IKT is resource intensive, requiring a specific set of skills, knowledge and sufficient time [7]. Further, at the interpersonal level, establishing and maintaining research partnerships with key knowledge users can pose a significant barrier in successfully using an IKT approach [4, 7, 13]. A lack of understanding and skills of the collaboration process are significant barriers to the success of research partnerships with key knowledge users [4]. Lastly, the organizations that support trainees, knowledge users and researchers often have competing priorities (e.g. timely thesis/project completion, patient care, service delivery, resource use) which make it challenging to engage in IKT research [12, 14].

To address these barriers, effective collaborative health research requires researchers to have specific knowledge and skills to work in partnership with knowledge users [15]. Although there is a growing emphasis on researchers establishing knowledge and skills in collaborative partnerships, traditionally, IKT has not been taught in graduate health research programmes [15]. A survey of PhD-prepared researchers showed that they have unmet learning needs related to collaboration in research during their training [16]. Graduate students are often not provided with the opportunity to learn skills on how to establish collaborative relationships with knowledge users in the health system[13], and most do not receive training on collaborative health research approaches [17, 18]. Further, health system leaders report a significant lack of preparation in graduate health students engaging in collaborative research partnerships [19], which impedes the ability for students to successfully engage in an IKT approach to their research. Graduate students in health-related programmes should have access to resources to support their successful development of knowledge and skills in creating collaborative partnerships with key knowledge users in research [12].

We recently conducted a scoping review to identify how trainees have used an IKT approach in their health research [12]. A trainee is defined by the Canadian Institute of Health Research (2023) as “an individual who is enhancing their research skills through actual involvement in research and who works under the formal supervision of an independent researcher (p. 1)” [20]. The review identified a need for increased graduate level education and skills in conducting IKT, and a need to promote the value of IKT in trainee-led research [12]. Specifically, one major finding was that trainees reported a lack of knowledge and skills on co-production and difficulty navigating multiple competing priorities with their knowledge users. Despite the lack of knowledge and skills, trainees across diverse disciplines (e.g., nursing, physiotherapy, medicine, education) showed an overwhelming interest in using an IKT approach to research [12]. Currently, trainees who engage in research partnerships with knowledge users are often self-motivated, supported with experiential learning opportunities, and are supervised or receive mentorship from established researchers with expertise in IKT [21]. Establishing effective skills in building trusting, collaborative partnerships with knowledge users is imperative to ensure all health research trainees are engaging in meaningful, ethical research with relevant outcomes [22].

Efforts are needed to improve academic preparation for engaging in health research partnerships [19, 21]. A guideline is a promising tool to address the identified gap in knowledge and skill development for trainees in health research. Guidelines are familiar documents used in healthcare to support education and training of healthcare professionals [23]. As such, the objective of this environmental scan is to identify available guidelines and/or resources for graduate students and trainees to use an IKT approach in their research. To our knowledge, no reviews have been completed on this topic. Results from this review will guide the development of guidelines to support trainees in engaging in an IKT approach to research, thus improving the relevancy and impact of their research.

This paper reports on phase one of a multiphase study that aims to co-design guidelines for engaging in an IKT approach in graduate studies. The research team has engaged in an IKT approach in the completion of this study. The team is comprised of graduate students (lead author, and author 5), undergraduate student (author 3), health system partner (author 6) and graduate program educators (authors 2, 4 and 7). The larger program of work aims to address the following research question: How can graduate students use an IKT approach in their thesis work? As a first step in this study, we conducted an environmental scan of relevant documents related to guiding graduate students to engage in an IKT approach to research [24].

Methods

We conducted an environmental scan, a systematic approach to exploring the available information on a specific topic, to gain an understanding of the current state of resources available for graduate students in health to engage in an IKT approach to research [25]. The environmental scan followed Godin’s grey literature search methodology [26]. This methodology encompasses complementary search strategies including (1) customized Google searches, (2) a targeted website search and (3) expert consultations [26].

Aim of the environmental scan

The aim of the environmental scan was to identify and review relevant documents available to guide graduate students in engaging in an IKT approach to research. The following question and sub-question were used to guide the scan.

  • 1. What guidelines exist for graduate students to use an integrated knowledge translation approach in their research?

  • A. What are key components of the guidelines to be included in future co-development of guidelines for trainee engagement in IKT?

Identify relevant resources

We outlined key inclusion criteria in the categories of population, concept and context, to ensure identification of relevant studies [27]. Inclusion criteria has been developed on the basis of our previous work which identified a lack of guidelines for graduate students in health to engage in an integrated knowledge translation approach to health research [12]. We included only documents in the English language as authors were fluent in only the English language, which limited the ability to adequately assess documents completed in another language. No limits were set on publication date to document the evolution of documents over time.

Population

We included resources developed for the target audience of graduate students in health research. A graduate student can include masters’, doctoral or post-doctoral students in health-related research programmes. We also included resources that are noted for research trainees in health as defined by the CIHR as “an individual who is enhancing their research skills through actual involvement in research and who works under the formal supervision of an independent researcher (p. 1)” [20].

Concept

We included all documents, guidelines, papers and/or resources, hereby referred to as documents, that provided guidance on how to engage in collaborative partnership research, including but not limited to integrated knowledge translation, research co-production or engaged scholarship research. These approaches share similar underlying purposes of conducting research with the intent to enact change by engaging in collaborative partnerships with key knowledge users [1]. For the purpose of this review, authors have focused on IKT as the collaborative research term, given the context of the research is geographically located in Canada, where IKT is the most commonly used term, and origins are located in the discipline of health [1].

Context

This environmental scan will include documents developed for graduate students in health-related programmes.

Search strategy

We completed three complementary search strategies following Godin’s methodology. We worked with a librarian scientist to identify keywords to be used in the searches. We completed the environmental scan between April 2022 and August 2022. We screened the potential resources using the above-listed inclusion criteria to ensure relevant resources were included to meet the outlined research question and sub-question. We took a two-step screening approach to each customized search strategy. First, we completed a scan of the results based on their title and supplemental text; eligible materials based on title were saved in PDF form. Second, all eligible saved PDFs were screened on the basis of outlined inclusion criteria. Two reviewers met regularly to discuss the screening process and documents reviewed. A third reviewer (author 2) addressed any arising discrepancies between reviewers. We saved all documents meeting the outlined inclusion criteria.

Part 1: customized Google search

We conducted a customized search based on the power of relevancy ranking within the Google search engine to bring the most relevant results to the top of the list [26]. Then we pre-determined the number of pages we screened to ensure feasibility and consistency across searches. We used the Google search engine in “incognito” mode to ensure no recommended websites were in the search due to personal history. We completed six separate searches based on the keywords determined in consultation with the librarian specialist. The following key phrases were used in each search (1) “Integrated Knowledge Translation” Guide; (2) “Co-design” “In research” Guide; (3) “Knowledge User Engagement” “in research” Guide; (4) “Co-Production Research” Guide; (5) “Engaged scholarship” “in research” guide; and (6) “Collaborative Research Approach” Guide.

We first conducted a Google search using the above-outlined search phrases to identify the relevant organizations and websites publishing documents on the relevant subject area. The team reviewed the first 10 pages of each search’s hits (representing 100 results) for potentially relevant titles (supplemented with the text under the title). We recorded the website’s name/organization and Uniform Resource Locator (URL) into an Excel spreadsheet of potential documents meeting the inclusion criteria (Table 1). We saved the URLs to be further screened by two reviewers.

Table 1 Inclusion criteria template and associated inclusion definitions

Next, we hand-searched each of the relevant websites’ homepage for potentially relevant documents (e.g. web pages, reports). Within this step, we documented each website and the date each search was completed. Two reviewers screened all applicable documents and resources using a standardized inclusion template (Table 1). The documents meeting the inclusion requirements were kept for data extraction.

Part 2: Targeted Canadian university website search

One reviewer (author 1) completed a Google search to determine all possible Canadian universities that offered graduate programmes in health (N = 45). We chose to limit the targeted university website search to Canadian universities because the aim of the proposed environmental scan was to review what guidelines existed for trainees in health research to guide part 2 of the study. In part 2 of the study, we will be engaging in the co-design of guidelines for trainees’ engagement in IKT in a Canadian university; therefore, it was important to find documents which were context specific to Canadian universities. Furthermore, understanding IKT in the Canadian post-secondary system was imperative to ensure we were reviewing resources within the Canadian geographic, allowing us to use findings to inform future work. In addition, it was beyond the scope of the project to do a targeted search of all universities in the world. Further, documents from non-Canadian universities would be captured in the Google search. We used the search function on the qualifying university websites to search for each of the following terms: (1) “Integrated Knowledge Translation Guide”; (2) “Co-design guide”; (3) “Knowledge user engagement guide”; (4) “Co-Production Research Guide”; (5) “Engaged scholarship guide”; (6) “Collaborative Research Approach guide”. We reviewed the first 100 results from each individual search. The university websites use Google as a search engine for their website; therefore, the power of relevancy was assumed in the first 100 results.

We engaged in the two-step screening process as described above to identify relevant documents to meet our outlined research question and sub-question. Throughout the screening process we documented key aspects of the search including (1) the keywords used, (2) date searched, (3) total results retrieved, (4) an email contact (for search three detailed below) and (5) a copy of the eligible documents in PDF form. The documents saved were included for data extraction.

Part 3: Consultations with administrators via email

During the previous searches, we noted the email address of any expert (e.g. university administrators) to include in the final search. We saved a total of (N = 45) emails and sent an initial email on 23 June 2022 to prospective graduate student administrators. The email outlined the purpose of the proposed project and requested graduate student administrators to send any known documents available at their perspective universities that could be used as a guide for trainees to engage in an IKT research approach. Emails were sent directly to the Associate Dean of graduate studies where available, and if not available, an email was sent to the graduate studies email.

We sent the email using a secure university account (author 1). We documented the date the email was sent, responses, documents received and any follow-up. We were open to receiving responses up to 2 months following the sent date. Follow-up emails were sent where deemed necessary (e.g. another contact was provided).

We engaged in the two-step screening process as described above to identify relevant documents to meet our outlined research question based on the material that was sent through email. The documents meeting the inclusion requirements were kept for data extraction.

Data extraction

We created a data extraction tool to collect general information on the documents that met all three inclusion criteria, in three specific categories. First, we captured general information on the document’s characteristic including author, type of author, year of publication, purpose of document, setting, location and format of the document. Next, we identified characteristics of the documents that were specific to graduate students, including the following topics: health discipline, stage of training, and type of programme the document was geared towards. Finally, we reviewed all IKT content that was included in the document including a description of (1) the type of knowledge users involved; (2) the level of engagement based on the International Association of Public Participation (IAP2) tool [28]; (3) the steps taken to engage in an IKT approach; (4) suggested timeline to engage knowledge users in the research process; (5) reported outcomes of using an IKT guideline; and (6) any implications or recommendations. We piloted the data extraction tool with two independent reviewers (authors 1 and 3). No modifications were made following the pilot testing. We extracted data using an Excel spreadsheet, and a third reviewer (author 2) addressed any discrepancies between reviewers.

Data analysis

We used a directed content analysis approach [29] to analyse the extracted data from the documents meeting the inclusion criteria. Specifically, we coded the data using the International Association of Public Participation (IAP2)to determine how the documents suggested involving knowledge users in an IKT approach to research [28]. The IAP2 provides a framework to guide public participation in research endeavours. It encompasses a spectrum from “least” involved to “most” involved the public can be on research projects. The spectrum includes the following categories from least to most involved; (1) inform, where the public is informed of the project; (2) consult, where the researcher elicits feedback from the public; (3) involve, where the public is involved in the research process; (4) collaborate, where the public is involved in decision-making processes for the project; and (5) empowerment, where the public makes the final decisions for research processes [28]. Theoretically, only the collaborate and empowerment levels should be considered IKT; however, we used the full spectrum to understand how IKT is being described and employed in the documents.

Furthermore, we examined the stages of research that trainees were encouraged to engage knowledge users in, using Greenlee et al. engagement in the research process categories [30]. Finally, we narratively synthesized a description of outcomes explicitly shared in the document along with the content related to IKT.

Post hoc conventional content analysis

Due to the minimal retrieval of documents meeting the a priori eligibility criteria, we returned to the excluded records originally screened out during the second stage of the screening process for part one through three (N = 176). We felt there may be important insights to gather from the excluded records that were relevant but did not meet all three inclusion criteria. We included any document that was screened in during the first screening step.

Data extraction

We took field notes throughout the second stage of screening including listing the (1) content type (i.e. educational material, IKT event), and (2) reason for exclusion (i.e. resource was not inclusive for trainees) of the documents excluded in the second stage.

Data analysis

We used a conventional content analysis approach to further categorize the extracted data on the records excluded from the second stage of screening. We engaged in inductive category development with this dataset through back-and-forth discussion amongst team members [29]. First, we read all the extracted data repeatedly to fully immerse ourselves within the content. Next, we derived potential codes from the data extracted. Finally, we organized the codes into categories to create meaningful themes representative of the data found [29].

Results

Our environmental scan yielded a total of 22 900 items. After initial screening of titles, 183 resources remained for assessment based on detailed inclusion criteria. After second stage screening and removing duplicates (N = 4), three resources were included in the final review (Fig. 1). We report each search below separately. A summary of the results is included in Table 2.

Fig. 1
figure 1

Search diagram adapted from: Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021;372:n71. https://doi.org/10.1136/bmj.n71

Table 2 Results of three documents retrieved from the individual searches including (1) customized Google search, (2) targeted university search and (3) consultation with administrators

Part 1: Customized Google search

In total, 577 results were reviewed from the customized Google search and 50 potential resources were identified for full-text review. Of these, only two documents [31, 32] met the inclusion criteria. Neither of these documents was written directly for graduate students/ trainees; however, they included a category of researchers, including students, as part of the description. Both documents aimed to provide direction for researchers to engage in an IKT or similar type of collaborative research approach. Both documents were created in partnership: one document was a partnership between The Center for Excellence in Assisted Living (a health organization) and University of South Carolina (a university) [31], while the other was a partnership between Australian Health Research Alliance (a health organization) and Western Australian Health Translation Network (a knowledge translation institution) [32]. Documents were developed in the United States (N = 1) and Australia (N = 1). One document was developed in 2013 [31], while the other was more recent in 2021[32]. Both documents were accessible online through a Google search in PDF format.

In terms of IKT content for both documents, knowledge users were described as any consumer or person who would be affected by research [31, 32]. This statement was purposefully broad to include all possible consumers of research including patients, health organizations, funding agencies, community members, etc. Both documents emphasized the importance of knowledge users being involved in all aspects of the research, with a clear recommendation for knowledge users to be decision makers in the research process. Due to the emphasis and focus on decision-making, we classified both documents on the IAP2 scale as collaborate [28].

Both documents describe steps to ensure a seamless IKT approach, including a cyclical planning process [31, 32]. Both documents emphasized the importance of developing a plan for IKT, including a detailed step-by-step engagement and communication plan to ensure successful engagement throughout the research design. Furthermore, in applying a research process lens, as described by Greenlee et al. to the engagement of knowledge users, both documents identified the importance of early engagement from the project conception and planning stages [30]. Finally, both documents outlined the potential outcomes of using their resource to improve relevance and effectiveness of proposed research by using an IKT approach to research [31, 32].

Part 2: Targeted university search

In total 22 322 results were reviewed from the targeted university search; from these, 132 were identified as potential documents guiding graduate trainees in using an IKT approach to research. Two duplicates were removed. Of these 130 potential documents, only one met the detailed inclusion criteria [33]. The document was identified as a resource for engaging students in projects and research across a continuum. Although not directed to graduate students specifically, the document included all students at the university. The document was created in 2015 at the University of Alberta, with the intention that students and faculty use the document in university level projects and research. Ultimately, the purpose of these guidelines was to ensure diversity in participation in projects especially in terms of meaningful engagement and decision-making. This document was available in PDF format and accessible through the university’s website.

In terms of IKT content, the document described knowledge users as any individual that may be affected by the project and/or decisions made during the project/research. In applying the IAP2 [28] framework to data extraction, this document described the need to involve knowledge users on a continuum, depending on the needs of the project [33]. This recommendation is unlike the previous two resources analysed in the Google search [31, 32], as they both emphasized the importance of collaboration with all knowledge users despite the nature of the project. This document [33] emphasizes the importance of meeting the “involve level” in the IAP2 framework; however, it does not necessarily emphasize that each project must meet the collaborate or empowerment levels of engagement [28].

Furthermore, the steps to engage in an IKT approach were outlined with an emphasis on the planning stage to establish clarity of the knowledge users needed to be involved, and degree of involvement required. Additionally, there was an emphasis on planning for communication between researchers and knowledge users, ensuring there was a plan to establish and maintain effective communication throughout the project [33]. There were no specified outcomes reported in using this document in IKT research.

Part 3: Consultation with administrators

Nine university administrators responded to our email. Only one administrator provided a document in response to our request; however, it was a guideline for researchers and not for graduate students and so was not relevant to our review. Other responses included (1) automatic responses with no follow-up (N = 4); (2) responses indicating that the recipient of the email was unable to provide guidance (N = 2); and (3) responses indicating an alternate contact to follow up with (N = 3). Follow-up emails were sent to the alternate contacts identified, and no responses were received with the follow-up emails. No documents from this search strategy were included in data extraction.

Post hoc analysis: Response to minimal results

After the initial search yielded only three documents meeting a priori inclusion criteria, authors returned to the records excluded (N = 176) in the second stage of the screening process to conduct a post hoc analysis. Numerous documents (N = 71) were removed as the title originally screened was misleading and the record was not applicable to the study. A total of 105 records were included in the post hoc analysis. Five themes were identified through a conventional content analysis [29] highlighted in Table 3.

Table 3 Five themes identified through conventional content analysis in post hoc analysis

The first theme relates to “strategic plans and annual research reports with the goal of collaborative research”. Many universities emphasized the goal of partnerships and collaboration in research (N = 16). Some universities went as far as outlining goals for IKT research approaches for their faculty and students, but did not include any guidelines or recommendations for graduate students.

The second theme identified was “Grant funding applications and resources supporting and/or requiring IKT approach in application”. In the screening process, we found that many grant and funding applications required or emphasized the importance of using an IKT approach in research (N = 13).

The third theme identified was “courses, events, and education sessions for graduate student engagement in an IKT research approach”. We found that many courses, events and education sessions for students emphasized the importance of using an IKT approach in research (N = 19); however, none of these results were noted to be guidelines for trainees on how to engage in IKT research.

The fourth theme identified was “Information or education materials emphasizing importance of using an IKT approach in research”. This theme was the most prominent (N = 38). While many of the documents had valuable IKT content and discussion, most were not tailored to graduate students, and as such, were not deemed eligible for inclusion in the environmental scan. Many of the results included resources and information sessions on IKT and the importance of including this approach to improve research outcomes; however, none of these results were specific guidelines for trainees.

Finally, the fifth theme identified was “IKT Toolkits specific to researchers, but not inclusive of graduate students/trainees”. Many resources outlined specific tool kits to be used by researchers to ensure seamless engagement in an IKT approach to their research (N = 25). These toolkits were not, however, tailored to graduate students.

Discussion

We conducted an environmental scan to identify publicly available documents for graduate students and trainees in health to use an IKT approach to research. There was a lack of documents identified (N = 3) for graduate students and trainees to use an IKT approach to their research. The three documents meeting a priori eligibility criteria were not specific to IKT, but were designed to guide broad engagement in collaborative research methods. Although the documents were not specific to IKT, we did identify several important insights to support future work and guideline development for trainees using an IKT approach to research.

We identified two important findings from the three included documents identified in our environmental scan. These findings will be instrumental in guiding future resource development, implementation and evaluation for graduate students in health. First, all three documents emphasized the importance of engaging knowledge users in the research process [31,32,33]. More specifically, it was noted that engagement is critical to consider at the beginning of the project/research conception, urging graduate students/trainees to reflect on the involvement of their prospective knowledge users from project outset. Two out of the three documents suggested using a collaborative approach in all research situations [28], with an emphasis on shared decision-making amongst knowledge users and researchers as being key to successful collaborative research [31, 32]. These findings are echoed in the literature that highlights improved relevancy in results and translation of findings occurs with collaboration, empowerment and early engagement with key knowledge users [36, 38]. Early engagement of key knowledge users supports researchers to design research methods accessible and appropriate for their target population and, ultimately, improves richness and relevancy of results to improve health outcomes [38]. These findings further highlight the need to co-develop guidelines to support graduate students/trainees in health to engage in early reflection of knowledge user involvement in their research.

Second, in all three resources, there was an emphasis on including an IKT plan separate from the research proposal to ensure an IKT approach to research was implemented and sustained over the duration of the project [31,32,33]. When IKT engagement plans are thoughtfully developed, reviewed and evaluated throughout the research process, there is greater likelihood of improvements in research relevancy and uptake [39]. The use of an IKT plan alongside the research plan ensures engagement is sustained throughout the project [39]. We found similar findings in our environmental scan. The resources described steps related to the process of engaging and sustaining an integrated knowledge translation approach, partnering with knowledge users, and empowering them throughout the entire research process. Our previous scoping review identified that trainees reported feeling like outsiders to organizations, and cited this as a barrier in engaging in an IKT approach [12]. An IKT plan is a potential way to mitigate the feeling of being an outsider, as relationships are created at the inception of the project to build stronger collaborative research partnerships [40].

The included documents detailed communication plans on how to engage with knowledge users throughout the duration of the research project. The communication plan was made alongside the research protocol, ensuring that knowledge users would be properly engaged and empowered at every step of the research process. This included a range of activities, such as detailing monthly meetings to ensure feedback was received in a timely manner and developing an involvement agreement document to ensure all parties were aware of their respective responsibilities [32]. These activities were particularly important to ensure seamless engagement throughout the entire research process. Furthermore, one document suggested the designation of a research mentor, responsible for ensuring the inclusion and support for the knowledge user throughout the process [32]. Having a research mentor could potentially enhance the relationship between the research team and knowledge users, ensuring that the most effective outcomes can be achieved [32].

Post hoc analysis discussion

Our previous scoping review on trainee experiences with IKT [12] revealed important barriers in using an IKT approach for trainees at the individual, interpersonal, and organizational level. Our scoping review proposed the need for a culture shift in improving infrastructure supports for IKT in trainee led research [12]. Our post hoc conventional content analysis highlighted how this culture shift is happening through the identification of two important observations at the interpersonal and organizational level.

First, we found that collaborative research is a strategic goal for many Canadian universities. This finding demonstrates how universities are starting to value an IKT approach to research by engaging with key knowledge users in the community as a means of supporting research partnerships. Several documents from the targeted university search included strategic planning and annual reports that outlined goals for IKT research in their university programmes (N = 16). For instance, Concordia University outlined the goal of engaging in collaborative research approaches since 2015 [41]. Similarly, the University of Calgary stated a goal of integrated and collaborative research in their strategic research plan since 2012 [42].

There has been a shift in educational opportunities and events offered at universities in recent years to improve education and knowledge in IKT. In 2019, the University of Calgary held a symposium of mobilizing knowledge on newcomers [35]. This event was designed with four main goals in mind, one being that knowledge users and researchers (including graduate students) would have a space to collaborate and discuss priority concerns from a knowledge user point of view, to be addressed in research [35]. Providing the space for discussion and partnership between knowledge users and researchers, followed by education sessions from experts on collaborative research, is an example of how change is happening to educate graduate students in IKT.

Second, our previous scoping review revealed that a lack of funding was a barrier in using an IKT approach in trainee-led research [12]. Interestingly, we found throughout our post hoc analysis several documents emphasizing the need for an IKT approach in research funding applications (N = 13). This finding has also been noted in recent literature [1, 7]. Globally, some funding agencies have started to require the use of an IKT approach for grant applications and recognize the impact that an IKT approach has on research outcomes and uptake of research knowledge in practice [1, 7]. Many documents, in our post hoc analysis, described funding application requirements as having a plan for engaging in IKT in the proposed research plan. For instance, during the targeted university search, Strategy for Patient Orientated Research (SPOR) support units across Canada were highlighted on university websites due to their funding opportunities for graduate students. Maritime SPOR Support Unit (MSSU), for instance, offers the “MSSU Trainee Support Program”. This application requires students to share a knowledge user engagement plan as a critical component of their research proposal. The knowledge user and patient engagement plans constitute one third of the points allotted for the award [43].

Implications for research and practice

Despite these strategic goals, education events and IKT-related funding calls, no resources were offered by the university to guide graduate students/trainees in health research to meet this goal. Although numerous guidelines have been developed for researchers (N = 25), as identified in our post hoc analysis, these guidelines continue to be geared towards established researchers and not trainees. This lack of consideration for trainees leaves a gap in addressing unique barriers and challenges that trainees experience [12]. We recommend addressing this gap in the IKT literature by co-designing guidelines for engaging in an IKT approach to research. In using a co-design approach, end users (i.e. researchers, knowledge users and graduate students/trainees) are engaged creatively throughout the entire design process to ultimately improve the uptake of change in practice [44]. Furthermore, sustainability and maintenance of health care innovation and change can be improved through engagement in a co-design process [44]. Knowledge user engagement in a co-design process can address any equity concerns, along with any specific barriers to the individual [45]. Through engagement in a co-design event, guidelines for engaging in an IKT approach to research could be developed encompassing steps reflective of equity concerns and barriers found at an individual level for graduate students [12].

Limitations

This environmental scan has several limitations. First, we developed the search strategy based on previous research completed on terminology for partnership research [46]; however, partnership research approaches vary, and it is possible that we may have overlooked guidelines using different terminology. Second, the term integrated knowledge translation is a predominantly Canadian term, and therefore there is potential we may have missed resources describing research partnership guidelines in other languages or terminologies. Third, we limited included documents to those written in the English language. Authors were fluent in only the English language, which limited the ability to adequately assess documents completed in another language. Lastly, due to resource constraints, we were only able to conduct a targeted hand search and email survey of Canadian universities. We may have missed relevant records from other international universities or colleges.

Conclusion

This environmental scan aimed to identify the current state of guidelines for trainees to engage in an IKT approach in Canadian universities. We identified a lack of documents to support graduate students and trainees in using an IKT approach to health research. The three included documents outlined the importance of early engagement with key knowledge users, including how to properly engage and maintain relationships throughout the research process. The documents also outlined the importance of establishing an IKT plan separate from the research plan, ensuring that engagement of knowledge users was planned and evaluated throughout the research process. Although minimal documents were included, two important findings were noted in the post hoc conventional analysis of excluded records. At an organizational level, universities across Canada and funding agencies are starting to recognize the importance of using an IKT approach in trainee-led research. Universities are hosting educational events and funding agencies are offering support to graduate students engaging in an IKT approach in their research. Further efforts are now needed to build on this momentum and address barriers at an individual level supporting trainees to gain the required knowledge and skills to use an IKT approach to health research.

Data availability

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

IKT:

Integrated knowledge translation

IAP2:

International Association of Public Participation

References

  1. Nguyen T, Graham ID, Mrklas KJ, Bowen S, Cargo M, Estabrooks CA, et al. How does integrated knowledge translation (IKT) compare to other collaborative research approaches to generating and translating knowledge? Learning from experts in the field. Health Res Policy Syst. 2020;18(1):35.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Kothari A, McCutcheon C, Graham ID. Defining integrated knowledge translation and moving forward: a response to recent commentaries. Int J Health Policy Manag. 2017;6(5):299–300.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Mendell J, Richardson L. Integrated knowledge translation to strengthen public policy research: a case study from experimental research on income assistance receipt among people who use drugs. BMC Public Health. 2021;21(1):153–153.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Gagliardi AR, Berta W, Kothari A, Boyko J, Urquhart R. Integrated knowledge translation (IKT) in health care: a scoping review. Implement Sci. 2016;11(1):38.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Jagosh J, Macaulay AC, Pluye P, Salsberg J, Bush PL, Henderson J, et al. Uncovering the benefits of participatory research: implications of a realist review for health research and practice. Milbank Q. 2012;90(2):311–46.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Jessani NS, Valmeekanathan A, Babcock C, Ling B, Davey-Rothwell MA, Holtgrave DR. Exploring the evolution of engagement between academic public health researchers and decision-makers: from initiation to dissolution. Health Res Policy Syst. 2020;18(1):15.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Oliver K, Kothari A, Mays N. The dark side of coproduction: do the costs outweigh the benefits for health research? Health Res Policy Syst. 2019;17(1):33.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Walter I, Davies H, Nutley S. Increasing research impact through partnerships: evidence from outside health care. J Health Serv Res Policy. 2003;8(2 suppl):58–61.

    Article  PubMed  Google Scholar 

  9. Hofmeyer A, Scott C, Lagendyk L. Researcher–decision-maker partnerships in health services research: practical challenges, guiding principles. BMC Health Serv Res. 2012;12(1):280.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Oliver S, Liabo K, Stewart R, Rees R. Public involvement in research: making sense of the diversity. J Health Serv Res Policy. 2015;20(1):45–51.

    Article  PubMed  Google Scholar 

  11. Lamontagne F, Rowan KM, Guyatt G. Integrating research into clinical practice: challenges and solutions for Canada. CMAJ. 2021;193(4):E127.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Cassidy CE, Shin HD, Ramage E, Conway A, Mrklas K, Laur C, et al. Trainee-led research using an integrated knowledge translation or other research partnership approaches: a scoping review. Health Res Policy Syst. 2021;19(1):135.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Nyström ME, Karltun J, Keller C, Andersson GB. Collaborative and partnership research for improvement of health and social services: researcher’s experiences from 20 projects. Health Res Policy Syst. 2018. https://doi.org/10.1186/s12961-018-0322-0.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Hoekstra F, Mrklas KJ, Khan M, McKay RC, Vis-Dunbar M, Sibley KM, et al. A review of reviews on principles, strategies, outcomes and impacts of research partnerships approaches: a first step in synthesising the research partnership literature. Health Res Policy Syst. 2020;18(1):1–23.

    Article  Google Scholar 

  15. Barratt H, Shaw J, Simpson L, Bhatia S, Fulop N. Health services research: building capacity to meet the needs of the health care system. J Health Serv Res Policy. 2017;22(4):243–9.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Kyvik S, Olsen TB. The relevance of doctoral training in different labour markets. J Educ Work. 2012;25(2):205–24.

    Article  Google Scholar 

  17. Bornstein S, Heritage M, Chudak A, Tamblyn R, McMahon M, Brown AD. Development of enriched core competencies for health services and policy research. Health Serv Res. 2018;53(5):4004–23.

    Article  PubMed  PubMed Central  Google Scholar 

  18. McMahon M, Bornstein S, Brown A, Tamblyn R. Training for impact: PhD modernization as a key resource for learning health systems. Healthc Policy. 2019. https://doi.org/10.12927/hcpol.2019.25983.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Bowen S, Botting I, Graham ID, MacLeod M, de Moissac D, Harlos K, et al. Experience of health leadership in partnering with university-based researchers in Canada—a call to “Re-imagine” research. Int J Health Policy Manag. 2019;8(12):684–99.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Canadian Institutes of Health Research. Glossary of funding-related terms [Internet]. 2023. https://cihr-irsc.gc.ca/e/34190.html#t. Accessed 3 Feb 2023.

  21. Cassidy CE, Bowen S, Fontaine G, Côté-Boileau É, Botting I. How to work collaboratively within the health system: workshop summary and facilitator reflection. Int J Health Policy Manag. 2020;9(6):233–9.

    PubMed  Google Scholar 

  22. Antes AL, Kuykendall A, DuBois JM. Leading for research excellence and integrity: a qualitative investigation of the relationship-building practices of exemplary principal investigators. Account Res. 2019;26(3):198–226.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Panteli D, Legido-Quigley H, Reichebner C, Ollenschlager G, Schafer C, Busse R. Clinical Practice Guidelines as a quality strategy. In: Improving healthcare quality in Europe: Characteristics, effectiveness and implementation of different strategies [Internet]. Copenhagen (Denmark): European Observatory on Health Systems and Policies; 2019. (Health Policy Series; vol. 9). https://www.ncbi.nlm.nih.gov/books/NBK549283/?report=classic. Accessed 3 Feb 2023.

  24. Graham P, Evitts T, Thomas-MacLean R. Environmental scans. Can Fam Physician. 2008;54(7):1022–3.

    PubMed  PubMed Central  Google Scholar 

  25. Charlton P, Doucet S, Azar R, Nagel DA, Boulos L, Luke A, et al. The use of the environmental scan in health services delivery research: a scoping review protocol. BMJ Open. 2019;9(9): e029805.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Godin K, Stapleton J, Kirkpatrick SI, Hanning RM, Leatherdale ST. Applying systematic review search methods to the grey literature: a case study examining guidelines for school-based breakfast programs in Canada. Syst Rev. 2015;4(1):138.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Peters MDJ, Godfrey C, McInerney P, Munn Z, Tricco AC, Khalil, H. Chapter 11: Scoping Reviews (2020 version). In: Aromataris E, Munn Z (Editors). JBI Manual for Evidence Synthesis, JBI, 2020. Available from https://synthesismanual.jbi.global. https://doi.org/10.46658/JBIMES-20-12

  28. International Association for Public Participation. Public Participation Pillars [Internet]. https://cdn.ymaws.com/www.iap2.org/resource/resmgr/communications/11x17_p2_pillars_brochure_20.pdf. Accessed 2 Aug 2022.

  29. Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.

    Article  PubMed  Google Scholar 

  30. Greenlee R, Olden H, Tuzzio L, Dillon EC, Madrid S. Measuring the impact of patient-engaged research: how a methods workshop identified critical outcomes of research engagement. J Patient Cent Res Rev. 2017;4(4):237–46.

    Article  PubMed  PubMed Central  Google Scholar 

  31. CEAL-UNC Collaborative. A Manual for Community-Based Participatory Research [Internet]. 2013. https://www.shepscenter.unc.edu/wp-content/uploads/2013/05/CEAL-UNC-Manual-for-Community-Based-Participatory-Research-1.pdf. Accessed 3 Aug 2022.

  32. Australian Health Research Alliance WAHTN. Involving Consumers in Health and Medical Research [Internet]. 2021. Available from: https://wahtn.org/wp-content/uploads/2021/09/WAHTN-CCI-Handbook_29092021.pdf. Accessed 3 Aug 2022.

  33. University of Alberta, University of Alberta Student Union, The Graduate Students’ Association of the University of Alberta. UNIVERSITY OF ALBERTA STUDENT PARTICIPATION PROCESS HANDBOOK [Internet]. 2015. https://www.ualberta.ca/governance/media-library/documents/resources/guides-and-handbooks/ua-studentparticipationprocess-handbookwsummary.pdf. Accessed 3 Aug 2022.

  34. University of Alberta. How to Incorporate Patient Engagement and Integrated Knowledge Translation (iKT) GAP CIHR Project Grant Workshop [Internet]. 2020. https://era.library.ualberta.ca/items/05defd25-b846-43ac-a01b-6304bc834078/view/6612a827-3991-4f5d-8fca-d1f66e8ab407/2020-02-04%20-%20Patient%20Engagement%20&%20iKT%20Workshop%20-%20Powerpoint.pdf. Accessed 16 Aug 2022.

  35. Newcomer Research Network, University of Calgary. Mobilizing Knowledge on Newcomers Symposium [Internet]. 2019. https://www.ucalgary.ca/sites/default/files/teams/445/NRN%20Symposium%20Program%20(4).pdf. Accessed 12 Aug 2022.

  36. Canadian Institutes of Health Research. Guide to Knowledge Translation Planning at CIHR: Integrated and End-of-Grant Approaches [Internet]. 2015. https://cihr-irsc.gc.ca/e/documents/kt_lm_ktplan-en.pdf. Accessed 15 Aug 2022.

  37. Social Sciences and Humanities Research Council of Canada. A RESEARCHER GUIDE TO KNOWLEDGE TRANSLATION [Internet]. https://cdpp.ca/sites/default/files/Guide%20to%20Knowledge%20Translation_%20Infographic.pdf. Accessed 16 Aug 2022.

  38. International Alliance of Patients’ Organizations. Empowered Patients in Research: moving beyond participation [Internet]. 2017. https://www.iapo.org.uk/sites/default/files/files/Empowered%20Patients%20in%20Research(2).pdf. Accessed 15 Aug 2022.

  39. Elliott MJ, Allu S, Beaucage M, McKenzie S, Kappel J, Harvey R, et al. Defining the scope of knowledge translation within a national, patient-oriented kidney research network. Can J Kidney Health Dis. 2021;8:20543581211004804–20543581211004804.

    Article  Google Scholar 

  40. Stamatakis KA, Norton WE, Stirman SW, Melvin C, Brownson RC. Developing the next generation of dissemination and implementation researchers: insights from initial trainees. Implement Sci. 2013;8(1):29.

    Article  PubMed  PubMed Central  Google Scholar 

  41. University of Alberta. Comprehensive Institutional Plan 2015–2018 [Internet]. 2015. https://concordia.ab.ca/wp-content/uploads/2017/03/2015-2018-Comprehensive-Institutional-Plan.pdf?x42547. Accessed 5 Aug 2022.

  42. University of Calgary. 2012 Strategic Research Plan [Internet]. 2012. https://www.ucalgary.ca/research/files/research/strategicresearchplan2012.pdf. Accessed 5 Aug 2022.

  43. Maritime SPOR SUPPORT unit. MSSU Trainee Support Program [Internet]. 2022. https://mssu.ca/get-support/mssu-student-awards/. Accessed 15 Sept 2022.

  44. Bird M, McGillion M, Chambers EM, Dix J, Fajardo CJ, Gilmour M, et al. A generative co-design framework for healthcare innovation: development and application of an end-user engagement framework. Res Involv Engagem. 2021;7(1):12.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  45. Kerkhoff AD, Farrand E, Marquez C, Cattamanchi A, Handley MA. Addressing health disparities through implementation science—a need to integrate an equity lens from the outset. Implement Sci. 2022;17(1):13.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Hoekstra F, Mrklas KJ, Sibley KM, Nguyen T, Vis-Dunbar M, Neilson CJ, et al. A review protocol on research partnerships: a coordinated multicenter team approach. Syst Rev. 2018;7(1):217.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

S.G. is a PhD in Nursing Student at Dalhousie University School of Nursing and has had the support of the Master of Science in Nursing Entrance Scholarship, the Margaret Inglis Hagerman Graduate Scholarship, the School of Nursing PhD Scholarship, the Helen Watson Memorial Scholarship, the CIHR—Canada Graduate Scholarship—Master’s Program Award and the BRIC NS Student Research Award while completing this environmental scan.

Funding

This project was funded by the Nursing Research and Development Fund (award 2403-001) through Dalhousie University, Halifax, Nova Scotia.

Author information

Authors and Affiliations

Authors

Contributions

C.C., S.G., E.M., H.D.S., A.S. and S.B. conceptualized and designed the environmental scan. C.C., S.G. and J.A. co-developed the comprehensive search strategy with a librarian scientist. S.G. and J.A. screened the records and synthesized the data. C.C., S.G. and J.A. completed the first draft of manuscript. E.M., H.D.S., A.S. and S.B. provided feedback and edits on the draft for publication. All authors approved the final version for publication.

Corresponding author

Correspondence to Sarah Madeline Gallant.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

Authors have no conflict of interest to disclose.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gallant, S.M., Cassidy, C., Al-Rassi, J. et al. Integrated knowledge translation guidelines for trainees in health research: an environmental scan. Health Res Policy Sys 21, 74 (2023). https://doi.org/10.1186/s12961-023-01024-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12961-023-01024-3

Keywords