- Open Access
- Open Peer Review
This article has Open Peer Review reports available.
Collaborative and partnership research for improvement of health and social services: researcher’s experiences from 20 projects
© The Author(s). 2018
Received: 29 August 2017
Accepted: 4 May 2018
Published: 30 May 2018
Getting research into policy and practice in healthcare is a recognised, world-wide concern. As an attempt to bridge the gap between research and practice, research funders are requesting more interdisciplinary and collaborative research, while actual experiences of such processes have been less studied. Accordingly, the purpose of this study was to gain more knowledge on the interdisciplinary, collaborative and partnership research process by investigating researchers’ experiences of and approaches to the process, based on their participation in an inventive national research programme. The programme aimed to boost collaborative and partnership research and build learning structures, while improving ways to lead, manage and develop practices in Swedish health and social services.
Interviews conducted with project leaders and/or lead researchers and documentation from 20 projects were analysed using directed and conventional content analysis.
Collaborative approaches were achieved by design, e.g. action research, or by involving practitioners from several levels of the healthcare system in various parts of the research process. The use of dual roles as researcher/clinician or practitioner/PhD student or the use of education designed especially for practitioners or ‘student researchers’ were other approaches. The collaborative process constituted the area for the main lessons learned as well as the main problems. Difficulties concerned handling complexity and conflicts between different expectations and demands in the practitioner’s and researcher’s contexts, and dealing with human resource issues and group interactions when forming collaborative and interdisciplinary research teams. The handling of such challenges required time, resources, knowledge, interactive learning and skilled project management.
Collaborative approaches are important in the study of complex phenomena. Results from this study show that allocated time, arenas for interactions and skills in project management and communication are needed during research collaboration to ensure support and build trust and understanding with involved practitioners at several levels in the healthcare system. For researchers, dealing with this complexity takes time and energy from the scientific process. For practitioners, this puts demands on understanding a research process and how it fits with on-going organisational agendas and activities and allocating time. Some of the identified factors may be overlooked by funders and involved stakeholders when designing, performing and evaluating interdisciplinary, collaborative and partnership research.
Healthcare organisations are complex and knowledge intensive, with patients often taking for granted that care providers use the best available knowledge on diagnosis and treatment. Evidence-based medicine and practice ensure that the best available knowledge is used systematically in clinical care (e.g. ). Nevertheless, the gap between research and practice in healthcare is well-known and a recognised concern (e.g. [2, 3]), where failures to translate research into practical actions contribute to health inequities [4, 5]. The process from research-produced knowledge to its use in healthcare practices can take considerable time (e.g. ). The estimated lack of research use in the United States and the Netherlands has suggested that 30–40% of patients do not receive care complying with current research evidence . The required increase in the speed of uptake of evidence-based clinical practice guidelines has been frequently discussed (e.g. ) and factors influencing their adoption have been extensively studied (e.g. [9, 10]). Getting research into policy and practice in healthcare is a recognised, world-wide concern (e.g. ).
Several research areas deal with aspects related to the transfer of knowledge and use of research findings for improving healthcare. The view of research production as separate from the use of research findings initially inspired research on diffusion and implementation processes [12, 13], mainly focusing on the later stages of the research process with variable emphasis on a division between knowledge production and its implementation.
The shortcomings of the traditional ‘linear’ model of research-into-practice have become more evident . Van de Ven and Johnson  suggest that the problem may be one of methods for knowledge production rather than knowledge transfer or knowledge translation. To enhance a faster and more systematic use of knowledge, collaborative and interdisciplinary research approaches have been asked for as well as more useful research [15–17]. Research collaboration is assumed to enable and enhance both the use of research and increase the amount of research relevant to end users.
Research on knowledge transfer and exchange describes an interactive exchange of knowledge between research users and researcher producers [18, 19]. Knowledge transfer and exchange interaction between researchers and practitioners can take place from the on-set of the research process and involve more long-standing relationships. Several approaches to knowledge transfer have been described, focusing, for example, on systematic synthesis and guidelines, social interaction between researchers and decision-makers, contextual features and organisational readiness . The Canadian Institute of Health Research uses the term ‘integrated knowledge translation’ to describe projects where the knowledge users are involved as equal partners during the entire research process [21, 22].
Funding organisations have started to request research proposals to include researcher–decision-maker partnerships in collaborative research teams with representatives of industry, local communities and professional organisations (e.g. [23, 24]). The increased focus on research-use is also mirrored in research funders’ strategies (e.g. ). Some examples of collaborative initiatives are the Partnership projects and Centres financed by the National Health and Medical Research Council in Australia, the Dutch Academic Collaborative Centres for Public Health in the Netherlands, and The Collaborations for Leadership in Applied Health Research and Care in the United Kingdom (e.g. ), as well as the practice-based research networks and structured use of practice facilitators [27, 28] and the Integrated Delivery Systems Research Network programme to foster public–private collaboration between health service researchers and healthcare delivery systems in the United States . There are three main strategies that research funding agencies might use to enhance knowledge translation – push, pull, or linkage and exchange. The push–pull strategies distinguish between mechanisms driven by science (push) and those driven by the demands of practitioners or policy-makers (pull) . The linkage and exchange model is based on co-construction of applied knowledge and the relevance of applied research to both practitioners and researchers . In a recent review of the ways research funding agencies support science integration into policy and practice in the field of health , most of the 13 agencies investigated used one or two of these strategies. The large heterogeneity of users and how this may affect the use of various mechanisms for research initiation, development and dissemination was highlighted in this review.
Collaboration has been addressed for some time in community-based participatory research regarding public health and social issues in society (e.g. [32, 33]), for example, on how to achieve policy level collaboration (e.g. [24, 34]) and evidence-informed policy-making (e.g. ). Nevertheless, there is a need for more empirical research on the actual processes, conditions and outcomes of the more recent collaborative and partnership research initiatives in healthcare [36, 37] and, to date, there are few empirical studies on researchers’ approaches and experiences of the combination of interdisciplinary and collaborative and partnership research, including the actual effect of such programme or project calls. Less explored is also research partnership aiming to respond to the challenges and priorities of the health system and much research has been based on assumptions of researcher-driven initiatives with newly established collaborations .
Collaborative and partnership research
Approaches, strategies and roles
Collaboration and partnerships are two concepts used to describe the involvement of people and groups from different contexts and with different experiences, perspectives and agendas in research and development. Accordingly, collaborative research contains social relations and a variation of potential roles for those involved during the research process. In earlier research, means for collaboration were described in the form of ‘linkage mechanisms’ between researcher and user contexts, i.e. the presence of intermediaries (boundary spanners); formal and informal contacts with users during studies; involvement of users during data collection; and interim feedback . The boundary-spanning role of knowledge brokers has been brought forward as a bridge between research and practice (e.g. ). Knowledge brokering has been defined as “all the activity that links decision-makers with researchers, facilitating their interaction so that they are able to better understand each other’s goals and professional cultures, influence each other’s work, forge new partnerships, and promote the use of research-based evidence in decision-making” (, p. 131). Individuals, teams or organisations can all play the role of knowledge brokers [41, 42]. Michaels  describes six primary brokering strategies that span from more passive dissemination of information, interaction by seeking and using expert’s advice and linking different actors, to active engagements and close collaborative relations with healthcare actors, and which aim to inform, consult, match-make, engage, collaborate and build capacity. A recent study highlights the importance of effective ‘relationship brokering’ in researcher-health system partnership for establishing a meaningful collaboration .
A detailed road map on research collaboration is offered by Martin  in his description of five approaches to co-production of research. Depending on the chosen approach, stakeholders can be more or less involved in phases of the research process, from study design, data collection and analyses, to dissemination, while the degree of academic independence of the researcher/s and the utilisation of the research results may vary. Consequently, practitioners can play the role of informants, recipients, endorsers, commissioners or co-researchers.
On programme level, King et al.  describe four research programme operating models used in a collaborative approach to enhance research-informed practice in community-based clinical service organisations. The models describe the types of partnership involved such as the ‘clinician-researcher skills development model’, ‘clinician and researcher evaluation model’, ‘researcher-led evaluation model’, and the ‘knowledge-conduit model’. To differentiate research-practice partnerships from other ways of conducting research, Øvretveit et al.  suggest five criteria for partnership research, namely research that contributes to actions taken by actors within a health system; studies intended to produce quick and actionable findings as well as scientific publications; both researchers and practitioners take part in defining the research question and interpret findings; significant time and contributions from both researchers and practitioners; and an extensive formulated description of the partnership approach.
Challenges and enabling features
One challenge for collaborative and partnership research concerns the variation of views on the production and use of knowledge and on the relationship between researcher and practitioner, spanning from top-down to bottom-up or from linear to interactive and multidimensional (e.g. [39, 47]). Depending on research tradition and/or experiences, basic assumptions regarding knowledge and learning can vary among researchers, but also among stakeholders (e.g. ). Sibbald et al.  identified challenges such as role clarity, organisational change and cultural differences regarding expectations on research output and (positive) effects on actual practice and found that role ambiguity, multiple roles and role conflicts could hamper social relationships. Factors facilitating collaboration were already established relationships, the alignments of goals/objectives, skilled and experienced researchers, and the use of regular, multi-modal communication.
Another influence on collaboration, mainly from the researcher context, is the variety of research paradigms and areas and related basic assumptions. One approach to be expected is action research, where knowledge creation is combined with practice development. There are a variety of action research approaches depending on, for example, how the collaborative element is organised . The interactive research approach builds on action research and emphasises the common learning and knowledge creation for both practitioners and researchers during the complete process . Both approaches involve a number of different roles for the researcher to enact .
Based on a realist evaluation, Rycroft-Malone et al.  list features of research collaboration likely to enhance knowledge use, namely attention to communication mechanisms, setting intermediate/outcome goals, providing time and space for the development and implementation of plans, making the choice of topic with resonance and relevance, close proximity between partners, re-balancing and sharing power, and allowing time to develop mutual trust and respect. These features put other demands on the planning and execution of research than a traditional approach when research has precedence over practice.
To reach expected results, both freedom and flexibility to handle the uncertainty in research is needed, as well as a tight and managed firm project structure.
The necessary integration of different views of the actors involved may also lead to intercultural, interorganisational and interdisciplinary problems that need to be managed.
The limited formal authority of the project manager is in contrast with the demands for integrative managing of results, commitment and involvement of all parties.
Thus, collaborative and partnership research may have the potential to enhance the use of knowledge in practice and thereby improve healthcare and social services, but also to challenge the practitioners’ and researchers’ views, assumptions and roles.
The empirical base of the present study is an example of a collaborative and interdisciplinary research initiative – a national research programme seeking to boost collaborative and partnership research to improve health and social services in Sweden. The purpose of the study was to gain more knowledge on the interdisciplinary, collaborative and partnership research process by investigating researchers’ experiences based on their participation in this national programme. We have studied the experiences of researchers in all 20 research projects funded by the programme during the period 2008–2014, focusing on three themes – complexity in collaboration, collaborative procedures, and challenges, obstacles and lessons learned. The research questions posed were (1) what types of research approaches, research focus and partners/actors were involved in the projects? (2) How was collaborative and partnership research achieved, according to the researchers? (3) What were the challenges and obstacles to interdisciplinary, collaborative and partnership research encountered, and what main lessons were learned?
This study is based on analyses of interviews and archival data. The interviews were performed during the final stages of the projects and the documents covered the entire project period.
Empirical setting – the national research programme
The Vinnvård research programme was financed by a consortium of research funders, including the Ministry of Health and Social Welfare, Sweden’s innovation agency VINNOVA, Vårdalstiftelsen and the Swedish Association of Local Authorities and Regions. It was the first major attempt by research funders in Sweden to address the challenges of the ‘quality chasm’ in health and social services focusing on organisational aspects, with clear aspirations to bridge research and practice, stimulate interdisciplinary research and enhance research collaboration between universities/research institutions and healthcare/social service organisations. In addition, new research and learning infrastructures were expected to emerge. The requirements and evaluation criteria for the applications reflected these aspirations and documented active cooperation between practitioners, researchers and other public actors was asked for. Moreover, applications had to include an interdisciplinary approach, a common vision for all parties involved and documented approaches for securing participation and dissemination of research and/or development results. Both researchers and practitioners/public institutions could apply for funding. Non-researchers were part of the peer-review panel in both calls. The programme’s broad approach was new, both to the funding agencies and the research community. With a focus on health and social services, the programme aimed to (1) increase the use of research-based knowledge (bridge research and practice), (2) develop innovative ways of organising work, (3) stimulate the development of institutional learning structures with a focus on how to lead, manage and develop practices in organisations, and (4) establish more research on how to lead, manage and develop practices in health and social services organisations at Swedish universities.
The subsequent aims (3 and 4) had a more long-term character than the preceding ones (aims 1 and 2) and can be seen as a means to build long-lasting support for these. During the period studied (2008–2013) there were two calls for projects lasting up to 4 years each. A total of 20 projects were funded, 9 in 2008–2011 and 11 in 2009–2013, all of which are included in the present study. All projects were on-going when the interviews were conducted and all except one had ended when the archival data was gathered in May 2015.
Interviews were conducted between September and November 2011, when most projects were in their later stages. In total, 17 respondents with an equal gender distribution were chosen based on their overall project involvement. Four respondents were responsible for two projects each and one project was represented by two respondents. All 20 projects were covered. All respondents held a PhD and were intensely involved in the projects, either as project leaders, principal investigators, or as the most important researcher, as judged by the project leader. The semi-structured interviews had the aim of following up on the main goals and lessons learned within the projects and covered the characters of the projects with its overall contributions, roles taken in projects, collaborations, and participating or studied organisations and institutional levels. Questions followed five themes for each one of the four programme goals, namely interpretations of the goal, the importance it was given, how it was fulfilled, how the project had worked to reach the goal, and results related to the goal. Practical examples of the last two themes were requested. The last part of the interview covered how the four goals were integrated, any expected or unexpected insights, difficulties experienced, and emphasised and miscellaneous findings. In a few cases, interviews were complemented by the respondents with written comments or documents. Interviews lasted 40 to 120 min, with longer interviews with respondents representing two projects. The respondents received the questions a week in advance. Each interview was recorded and transcribed verbatim.
Archival data were gathered in May 2015 and consisted of the projects’ final reports and, for one project not yet finished, a progress report (same structure as the final reports, but without a popular science description and financial report). The report template had the following headings: introduction; short summary on how the project had worked to fulfil the research programme’s goals (with subheadings for each of the four goals); publication list; participation in national and international conferences/workshops; PhD students; description of potential problems encountered; description of the most important lessons learned; popular science description; references; and financial accounting. Reports varied in length from 4 to 42 pages, with an average of 19 pages; yet the four-page report came from the project not yet finished. A total of 386 pages were analysed.
Qualitative data in interviews and documents were scrutinised in several steps, first by using a mix between directed (guided by the research questions) and conventional content analysis . The entire material was read through to get a sense of the whole and then analysed to identify relevant text related to the research questions. Both data sources were then further used for determining themes, categories and overall patterns. Finally, a summative content analysis  was applied to get a sense of variation by identifying how many projects provided information in the identified categories. Three researchers performed the analyses, first individually and through meetings held to discuss and validate interpretations.
Document analysis focused on information related to the three research questions, namely (1) system level actors involved (care recipient, unit/clinic/ward, organisation, region/county council, and/or national level) and basic project information; (2) descriptions of or activities and strategies for research collaboration, including with which actors; and (3) obstacles/problems encountered and main lessons learnt. A fourth category (Other) was used in order not to miss important aspects. Described collaborations and process reflections (i.e. obstacles/problems and lessons learnt) were the main categories used to sort the material for questions 2 and 3. In a second iterative step for these questions, subcategories were identified, tested, revised and defined. The category definitions were then used in a third step for a final text classification of data.
As the interviews were performed when the projects were still ongoing, they were used to complement, add details, provide examples and validate information found in documents. Moreover, they also added a more personal perspective on the results based on the experience of the main researchers.
Project overviews and the complexity of the collaborations
System/organisational levels where research was performed and levels where support was needed in order to establish the projects and keep them going; the summary provides an overview for comparison
Levels where research was performed
Levels where support was established
Summary of levels
ACTION – partnership for increased care and quality
Homebased health and social care
Meetings with patients and next-of-kin
National networks for IT support
Reg., Org, Unit, Care recipient
Bridging the gaps
Micro system (i.e. patient-care provider interaction), Clinical Dep., Diagnosis cohorts, Patient - web support
Micro system, Clinical Dep., Region, National level IT (quality reg.), Municipality IT network (quality reg.)
Nat., Reg., Org, Unit, Care recipient
Specialist (MD) cohort
Multiple clinical dep. (several regions)
National level IT (quality reg.)
Nat., Unit, Care recipient
Innovation systems for better health
Hospital or organisation, Region
Hospital or organisation, Region
Reg., Org., Unit
Sustainability in innovation and organisation learning in healthcare
Patient cohort, Clinical Dep.
Hospital or organisation, Region,
Hospital or organisation
Reg., Org., Unit
NDR – Better use of the national diabetes registry (a national quality registry)
Diagnosis cohort, Specialist (Medical Doctor) cohort, Clinical Dep. Hospital or organisation, National level IT
National level information technology (quality reg.)
Nat., Org, Unit
Knowledge, management and value creation in geriatric care
County top management
Increased participation/access to society for people with psychiatric conditions
Meetings with patients and next-of-kin, Diagnosis cohort, Region, National
Region, National, Non-governmental organisation
Reg., Unit, Care recipient
QIHREA - Quality improvement in healthcare, a research and education agenda
Patient, Clinical Dep., Hospital, Region, Region based management network
Internat., Nat., Reg., Org.
Bridging the gaps 2 – Patients as active co-creators in care processes
National level IT (quality reg.)
National level IT (quality reg.)
Region-based management network
Reg., Org, Unit, Care recipient
Care chain – From emergency care to home
Meetings with patients and next-of-kin, Clinical Dep., Hospital management, Municipality management
Municipality (management), Region
Learning on patient safety
Nat., Reg., Unit
FLIP – Atrial fibrillation in primary care
Specialist (MD) cohort
Nat. guidelines for health promotion – from evidence to clinical practice
Professional cohorts in care
County, National, Government body
Clinical Dep., Professional cohorts in care, County, National
Nat., Reg., Unit
Lean and agile
National research cohort
P-Inn – The patient’s innovation system
National level IT (quality reg.)
National level IT (quality reg.)
Nat., Unit, Care recipient
Patient choice system in primary care
Clinical Dep., Hospital
Clinical Dep., Hospital, National level IT, National patient organisation, European Stroke Organisation
Internat., Nat., Reg., Unit,
FELLOW – Fellowship program
Descriptions of collaborative procedures
Collaboration as described by the overall research and development design
Seventeen projects (85%) clearly described an interactive research design that either involved healthcare practitioners, managers, politicians, patients, next-of-kin or a mixture of those. Seven projects used the term ‘action research’ or ‘action-oriented research’, two used the term ‘interactive research model’, and one used the term ‘participatory design’, all of which imply a close interaction between researchers and practitioners. Examples of statements are “the project’s action research approach has involved a continuous and iterative collaboration that has both fed into and questioned on-going [change and learning] processes” and “we used a participatory design where the young people actively participated in the creation of what to study, that is the effects of using a web-based instrument”. Four projects developed information and communication technology-based solutions in close collaboration with practitioners. The terms ‘co-design’ or ‘co-creator’ were often used in two projects involving patients and their next-of-kin and in a project focusing on mixed learning networks with researchers, patients and other actors.
Collaborative involvement of practitioners in different stages of the research process
Interactive forms were described as being used during the following stages: (1) mapping of the research problem and its manifestation in practice, and formulation of research questions; (2) planning, creation of interventions and choices of design; (3) investigation, test, follow-up and implementation processes; (4) analyses, reflection and learning; and (5) reporting on and dissemination of results, including further implementation of studied intervention. Nineteen projects (95%) described an interactive approach in at least one of these stages. Collaboration or interaction was most common during follow-ups and feedback processes (Stage 3 and 5), and less interaction was described during the formulation of the research problem and during analyses (Stage 1 and 4). Statements like “conducting research with practitioners, not on practitioners” and “patients have participated in the mapping [of the current situation]” are examples of Stage 1. Stage 2 is exemplified by the statements “practitioners participated during the construction of the interview [manual]”. Statements such as “the researchers and contact persons [from the healthcare organisations] have met 1–2 times a year to discuss and reconcile research questions, data collections and results from different sub-projects” represent several stages (Stage 1, 2, 3 and 5). Involving practitioners directly in analyses (Stage 4) was not explicitly mentioned, but the described interactive sessions could involve the discussion and validation of results. Statements such as “the researchers regularly fed back their observations and analyses to the hospital management and hospital unit representatives”; “we had several formal and informal feedback sessions and this feedback has been further used”; or “the feedback and the action research approach have given researchers an opportunity to stimulate reflection and contribute with knowledge on implementation, learning and change” can represent situations when practitioners participated in the interpretation of results and that this had effects on both research and practice. Thus, if researchers in the research teams holding dual roles are not accounted for, no project involved non-researchers in the entire research process.
Collaboration enhanced by the dual role of practitioners and/or researchers
Ten projects (50%) described a dual, boundary-spanning role held by either the practitioners or the researchers. This dual role of being involved in both practical work and research was more common for clinicians performing research in the area of their expertise, e.g. in projects and sub-cases with a clinical focus. This can be exemplified by statements such as “we are conducting research with actively serving practitioners and clinicians” or as a statement made by a clinician project leader “improvement work for increased quality in healthcare is best performed directly in connection to the meeting between patients and professional care-givers”. In one case, in the Clinical Innovation Fellowship programme, teams of practitioners were trained as action researchers for 2 months (fellows) and spent 6 months working in clinical quality improvement in healthcare, sometimes in collaboration with students working on their masters or bachelor thesis. Examples on practitioners’ dual role were described as “some healthcare staff became PhD students and thereby gained a double bridge-building role” (e.g. conducting research within their organisation). The role of translating knowledge as part of the dual role was exemplified as “we have involved healthcare staff as interpreters”. No further details on what this actually meant were provided. Three projects described that their research team consisted of both researchers and practitioners.
Collaboration via education
Seven projects (35%) described interactive processes linked to educational activities, either designed for enhancing learning and (sustained) interaction between researchers, practitioners and their organisations, or designed for students to participate in and study development initiatives while learning together with practitioners. Some involved the development of new programmes and courses where “experience-based education” was essential or where networks of previous healthcare students (now as practitioners) were established as a resource. Some examples concerned the interaction between students and practitioners exemplified by statements such as “collaboration with students concerning knowledge on improvement, using a model for learning that involves multi-professional teams with care professionals and students that together reflect on the potential improvements of the care practices”, or the involvement of students in the development of healthcare practices exemplified by one project’s new master’s programme where conducting an improvement project in practice was a basic requirement for a master’s thesis.
Collaboration by involving patients/next-of-kin
Five projects (25%) described an active involvement of patients in the research process. One project developed mixed learning networks with both patients and their next-of-kin in an active learning process. Another project had “engaged patients, relatives and care professionals in the work of changing care practices” describing patients as “co-creators, co-producers and co-evaluators”. Two projects had developed information and communication technology solutions together with patients and one project had given patients the opportunity to conduct single randomised controlled trial (RCT) studies using their own measurements.
Challenges, obstacles encountered and the main lessons learned from the research collaborations
Reported problems related to ‘the practitioner context’ concerned partner engagement, competing activities, economy, political decisions and organisational changes. Examples of problems were “delays, organisational changes and changes in management teams that altered the initial engagement in the project”; “other parallel development projects have taken time for our collaborating organisations” and “the development unit that was to coordinate interventions within the county council was closed down”. The major lessons learned mirrored these problems, acknowledging the anchoring, flexibility and time needed to work with the practitioners’ (politically governed) organisations. Examples of statements provided are “county councils and universities are large organisations where change takes time and anchoring on several levels must be secured” or “changes in health and social care occur quickly and are difficult to foresee and improvements have to adjust to this, and to document such periods is both a challenge and an opportunity”.
Reported problems related to ‘the researcher context’ often concerned the PhD, master or bachelor level students involved, where university demands caused delays, frustration or extra work. Examples of statements were “writing applications to fully finance participating PhD students have taken a lot of time and energy”, “the full student participation was delayed and affected the project”, and “the choice to build a school for research studies have delayed publications”. Learnings included the need to deal with such aspects and the demands this put on the project management and the research group, exemplified by “the research field is young and it has been central to build networks and cooperation with others” and “to build research and education demands active and competent project management, not only an effective administrative management but also an overarching research perspective, and this administration and research overview is time demanding”.
The category ‘staff-related concerns’ contained human resource management issues related to research group members (mainly researchers and PhD students) and no lessons learned related to these were recorded. Issues concerned interruptions or delays in the project process due to recruitment of staff, leave due to sickness, parental leave or other changes in work situation. Example of statements were, “one researcher was on leave for a long-time due to sickness and this made us have to start all over again with analyses”, “the project leader was assigned a mission by the government”, and “two of the project’s PhD students went on parental leave for a total period of 3 years, which delayed the project”.
Problems related to ‘the collaborative and partnership research and development process’ concerned the time and energy needed for the process, expectations on the practitioner organisation, and differences in focus and pace of the more rigorous scientific process compared to the quicker decision-processes in the practitioners’ contexts. Statements such as “the interactive research process takes more time to establish”, “output data were supposed to be generated and provided by the county council, we had to use whatever we could find when this could not be done”, and “our organisational partners’ need for quick results and tendency to change work approaches towards the introduced intervention made it hard to scientifically evaluate the results”. The lessons learned described were related to insights concerning different views, contexts and efforts to handle dilemmas. Example of statements were, “research and practice are two systems with a different pace, demands on PhD students delay analyses and cause delays in the feedback to practitioners”, “practitioners sometimes have un-realistic expectations on researchers”, and “the importance as a researcher to always be prepared to re-evaluate, be flexible and adapt the project focus and time plan after the dynamic situation of the empirical reality studied”. Some important actors in the researcher context made this process difficult, exemplified by “the ethical board approving the project has demanded a clear distinction between research and improvement work”.
Problems related to conducting ‘inter-disciplinary research’ gave examples of paradigmatic differences in perspectives, assumptions, experiences, methods and ways to report results. Examples of statements were “PhD students struggled against time and felt fragmented and torn between their own research area and the demand for interdisciplinary research” and “to form such group consisting of different disciplines takes a long time and the mixed methods approach demanded a period of interactive learning for the interdisciplinary research group”. Lessons learned related to conducting interdisciplinary research concerned insights into the process of building interdisciplinary teams and benefits of several perspectives, for example, “interdisciplinary research is not easily or quickly established, it takes a long time for participants to build trust and understanding of each other’s perspectives and terminology, and to be attentive and responsive towards each other’s contributions” and “the importance of a firmly grounded theoretical framework and the creation of instructions for the research activities during an interactive process”.
Problems connected to ‘the research focus’ were reported by one project and concerned the investigated health economic concept, which was new to the area and demanded a shift in perspective. Six projects reflected on lessons learned connected to the research focus, for example, “internet-based support and coaching have provided coaches with increased insights into how large a disability individuals with neuropsychiatric disabilities can actually have” and “the care structure is a central factor for improvement and the availability of stroke units essential”.
Problems related to the chosen ‘research design and methods’ concerned demands of specific methods and instruments, for example, “building a computer model and the inclusion in the RCT study has taken more time than anticipated”, “the ethno-methodological observation method is time and resource consuming”, and “it was challenging to find data for follow-up studies and a lot of work studying patient journals”. The reported lessons learned concerned the chosen approach, design or spread of interventions exemplified by the following statements: “the meta-study has been important for synthesising and extracting knowledge”, “action research is an important method for gaining new knowledge and for stimulating participation in improvement initiatives”, and “the major lesson learned has been that the work to implement findings does not start or continue by itself, it will demand large efforts and continuing economic resources”.
Addressing complex research areas in complex systems affects the complexity of the collaboration
The research programme was set out to address problems related to the gap between research and practice in health and social services. Several projects reported putting large efforts on addressing this broad and interdisciplinary content by trying to frame clinical and service activities within general organisational frameworks. Many projects focused on how to organise care to achieve a more research-based practice or to identify hindrances, contradictions or opportunities related to development. To study such complex phenomena over several system levels often requires longitudinal designs, interdisciplinary approaches and a mix of methods , in combination with participatory approaches (e.g. ). A large variation of research and methodological approaches, most of them very demanding, was used in the projects, from action research to quasi-experimental studies and RCT designs. Single or multiple case studies using qualitative and mixed methods were common. The use of a demanding research design and the lack of a research culture on behalf of practitioners and their organisation can act as a strong barrier for research collaboration .
Research use represents a specific form or knowledge utilisation [57, 58], where research findings support decisions through a complex process enacted at a practical level. Scott-Findlay and Golden-Biddle  argue that understanding this process only at an individual level is misguiding and should be complemented with an understanding of practitioners’ research use at an organisational level. When making major changes in line with new research knowledge the authors propose strategies involving efforts to change organisational culture and consideration of the organisation’s values and assumptions. This indicates the need for researchers to have an in-depth understanding not only of the involved practitioners as individuals or professional groups but also of their organisations in order to enhance the use of research findings.
A majority of the projects addressed several levels of the involved healthcare organisations (or systems) implying several types of partners and stakeholders to interact with. Demands put on project management and the project group corresponded with these multidimensional views and mixed approaches – providing variable room and energy to support and adhere to demands related to collaboration and research use. The importance to understand and address the interaction and inter-connection between system levels during development efforts has been highlighted by several researchers [60, 61]. The types of project management, research design and collaboration across the organisational system that are needed to get access, and to build, co-create and transfer knowledge in order to enhance development in organisations have been less discussed. Recently, the heterogeneity among knowledge users and the need for relationship brokering in collaborative and partnership research has been highlighted .
Different perceptions of interdisciplinary, collaborative and partnership research and on the roles and relationships of involved actors
Any empirical research process is characterised by interaction between the researcher and practitioner context, each one in a constant flux, continuously changing and restructuring. The research process in itself also differs depending on the type of research and focus, for example, if there is an innovative or developmental component involved to be tested and evaluated or if an on-going situation or phenomenon is investigated. Qualified practitioners, sometimes enrolled as PhD students, served as knowledge brokers interpreting results – in both directions – when understanding the practical phenomenon in theoretical terms and when translating theories and models used into practical terms. Educational fora and interactive learning approaches were a significant part of many projects, often combined with active involvement of practitioners. Involvement of patients and their next-of-kin, often during intervention design, was also described.
Based on our findings, using the terms introduced by Sibbald et al. , two projects could be described as having a more researcher-dominant or token partnership, while eight projects involved non-researchers to some extent in an asymmetric partnership and ten projects had features that indicated a more egalitarian partnership.
Interdisciplinary research, often across faculties, was enhanced, further developed and deepened in the majority of the projects. There were several examples of clinical researchers working together with both social scientists and scientists from technical faculties. Building trust and lessons learned concerning different perspectives and ways of conducting research were important. The programme’s goals regarding the expected development of institutional learning structures and establishment of research on how to lead, manage and develop practices in health services organisations might have aided this development, more so than traditional programme calls.
Creating long-term relationships between researchers and decision-makers might be a useful way for bridging research and practice. For such a strategy to become successful it has been argued that it must be complemented with strategies for involving researchers in decision-making around policy and practice and with core funding for building and upholding capacity for knowledge exchange . Maintaining such relationships for longer periods often requires formal support or structure. The national collaborative examples (e.g. practice-based research networks) described in the introduction can be one way to achieve this. Incentives for supporting and nourishing such relationships are scarce in the research context where funding is often difficult to obtain and outcomes are measured in production of scientific publications. Supporting the costs associated with research involvement (for both parts) can facilitate partnership with managers and decision-makers . This is an important message to research funders, who despite tasks to increase “research utilisation and interaction with society”, often support short-term projects with more limited scopes – a strategy that is seen as insufficient for sustaining practitioner relationships and achieving goals of research utilisation .
Research collaboration between researchers and decision-makers and other types of stakeholders can be ethically challenging, especially when members of the team are insiders or participants in a studied case. The role of insiders needs to be clarified, for example, with regards to access to raw data and ensuring anonymity and confidentiality , but also a sensitivity on how to handle organisational information as a researcher. Hofmeyer et al.  recommend the use of self-reflection and ethical dialogues to enhance shared meanings and understandings among researchers and decision-makers – a practice that requires time, motivation and skills, and which could be highlighted in future programmes aiming for collaborative and partnership research.
Experienced challenges, obstacles and enablers for interdisciplinary collaborative, partnership research
There were indications of the tension between the demands from the practitioner versus the researcher contexts and the role of the researcher. Dilemmas occurred, for example, when adhering to conflicting demands for knowledge translation and the different types of knowledge production , such as a curiosity-driven inquiry based on a positivist epistemology or a problem-solving epistemology with knowledge production in the context of application .
Collaboration in the projects’ research constellations was mentioned both as an asset and a challenge, especially the interdisciplinary aspect where team members might differ in views and ways to handle collaboration. That interdisciplinary research is challenging is not a new insight (e.g. [65, 66]) and there are strategies to facilitate such research, i.e. selective collaboration, cross-training, sustained relationships, good humour, participation in peer review, declaring the place of one’s work, and balancing dissemination of research between peer and other audiences . Past experience of interdisciplinary collaborations and an understanding of different views on epistemology are foundations that can enhance collaborations. There were indications in some projects that participating researchers did gain a deepened appreciation of the need to join several paradigms in order to understand the complexities of the issues at hand. The ‘inside’ clinical PhD students could act as door openers and knowledge brokers  to the world and practice of health and social services for the social or technical sciences PhD students, and vice versa. Clinical researchers and PhD students were invited to new knowledge paradigms by social scientists. Other practitioners involved as co-researchers in the projects could employ various brokering strategies, e.g. to engage, collaborate and build capacity . The described challenges for these persons to adhere to expectations and demands from several contexts in their in-between role and the conflicts that follow when demands are incompatible or role expectations are ambiguous have also been identified elsewhere (e.g. [40, 68]). Previous research has shown that innovative researchers tend to be more engaged in research collaborations, both disciplinary and interdisciplinary, than adaptive researchers who prefer to work with well-established procedures within existing frameworks and in stable groups [69, 70]. Female scientists are also more engaged in interdisciplinary research, while years of research experience has been found to be positively correlated with collaboration both within one’s own discipline and with researchers from other scientific disciplines [70, 71].
Some of the problems and enablers experienced in the projects correspond to the enabling factors in the research partnership process as described by Sibbald et al.  and Rycroft-Malone et al. . The described difficulties due to changes occurring in the partner organisation, role problems due to ambiguous or conflicting demands, and different view and paces for knowledge production and use between researcher and partner organisations correspond to the challenges described by Sibbald et al.  (Fig. 1). Problems and lessons learned related to time needed for development of mutual trust and respect, power issues, and planning and implementing change are in line with Rycroft-Malone et al.’s  observations (Fig. 1). Skilled project leaders and researchers able to handle various perspectives and enhance communication among involved actors and the establishment of infrastructures and long-term relationships, as in the sustainable collaborative structures initiated or strengthened by the projects, are all considered as enablers for research partnership .
Ideally, there is room for a mixture of research approaches in a programme, in line with current debates on mixed methods where Gorard et al. advocate the development of a research community where “all methods have a role, and a key place in the full research cycle from the generation of ideas to the rigorous testing of theories for amelioration” ( p. 162, ). Collaborative approaches are amendable to many different research topics, designs and disciplines, and the mixture of projects, research approaches and collaborations in the programme provides an example of this. It also shows the need to consider how to evaluate research applications when broader, complex issues are the topics, as also highlighted by others . Assessment of the benefits and lessons learned through participating in the research process for individuals and partnership organisations, as well as of the sustainability of partnerships and joint interventions, might be a way forward.
Limitations of the study
The study mainly represents project leaders’ and senior scientists’ views on the research programme and their own project’s efforts to bridge research and practice and initiate collaborative and partnership research. No representatives of the involved practitioners were interviewed and the reporting on impact and collaboration with stakeholders was retrieved via project documents and interviews with representatives of the projects. To expand the understanding of the entire process and all actors’ perspective on the acquired knowledge, the partners’ views will need to be addressed. We also acknowledge that there might be information missing in final reports depending on the amount of text provided and how questions in the report template were interpreted, as well as the potential bias introduced by providing ‘socially accepted’ information to highlight the project’s benefits. We sought to reduce this bias by asking representatives from all projects to read through the results of analyses and comment on any missing information or misunderstandings – all projects provided answers and five of them provided additional information or corrections. Frequencies and proportions were calculated to indicate trends and overall patterns and should otherwise be interpreted with caution. Due to resources, it was no possible, but it would be interesting for future research, to address the actual impact of the collaborative and partnership projects on healthcare practices, on further collaboration, and in terms of cultural change, research use and relevance of the research conducted , despite the potential challenges posed by the projects’ diversity.
Using collaborative efforts to perform research on complex areas in complex systems requires a contextual understanding, longitudinal efforts, collaboration on multiple system levels and often interdisciplinary designs. Described problems, mirrored in the lessons learned, provided an indication on challenges to manage interdisciplinary, collaborative and partnership research, enact different roles and bridge several worlds as a researcher. Staffing, funding PhD students and paying attention to the work environment are some of the duties adhering to the tasks of an employer. Administrating and handling the project budget and monitoring its progress belong to the role of a project leader/administrator. Possessing knowledge on research designs and on the characteristics, demands, etc. of several disciplines is important in interdisciplinary, collaborative and partnership research. Finally, skills in collaboration and communication are needed, including a basic understanding of both the researcher and the practitioner contexts, while not forgetting any ethical concerns. Such demands and the often ambiguous roles and conflicting expectations make the research process challenging.
Funders, as well as managers, practitioners and researchers, might underestimate the complexity induced and efforts needed to collaborate during a research process, especially in multifaceted and complex research areas. Both interdisciplinary research teams and researcher–non-researcher teams can be challenging and time-consuming per se. By mixing these two conditions the situation becomes exponentially complex, as everyone has to learn about each other and adapt in various ways. The development of support from various decision-makers and build trust and understanding with involved practitioners at several levels of a healthcare system/organisation will need both skills in and arenas for communication and interaction. For the researchers, this takes time and energy from actual work with data collection, analyses and scientific writing. For the practitioners, this puts demands on understanding a research process and how it fits with ongoing organisational agendas and activities, and allocating enough time. Nevertheless, ensuring good relations (relationship brokering) is an important precondition for establishing a research process and gaining access to high quality data, especially on complex issues.
Another process that might be overlooked is the formation and building of research teams and the enactment of different roles in research intending to be both interdisciplinary and collaborative. If collaboration is not already established among researchers and involved partners, the experiences show that these processes need significant time and effort on behalf of both researchers and practitioners. Such efforts must not be underestimated if project agendas and schedules are to be realistic. The different roles and skills and the time required by researchers to both conduct research and contribute to the solving of complex problems in society by forming interdisciplinary research collaborations and collaborations with decision-makers and practitioners may be underestimated or simply ignored by involved stakeholders. Many researchers (especially PhD students) are not trained or experienced in working with interdisciplinary research teams or in a collaborative way with practitioners. Practitioners, in turn, may lack experience and skills in research collaboration. Both these aspects may have contributed to the problems encountered in this study. The lessons expressed can thus provide input for future collaborative or partnership research initiatives.
Research funders, as well as researchers and partners, may also benefit from gaining an overall understanding of the different types of research that can aid an understanding of and support changes in health and social services – from explanatory studies and experimental research to explorative studies and case study research, as in this case, which focused on understanding larger systems and more complex phenomena. Moreover, a flexibility regarding content and schedule is necessary to meet the complex demands, particularly concerning the time and resources needed for project management. To avoid exhaustive situations for involved researchers and practitioners, such considerations need to be included in the agenda of the funding body.
There is a need for more empirical studies on the conditions for researchers and practitioners in collaborative partnership and interdisciplinary research processes with the aim to increase the capabilities in addressing complex questions and the ‘usefulness’ of research in practice. An assessment of the efforts made to handle the different contexts and views of all involved actors in interdisciplinary, collaborative and partnership research initiatives in greater detail would provide more information on such processes and on their outcomes. Future studies could also address some remaining questions, including do the efforts to build interdisciplinary, collaborative and partnership research lead to better uptake and use of research outcomes, or provide more useful outcomes for practitioners and patients? Do they lead to deeper learning and understanding for researchers, and does the bilateral learning process and integrated knowledge translation between practice and academia occur?
Comments on the results of the national programme
The programme’s goals can be considered as new and innovative in the Swedish context. Further, the programme chose to fund less traditional research projects such as intervention studies, studies of natural experiments and the building of new infrastructures. This approach may be risky with regards to results evaluation, but the rich variety of projects, foci, new structures and lessons learned provided more types of results than traditional ones (i.e. scientific presentations and publications), which fits rather well with the initial broad aims of the programme. Scientific production, measured through traditional metrics, was substantial. Other presented results were categorised into five areas of innovation (what to develop) – a product/artefact, an approach when meeting patient/next-of-kin, routines and work procedures, administrative systems and structures, and increased organisational learning/competence. All projects reported results in at least two categories, and six projects reported results in all categories. Some of these were tangible, like employment of nurses in new roles, education of hundreds of care providers, new IT systems, web portals, academic courses, and a decision support used yearly in 25,000 patient meetings; some results were also very vulnerable. Quality in care processes can take long time to develop, especially when many actors and interests are involved, but might be destroyed by one major politically decided organisational change.
We wish to thank the interview respondents for their participation, the research project leaders and representatives for reviewing results for potential biases or misinterpretations, and Professor John Øvretveit who provided helpful comments to improve the manuscript.
This work was mainly supported by the universities where the authors were situated (Karolinska Institutet and Jönköping University), with additional contribution from the Vinnvård research programme in Sweden 2014–15 [no grant no provided]. The Vinnvård research programme management placed no restrictions and had no influence on the research process.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request. It consists of transcripts from interviews and project documents (all in Swedish). Excerpts from the data sources are presented in the article as citations (translated to English and checked by multi-lingual persons).
MN, CK, JK and BA-G designed the study, MN collected the archival data, and CK and JK conducted the interviews. MN, CK and JK performed the analyses and MN drafted the manuscript. All authors read, contributed to and approved the final manuscript.
Ethics approval and consent to participate
For the 20 investigated projects, regional Ethical Committees approved the studies according to Swedish regulations. The project documents and the Swedish report on the interview study (data used in the study) are openly displayed on the programme’s public website (http://www.vinnvard.se). Seeking ethical approval for this type of study is not required according to Swedish regulations. Participation in the original interview study was based on informed consent, also for open publication. For this study, the interviewed project leaders and senior researchers were given an additional opportunity to read and comment on the results of the analyses and to correct or add missing information and provide consent; they all provided answers, information and consent.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Sackett DL, Rosenberg WM, Gray JM, Haynes RB, Richardson WS. Evidence-based medicine. BMJ Brit Med J. 1996;313:170.View ArticleGoogle Scholar
- Glasgow RE, Emmons KM. How can we increase translation of research into practice? Types of evidence needed. Annu Rev Public Health. 2007;28:413–33. https://doi.org/10.1146/annurev.publhealth.28.021406.144145.View ArticlePubMedGoogle Scholar
- McIntyre D. Bridging the gap between research and practice. Camb J Educ. 2005;35(3):357–82.View ArticleGoogle Scholar
- Aita M, Richer MC, Héon M. Illuminating the processes of knowledge transfer in nursing. Worldviews Evid Based Nurs. 2007;4:146–55.View ArticlePubMedGoogle Scholar
- Berwick DM. Disseminating innovations in health care. JAMA. 2003;289:1969–75.View ArticlePubMedGoogle Scholar
- Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003;362:1225–30.View ArticlePubMedGoogle Scholar
- Grol R. Successes and failures in the implementation of evidence-based guidelines for clinical practice. Med Care. 2001;39:8. Suppl. 2, II46–II54View ArticleGoogle Scholar
- Grimshaw J, Eccles M, Tetroe J. Implementing clinical guidelines: current evidence and future implications. J Contin Educ Health Prof. 2004;24:31–7.View ArticleGoogle Scholar
- Cabana M, Rand C, Powe N, Wu M, Abbound P, Rubin H. Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999;282:1458–65.View ArticlePubMedGoogle Scholar
- Richter-Sundberg L, Kardakis T, Garvare R, Weinehall L, Nyström ME. Addressing implementation challenges when developing evidence based guidelines for health promotion – A case study of the Swedish national guidelines for disease prevention. BMC Health Serv Res. 2015;15:19. https://doi.org/10.1186/s12913-014-0672-4. View ArticlePubMedPubMed CentralGoogle Scholar
- Uzochukwu BC, Onwujekwe OE, Mbachu CO, Okwuosa C, Etiaba E, Nyström ME, Gilson L. The challenge of bridging the gap between researchers and policy makers: Experiences of a Health Policy Research Group in engaging policy makers to support evidence informed policy making in Nigeria. Glob Health. 2016;12:67.View ArticleGoogle Scholar
- Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation Research: A Synthesis of the Literature, FMHI Publication. Tampa: Louis de la Parte Florida Mental Health Institute, National Implementation Research Network, University of South Florida; 2005. p. 231.Google Scholar
- Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O. Diffusion of innovation in service organisations: systematic review and recommendations. Milbank Q. 2004;82:581–629.View ArticlePubMedPubMed CentralGoogle Scholar
- Rycroft-Malone J, Kitson A, Harvey G, McCormack B, Seers K, Titchen A. Ingredients for change: revisiting a conceptual framework. Qual Saf Health Care. 2002;11:174–80.View ArticlePubMedPubMed CentralGoogle Scholar
- Van de Ven AH, Johnson PE. Knowledge for theory and practice. Acad Manag Rev. 2006;31:802–21.View ArticleGoogle Scholar
- Golden-Biddle K, Reay T, Petz S. Toward a communicative perspective of collaborating in research: the case of the researcher-decision-maker partnership. J Health Serv Res Policy. 2003;8(Suppl 2):20–5.View ArticlePubMedGoogle Scholar
- Straus SE, Tetroe JM, Graham ID. Knowledge translation is the use of knowledge in health care decision making. J Clin Epidemiol. 2011;64:6–10.View ArticlePubMedGoogle Scholar
- Mitton C, Adair CE, McKenzie E, Patten SB, Perry BW. Knowledge transfer and exchange: review and synthesis of the literature. Milbank Q. 2007;85:729–68.View ArticlePubMedPubMed CentralGoogle Scholar
- Thompson GN, Estabrooks CA, Degner LF. Clarifying the concepts in knowledge transfer: a literature review. J Adv Nurs. 2006;53:691–701.View ArticlePubMedGoogle Scholar
- Oborn E. Facilitating implementation of the translational research pipeline in neurological rehabilitation. Curr Opin Neurol. 2012;25:676–81.View ArticlePubMedGoogle Scholar
- Bowen S, Graham ID. Integrated knowledge translation. In: Straus SE, Tetroe J, Graham ID, editors. Knowledge Translation in Health Care: Moving from Evidence to Practice, 2nd ed. Chichester: Wiley; 2013. p. 14–23.Google Scholar
- Straus SE, Tetroe J, Graham ID. Knowledge translation in healthcare: moving from evidence to practice. 2nd ed. Chichester: Wiley; 2013.Google Scholar
- Canadian Institutes of Health Research. Knowledge to Action: A Knowledge Translation Casebook. 2008. http://www.cihr-irsc.gc.ca/e/documents/kt_casebook_e.pdf. Accessed 1 Sep 2015.Google Scholar
- Mitchell P, Pirkis J, Hall J, Haas M. Partnerships for knowledge exchange in health services research, policy and practice. J Health Serv Res Policy. 2009;14:104–11.View ArticlePubMedGoogle Scholar
- Boaz A, Fitzpatrick S, Shaw B. Assessing the impact of research on policy: a literature review. Sci Public Policy. 2009;36:255–70.View ArticleGoogle Scholar
- Rycroft-Malone J, Wilkinson JE, Burton CR, Andrews G, Ariss S, Baker R, Dopson S, Graham I, Harvey G, Martin G, McCormack BG, Staniszewska S, Thompson C. Implementing health research through academic and clinical partnerships: a realistic evaluation of the Collaborations for Leadership in Applied Health Research and Care (CLAHRC). Implement Sci. 2011;6:74. https://doi.org/10.1186/1748-5908-6-74.View ArticlePubMedPubMed CentralGoogle Scholar
- DeVoe JE, Likumahuwa S, Eiff MP, Nelson CA, Carroll JE, Hill CN, Gold R, Kullberg PA. Lessons learned and challenges ahead: report from the OCHIN Safety Net West practice-based research network (PBRN). J Am Board Fam Med. 2012;25:560–4.View ArticlePubMedPubMed CentralGoogle Scholar
- Nagykaldi Z, Mold JW, Robinson A, Niebauer L, Ford A. Practice facilitators and practice-based research networks. J Am Board Fam Med. 2006;19:506–10.View ArticlePubMedGoogle Scholar
- Gold M, Taylor EF. Moving research into practice: lessons from the US Agency for Healthcare Research and Quality's IDSRN program. Implement Sci. 2007;2:1–9.View ArticleGoogle Scholar
- Smits PA, Denis JL. How research funding agencies support science integration into policy and practice: an international overview. Implement Sci. 2014;9:1.View ArticleGoogle Scholar
- Lomas J. Using ‘linkage and exchange’ to move research into policy at a Canadian foundation. Health Aff. 2000;19:236–40.View ArticleGoogle Scholar
- Israel BA, Schulz AJ, Parker EA, Becker AB. Community-based participatory research: policy recommendations for promoting a partnership approach in health research. Educ Health. 2001;14:182–97.View ArticleGoogle Scholar
- Wallerstein N, Duran B. Community-based participatory research contributions to intervention research: the intersection of science and practice to improve health equity. Am J Public Health. 2010;100(Suppl. 1):40–6.View ArticleGoogle Scholar
- Ross SE, Lavis JN, Rodriguez C, Woodside JM, Denis JL. Partnership experiences: involving decision-makers in the research process. J Health Serv Res Policy. 2003;8(Suppl 2):26–34.View ArticlePubMedGoogle Scholar
- Strehlenert H, Richter-Sundberg L, Nyström ME, Hasson H. Evidence-informed policy formulation and implementation: Comparative case study of two national policies for improving health and social care in Sweden. Implement Sci. 2015;10:169. https://doi.org/10.1186/s13012-015-0359-1.View ArticlePubMedPubMed CentralGoogle Scholar
- Rycroft-Malone J, Burton CR, Wilkinson J, Harvey G, McCormack B, Baker R, Dopson S, Graham ID, Staniszewska S, Thompson C, Ariss S, Melville-Richards L, Williams L. Collective action for implementation: a realist evaluation of organisational collaboration in healthcare. Implement Sci. 2016;11:17. https://doi.org/10.1186/s13012-016-0380-z.View ArticlePubMedPubMed CentralGoogle Scholar
- Cordero C, Delino R, Jeyaseelan L, Lansang MA, Lozano JM, Kumar S, Moreno S, Pietersen M, Quirino J, Thamlikitkul V, Welch VA, Tetroe J, ter Kuile A, Graham ID, Grimshaw J, Neufeld V, Wells G, Tugwell P. Funding agencies in low-and middle-income countries: support for knowledge translation. Bull World Health Organ. 2008;86(7):524–34.View ArticlePubMedPubMed CentralGoogle Scholar
- Bowen S, Botting I, Graham ID, Huebner LA. Beyond “two cultures”: Guidance for establishing effective researcher/health system partnerships. Int J Health Policy Manag. 2017;6(1):27.View ArticleGoogle Scholar
- Huberman M. Research utilization: the state of the art. Knowledge Policy. 1994;7:22–42.Google Scholar
- Lomas J. The in-between world of knowledge brokering. Br Med J. 2007;334:129–32.View ArticleGoogle Scholar
- Knight C, Lyall C. Knowledge brokers: the role of intermediaries in producing research impact. Evid Policy. 2013;9:309–16.View ArticleGoogle Scholar
- Nyström ME, Hansson J, Garvare R, Andersson Bäck M. Locally based research and development units as knowledge brokers and change facilitators in health and social care of older people in Sweden. Evid Policy. 2015;11:57–80.View ArticleGoogle Scholar
- Michaels S. Matching knowledge brokering strategies to environmental policy problems and settings. Environ Sci Pol. 2009;12:994–1011.View ArticleGoogle Scholar
- Martin S. Co-production of social research: strategies for engaged scholarship. Public Money Manag. 2010;30:211–8.View ArticleGoogle Scholar
- King G, Currie M, Smith L, Servais M, McDougall J. A framework of operating models for interdisciplinary research programs in clinical service organisations. Eval Prog Plann. 2008;31:160–73.View ArticleGoogle Scholar
- Øvretveit J, Hempel S, Magnabosco J, Mittman B, Rubenstein L, Ganz D. Guidance for Research-Practice Partnerships (R-PPs) and Collaborative Research. J Health Organ Manag. 2014;28:115–26.View ArticlePubMedGoogle Scholar
- Svensson L, Ellström PE, Brulin G. Introduction on interactive research. Int J Action Res. 2007;3:233–49.Google Scholar
- Nyström ME, Höög E, Garvare R, Weinehall L, Ivarsson A. Change and learning strategies in large scale change programs: describing the variation of strategies used in a health promotion program. J Organ Chang Manag. 2013;26:1020–44.View ArticleGoogle Scholar
- Sibbald SL, Tetroe J, Graham ID. Research funder required partnerships: a qualitative inquiry. Implement Sci. 2014;9:176. https://doi.org/10.1186/s13012-014-0176-y.View ArticlePubMedPubMed CentralGoogle Scholar
- Elden M, Chisholm RF. Emerging varieties of action research: introduction to the special issue. Hum Relat. 1993;46:121–42.View ArticleGoogle Scholar
- Aagaard Nielsen K, Svensson L. Action and Interactive Research. Maastricht: Shaker Publishing BV; 2006.Google Scholar
- Westlander G. Researcher roles in action research. In: Aagaard Nielsen K, Svensson L, editors. Action and Interactive Research. Maastricht: Shaker Publishing BV; 2006.Google Scholar
- vom Brocke J, Lippe S. Managing collaborative research projects: A synthesis of project management literature and directives for future research. Int J Proj Manag. 2015;33:1022–39.View ArticleGoogle Scholar
- Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15:1277–88.View ArticlePubMedGoogle Scholar
- Creswell J, Tashakkori A. Differing perspectives on mixed methods research. J Mixed Method Res. 2007;1:303–8.View ArticleGoogle Scholar
- Richter-Sundberg L, Nyström ME, Krakau I, Sandahl C. Improving treatment of depression in primary health care: A case study of obstacles to perform a clinical trial designed to implement practice guidelines. Prim Health Care Res. 2014;16:188–200. https://doi.org/10.1017/S1463423614000243.View ArticleGoogle Scholar
- Estabrooks CA. Research utilization and qualitative research. In: Morse J, Swanson J, Kuzel A, editors. The Nature of Qualitative Evidence. Thousand Oaks: Sage; 2001. p. 275–98.Google Scholar
- Loomis M. Knowledge utilization and research utilization in nursing. J Nurs Scholarsh. 1985;17:35–9.View ArticleGoogle Scholar
- Scott-Findlay S, Golden-Biddle K. Understanding how organisational culture shapes research use. J Nurs Admin. 2005;35:359–65.View ArticleGoogle Scholar
- Pawson R, Greenhalg J, Brennan C, Glidewell E. Do reviews of healthcare interventions teach us how to improve healthcare systems? Soc Sci Med. 2014;114:129–37. https://doi.org/10.1016/j.socscimed.2014.05.032.View ArticlePubMedGoogle Scholar
- Willis CD, Best A, Riley B, Herbert CP, Millar J, Howland D. Systems thinking for transformational change in health. Evid Policy. 2014;10:113–26.View ArticleGoogle Scholar
- Hofmeyer A, Scott C, Lagendyk L. Researcher-decision-maker partnerships in health services research: Practical challenges, guiding principles. BMC Health Serv Res. 2012;12:280. https://doi.org/10.1186/1472-6963-12-280.View ArticlePubMedPubMed CentralGoogle Scholar
- Gibbons M, Limoges C, Nowotny H, Schwartzman S, Scott P. The New Production of Knowledge. London: Sage; 1994.Google Scholar
- Estabrooks CA, Norton P, Birdsell JM, Newton MS, Adewale AJ, Thornley R. Knowledge translation and research careers: Mode I and Mode II activity among health researchers. Res Policy. 2008;37:1066–78.View ArticleGoogle Scholar
- Brewer GD. The challenges of interdisciplinarity. Policy Sci. 1999;32:327–37.View ArticleGoogle Scholar
- Bromme R. Beyond one’s own perspective: the psychology of cognitive interdisciplinarity. In: Weingart P, Stehr N, editors. Practising Interdisciplinarity. Toronto: University of Toronto Press; 2000. p. 115–33.Google Scholar
- Giacomini M. Interdisciplinarity in health services research: dreams and nightmares, maladies and remedies. J Health Serv Res Policy. 2004;9:177–83.View ArticlePubMedGoogle Scholar
- Meyer M. The rise of the knowledge broker. Sci Commun. 2010;32:118–27.View ArticleGoogle Scholar
- Van Rijnsoever FJ, Hessels LK, Vandeberg RLJ. A resource-based view on the interactions of university researchers. Res Policy. 2008;37:1255–66.View ArticleGoogle Scholar
- Van Rijnsoever FJ, Hessels LK. Factors associated with disciplinary and interdisciplinary research collaboration. Res Policy. 2011;40:463–72.View ArticleGoogle Scholar
- Rhoten D, Pfirman S. Women in interdisciplinary science: exploring preferences and consequences. Res Policy. 2007;36:56–75.View ArticleGoogle Scholar
- Gorard S. Current contexts for research in educational leadership and management. Educ Manag Adm Lead. 2005;33:155–64.View ArticleGoogle Scholar
- Symonds JE, Gorard S. Death of mixed methods? Or the rebirth of research as a craft. Eval Res Educ. 2010;23:121–36.View ArticleGoogle Scholar