- Open Access
Conceptualizing researchers’ perspectives on involving professionals in research: a group concept mapping study
Health Research Policy and Systems volume 19, Article number: 39 (2021)
Researchers have shown an increased interest in involving professionals from outside academia in research projects. Professionals are often involved in research on ageing and health when the purpose is to address the gap between research and practice. However, there is a need to acquire more knowledge about what the involvement might lead to by exploring researchers’ experiences of involving professionals in research on ageing and health and developing conceptual areas. Therefore, the aim of this study was to identify conceptual areas of professionals’ involvement in research on ageing and health, from the perspective of researchers themselves.
Group concept mapping, a participatory and mixed method, was used to conceptualize areas. Researchers with experience of involving professionals in research projects on ageing and health participated in qualitative data collection through brainstorming sessions (n = 26), and by sorting statements (n = 27). They then took part in quantitative data collection, where they rated statements according to how much a statement strengthened research (n = 26) and strengthened practice (n = 24). Data were analysed using multidimensional scaling analysis and hierarchical cluster analysis. In addition, a qualitative analysis of the latent meaning of the cluster map was conducted.
Analysis of the sorting stage generated five clusters illustrating conceptual areas of professionals’ involvement in research projects on ageing and health. The five clusters are as follows: complex collaboration throughout the research process; adaptation of research to different stakeholders, mutual learning through partnership; applicable and sustainable knowledge; legitimate research on ageing and health. The qualitative latent meaning of the cluster map showed two themes: the process of involvement and the outcome of involvement. A positive strong correlation (0.87) was found between the rating of strengthened research and practice.
This study reveals conceptual areas on a comprehensive and illustrative map which contributes to the understanding of professionals’ involvement in research on ageing and health. A conceptual basis for further studies is offered, where the aim is to investigate the processes and outcomes entailed in involving professionals in research on ageing and health. The study also contributes to the development of instruments and theories for optimizing the involvement of professionals in research.
Researchers in the field of ageing and health have shown an increased interest in involving professionals from outside academia in different steps in the research process, with the aim of making research more relevant, applicable and sustainable [1,2,3]. Researchers also need to satisfy requirements from research funding bodies to involve people from outside academia, where the goal is to ensure quality, and to make good use of research by promoting collaboration in the research process [4,5,6]. Aspects researchers may be required to consider, describe and reflect on in grant proposals include societal relevance, collaboration and knowledge dissemination . Although there is agreement between researchers, policy-makers and research funding bodies that people from outside academia should be involved in research, it is more difficult to agree on how and why they should be involved [7, 8], as this is an area which is still under development.
A variety of motives and underpinning philosophical assumptions affect why, how and when researchers involve and collaborate with different people in the research process . Involvement can be seen as an umbrella term covering a continuum extending from information and education to collaboration . However, a common feature is that the research is conducted with people and not on people .
Professionals constitute a specific group of people who may be involved in research studies. Professionals can be described as people with specific knowledge and sometimes even scientific knowledge gained through education [12, 13]. They may be interested in or stand to benefit from research in relation to their work, and their knowledge and expertise in relation to their work can contribute to research [14, 15]. Professionals can work on different levels. For example, they can be policy-makers, decision-makers, managers and practitioners. Professionals who practice in areas of ageing and health play an important role in enhancing the older peoples’ possibilities for healthy aging, for example health care professionals, managers or decision-makers. However, it is also important to acknowledge the relevance of people working in areas influencing older peoples’ everyday life, and who have context-specific knowledge that is valuable for the research project, but who are not commonly seen as professionals , such as assistant nurses. Hence, in this study professionals are defined as mediators of context-specific knowledge . An argument for involving professionals is that it facilitates implementation by shortening the time required to incorporate research into practice. This might otherwise take a long time . Professionals play an important role in translating knowledge from research to practice and vice versa, thereby facilitating the exchange of knowledge, which is highlighted in the Knowledge Translation framework on ageing and health .
Moreover, in response to increasing numbers of older people , and a gap between research and practice which means that people do not always receive the best care , there is a need for relevant, applicable and sustainable scientific knowledge within the field of ageing and health to ensure greater benefit for the intended beneficiaries of research. One way of obtaining relevant, applicable and sustainable knowledge may be through involving professionals in research on ageing and health.
The involvement of professionals is described as leading to benefits, challenges, obstacles and cost for the researchers, the professionals and the research itself [1, 15, 20,21,22]. When investigating researchers’ experience of involving professionals, a deductive way of analysis has been used, either by applying a framework  or by being informed by literature [1, 20]. Articles describing researchers’ reflections from collaborating with professionals  and researchers’ arguments for collaborating with professionals [21, 22, 24] illustrate what the involvement might lead to. A review study found that there is limited objective evaluation of what the involvement of professionals might lead to . However, another review study suggested there was a relationship between professionals’ involvement in research and improved health care processes and outcomes .
The growing interest in involving professionals in research has resulted in researchers acquiring more experience in the area, which makes it possible to gain deeper knowledge by involving the researchers in exploring their experiences in the area of ageing and health and developing conceptual areas. There is a need for a clear picture of both researchers’ and professionals’ perspectives to gain a comprehensive insight, though it is also important to differentiate between the two perspectives. This study only focuses on the researchers’ perspective in order to gain a clear and delimited picture of their experiences. Therefore, the aim of this study was to identify conceptual areas of professionals’ involvement in research projects on ageing and health, from the perspective of researchers themselves.
This study is part of the broader research programme UserAge , which focuses on developing knowledge about involving people from outside academia in research on ageing and health, such as frail older people, informal carers and professionals.
Group concept mapping (GCM) was used to capture and conceptualize researchers’ experiences of involving professionals in research on ageing and health. GCM is a mixed method that combines qualitative and quantitative methods and results in a map of conceptual areas . An exploratory sequential approach is employed  by means of that the qualitative research phase precedes and informs the quantitative phase . A conceptual area defines a concept and its content. It concretizes the concept by specifying indicators of the content and establishing boundaries of the concept area . GCM is a structured method with a number of steps: a first planning phase, brainstorming, a second planning phase, organizing, analyses, interpretation and use . In the first phase of planning, the project plan is finalized, a focus prompt is developed and relevant participants are recruited. The participants are involved through brainstorming, where they are asked to provide an ending for the focus prompt and thereby generate statements. In the second phase of planning, all the statements which have been generated are reviewed and synthesized. Rating questions are developed so that participants can rate the statements. The organizing step involves the participants being asked to sort the statements into groups and to rate them according to the rating questions by using a predefined scale. The data are then analysed using multidimensional scaling (MDS) analysis and hierarchical cluster analysis. The steps involving interpretation and use of the results are conducted in collaboration with the participants or other relevant users of the research . The Concept System® groupwisdom™ (Concept Systems Inc., Ithaca, NY) has been especially developed to support this method. It can be used in all or some of the steps to support participants’ involvement and to support the researchers in the analysis of the data.
Procedure and sample
First planning phase
During the first planning phase the aim of the study was clarified, and the focus prompt “Involving professionals in research on ageing and health can lead to…” was evaluated during a pilot brainstorming session. Initially, the prompt was phrased using the words “contribute to…”, but it was rephrased to “lead to…” in order to capture both positive and negative aspects. During this phase, relevant participants were identified and invited to take part in the study. Purposeful sampling  was used in the search for relevant participants with experience in the topic of interest, and was conducted on a national level through the network of leading researchers within the field of ageing and health, striving for heterogeneity. The inclusion criteria were that participants should have a PhD or be a PhD student, have experience in involving professionals in one or more parts of the research process, and have experience of research in the field of ageing and health, such as health and social care of older people, or rehabilitation and supportive environments. Involvement was defined as “more than just being interviewed or answering a survey”. However, it could imply varying degrees of involvement, from consultation to collaboration.
Potential participants received written and oral information about the aim of the study and the estimated use of time during their involvement. If they accepted, they were asked to complete a letter of consent and a questionnaire on gender, academic level and research experience (Table 1). Participants were also asked to describe in what circumstances they had involved professionals. Most participants had experience of involving professionals in the following ways: as members of a reference group or steering group, or by having them give advice on the research or help to recruit participants, collect or interpret data, or disseminate results. A total of 36 researchers were asked to participate in the study, and six researchers declined to participate, giving time constraints as their main reason. In all, 30 researchers participated in the study (Table 1). The participants received additional information, both written and oral, specifically related to their participation in the different steps. Some researchers participated in all steps of the process, and some only in one or two. For an overview of the GCM process and the number of participants in each step, see Fig. 1. Three participants dropped out after the brainstorming, and four new participants agreed to participate in the organizing phase. There was additional dropout during the organizing phase where some participants did not conduct all the steps.
To facilitate the involvement of the participants, several brainstorming sessions (between November 2018 and April 2019) were conducted on different days and in different places. A total of 26 people participated in these brainstorming sessions, which were divided into six group sessions with two to six participants in each. The participants were offered the choice of participating face to face or online (by using video conferencing platforms) and could choose what suited them best. Three of the sessions were face to face meetings, in two sessions a combination of face to face and online participation was used and one session was solely online. Two participants brainstormed individually by using the web-based Concept System® groupwisdom™. Before the brainstorming session, participants were given instructions to complete the focus prompt according to their experience and knowledge. During brainstorming they were encouraged to think about both positive and negative aspects of what involving professionals can lead to in relation to research and practice. The rules for brainstorming were followed ; for example, participants were asked to brainstorm freely and not debate the statements, since the aim was to capture their broad experiences and knowledge, not to reach consensus. Moreover, participants were asked to restrict each statement to one focus only, otherwise it would have to be split into two statements. Two of the authors participated in each session, one facilitating the brainstorming and one writing down the statements, which were displayed directly on a screen for all participants.
Second planning phase
During the second planning phase, all statements from the brainstorming sessions were reviewed and synthesized. The reason for synthesizing is to have a manageable number of statements for the participants to sort and rate, and at the same time to ensure that the statements are representative as well as saturation of the participants’ experiences of the topic [28, 33]. During the process of reviewing and synthesizing, the first author marked statements not related to the focus prompt, which upon confirmation from the other authors were removed. The first author sorted statements with the same or a similar meaning, or keywords, into a horizontal row in a document. This helped find the statement that best captured the meaning of the statements in each row and enabled an audit trail of the process. The list of statements was reviewed by the second author, and then discussed by all the authors together and reviewed further, resulting in a final list of statements. To enable confirmability  all the authors could keep track of the synthesizing process since all statements were viewed in the document during the process.
Later in the organizing step, participants individually sorted (n = 27) and rated (rating I, n = 26; rating II, n = 24) the statements in the web-based Concept System® groupwisdom™. By using the web-based system the participants were able to conduct the sorting and rating when they wanted, at their own pace within a time frame of 10 weeks. Three of the 26 participants who participated in the brainstorming session did not conduct the sorting and rating. However, four other participants who were interested in participating in the study but were unable to participate in any brainstorming sessions chose to participate in only the organizing step. The GCM method is flexible in that way; it is not necessary for the same people to participate in all the steps .
In order to conduct the sorting, the participants were asked to sort the statements into groups on the basis of how they perceived that the statements related to each other, and to label each group. The participants were informed that it was not acceptable to sort all the statements into one group, and that they should only place a statement on its own in a group if it was in no way related to any other statement. Furthermore, participants were instructed that they should not create groups according to priority or value, such as “important” or “difficult to do”, and that they should avoid creating groups which covered a variety of statements, such as “miscellaneous” or “other”.
Next, the participants were asked to rate all statements according to the following two questions: “To what extent can the following statements strengthen research conducted with the involvement of professionals?” (rating I) and “To what extent can the following statements strengthen practice when conducting research with the involvement of professionals?” (rating II). Strengthening was defined for the participants as developing relevant, applicable and/or sustainable knowledge. The participants were instructed to use a scale from 1 to 4 (1 = not at all, 2 = a little, 3 = a lot, 4 = very much), and to use the entire range of response categories.
MDS analysis and hierarchical cluster analysis were conducted using the Concept System® groupwisdom™. Calculating a similarity matrix, the MDS analysis, based on how the participants sorted the statements into groups, resulted in a point map where each point represents one statement. The point map is a two-dimensional map that illustrates the relations between the statements as a result of how these have been sorted by the participants. Statements which were most frequently sorted together appeared closer to each other on the point map . A low stress value represents a better fit between the similarity matrix for the MDS and the point map , and in GCM studies the stress value often lies between 0.10 and 0.35 . Rosas and Kane  estimate that acceptable stress values can be achieved with a sample of 20–30 participants.
Following the MDS analysis, a hierarchical cluster analysis calculated the cluster solution. Bridging values (BVs) were calculated for each statement, as well as the average BV for each cluster. BV ranges from 0 to 1 and describes an aggregation of the sorting by all participants. The values refer to how the statements are related to other statements. The lower the BV, the more the statement is anchored to its place on the map, meaning that it has been sorted with statements that are in the same area on the map. The higher the BV, the more a statement has been sorted with statements placed further away on the map, thereby bridging to other areas on the map. Statements with a low BV are more representative of the meaning of the cluster in which they are located than those with higher BVs. The BV for a cluster is the average of all the BVs for the statements in each cluster. Lower BVs represent a more homogeneous cluster and higher BVs a more heterogeneous cluster .
The first and second author discussed labelling of the clusters. They read through all the statements in each cluster and interpreted the content of the cluster in a qualitative way, at the same time looking both at the participants’ suggestions for labels as well as statements with a low BV, i.e. representing “anchors” within that cluster. The label decided on encapsulated the conceptual content of the cluster. GCM maps include observable features, which are descriptive and manifest, as well as hypothetical, unobservable features, which are latent . Thus, a qualitative analysis  of the latent meaning of the cluster map was then carried out inductively, by grouping clusters into two themes based on the content of the clusters.
The data from the ratings of the extent to which the statements could strengthen research (rating I) and practice (rating II) from 1 (not at all) to 4 (very much) were then analysed by plotting the statements in a bivariate scatterplot, known as a go-zone map in GCM studies. The go-zone shows the mean rating of each statement, thereby illustrating similarities and differences in how the participants rated the statements . The go-zone map was used to analyse and illustrate associations between the two ratings (rating I and rating II) of the statements.
Interpretation and use
The possibility to conduct member check to validate the interpretation of the results  was given through a seminar when the authors met other researchers who had experience of involving professionals in research, and some of the participants who had taken part in the study. The preliminary maps were presented, and to check the validity of the authors’ interpretation of the clusters they were especially asked to verify the labels of the clusters in relation to the statements. No changes to the results were suggested.
According to Rosas , a GCM map is the basis for developing an explanation for and expanding understanding of the area under investigation, since “conceptual models generated in concept mapping are devices to help individuals and groups understand the real world more clearly” (p.1413). GCM is often used as a method for evaluating or planning interventions, and developing instruments or theories . The discussion and conclusion will illustrate how the results from this study can be used.
Before accepting an invitation to take part, participants received written and oral information about the project and about what they could expect if they participated, and they were informed that all data would be handled confidentially. Participation was voluntary, and they were informed that they could end their participation at any time. They were informed that the brainstorming sessions would be in groups, meaning that they would not be anonymous. However, the organizing phase would be carried out individually, and the results would be presented on group level without any possibility to identify individual persons. Furthermore, they had the opportunity to contact the researchers with any questions or problems related to their involvement in the web-based parts of the study.
A total of 512 statements were generated during the brainstorming phase. The statements were reviewed and synthesized, resulting in a final list of 94 statements. Table 2 lists the statements within the five clusters, the BVs of clusters and statements, and the mean ratings of the extent to which the statements could strengthen research (rating I) and practice (rating II).
An MDS of the sorted statements resulted in a point map (Fig. 2). The stress value of 0.26 for the point map indicates a good fit between the raw data and the result. The point map illustrates how the statements are related. Statements which are sorted together more often are placed near each other; therefore, it is the relationships between the points that are of interest.
Hierarchical cluster analysis was used to create a map of conceptual areas, and a solution with five clusters was chosen (Fig. 3) because of the coherency of the statements in the clusters. BVs for the clusters and statements were also taken into consideration in deciding on the cluster solution.
The five clusters are as follows: complex collaboration throughout the research process (cluster 1); adaptation of research to different stakeholders (cluster 2); mutual learning through partnership (cluster 3); applicable and sustainable knowledge (cluster 4) and legitimate research on ageing and health (cluster 5). The BVs of the clusters are illustrated as layers in the clusters; the more layers there are in a cluster, the higher the BV of the cluster (see Fig. 3).
Cluster 1 (complex collaboration throughout the research process) has an average BV of 0.25, indicating that it is a homogeneous cluster. Statement 4, “research project taking a long time”, and statement 21, “difficulties for the researcher in deciding how much the professional should be involved in interpreting results”, are the most anchored statements in the cluster with the lowest BVs (0.02). The cluster illustrates the complex collaboration between researchers and professionals involving challenges regarding aspects of roles and responsibilities in research. Cluster 2 (Adaptation of research to different stakeholders) has an average BV of 0.3. Statement 84, “distortion of research results caused by the professionals’ own interests” is the anchor for this cluster (BV = 0.07). This cluster illustrates aspects of the process when research is adapted in order to involve professionals. It demonstrates the need for balance between aspects valued by research and aspects valued by practice which can result in conflicts but also in a feeling of ownership for professionals. Cluster 3 (mutual learning through partnership) has an average BV of 0.41, and statement number 75, “mutual learning” (BV = 0.2), has the lowest BV. Learning is described in this cluster as achieved by both the researchers and the professionals. They are inspired by each other and gain an understanding of each other. Respect, communication and good relationships foster the partnership. Cluster 4 (applicable and sustainable knowledge) has an average BV of 0.13. Two of the statements have a BV of 0: statement 47, “increased sustainability of results and working methods”, and statement 86, “facilitation of knowledge dissemination”. This cluster illustrates aspects of what applicable and sustainable knowledge can achieve. The professionals’ role in mediating and enabling context-relevant knowledge is highlighted as a facilitating element. Cluster 5 (legitimate research on ageing and health) has an average BV of 0.57, and is therefore the most heterogeneous cluster. Statement 92, “better health care for older people” has the lowest BV (0.17), and is therefore the anchor statement in this cluster. This cluster illustrates aspects of how legitimacy is achieved for research on ageing and health. Considering the professionals as experts, and seeing ethical justifiable research and outcomes that benefit the researchers, the professionals as well as the older people are factors contributing to legitimacy.
Through further qualitative analysis of the latent meaning of areas, the two clusters at the top of the map, cluster 1 (complex collaboration throughout the research process) and cluster 2 (adaptation of research to different stakeholders), can be seen as comprising conceptual areas related to the process of involving professionals in research on ageing and health, whereas the three conceptual areas at the bottom, cluster 3 (mutual learning through partnership), cluster 4 (applicable and sustainable knowledge) and cluster 5 (legitimate research on ageing and health), can be seen as related to the outcome of involving professionals in research (Fig. 4).
The mean rating of the five clusters (see Table 2), or the extent to which they strengthen research and practice, ranges from 2.01 to 3.24, indicating that most of the statements were rated high on the scale from 1 to 4. Cluster 3 (mutual learning through partnership) was rated highest in terms of both strengthening research (3.20) and strengthening practice (3.24). Cluster 2 (adaptation of research to different stakeholders) was rated lowest in terms of both strengthening research (2.06) and strengthening practice (2.01).
The go-zone map (Fig. 5) is a bivariate scatterplot where the statements are visually placed on an x-axis (strengthens research) and a y-axis (strengthens practice), according to the mean of the participants’ ratings for each statement. There is a strong positive correlation (0.87) between the statements rating: the more a statement is graded to strengthen research, the more it is graded to strengthen practice, and vice versa.
The go-zone map is divided into quadrants above and below the mean of all statement ratings in terms of strengthening research and practice. The mean for strengthening research is 2.73 and the mean for strengthening practice is 2.69. The statements in the upper-right quadrant, the go-zone, are rated high in terms of strengthening both research and practice, and are mostly statements from clusters related to outcome: mutual learning through partnership (cluster 3), applicable and sustainable knowledge (cluster 4) and legitimate research on ageing and health (cluster 5). The lower-left quadrant, the “o-zone”, contains statements which are rated low in terms of strengthening both research and practice. On this map, the o-zone mostly contains statements from clusters related to the process: complex collaboration throughout the research process (cluster 1) and adaptation of research to different stakeholders (cluster 2). The two other zones, the gap zones, contain statements which are rated high in one and low in the other for research or practice.
The aim of this study was to identify conceptual areas of professionals’ involvement in research on ageing and health, from the perspective of researchers themselves. Using the GCM method enabled the study to capture the range and diversity of the participants’ knowledge and experience in terms of involving professionals in research on ageing and health, and to merge it into one map of conceptual areas. The following discussion of the results is based on a qualitative analysis of the latent meaning of the cluster map, the outcome of involvement and the process of involvement. The results of this study illustrating conceptual areas emphasize the need for a holistic view including both the process and the outcome when involving professionals. Other studies on research partnership also emphasize the relationship between process and outcome. For example, Tabriz et al.  structured their findings in terms of inputs to, processes of and outcomes from the partnership, and Nyström et al.  illustrate the research partnership process as preparation, process and impact. Furthermore, the results of this study also contribute by illustrating what the involvement can lead to during the process as well as by giving a more extensive description of the outcomes.
Outcome of involvement
The conceptual areas “mutual learning through partnership”, “applicable and sustainable knowledge” and “legitimate research on ageing and health” can be seen as related to the outcome of involving professionals in research projects on ageing and health. The participants’ experience that involving professionals leads to mutual learning through partnership illustrates that a development occurs not only for the professionals involved and their practice but also for the researchers and their research. This is illustrated in the statements “professionals and researchers inspiring each other” and “the researcher gaining greater understanding of the professionals’ perspectives”. This is in line with the results of Staley’s  narrative literature review which is conducted within the context of patient and public involvement. The findings show that researchers learn by acquiring new knowledge and communication skills through patient and public involvement. Also, Staley’s  study found that the researchers’ attitudes to involvement change, which might ultimately change how they conduct their research. Mutual learning is described as an outcome of participatory research when the researcher and the people involved work together as colleagues , and is argued to be important for the process in research partnerships with professionals .
Our finding that mutual learning takes place through partnership aligns with the assumption that people learn through social relationships, or in other words that people can co-create new knowledge by sharing constructions of their reality or worldview . In turn, it is more likely that the co-created knowledge will fit the context of practice, and thereby be more relevant and applicable. This is exemplified in the conceptual area illustrating that involvement of professionals leads to applicable and sustainable knowledge. Hence, applicable and sustainable knowledge cannot be created isolated from its context , in this case practice, since it is historically and socially constructed . This emphasizes the importance of involving the professionals who can benefit from the research, and developing mutual learning through collaboration. According to Lincoln and Guba , the way people see and understand realities develops when they learn from others by gaining new knowledge, which enables them to adapt their understanding of the world. If the new knowledge they gain adds to their understanding of the world, their aggregated knowledge is more likely to become applicable and sustainable, generating “contextually adapted, relevant research”, as one of the statements in the study suggested. Sustainable knowledge which leads to an impact on society is considered to be an outcome of the collaborative process in a number of co-creation models, where stakeholders are involved . Furthermore, applicable knowledge being more context-sensitive is highlighted as a means of enabling implementation of the knowledge [17, 24].
Involving professionals in a collaborative process has an underlying democratic ideology which aims to legitimize research on ageing and health. Accordingly, the results of the present study show that legitimate research on ageing and health is a conceptual area illustrating what involvement of professionals can lead to. Legitimacy can be achieved when the research process is viewed as fair and ethical. This entails respect of different values and interest in an unbiased and fair process by genuine inclusion of stakeholders in the process of collaboration . Thereby legitimacy may depend on how decisions are made and whether they are widely accepted by people. The statement “professionals are heard and seen as experts” confirms that professionals can influence research and can have a say by being involved in it, and this, in turn, contributes to the legitimacy of the research. However, in itself, research is often legitimized through standardized and precise rules or proof for how “something” works, which is in keeping with the “legal-bureaucratic model” described by Rothstein . Rothstein  describes several models to explain how policies for the welfare state are legitimized in a democratic way. The “legal-bureaucratic model” and the “professional model” are of particular interest in terms of the legitimacy of research on ageing and health. In the “legal-bureaucratic model”, governance and decisions are built on precise, standardized rules, where people are acquainted with the regulations and can predict the outcomes. In the “professional model”, legitimacy is the result of leaving licensed professionals to decide how to implement decisions. Licensed professionals have specific knowledge and ethics which they have acquired through an established education, so they can be designated the responsibility for making decisions in their work . When professionals are involved in research, they represent their organization, and bring specific knowledge and ethics which enable them to help adapt research to the context, that is, the practice. This is illustrated in the statement “greater degree of person centredness in practice and research”. This is well in line with a study on transdisciplinary research (collaboration between researchers and different professionals) in sustainable urban development which showed that legitimacy could be achieved by involving different expertise and perspectives in the process .
The conceptual areas interpreted as outcomes were rated high on the go-zone map in terms of strengthening research and practice. Interestingly, there was a strong positive correlation (0.87) between statements rating. Statements and clusters in the upper-right quadrant of a go-zone map are often those most emphasized in projects for evaluation or development [48, 49] since they are rated highest and are often rated according to importance and feasibility. However, it is important to reflect on the clusters and statements in the o-zone and gap zones as well, as they may have a more philosophical foundation. In addition, all clusters and statements are related to each other, as illustrated by the BVs. The go-zone (Fig. 5) shows that the conceptual areas related to the process of involving professionals are rated low in terms of strengthening research and practice. However, it could be argued that it is not possible to reach the conceptual areas related to outcome without successfully “going through” the conceptual areas related to the process, since involving professionals in research is not a linear process. The conceptual areas related to the process may not direct or clearly strengthen research or practice but by looking at the content of these areas it can be argued that they are equally important. Hence researchers’ considerations of what the involvement of professionals may lead to should be supported by considerations of how to involve. Drawing links between process and outcome and investigating the relationship is important since there is limited knowledge of what in the process of involvement might lead to different outcomes given the complexity of the process and different contexts [25, 26].
Process of involvement
The conceptual areas related to the process of involvement are “complex collaboration throughout the research process” and “adaptation of research to different stakeholders”.
In this study, complex collaboration throughout the research process is illustrated by several statements related to aspects of the roles and responsibilities of researchers and professionals. One of the statements indicates that involving professionals leads to an “increased demand for clarifying roles and frameworks for the project”. Unclear definitions of roles and expectations are shown to be a barrier to collaboration . Role descriptions for those involved in research  were suggested as a way of minimizing barriers related to roles. However, involving professionals is a complex and constantly changing process of collaboration, so it is difficult to build on static roles and responsibilities. This can lead to “conflicts between professionals and researchers” and a “more complex and demanding role of the researcher”, as they need to balance the “increased demand for clarifying roles and frameworks for the project” as well as “ethical challenges”. Olswang and Goldstein  describe that professionals and researchers have different roles when they collaborate in a research project. They have different knowledge and expertise, and understanding and appreciating this will make collaboration more productive. The statement in this cluster that was rated highest in terms of strengthening research and practice was “demands on the researcher to make the research understandable and accessible”. This illustrates a need to clarify the research process for the professionals involved.
The other conceptual area related to the process of involvement is “adaptation of research to different stakeholders”. When researchers involve professionals, they adapt themselves in order to reach a balance of power, as illustrated in the statements “power balance between researchers and professionals”. This requires qualities from the researchers which are not always explicit. The statement “increased demands for creativity and flexibility from the researcher” provides an example of these qualities. There nevertheless remains a risk of conflict or tension between researchers and professionals, especially when the interests of one party dominate. Several statements in this cluster include examples of these risks, such as populist research, distortion of research results and non-democratic processes. The relationship between researchers and professionals is not without tension, which is described in a study by Bartunek and Rynes , where logic, the time dimension and communication illustrate some of the sources of tension. Interestingly, the authors suggest harnessing these tensions to foster change . The theory for expansive learning by Engeström  also stresses that “contradictions are the prime source of change” (p.16) in collaboration between different professions. This can be applied to the relationship between researchers and professionals in collaborative research projects. Lofman et al.  point out that researchers in participatory action research must be aware of the power balance during the whole process of collaboration, and that professionals must be seen as equals in order to feel a sense of ownership of the project. The statement “ownership for professionals” was rated high in terms of strengthening practice in conducting research where professionals are involved. Furthermore, the statement is located in the centre of the point map (Fig. 2), illustrating its central conceptual relationship with all the other statements. A power balance and a feeling of ownership are linked to the relationship between researchers and professionals, indicating that the way in which researchers encounter professionals in the process of involvement is an essential aspect of the process.
The approach and epistemological considerations of researchers have an impact on how they involve professionals, such as how they encounter the people they involve, which affects the process of involvement . The increased focus on involving people, such as professionals, in research indicates that the definition of scientific evidence has developed to include a broader perspective on what counts as knowledge, and an acceptance of different kinds of knowledge. Building on Polanyi’s (1958) ideas, McHugh and Walker  assert that the justification of different kinds of knowledge is related to epistemologies, and they emphasize that tacit, explicit, particular and general forms of knowledge are required in a dynamic combination in research and in health care. However, the statement “the research community questioning the quality of the research” illustrates that, although some researchers value collaboration with professionals, there may be some from other research traditions who do not, since knowledge gained through collaboration is not always acceptable in other research paradigms . Researchers are often schooled in a certain scientific philosophy in terms of what they consider knowledge to be , and these views rely on socially and culturally acceptable circumstances in their area and community of research. Kuhn  and Guba and Lincoln  explain this as researchers working within different paradigms. Therefore, when researchers on the same project have different views on knowledge, it can cause tensions in the research process .
This study shows that involving professionals in research can lead to mutual learning, applicable and sustainable knowledge, and legitimate research. However, it is necessary to navigate successfully through the complex research process and adapt to the professionals involved. In this sense, it is crucial that researchers who involve professionals reflect on their underpinning epistemic beliefs in a critical way during the research process and reflect on how these affect not only their views about knowledge but also how they involve professionals in the research process.
By using a mixed method, the strengths of both the qualitative and quantitative analysis give breadth and depth to the understanding of the research question . Through participants’ brainstorming and sorting of statements depending on how they experience that statements relate to each other (qualitative) and the subsequent statistical analysis (quantitative), of the participants sorting and rating, GCM can be considered an exploratory sequential approach . In addition, what is found quantitatively, by means of clusters, is then qualitatively analysed by its latent content. The design of GCM aligns with an exploratory sequential approach; however, as Rosas  argues, the method integrates data and analysis at multiple points of the process, thereby intertwining the qualitative and quantitative methods in a more complementary and additive manner, which possibly can be regarded as slightly different from letting the quantitative phase build on the qualitative research phase. Mixed methods use multiple worldviews , and GCM was chosen as it enabled the authors to combine a participatory worldview, emphasizing collaboration, with a pragmatic worldview, which focuses on practice and the participants’ real-world issues. The statements were brainstormed by the participants in order to collect their experiences as a basis for the analysis. Predetermined statements can be used in GCM studies and can be defined, for example, from theory or literature . However, a valuable aspect of this study was that the participants were involved and that the statements originated from their own experiences. Participating in a GCM study was believed to be meaningful for the participants per se, but the illustrative and usable results are also considered meaningful for practice and research. GCM is a reliable and valid method , but precautions need to be taken to ensure the validity of the qualitative and quantitative data , especially given the participatory approach. It was therefore important to make sure that the participants understood the questions and instructions in the steps they were involved in. Our experience is that the participants understood the instructions and questions, and had a greater understanding of the study, precisely because they were researchers who had considerable experience and knowledge of involving professionals in research on ageing and health. This also meant that they could provide rich and complex data. The qualitative data collection conducted through brainstorming sessions generated 512 statements which were reviewed and synthesized, resulting in a final list of 94 statements, indicating that a high degree of saturation of the topic had been reached. To enhance the trustworthiness, all the authors participated in the qualitative analysis. Several of the authors were skilled in both qualitative research and the GCM method, ensuring the enquired sensitivity to the study’s data and process . GCM has been shown to give structure and order to rich and complex data, and thereby enable further interpretation for evaluation, development or decision-making [60, 61]. A concept map constructed through GCM visualizes empirical co-constructions of the participants’ real world . This means that the participants who were researchers themselves co-constructed the map in this study, giving structure to the complex and real-world issues introduced by involving professionals in research.
In a GCM study, participants’ involvement in some of the steps of the research process is rather time consuming, and in this case it resulted in some participants withdrawing due to lack of time. There were a few participants who dropped out after the brainstorming phase and others participated only in the organizing phase. GCM is a flexible method  that allows different participants to take part in the different steps, since brainstorming and organizing constitute two completely different elements of the research process. In considering involvement of professionals in research, the study covers areas of involvement extending from consultation to collaboration, and does not differentiate between different approaches of involvement. This may limit the extent to which the result can be used. The conceptual areas of this study focus on professionals’ involvement in research projects on ageing and health; however, the results are believed to be transferable to other research areas given the broad concepts covered in the findings. This study solely includes the researcher’s perspective and thereby limits the results. There is a need to also investigate the professionals’ perspective. Using the results at hand and conceptualizing the researchers’ as well as the professionals’ perspective will give a more comprehensive understanding of the area.
This study brought together the experiences and knowledge of a wide range of researchers in one comprehensive and illustrative map of what involving professionals can lead to in research projects on ageing and health. The conceptual areas found in the study contribute to a knowledge basis for the understanding of professionals’ involvement in research on ageing and health. The conceptual areas also have significant implications for the theoretical development of involvement in research by illustrating the perspectives of process and outcome. In addition, the results of this study have implications for practice. The results could be of interest in developing instruments to measure involvement, and in developing education for both professionals and researchers. Also, the study is useful for improving the understanding of involvement in research and optimizing the involvement of professionals. However, the study also raises questions about the relation between process and outcome when involving professionals in research on ageing and health. Further research is required to explore this relationship. Moreover, further research into the professionals’ perspective is needed to obtain a more comprehensive understanding of the area and the differences and similarities of the two perspectives.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Group concept mapping
Nyström ME, Karltun J, Keller C, Andersson GB. Collaborative and partnership research for improvement of health and social services: researcher’s experiences from 20 projects. Health Res Policy Syst. 2018;16(1):46. https://doi.org/10.1186/s12961-018-0322-0.
Boaz A, Hanney S, Borst R, O’Shea A, Kok M. How to engage stakeholders in research: design principles to support improvement. Health Res Policy Syst. 2018;16(1):60. https://doi.org/10.1186/s12961-018-0337-6.
Kothari A, McCutcheon C, Graham ID. Defining integrated knowledge translation and moving forward: a response to recent commentaries. Int J Health Policy Manag. 2017;6(5):299–300. https://doi.org/10.15171/ijhpm.2017.15.
Forskningsrådet för arbetsliv hälsa och väldfärd. Strategisk agenda 2019–2022 [Swedish Research Council for Health, Working Life and Welfare: Strategic agenda 2019–2022]. Sweden: Forte; 2019.
The Swedish Research Council Formas. Research for meeting the challenges of climate change. Stockholm: Formas; 2018.
Horizon 2020. How to get fundings? 2019 https://ec.europa.eu/programmes/horizon2020/node/115. Accessed 4 Nov 2019.
Greenhalgh T, Hinton L, Finlay T, Macfarlane A, Fahy N, Clyde B, et al. Frameworks for supporting patient and public involvement in research: systematic review and co-design pilot. Health Expect. 2019. https://doi.org/10.1111/hex.12888.
Staley K, Sandvei M, Horder M. 'A problem shared…' The challenges of public involvement for researchers in Denmark and the UK. University of Southern Denmark and TwoCan Associates, UK. 2019.
Greenhalgh T, Raftery J, Hanney S, Glover M. Research impact: a narrative review. BMC Med. 2016;14(1):78. https://doi.org/10.1186/s12916-016-0620-8.
Health Canada. The Health Canada Policy Toolkit for Public Involvement in Decision Making: Minister of Public Works and Government Services Canada; 2000. https://www.canada.ca/en/health-canada/corporate/about-health-canada/reports-publications/health-canada-policy-toolkit-public-involvement-decision-making.html#a99. Accessed 2 Jan 2019.
Kylberg M, Haak M, Iwarsson S. Research with and about user participation: potentials and challenges. Aging Clin Exp Res. 2018;30(1):105–8. https://doi.org/10.1007/s40520-017-0750-7.
Sullivan WM. Medicine under threat: professionalism and professional identity. CMAJ. 2000;162(5):673–5.
Brante T. Vad är en profession? Teoretiska ansatser och definitioner. [What is a profession? Theoretical appoaches and definitions]. In Vetenskap för profession [Science for profession]. University of Borås. 2009:8
Glegg SM, Hoens A. Role domains of knowledge brokering: a model for the health care setting. J Neurol Phys Ther. 2016;40(2):115–23. https://doi.org/10.1097/NPT.0000000000000122.
Bullock A, Morris ZS, Atwell C. Collaboration between health services managers and researchers: making a difference? J Health Serv Res Policy. 2012;17(s2):2–10. https://doi.org/10.1258/jhsrp.2011.011099.
Balas EA, Boren SA. Managing clinical knowledge for health care improvement. In: Bemmel J, McCray AT, editors. Yearbook of medical informatics 2000: patient-centered systems. Stuttgart, Germany: Schattauer Verlagsgesellschaft mbH; 2000. p. 65–70.
Ellen ME, Panisset U, Araujo de Carvalho I, Goodwin J, Beard J. A Knowledge Translation framework on ageing and health. Health Policy. 2017;121(3):282–91. https://doi.org/10.1016/j.healthpol.2016.12.009.
Foreman KJ, Marquez N, Dolgert A, Fukutaki K, Fullman N, McGaughey M, et al. Forecasting life expectancy, years of life lost, and all-cause and cause-specific mortality for 250 causes of death: reference and alternative scenarios for 2016–40 for 195 countries and territories. Lancet. 2018;392(10159):2052–90. https://doi.org/10.1016/S0140-6736(18)31694-5.
Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26:13–24. https://doi.org/10.1002/chp.47.
Ross S, Lavis J, Rodriguez C, Woodside J, Denis JL. Partnership experiences: involving decision-makers in the research process. J Health Serv Res Policy. 2003;8(Suppl 2):26–34. https://doi.org/10.1258/135581903322405144.
Oliver K, Kothari A, Mays N. The dark side of coproduction: do the costs outweigh the benefits for health research? Health Res Policy Syst. 2019;17(1):33. https://doi.org/10.1186/s12961-019-0432-3.
Olswang LB, Goldstein H. Collaborating on the development and implementation of evidence-based practices: advancing science and practice. Evid Based Commun Assess Interv. 2017;11(3–4):61–71. https://doi.org/10.1080/17489539.2017.1386404.
Hummelvoll JK, Severinsson E. Researchers’ experience of co-operative inquiry in acute mental health care. J Adv Nurs. 2005;52(2):180–8. https://doi.org/10.1111/j.1365-2648.2005.03570.x.
Langley J, Wolstenholme D, Cooke J. ‘Collective making’ as knowledge mobilisation: the contribution of participatory design in the co-creation of knowledge in healthcare. BMC Health Serv Res. 2018;18(1):585. https://doi.org/10.1186/s12913-018-3397-y.
Daniels N, Gillen P, Casson K. Practitioner engagement by academic researchers: a scoping review of nursing, midwifery, and therapy professions literature. Res Theory Nurs Pract. 2020;2:85–128. https://doi.org/10.1891/RTNP-D-18-00125.
Boaz A, Hanney S, Jones T, Soper B. Does the engagement of clinicians and organisations in research improve healthcare performance: a three-stage review. BMJ Open. 2015;5(12):e009415. https://doi.org/10.1136/bmjopen-2015-009415.
Iwarsson S, Edberg AK, Ivanoff SD, Hanson E, Jonson H, Schmidt S. Understanding user involvement in research in aging and health. Gerontol Geriatr Med. 2019;5:2333721419897781. https://doi.org/10.1177/2333721419897781.
Kane M, Rosas S. Conversations about group concept mapping. Thousand Oaks: SAGE; 2018.
Hanson WE, Creswell JW, Clark VLP, Petska KS, Creswell JD. Mixed methods research designs in counseling psychology. J Couns Psychol. 2005;52(2):224–35. https://doi.org/10.1037/0022-0184.108.40.206.
Creswell JW, Creswell JD. Research design: qualitative, quantitative and mixed methods approaches. 5th ed. Los Angeles: SAGE; 2018.
Rosas SR. Group concept mapping methodology: toward an epistemology of group conceptualization, complexity, and emergence. Qual Quant. 2017;51(3):1403–16. https://doi.org/10.1007/s11135-016-0340-3.
Creswell JW, Plano Clark VL. Designing and conduction mixed methods research. Thousand Oaks: SAGE; 2011.
Rosas SR, Kane M. Quality and rigor of the concept mapping methodology: a pooled study analysis. Eval Program Plann. 2012;35(2):236–45. https://doi.org/10.1016/j.evalprogplan.2011.10.003.
Lincoln YS, Guba EG. Naturalistic inquiry. Newbury Park: SAGE; 1985.
Trochim WM, McLinden D. Introduction to a special issue on concept mapping. Eval Program Plann. 2017;60:166–75. https://doi.org/10.1016/j.evalprogplan.2016.10.006.
Petrucci CJ, Quinlan KM. Bridging the research-practice gap. J Soc Serv Res. 2007;34(2):25–42. https://doi.org/10.1300/J079v34n02_03.
Polkinghorne DE. An agenda for the second generation of qualitative studies. Int J Qual Stud Health Well-being. 2006;1(2):68–77. https://doi.org/10.1080/17482620500539248.
Tabriz AA, Flocke SA, Shires D, Dyer KE, Schreiber M, Elston LJ. Logic model framework for considering the inputs, processes and outcomes of a healthcare organisation–research partnership. BMJ Qual Saf. 2020;29(9):746–55. https://doi.org/10.1136/bmjqs-2019-010059.
Staley K. Changing what researchers “think and do”: is this how involvement impacts on research? Res All. 2017;1(1):158–67. https://doi.org/10.18546/RFA.01.1.
Cornwall A, Jewkes R. What is participatory research? Soc Sci Med. 1995;41(12):1667–76. https://doi.org/10.1016/0277-9536(95)00127-s.
Nyström ME, Strehlenert H. Advancing health services collaborative and partnership research; comment on “experience of health leadership in partnering with university-based researchers in Canada—a call to ‘re-imagine’ research.” Int J Health Policy Manag. 2020. https://doi.org/10.15171/IJHPM.2020.16.
Lincoln YS, Guba EG. The constructivist credo USA. Walnut Creek: Left Coast Press; 2013.
Engeström Y. Expertise in transition: expansive learning in medical work. Cambridge: Cambridge University Press; 2018.
Greenhalgh T, Jackson C, Shaw S, Janamian T. Achieving research impact through co-creation in community-based health services: literature review and case study. Milbank Quart. 2016;94(2):392–429. https://doi.org/10.1111/1468-0009.12197.
Belcher BM, Rasmussen KE, Kemshaw MR, Zornes DA. Defining and assessing research quality in a transdisciplinary context. Res Eval. 2015;25(1):1–17. https://doi.org/10.1093/reseval/rvv025.
Rothstein B. Välfärdsstat, förvaltning och legitimitet [Welfare state, management and legitimacy]. In: Rothstein B, editor. Politik som organisation [Politics as organisation]. Lund: Stundentlitteratur; 2014. p. 15–34.
Hansson S, Polk M. Assessing the impact of transdisciplinary research: the usefulness of relevance, credibility, and legitimacy for understanding the link between process and impact. Res Eval. 2018;27(2):132–44. https://doi.org/10.1093/reseval/rvy004.
Velonis AJ, Molnar A, Lee-Foon N, Rahim A, Boushel M, O’Campo P. “One program that could improve health in this neighbourhood is ____?” Using concept mapping to engage communities as part of a health and human services needs assessment. BMC Health Serv Res. 2018;18(1):150. https://doi.org/10.1186/s12913-018-2936-x.
Fitzpatrick SJ, Zizzi SJ. Using concept mapping to identify action steps for physical activity promotion in cancer treatment. Am J Health Educ. 2014;45(1):20–8. https://doi.org/10.1080/19325037.2013.852999.
Sibbald SL, Tetroe J, Graham ID. Research funder required research partnerships: a qualitative inquiry. Implement Sci. 2014;9(1):176. https://doi.org/10.1186/s13012-014-0176-y.
INVOLVE. Briefing notes for researchers: public involvement in NHS, public health and social care research. INVOLVE: Eastleigh; 2012.
Bartunek JM, Rynes SL. Academics and practitioners are alike and unlike: the paradoxes of academic-practitioner relationships. J Manag. 2014;40(5):1181–201. https://doi.org/10.1177/0149206314529160.
Lofman P, Pelkonen M, Pietila AM. Ethical issues in participatory action research. Scand J Caring Sci. 2004;18(3):333–40. https://doi.org/10.1111/j.1471-6712.2004.00277.x.
Carter SM, Little M. Justifying knowledge, justifying method, taking action: epistemologies, methodologies, and methods in qualitative research. Qual Health Res. 2007;17(10):1316–28. https://doi.org/10.1177/1049732307306927.
McHugh HM, Walker ST. “Personal knowledge” in medicine and the epistemic shortcomings of scientism. J Bioeth Inq. 2015;12(4):577–85. https://doi.org/10.1007/s11673-015-9661-5.
Kuhn TS. The structure of scientific revolutions. 4th ed. Chicago: The University of Chicago Press; 2012.
Guba EG, Lincoln YS. Competing paradigms in qualitative research. In: Denzin NK, Lincoln YS, editors. Handbook of qualitative research. Thousand Oaks: SAGE; 1994. p. 105–17.
Rosas SR. The utility of concept mapping for actualizing participatory research. Cuad Hispanoam Psicol. 2013;12(2):7–24.
Kane M, Trochim WM. Concept mapping for planning and evaluation. Thousand Oaks: SAGE; 2007.
Hagell P, Edfors E, Hedin G, Westergren A, Hammarlund CS. Group concept mapping for evaluation and development in nursing education. Nurse Educ Pract. 2016;20:147–53. https://doi.org/10.1016/j.nepr.2016.08.006.
Westergren A, Edfors E, Norberg E, Stubbendorff A, Hedin G, Wetterstrand M, et al. Computer-based training in eating and nutrition facilitates person-centered hospital care: a group concept mapping study. Comput Inform Nurs. 2018;36(4):199–207. https://doi.org/10.1097/CIN.0000000000000416.
The authors wish to thank all the researchers who took the time to participate in this study. We also wish to thank Steven Wallace and colleagues from Concept Systems Incorporated for technical support regarding the use of the Concept System® groupwisdom™. The PhD students’ (CEL) learning process was supported by the Swedish National Graduate School for Competitive Science on Ageing and Health (SWEAH), funded by the Swedish Research Council.
Open Access funding provided by Kristianstad University. The study was conducted within the UserAge Programme funded by the Swedish Research Council for Health, Working Life and Welfare (Forte, 2016-07090). Additional funding was provided by the Research Platform for Collaboration for health, Kristianstad University, Sweden. The funding bodies had no influence on the research project.
Ethics approval and consent to participate
The study was approved according to Swedish regulations by the Ethical Review Board in Lund, Sweden (Dnr: 2018/34). The participants gave informed consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Laustsen, C.E., Westergren, A., Petersson, P. et al. Conceptualizing researchers’ perspectives on involving professionals in research: a group concept mapping study. Health Res Policy Sys 19, 39 (2021). https://doi.org/10.1186/s12961-021-00685-2
- Ageing and health
- Group concept mapping
- Involvement in research