Skip to main content

The Implementation in Context (ICON) Framework: A meta-framework of context domains, attributes and features in healthcare

Abstract

Background

There is growing evidence that context mediates the effects of implementation interventions intended to increase healthcare professionals’ use of research evidence in clinical practice. However, conceptual clarity about what comprises context is elusive. The purpose of this study was to advance conceptual clarity on context by developing the Implementation in Context Framework, a meta-framework of the context domains, attributes and features that can facilitate or hinder healthcare professionals’ use of research evidence and the effectiveness of implementation interventions in clinical practice.

Methods

We conducted a meta-synthesis of data from three interrelated studies: (1) a concept analysis of published literature on context (n = 70 studies), (2) a secondary analysis of healthcare professional interviews (n = 145) examining context across 11 unique studies and (3) a descriptive qualitative study comprised of interviews with heath system stakeholders (n = 39) in four countries to elicit their tacit knowledge on the attributes and features of context. A rigorous protocol was followed for the meta-synthesis, resulting in development of the Implementation in Context Framework. Following this meta-synthesis, the framework was further refined through feedback from experts in context and implementation science.

Results

In the Implementation in Context Framework, context is conceptualized in three levels: micro (individual), meso (organizational), and macro (external). The three levels are composed of six contextual domains: (1) actors (micro), (2) organizational climate and structures (meso), (3) organizational social behaviour (meso), (4) organizational response to change (meso), (5) organizational processes (meso) and (6) external influences (macro). These six domains contain 22 core attributes of context and 108 features that illustrate these attributes.

Conclusions

The Implementation in Context Framework is the only meta-framework of context available to guide implementation efforts of healthcare professionals. It provides a comprehensive and critically needed understanding of the context domains, attributes and features relevant to healthcare professionals’ use of research evidence in clinical practice. The Implementation in Context Framework can inform implementation intervention design and delivery to better interpret the effects of implementation interventions, and pragmatically guide implementation efforts that enhance evidence uptake and sustainability by healthcare professionals.

Peer Review reports

Background

Context is critical to successful implementation, as observed in many studies where the success of implementation efforts varied by context. For example, Hogg et al. [1, 2], in trials on the effects of practice facilitation on preventive care delivery, found benefits in capitation-funded practices but not fee-for-service practices. Similarly, Shojania et al. [3] found that point-of-care reminders that targeted inpatient settings resulted in larger improvements in processes of care compared with outpatient settings. More recently, Joseph-Williams and colleagues [4] conducted a realist review (n = 29 articles) of scenarios where the characteristics of healthcare professionals, patients, and management, and the broader organizational context can hinder or facilitate implementation of patient decision aids. In 8 [5,6,7,8,9,10,11,12] of the 29 included articles, investigators found that role clarity and appropriate distribution of tasks amongst a multidisciplinary team helped build team cohesion, which then influenced the success of implementing patient decision aids. Similarly, Indraratna and colleagues [13] found, in a process evaluation of the implementation of a new model of care, that lower uptake was attributed to time constraints. Additionally, the effectiveness of implementation efforts is frequently reported to depend on so-called contextual factors that: (i) cause and sustain the problem the intervention is designed to overcome, (ii) influence the susceptibility of the problem to the intervention and (iii) determine how the intervention can work [14]. Despite recognition and evidence that context can mediate the effects of implementation interventions, there is little consistency in the literature concerning what comprises context.

In the field of implementation science, multiple and vastly different definitions of context exist. For example, Øvretveit [15] defines context as all factors that are not part of an intervention. Similarly, Rycroft-Malone et al. [16] define context as “the environment or setting in which the proposed change is to be implemented” (p. 299). Other authors have adopted more specific definitions. For instance, May and colleagues [14] describe context as “the physical, organizational, institutional, and legislative structures that enable and constrain, and resource and realize, people and procedures” (p. 3). Comparably, Pfadenhauer [17] defines context as a set of characteristics and circumstances that consist of active and unique components surrounding an implementation project. A recent scoping review [18] of determinant frameworks used in implementation science found that most (n = 15 of 17, 88%) frameworks identified did not provide specific definitions of context. Instead, they defined the concept indirectly by identifying the contextual determinants that may comprise context. Due to this conceptual confusion regarding what constitutes context, researchers and implementation teams continue to investigate and operationalize context differently, seriously hampering progress in implementation science.

There are no implementation frameworks dedicated solely to context. However, several implementation frameworks include context [19,20,21,22,23,24,25,26]. In each of these frameworks, context is considered important to implementation success and is characterized as a multi-dimensional concept. While each of these frameworks provides an important starting point for understanding context within implementation, they offer limited detail, and thus guidance, for identification of the core attributes and features of context that are important to assess and promote implementation success. This study aimed to close this gap by advancing conceptual clarity on context through development of the Implementation in Context (ICON) Framework. ICON is a meta-framework of the context domains, attributes and features that can facilitate or hinder healthcare professionals’ use of research evidence and the effectiveness of implementation interventions in clinical practice. In this paper, we describe ICON and its development.

Methods

Figure 1 depicts a summary of the process used to develop ICON. We developed ICON through a meta-synthesis of findings from three interrelated studies we conducted to promote conceptual clarity and understanding of context in implementation. The three studies comprised: (1) a concept analysis of published literature on context [27], (2) a secondary analysis of healthcare professional interviews examining elements of context relevant to their use of research evidence across different settings and clinical behaviours [28] and (3) a descriptive qualitative study with health system stakeholders (change agents/implementation specialists and implementation researchers) to elicit their tacit knowledge of elements of context important to implementation in healthcare [29]. Following the meta-synthesis, ICON was developed and then further refined based on feedback from context and implementation experts. Studies 1–3, which were the building blocks for developing ICON are summarized next; greater detail on the individual methodologies used and the findings of each of the studies are reported in previous publications [27,28,29,30,31]. We used the Enhancing Transparency in Reporting the Synthesis of Qualitative Research (ENTREQ) statement to enhance the accuracy and transparency of reporting our methods (Additional file 1).

Fig. 1
figure 1

Process for developing the ICON Framework

Study 1: Concept analysis of context

In Study 1, we used a modified version of Walker and Avant’s [32] method to conduct a concept analysis of context; our protocol was published [30]. Our modified approach comprised five steps: concept selection, determination of aims, identification of uses of context, determination of its defining attributes and definition of its empirical referents. We systematically searched both biomedical and social science databases from inception to August 2014. These databases covered a wide range of disciplines including health, psychology, social sciences, business and engineering (Additional file 2). Empirical articles were included if a definition and/or attributes or features of context were reported. Theoretical articles were included if they reported a model, theory or framework of context or where context was a component of a model, theory or framework. Double independent screening and data extraction were conducted. Analysis was iterative, involving organizing and reorganizing until an initial framework of domains, attributes and features of context emerged. Our search identified 15 972 citations, of which 70 articles were included in the final analysis. In total, 201 unique context features were identified, of which 89 were shared (reported in two or more studies). The 89 shared features were grouped into 21 defining attributes of context [27].

Study 2: Secondary analysis of interviews with healthcare professionals

In Study 2, we conducted a secondary analysis of 11 studies on the determinants of using research evidence in clinical practice [28]. The 11 studies comprised 145 interviews conducted from 2007 to 2014 with physicians and nurses from two countries (Canada and Australia) across multiple healthcare settings, which included primary care and different hospital settings (for example, medical and surgical wards, preassessment units, emergency room settings (adult and pediatric), birthing units and intensive care units). Implementation and de-implementation of 11 behavioural practices were also included: hand hygiene, pre-operative assessment, computerized tomography head rules (adult and pediatric), organ donation after cardio-circulatory death, fetal monitoring, red blood cell transfusions, bone mineral density screening, smoking cessation and preconception care. The original interviews were conducted using interview guides informed by the Theoretical Domains Framework [33]. The interview questions were broad, enabling interviewees to spontaneously identify elements of context relevant to their use of evidence in clinical practice. We analysed these data inductively, using constant comparative analysis, to identify attributes of context and their features. Data analysis occurred in three steps. We identified 62 unique features that were grouped into 14 attributes of context. There was considerable consistency in the context attributes identified across the different professional roles and settings [28].

Study 3: Descriptive qualitative study with health system stakeholders

In Study 3, we conducted a descriptive qualitative study [29]. We undertook semi-structured interviews with health system stakeholders to elicit their tacit knowledge of the attributes and features of context important for improved research use by healthcare professionals. We conducted 39 interviews: 19 interviews with organizational change agents/implementation specialists and 20 interviews with senior researchers in the field of implementation science. Interviews were conducted across four countries: Australia (n = 12), Canada (n = 14), the United States of America (n = 7), and the United Kingdom (n = 6). We analysed the data inductively, using thematic content analysis, in four steps: (1) selection of utterances of context, (2) merging of similar codes into features of context, (3) categorizing features of context into higher-level attributes of context and (4) comparison of attributes and their features by country, years of interviewee experience in implementation, and interviewee primary role (organizational change agent or researcher). We identified 66 unique features, which were grouped into 16 attributes of context. Similar to Study 2, there was considerable consistency in the context attributes identified across the four countries and interviewee experience and role [29].

Meta-synthesis protocol – the current study

To create an initial version of the ICON Framework we conducted a meta-synthesis of the findings from Studies 1–3. We followed the triangulation protocol of Farmer and colleagues [34], designed to synthesize multiple qualitative data sources. This protocol comprises six steps: (1) sorting, (2) convergence coding, (3) convergence assessment, (4) completeness assessment, (5) team member comparison and (6) feedback. Two team members independently undertook all steps of the synthesis and then compared their results, seeking feedback from the larger team during each step. Synthesis occurred at the lowest level of data, features of context, aggregated to the higher levels found within ICON: first attributes of context, then context domains and, finally, levels (micro, meso and macro) of context.

Step 1: Sorting

Initially, three separate Microsoft Excel files were created from the findings of Studies 1–3; each file contained a listing of the features produced from the respective study. All three files were reviewed by a data synthesis team consisting of two research assistants and three senior investigators. After sorting and identifying features within the three phases, we compared the features included in Study 2 (healthcare professional interviews) and Study 3 (stakeholder interviews) because they used the same initial coding scheme. Features that were duplicated were merged, resulting in one list of features for Study 2 and Study 3. We then compared this merged list of features to those from Study 1 (concept analysis); duplicate features were again merged. During merging, we retained the definition for the feature that had greater clarity, or in select cases, we merged definitions from the different studies to create a more refined definition.

Step 2: Convergence coding

We created a convergence-coding matrix to compare the previously sorted and merged files described above (concept analysis file and the merged healthcare professional and stakeholder interviews file) with respect to the meaning (our definition of the feature) and frequency of the context feature. If a feature was identified in both lists and had similar frequency across them (within a 30% range, as suggested by Farmer and colleagues [34]), this was classified as “full agreement”. If a feature was identified in both lists, but with dissimilar frequencies, this was termed “partial agreement”. If a feature was only identified in one of our lists, this was termed “silence”. The type of convergence was classified as either “full agreement” (defined as full agreement between the sets of results on both elements of comparison, for example, the meaning and frequency are the same), “partial agreement” (defined as agreement on one but not both components, for example, meaning or frequency is the same), or “silence” (defined as one set of results covering the feature while another set of results was silent on the feature) [34].

Step 3: Convergence assessment and Step 4: Completeness comparison

Steps 3 and 4 were conducted iteratively. We conducted a convergence assessment by assessing the percent of features with full agreement, partial agreement and silence (as defined above) to gain a global understanding of convergence across the three studies. All discrepancies in convergence were resolved through consensus and in consultation with the investigator team. We recorded the final convergence assessment but kept track of disagreements that occurred. We then examined the final list of features to identify any similar and unique contributions from the three different studies.

Step 5: Team member comparison and Step 6: Feedback

Steps 5 and 6 were also conducted iteratively. Throughout the coding, weekly consensus meetings were held to resolve conflicts in consultation with a subgroup of senior investigators. The final list of features was grouped into attributes and further grouped into domains, which were reviewed by the wider interdisciplinary and international ICON investigator team. Refinements to the analysis were made based on team feedback to form the first iteration of the ICON Framework.

Further refinement of ICON

We sought expert feedback to further refine our initial version of ICON. First, we pursued broad external feedback; we presented the ICON Framework to 80 senior implementation researchers, trainees (PhD students and post-doctoral fellows in implementation) and knowledge users (health system stakeholders, including administrators and representatives of health research funding agencies) from 9 countries (Canada, the United States, Sweden, England, Australia, Saudi Arabia, Norway, the Netherlands, Denmark and China) attending the 2019 Knowledge Utilization Colloquium [35]. For each defining context attribute in ICON, attendees were asked to consider “When designing an implementation intervention, how important is it to assess this attribute of context?”. Findings from this assessment are in Additional file 3. Second, we sought expert feedback from our large interdisciplinary team. We sent the ICON Framework to the investigators from Studies 1–3 and the meta-synthesis, each of whom are international experts in the fields of context and/or implementation. This comprised sending ICON to a total of 41 people from six countries (Australia, Brazil, Canada, the United Kingdom, the United States and Sweden) and eight disciplinary backgrounds, including clinical epidemiology, dietetics, health and psychological sciences, health leadership, library science, nursing, medicine and rehabilitation. Based on the feedback received, we refined the ICON Framework to produce the current version, presented next.

Results

Overview of ICON

The meta-synthesis reported in this paper resulted in the development of the ICON Framework (Fig. 2, Tables 1, 2, 3). In ICON, context is conceptualized in three levels: (1) micro (or individual), in which activities by groups of individuals in the clinical setting provide a contextual influence (for example, collective characteristics of patients or healthcare providers); (2) meso (or organizational), in which organizational characteristics are a contextual influence (for example, the culture of an organization); and (3) macro (external to the organization, including between organizations), in which market-type forces are at play (for example, political climate) [36]. These three levels contain six domains, 22 attributes and 108 features of context. The six context domains are: (1) actors (micro level), (2) organizational climate and structures (meso level), (3) organizational social behaviour (meso level), (4) organizational response to change (meso level), (5) organizational processes (meso level) and (6) external influences (macro level). The 22 defining attributes of context that align with these domains are listed and defined in Tables 1, 2, and 3.

Fig. 2
figure 2

The Implementation in Context (ICON) Framework. The outer circle represents levels of context. The middle circle represents the 6 context domains within ICON. The inner circle represents the 22 core attributes of context by domain within ICON

Table 1 ICON micro level – attributes, attribute definitions and sample features
Table 2 ICON meso levelattributes, attribute definitions and sample features
Table 3 ICON macro level – attributes, attribute definitions and sample features

These contextual attributes are interconnected and have potential to directly or indirectly influence or modify the use of evidence by healthcare providers, policy-makers and recipients of care. For each of these context attributes, we identified several features (examples) that further elaborate on the meaning of the attributes. ICON is illustrated in Fig. 2. ICON attributes and their definitions, as well as sample features and equity, diversity and inclusion (EDI) considerations of each attribute, for the micro, meso and macro levels are presented in Tables 1, 2, and 3, respectively. Identification and definitions of all 108 features contained in ICON are presented in alphabetical order in Additional file 4.

Description of ICON by level and domain of context

The broad structure of ICON is reflective of the organizational literature [37, 38], where context is examined from the perspective of three levels: (1) micro (or individual), (2) meso (or organizational) and (3) macro (external to the organization, including between organizations).

Micro (individual) level of context

The micro level of ICON is summarized below; see Table 1 and Additional file 4 for additional details on the attributes and features contained within the micro level of ICON. This level of ICON contains a single context domain: actors.

Domain 1: Actors

The actors domain comprises two attributes: (1) patient/client/consumer population and (2) service provider (healthcare professional) population. Both attributes reflect individuals when considered as a group rather than as individuals. The patient/client/consumer population attribute refers to the characteristics of a group of individuals receiving care/services. We identified two unique features that illustrate this attribute: patient/client/consumer demographics (who they are) and patient/client/consumer expectations/preferences (what they want). The second attribute that comprises the actor domain is the service provider population. This attribute refers to the collective characteristics, expertise and behaviour of the individuals working as providers of services. We identified 19 unique features within this attribute; example features include healthcare provider role, experience and attitudes.

Meso (organizational) level of context

The meso level of ICON is summarized next; see Table 2 and Additional file 4 for additional details on the attributes and features contained within the meso level of ICON. This level of ICON contains four of the six context domains: (1) organizational climate and structures, (2) organizational social behaviour, (3) organizational response to change and (4) organizational processes.

Domain 2: Organizational climate and structures

The organizational climate and structures domain comprises four attributes: (1) economic arrangements (n = 3 features), (2) elements of organizations (n = 6 features), (3) organizational climate (n = 3 features) and (4) physical and technological resources (n = 7 features). The attribute economic arrangements refers to the income and expenditures relating to service delivery within organizations; example features include funding models and healthcare delivery costs. The attribute elements of organizations refers to the characteristics of units and organizations. This attribute is akin to sociodemographic characteristics for individuals. Example features within this attribute include type of ownership (for example, public, private or faith-based) and organizational size.

The attribute organizational climate refers to shared recurring patterns of behaviour, attitudes and feelings that characterize life in that organization [39]; example features include team climate and conflict. Lastly, the attribute physical and technological resources refers to an organization’s physical structures and technological resources that are required to deliver services; example features include space and online resources.

Domain 3: Organizational social behaviour

The organizational social behaviour domain comprises two attributes: (1) internal relationships (n = 3 features) and (2) organizational culture (n = 2 features). The attribute internal relationships refers to the ways in which two or more people or groups within an organization regard and behave toward each other [40]; example features include social networks and social capital. The attribute organizational culture refers to the normative beliefs and shared expectations that govern the work behaviour in an organization [41]; example features include cultural norms and shared expectations.

Domain 4: Organizational response to change

The organizational response to change domain comprises two attributes: (1) organizational change processes (n = 4 features) and (2) receptivity to change (n = 6 features). The attribute organizational change processes refers to the process of altering an organization’s strategies, processes, procedures, technologies and/or culture to improve service delivery [42]; example features include formal change systems and processes and engagement. The attribute receptivity to change refers to openness and responsiveness to ideas, impressions or suggestions, and readiness or fit of critical features of the environment as they specifically relate to a targeted practice [43]. Receptivity to change may occur at multiple levels (for example, patients, healthcare professionals/providers, leaders and organization). Example features of receptivity to change included in ICON are change culture and readiness for change.

Domain 5: Organizational processes

The organizational processes domain comprises seven attributes: (1) communication processes (n = 4 features), (2) evaluation activity (n = 5 features), (3) governance (n = 6 features), (4) leadership (n = 5 features), (5) management (n = 3 features), (6) organization of work (n = 8 features) and (7) system processes (n = 7 features). The attribute communication processes refers to imparting of, or exchanging, information or news (for example, between healthcare professionals/providers, patients and management) within an organization [44]; example features include formal communication and social influence. The attribute evaluation activity refers to the systematic collection of information about the activities, characteristics and outcomes of programs, services, policies or processes in an organization to make judgements about the program/process, improve effectiveness and/or inform decisions about future development in that organization [45]. Example features of evaluation activity include quality improvement monitoring and performance measurement. The attribute governance refers to the rules, policies, systems, structures and processes by which an organization is controlled and directed; example features include organizational mission, goals and priorities, and incentives and disincentives [46]. The attribute leadership refers to the types and styles of leaders within an organization; example features include formal leaders as well as role models and mentors. The attribute management refers to the process of dealing with or organizing things or people in an organization [47]; example features include formal planning and the use of resources. The attribute organization of work refers to the arrangement of tasks, responsibilities and resources within and between service providers working in the setting [48]. Example features within this attribute include workload and teamwork. Lastly, the attribute system processes refers to the processes required to deliver services within an organization; example features include quality assurance and continuity of care.

Macro (external) level of context

The macro level of ICON is summarized next; see Table 3 and Additional file 4 for additional details on the attributes and features contained within the macro level of ICON. This level of ICON contains a single domain: external influences.

Domain 6: External influences

The external influences domain comprises five attributes: (1) community influences (n = 2 features), (2) intercommunity/interorganizational/intersectoral relationships (n = 3 features), (3) political influences (n = 3 features), (4) regulatory influences (n = 4 features) and (5) regional/national/global health influences (n = 3 features). External influences can affect organizations as a complete entity, or the activity and functions of individuals (as an aggregated group, for example, teams or professional designations) present within an organization. The attribute community influences refers to influences from society at large; example features include public influences and peer organizational pressure. The attribute intercommunity/interorganizational/intersectoral relationships refers to the interactions or partnerships between different communities, organizations or sectors; example features include intersectoral collaboration and community health outreach. The attribute political influences refers to influences from government or public affairs; example features include politics and the political climate. The attribute regulatory influences refers to influences relating to regulatory bodies, created based on a legal mandate or legislation (for example, providing and enforcing standards for health and safety in an organization) [49]; example features include laws and legislation and the external policies, directives, mandates and regulations. Lastly, the attribute regional/national/global health influences refers to regional, national and worldwide influences. Example features within this attribute include epidemics/pandemics/endemics/outbreaks and climate change.

Discussion

The importance of context in influencing implementation success is well established [1,2,3,4, 13, 50,51,52,53]. Comprehensive guidance for implementers and researchers on what comprises context for implementation purposes is necessary but has been lacking. Such guidance is key to informing implementation intervention design and testing, context measurement and evaluation. The ICON Framework addresses this need, having been founded on a rigorous and systematic approach, involving an incremental series of complementary studies [27,28,29,30,31], to develop a comprehensive understanding of context for implementation purposes.

How ICON advances implementation science

ICON is the only implementation meta-framework solely dedicated to the role of context in implementation that is available to guide implementation efforts. Context is included in other implementation frameworks, for example: Diffusion of Innovations Theory [19]; Promoting Action on Research Implementation in Health Services Framework [20]; Integrated-Promoting Action on Research Implementation in Health Services [21]; Ottawa Model of Research Use [22]; Knowledge-to-Action Framework (KTA) [23]; Consolidated Framework for Implementation Research [24, 54]; Exploration, Preparation, Implementation, Sustainment Framework [25]; and Tailored Implementation in Chronic Diseases Checklist [26]. There are, however, important inconsistencies between these frameworks in how context is defined conceptually. For instance, while later frameworks such as the Integrated-Promoting Action on Research Implementation in Health Services [21], Consolidated Framework for Implementation Research [24, 54]; and the Exploration, Preparation, Implementation, Sustainment Framework [25] make explicit distinctions between inner and outer contexts, earlier conceptualizations such as Diffusion of Innovations Theory [19], Promoting Action on Research Implementation in Health Services [20] and Knowledge to Action Framework [23] do not. These frameworks are also inconsistent and incomplete with respect to the attributes of context they include. In contrast, some attributes are represented in more than one framework (for example, leadership and culture), and many attributes are unique to a single framework (for example, continuing educational system is only specified in the Tailored Implementation in Chronic Diseases Checklist [26]). Other attributes, based on ICON, are missing entirely from these frameworks (for example, attribute – elements of organizations; example features – facility size, location and type of ownership). ICON is the only synthesis and framework to date to comprehensively capture in a single place all core attributes of context that are relevant to implementation by healthcare professionals in clinical practice.

The ICON Framework differs from other implementation frameworks in several ways. First, the ICON Framework includes a main list of domains, attributes and features by level of context, providing much-needed conceptual clarity about context. Second, the ICON Framework provides a comprehensive representation of the core attributes of context relevant to implementation in healthcare. Finally, the ICON Framework includes attributes and features not previously identified; approximately half the features are not included in current implementation frameworks [28, 29]. Such a meta-framework of context with a high level of detail about the domains, attributes and features of context for implementation has not been developed previously. Thus, ICON substantially expands on previous understanding of context for implementation in healthcare.

How to use ICON

The ICON Framework guides knowledge users (for example, implementers) and implementation researchers seeking to design, deliver and evaluate implementation interventions. The ICON Qualitative Screening Tool (Additional file 5) was developed to complement ICON and enable prioritization of which core context attributes to measure, dependent on the evidence being implemented and the implementation circumstances. The screening tool contains seven questions addressing the six ICON domains and any other contextual factors that may influence implementation efforts. For each domain-related question, prompts concerning attributes within the respective domain are provided for use, as appropriate. The questions should be framed according to the implementation intervention being considered. Pre-tested by 10 knowledge users, when administered in interview format the tool took, on average, 20 min to complete. Feedback about the tool indicated it raised awareness about aspects of context that had not previously been considered to influence implementation efforts, highlighting areas that needed closer attention to improve the likelihood of implementation success. This screening tool was designed as a practical means for implementation teams to develop a broad understanding of the specific context in which they are working so they can identify areas in which more detailed exploration and measurement would be useful. The brief tool can readily be self-administered or administered through individual or focus group interviews of key informants. The use of the tool then enables implementation teams to invest resources in the measurement of aspects of context important to their specific implementation effort. It is important to acknowledge that context is dynamic. Therefore, while assessing each context attribute individually at a single point in time with the ICON screening tool will provide valuable information to help support implementation, it is important to concurrently consider the dynamic interactions between these context attributes that will not be captured when components are assessed independently of one another. It is also important to re-assess context periodically with the screening tool due to its temporal nature.

Implementation teams composed of knowledge users, implementers and/or patients/clients/consumers can use both the qualitative screening tool and the EDI considerations outlined in Table 1 to capture diverse perspectives pertaining to the implementation of care or services (for example, facilitators and barriers) and the priorities and outcomes that members of implementation teams seek to achieve. The EDI considerations can help teams to recognize the communities and populations whose perspectives are being excluded, whose voices are being amplified and the contextual factors that can be modified to ensure meaningful inclusion of equity-deprived communities and populations during implementation. Some of the EDI considerations are intended to facilitate reflexivity amongst teams regarding intersectionality pertaining to patients/clients/consumers, service providers and the diversity of their team composition. Furthermore, the EDI considerations for the ICON attributes and factors can be a way for organizations to evaluate their progress and stay accountable, which could prevent the criticism of performative EDI described by other scholars [55].

The Alliance for Health Policy and Systems Research reported four elements that should receive greater attention: trust and power, engaging communities and focusing on rights, looking beyond the health sector and considering factors beyond national boundaries [56]. These elements are present in ICON. Trust and power are represented in the internal relationship attribute (one example feature being partnership) and in the governance attribute (one example feature being power). Engaging communities and focusing on rights is represented by the intercommunity/interorganizational/intersectoral relationships attribute (two of the example features being community health outreach and coordinated action). Looking beyond the health sector is represented in the intercommunity/interorganizational/intersectoral relationships attribute (one example feature being intersectoral collaboration) and the political influences attribute (one example feature being the complexity of the broader sociopolitical environment). Considering factors beyond national boundaries is represented in the regional/national/global influences on health attribute (one example feature being climate change). In keeping with the Alliance for Health Policy and Systems Research stance [56], we emphasized in a response to commentaries [57] written on one of the studies [29] that informed the ICON Framework, that the ICON Framework has detailed descriptions of the context attributes at the macro level (for example, regulatory, and legislative standards). One of the commentators [58] reported that this level of detail is beneficial, as these context attributes and features are often under-assessed and under-developed aspects of context.

Next steps

Having advanced conceptual clarity and detail on context by defining it and by identifying its core domains, attributes and features – as depicted in the ICON Framework – the next logical steps to advance this work are currently underway to: (1) identify and evaluate measures that currently exist for each of the ICON Framework core 22 defining attributes, (2) evaluate the psychometric and pragmatic properties of the identified measures and (3) create a publicly accessible registry of these measurement tools, and assessments. The registry will contain a built-in decision-making algorithm to assist implementation teams in selecting the most appropriate measure(s) for their specific implementation effort. Future work should also investigate the transferability of ICON to regions and groups not reflected in the current data used to develop ICON, for example, the Global South, Indigenous communities, and non-English-speaking communities.

Limitations

Limitations of this work need to be acknowledged. While our approach involved a series of complementary studies to examine context rigorously and comprehensively from different perspectives and using different methodologies, followed by a rigorous meta-synthesis to produce the ICON Framework, it is possible that some attributes and/or features of context were not identified. A design element that likely constrained the attributes and features represented in ICON is that the published research we drew on, and the participants included in our research, largely reflected the Global North (for example, high-resourced settings such as North America, Europe and Australia). As such, context attributes and features that might be unique to the Global South (for example, low- and middle-resources settings in Asia, Africa, Oceania and Latin America) may have been omitted from ICON. Finally, given the more recent focus on equity and intersectionality in implementation science [59, 60], intersectional attributes related to context are likely not adequately reflected in the current version of ICON. The concept of intersectionality is not well represented in the literature we analysed in our concept analysis [27], and it was not specifically explored, nor was it identified by participants in the two interview studies [28, 29]. However, an intersectional lens can be applied to all aspects of the ICON Framework. Specifically, implementers could actively explore intersectional considerations for each attribute. Finally, ICON is a framework, not a theory; therefore, no associations between its domains/attributes/features are inferred or can be made.

Conclusion

ICON provides comprehensive and critically needed clarity of context as a concept and its domains, attributes and features. As such, it advances implementation science and the potential to influence healthcare professionals’ use of research in clinical practice. The ICON Framework consolidates and unifies the core attributes of context relevant to implementation derived from the published literature, and it embraces perspectives from a wide range of healthcare professionals, as well as tacit knowledge from health system stakeholders internationally. It is now time to identify, and develop where needed, assessment tools to measure the ICON defining attributes that will enable optimal tailoring of implementation intervention design and delivery, better interpretation of the effects of implementation interventions, and pragmatically guide knowledge users in their implementation efforts. ICON is the first framework of its kind, and it is poised to advance the practice and science of implementation substantially. We invite readers of this manuscript to use ICON in their implementation efforts and report on their experiences with it.

Availability of data and materials

The ICON features, the ranking of ICON attributes from the 2019 Knowledge Utilization Colloquium and the ICON screening tool are provided as additional files. The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

ENTREQ:

Enhancing Transparency in Reporting the Synthesis of Qualitative Research Checklist

ICON framework:

Implementation in Context Framework

EDI:

Equity, diversity and inclusion

References

  1. Hogg W, Lemelin J, Dahrouge S, et al. Randomized controlled trial of anticipatory and preventive multidisciplinary team care: for complex patients in a community-based primary care setting. Can Fam Physician. 2009;55(12):e76-85.

    PubMed  PubMed Central  Google Scholar 

  2. Hogg W, Lemelin J, Graham ID, et al. Improving prevention in primary care: evaluating the effectiveness of outreach facilitation. Fam Pract. 2008;25(1):40–8.

    PubMed  CAS  Google Scholar 

  3. Shojania K, Jennings A, Mayhew A, Ramsay C, Eccles M, Grimshaw J. The effects on on-screen, point of care computer reminders on process and outcomes of care. Cochrane Database Syst Rev. 2009;3: CD001096.

    Google Scholar 

  4. Joseph-Williams N, Abhyankar P, Boland L, et al. What works in implementing patient decision aids in routine clinical settings? A rapid realist review and update from the international patient decision aid standards collaboration. Med Decis Making. 2021;41(7):907–37.

    PubMed  Google Scholar 

  5. Berry DL, Hong F, Halpenny B, et al. Evaluating clinical implementation approaches for prostate cancer decision support. Urol Pract. 2019;6(2):93–9.

    PubMed  Google Scholar 

  6. Feibelmann S, Yang TS, Uzogara EE, Sepucha K. What does it take to have sustained use of decision aids? A programme evaluation for the Breast Cancer Initiative. Health Expect. 2011;14:85–95.

    PubMed  PubMed Central  Google Scholar 

  7. Munro S, Manski R, Donnelly KZ, et al. Investigation of factors influencing the implementation of two shared decision-making interventions in contraceptive care: a qualitative interview study among clinical and administrative staff. Implement Sci. 2019;14(1):1–16.

    Google Scholar 

  8. Lin GA, Halley M, Rendle KA, et al. An effort to spread decision aids in five California primary care practices yielded low distribution, highlighting hurdles. Health Aff. 2013;32(2):311–20.

    Google Scholar 

  9. Mangla M, Cha TD, Dorrwachter JM, et al. Increasing the use of patient decision aids in orthopaedic care: results of a quality improvement project. BMJ Qual Saf. 2018;27(5):347–54.

    PubMed  Google Scholar 

  10. Savelberg W, Boersma L, Smidt M, Goossens M, Hermanns R, van der Weijden T. Does lack of deeper understanding of shared decision making explains the suboptimal performance on crucial parts of it? An example from breast cancer care. Eur J Oncol Nurs. 2019;38:92–7.

    PubMed  CAS  Google Scholar 

  11. Stacey D, Taljaard M, Breau RH, et al. A patient decision aid for men with localized prostate cancer: a comparative case study of natural implementation approaches. Cancer Nurs. 2020;43(1):E10–21.

    PubMed  Google Scholar 

  12. The Health Foundation. Implementing shared decision making: clinical teams’ experiences of implementing decision making as part of the MAGIC programme. 2013. https://www.health.org.uk/publications/implementing-shared-decision-making. Accessed 7 Jul 2022.

  13. Indraratna P, Biswas U, Liu H, et al. Process evaluation of a randomised controlled trial for TeleClinical care, a smartphone-app based model of care. Front Med. 2021;8(780882):1–12.

    Google Scholar 

  14. May C, Finch T, Mair F, et al. Understanding the implementation of complex interventions in health care: the normalization process model. BMC Health Serv Res. 2007;7:148.

    PubMed  PubMed Central  Google Scholar 

  15. Ovretveit J. Understanding the conditions for improvement: research to discover which context influences affect improvement success. BMJ Qual Saf. 2011;20(Suppl 1):i18–23.

    PubMed  PubMed Central  Google Scholar 

  16. Rycroft-Malone J, Seers K, Crichton N, et al. A pragmatic cluster randomised trial evaluating three implementation interventions. Implement Sci. 2012;7:80.

    PubMed  PubMed Central  Google Scholar 

  17. Pfadenhauer LM, Gerhardus A, Mozygemba K, et al. Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) Framework. Implement Sci. 2017;12(1):21.

    PubMed  PubMed Central  Google Scholar 

  18. Nilsen P, Bernhardsson S. Context matters in implementation science: a scoping review of determinant frameworks that describe contextual determinants for implementation outcomes. BMC Health Serv Res. 2019;19(1):1–21.

    Google Scholar 

  19. Rogers EM. Diffusion of innovations. 3rd ed. New York: The Free Press; 1983.

    Google Scholar 

  20. Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: a conceptual framework. BMJ Qual Saf. 1998;7(3):149–58.

    CAS  Google Scholar 

  21. Harvey G, Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. 2016;11(1):1–13.

    Google Scholar 

  22. Logan J, Graham ID. Toward a comprehensive interdisciplinary model of health care research use. Sci Commun. 1998;20(2):227–46.

    Google Scholar 

  23. Graham ID, Logan J, Harrison MB, et al. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26(1):13–24.

    PubMed  Google Scholar 

  24. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50.

    PubMed  PubMed Central  Google Scholar 

  25. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38(1):4–23.

    PubMed  Google Scholar 

  26. Flottorp SA, Oxman AD, Krause J, et al. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013;8:35.

    PubMed  PubMed Central  Google Scholar 

  27. Squires JE, Graham I, Bashir K, et al. Understanding context: a concept analysis. J Adv Nurs. 2019;75(12):3448–70.

    PubMed  Google Scholar 

  28. Squires JE, Aloisio LD, Grimshaw JM, et al. Attributes of context relevant to healthcare professionals’ use of research evidence in clinical practice: a multi-study analysis. Implement Sci. 2019;14(1):52.

    PubMed  PubMed Central  Google Scholar 

  29. Squires JE, Hutchinson AM, Coughlin M, et al. Stakeholder perspectives of attributes and features of context relevant to knowledge translation in health settings: a multi-country analysis. Int J Health Policy Manag. 2021;8:1373–90.

    Google Scholar 

  30. Squires JE, Graham ID, Hutchinson AM, et al. Understanding context in knowledge translation: a concept analysis study protocol. J Adv Nurs. 2015;71(5):1146–55.

    PubMed  Google Scholar 

  31. Squires JE, Graham ID, Hutchinson AM, et al. Identifying the domains of context important to implementation science: a study protocol. Implement Sci. 2015;10(1):135.

    PubMed  PubMed Central  Google Scholar 

  32. Walker LO, Avant KC. Strategies for theory construction in nursing. 5th ed. New York: Prentice Hall; 2011.

    Google Scholar 

  33. Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14(1):26–33.

    PubMed  PubMed Central  CAS  Google Scholar 

  34. Farmer T, Robinson T, Elliott S, Eyles J. Developing and implementing a triangulation protocol for qualitative health research. Qual Health Res. 2006;16:377.

    PubMed  Google Scholar 

  35. University of Alberta. Knowledge utilization colloquia. n.d.; https://www.ualberta.ca/nursing/research/research-chairs-and-units/knowledge-utilization-studies-program/knowledge-utilization-colloquia/index.html. Accessed 7 Jun 2023.

  36. McNulty T, Ferlie E. Reengineering health care: the complexities of organizational transformation. New York: Oxford University Press; 2002.

    Google Scholar 

  37. Blalock HM. Social statistics. Revised. New York, NY: McGraw-Hill; 1979.

    Google Scholar 

  38. Box GEP, Cox DR. An analysis of transformations. J R Stat Soc Ser B (Methodology). 1964;26(2):211–52.

    Google Scholar 

  39. Isaksen SG. The situational outlook questionnaire: assessing the context for change. Psychol Rep. 2007;100(2):455–66.

    PubMed  Google Scholar 

  40. Collins. Definition of ’relationship’. n.d.; https://www.collinsdictionary.com/dictionary/english/relationship. Accessed 18 Jul 2022.

  41. Cooke RA, Szumal JL. Measuring normative beliefs and shared behavioral expectations in organizations: the reliability and validity of the Organizational Culture Inventory. Psychol Rep. 1993;72(3_suppl):1299–330.

    Google Scholar 

  42. Moran JW, Brightman BK. Leading organizational change. Career Dev Int. 2001;6(2):111–9.

    Google Scholar 

  43. Meriam-Webster. Receptive. n.d.; https://www.merriam-webster.com/dictionary/receptive. Accessed 18 Jul 2022.

  44. Lexico. Definition of communication in English. n.d.; https://www.lexico.com/en/definition/communication. Accessed 18 Jul 2022.

  45. Patton MQ. Utilization-focused evaluation. 4th ed. Thousand Oaks: Sage publications; 2008.

    Google Scholar 

  46. Shailer G. Corporate governance. In: Poff DC, Michalos AC, editors. Encyclopedia of business and professional ethics. Cham: Springer International Publishing; 2018. p. 1–6.

    Google Scholar 

  47. Lexico. Definition of management in English. n.d.; https://www.lexico.com/en/definition/management. Accessed 18 Jul 2022.

  48. The National Institute for Occupational Safety and Health. Organization of Work. 2017; https://www.cdc.gov/niosh/topics/workorg/default.html. Accessed 18 Jul 2022.

  49. Oikonomou E, Carthey J, Macrae C, Vincent C. Patient safety regulation in the NHS: mapping the regulatory landscape of healthcare. BMJ Open. 2019;9(7): e028663.

    PubMed  PubMed Central  Google Scholar 

  50. May CR, Johnson M, Finch T. Implementation, context and complexity. Implement Sci. 2016;11(1):141.

    PubMed  PubMed Central  Google Scholar 

  51. Edwards N, Barker PM. The importance of context in implementation research. J Acquir Immune Defic Syndr. 2014;67:S157–62.

    PubMed  Google Scholar 

  52. Tomoaia-Cotisel A, Scammon DL, Waitzman NJ, et al. Context matters: the experience of 14 research teams in systematically reporting contextual factors important for practice change. Ann Fam Med. 2013;11(Suppl 1):S115–23.

    PubMed  PubMed Central  Google Scholar 

  53. Kaplan HC, Brady PW, Dritz MC, et al. The influence of context on quality improvement success in health care: a systematic review of the literature. Milbank Q. 2010;88(4):500–59.

    PubMed  PubMed Central  Google Scholar 

  54. Damschroder LJ, Reardon CM, Widerquist MAO, Lowery J. The updated Consolidated Framework for Implementation Research based on user feedback. Implement Sci. 2022;17(1):1–16.

    Google Scholar 

  55. Kelly C, Dansereau L, Sebring J, et al. Intersectionality, health equity, and EDI: what’s the difference for health researchers? Int J Equity Health. 2022;21(1):1–8.

    Google Scholar 

  56. World Health Organization. 2022 Annual Report of the Alliance for Health Policy and Systems Research. World Health Organization; 2023. 9240070729.

  57. Squires JE, Santos WJ, Graham ID, et al. Attributes and features of context relevant to knowledge translation in health settings: a response to recent commentaries. Int J Health Policy Manag. 2023;12(7908):1–4.

    Google Scholar 

  58. Pfadenhauer LM. Conceptualizing context and intervention as a system in implementation science: learning from complexity theory; comment on “stakeholder perspectives of attributes and features of context relevant to knowledge translation in health settings: a multi-country analysis”. Int J Health Policy Manag. 2021.

  59. Brownson RC, Kumanyika SK, Kreuter MW, Haire-Joshu D. Implementation science should give higher priority to health equity. Implement Sci. 2021;16(1):1–16.

    Google Scholar 

  60. Etherington C, Rodrigues IB, Giangregorio L, et al. Applying an intersectionality lens to the theoretical domains framework: a tool for thinking about how intersecting social identities and structures of power influence behaviour. BMC Med Res Methodol. 2020;20(1):1–13.

    Google Scholar 

  61. O’Neill J, Tabish H, Welch V, et al. Applying an equity lens to interventions: using PROGRESS ensures consideration of socially stratifying factors to illuminate inequities in health. J Clin Epidemiol. 2014;67(1):56–64.

    PubMed  Google Scholar 

  62. Pederson A, Greaves L, Poole N. Gender-transformative health promotion for women: a framework for action. Health Promot Int. 2014;30(1):140–50.

    PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

JES holds a University of Ottawa Research Chair in Health Evidence Implementation. AMH holds a Chair in Nursing at the Centre for Quality and Patient Safety Research at Barwon Health, Geelong, Australia. IDG holds a CIHR Foundation Grant (FDN# 143237) in Integrated Knowledge Translation.

ICON team: Chantal Backman1, Anna Bergström6, Jamie Brehaut2,3, Melissa Brouwers3, Christopher Burton7, Ligyana Korki de Candido1, Christine Cassidy8, Cheyne Chalmers4,9, Anna Chapman4, Heather Colquhoun10, Janet Curran8, Melissa Demery Varin1, Paula Doering11, Annette Elliott Rose12, Lee Fairclough13, Jillian Francis14, Christina Godfrey15, Megan Greenough1, Jeremy M. Grimshaw2,3, Doris Grinspun16, Gillian Harvey17, Michael Hillmer18, Noah Ivers13,19, John Lavis20, Shelly-Anne Li21, Susan Michie22, Wayne Miller23, Thomas Noseworthy24, Tamara Rader25, Mark Robson26, Jo Rycroft-Malone27, Dawn Stacey1,2, Sharon Straus13,28, Andrea C. Tricco13,28, Lars Wallin29, and Vanessa Watkins4

1University of Ottawa, School of Nursing, Ottawa, Canada. 2Ottawa Hospital Research Institute, Clinical Epidemiology Program, Ottawa, Canada. 3University of Ottawa, School of Epidemiology and Public Health, Ottawa, Canada. 4Deakin University, School of Nursing and Midwifery, Geelong, Australia. 5Barwon Health, Geelong, Australia. 6Uppsala University, Department of Women’s and Children’s Health, Uppsala, Sweden. 7Canterbury Christ Church University, School of Allied and Public Health Professions, Canterbury, United Kingdom. 8Dalhousie University, School of Nursing, Halifax, Canada. 9Ryman Healthcare, Canterbury, New Zealand. 10University of Toronto, Department of Occupational Science and Occupational Therapy, Toronto, Canada. 11Élisabeth Bruyère, Ottawa, Canada. 12Izaak Walton Killam (IWK) Health Centre, Halifax, Canada. 13University of Toronto, Dalla Lana School of Public Health, Institute of Health Policy, Management and Evaluation, Toronto, Canada. 14University of Melbourne, School of Health Sciences, Victoria, Australia. 15Queen’s University, School of Nursing, Kingston, Canada. 16Registered Nurses’ Associated of Ontario (RNAO), Toronto, Canada. 17Flinders University, College of Nursing and Health Sciences, Bedford Park, South Australia, Australia. 18Ontario Ministry of Health and Long-Term Care, Toronto, Canada. 19Women’s College Research Institute, Toronto, Canada. 20McMaster University, Department of Health Research Methods, Evidence and Impact, Hamilton, Canada. 21Al & Malka Green Artists’ Health Centre, Department of Family and Community Medicine, University Health Network, Toronto, Canada. 22University College London, Division of Psychology & Language Sciences, London, United Kingdom. 23Canadian Patient Safety Institute, Ottawa, Canada. 24University of Calgary, Department of Community Health Sciences, Calgary, Canada. 25Canadian Agency for Drugs and Technologies in Health, Ottawa, Canada. 26Health Quality Ontario, Toronto Canada. 27Lancaster University, Faculty of Health and Medicine, Lancaster, United Kingdom. 28Li Ka Shing Knowledge Institute of St. Michael’s Hospital, Toronto, Canada. 29Dalarna University, Department for Health and Welfare, Falun, Sweden.

Funding

This research was supported by two Canadian Institutes of Health Research (CIHR) Project Grants (Awards #: 326947 and 426122). The CIHR had no role in the study’s design, conduct or reporting.

Author information

Authors and Affiliations

Authors

Consortia

Contributions

All authors contributed to the conceptualization of the study and interpretation of the findings. JES, AMH, IDG and WJS contributed to the meta-synthesis. JES, AMH, IDG and WJS drafted the manuscript. All team members critically reviewed and revised the manuscript content, approved the final version and agreed to be accountable for all aspects of the work.

Corresponding author

Correspondence to Janet E. Squires.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declared that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Enhancing transparency in reporting the synthesis of qualitative research: the ENTREQ statement.

Additional file 2.

Databases searched for concept analysis on context and the disciplines they cover.

Additional file 3.

Rankings from Knowledge Utilization Colloquium 2019 on ICON Framework.

Additional file 4.

Features of context in ICON.

Additional file 5.

ICON Qualitative Screening Tool.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Squires, J.E., Graham, I.D., Santos, W.J. et al. The Implementation in Context (ICON) Framework: A meta-framework of context domains, attributes and features in healthcare. Health Res Policy Sys 21, 81 (2023). https://doi.org/10.1186/s12961-023-01028-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12961-023-01028-z

Keywords