Skip to main content

A framework for value-creating learning health systems

Abstract

Background

Interest in value-based healthcare, generally defined as providing better care at lower cost, has grown worldwide, and learning health systems (LHSs) have been proposed as a key strategy for improving value in healthcare. LHSs are emerging around the world and aim to leverage advancements in science, technology and practice to improve health system performance at lower cost. However, there remains much uncertainty around the implementation of LHSs and the distinctive features of these systems. This paper presents a conceptual framework that has been developed in Canada to support the implementation of value-creating LHSs.

Methods

The framework was developed by an interdisciplinary team at the Institut national d’excellence en santé et en services sociaux (INESSS). It was informed by a scoping review of the scientific and grey literature on LHSs, regular team discussions over a 14-month period, and consultations with Canadian and international experts.

Results

The framework describes four elements that characterise LHSs, namely (1) core values, (2) pillars and accelerators, (3) processes and (4) outcomes. LHSs embody certain core values, including an emphasis on participatory leadership, inclusiveness, scientific rigour and person-centredness. In addition, values such as equity and solidarity should also guide LHSs and are particularly relevant in countries like Canada. LHS pillars are the infrastructure and resources supporting the LHS, whereas accelerators are those specific structures that enable more rapid learning and improvement. For LHSs to create value, such infrastructures must not only exist within the ecosystem but also be connected and aligned with the LHSs’ strategic goals. These pillars support the execution, routinisation and acceleration of learning cycles, which are the fundamental processes of LHSs. The main outcome sought by executing learning cycles is the creation of value, which we define as the striking of a more optimal balance of impacts on patient and provider experience, population health and health system costs.

Conclusions

Our framework illustrates how the distinctive structures, processes and outcomes of LHSs tie together with the aim of optimising health system performance and delivering greater value in health systems.

Peer Review reports

Introduction

Among the most fundamental shifts currently taking place in the healthcare landscape is the movement towards value-based healthcare [1]. Value-based healthcare strives to achieve the best possible health outcomes [1, 2] or the best possible care [3] at the lowest cost. While details surrounding the concept’s operationalisation remain debated [4, 5], the general goal of value improvement has been embraced in a growing number of healthcare settings. The concept is appealing because it represents a clear strategic focus that can potentially align the interests of all system actors and guide collective efforts to enhance healthcare system performance [2, 6]. The pursuit of greater value in health is not without its challenges, however, as it will demand significant changes to the way health systems currently deliver and fund care, share data, support innovation, and evaluate performance [6, 7].

The United States Institute of Medicine (now the National Academy of Medicine (NAM)) proposed that a key pathway towards value-based healthcare is through the implementation of learning healthcare systems (LHSs) [8, 9]. LHSs were defined as systems where “science, informatics, incentives, and culture are aligned for continuous improvement and innovation, with best practices seamlessly embedded in the delivery process and new knowledge captured as an integral by-product of the delivery experience” [8]. Such systems would capitalise on major technological advances in order to foster more dynamic approaches to evidence generation and application, enable rapid learning and improvement based on data flowing from routine patient care, and ensure greater quality, safety and innovation in healthcare. However, while the concept of LHSs has generated considerable enthusiasm across the United States and increasingly in other parts of the world [10,11,12], its implementation on a broad scale remains limited. Furthermore, LHSs that have been implemented to date vary widely in their goals, structure and scale, and have pursued different interpretations of the NAM’s views on the LHS [11, 13].

In Canada, several leading organisations now identify the delivery of high-value healthcare as an important system goal [14,15,16,17,18]. Similarly, recent reports have described the LHS approach as a fundamental strategy for enabling evidence-driven health system transformation across the country [19,20,21]. However, there remains no consensus in Canada around how value-based healthcare should be defined and little clarity about how LHSs can contribute to value improvement. The LHS concept has emerged primarily within the complex, largely privately funded United States healthcare context, which differs significantly from other systems internationally. Canada’s universal public healthcare system features different institutions, regulations and guiding values, and has historically emphasised the importance of population health approaches for social progress [22, 23]. Given these contextual differences, there is a need to clarify how the LHS concept applies in Canada and other jurisdictions sharing similar health systems characteristics.

Achieving this understanding is considered critical within the Institut national d’excellence en santé et en services sociaux (INESSS), a public organisation whose mission is to promote clinical excellence and the efficient use of resources in the health and social services sector in the province of Quebec, Canada. INESSS has been an early adopter of the notions of value and learning systems [16, 24] and has recently engaged with other Canadian partners to establish a shared vision for the future. The purpose of this paper is to present the conceptual framework that emerged from these efforts to guide progress towards value-creating LHSs.

Methods

The process we used to develop our conceptual framework included (1) a scoping review to identify definitions, models and case examples of LHSs, (2) interdisciplinary expert discussion meetings to build the conceptual framework, and (3) consultations with experts. The scoping review involved iterative searches in publication databases, journals and the grey literature [25]. Database searches were conducted in Medline, Embase and the Cochrane Library using keywords such as “learning healthcare system” and “learning health system”. We also performed searches for articles in the journal Learning Health Systems. Finally, we performed similar keyword searches in Google and consulted the websites of organisations or groups with a clear interest in learning systems (e.g. NAM, Academy Health, Agency for Healthcare Research and Quality, The Learning Healthcare Project). There were no restrictions on the types of articles or reports eligible for consideration, as long as they had LHSs as a primary focus. Among the over 80 articles we retrieved, 18 provided conceptual descriptions or frameworks for the LHS. We also identified 37 case examples of LHSs whose goals, structures and processes were sufficiently described to inform our framework (Additional file 1).

A team of four experts from INESSS with different backgrounds (e.g. health management, public health, epidemiology) met regularly between September 2017 and November 2018 to develop the conceptual framework. The development process was iterative and involved frequent discussions of cases and frameworks identified through the scoping review and concepts drawn from other seminal texts from the fields of organisational and educational sciences. Preliminary versions of the framework were presented at two Canadian health services research conferences and were revised based on participant feedback. Finally, we consulted with Canadian and international experts in health system learning and performance, including an interdisciplinary group of researchers from the University of Montreal, who provided suggestions that contributed to a final version of the framework and shared their perspectives on implementation issues in Canadian contexts.

Results

Other LHS conceptual frameworks

The scoping review helped us identify articles and reports providing helpful conceptual clarifications of the LHS or its components. An example is the strategy map for value and science-driven healthcare developed by leading healthcare experts in the United States [8, 9]. This strategy map outlines a vision for LHSs and their foundational elements (e.g. clinical data, information technology, evidence standards, patient engagement), characteristics (e.g. care-driven learning, person-centred, networked leadership), collaborative actions (e.g. clinical effectiveness research, best practices, value incentives) and goals (i.e. value based on health outcomes and costs). Whereas the map offers a comprehensive and high-level depiction of LHS strategic objectives, insights into its operationalisation can only be gleaned by consulting multiple NAM reports [8].

Friedman et al. [10, 26] have proposed a compelling framework that depicts the basic learning cycle at the heart of LHSs and the infrastructures that support the execution of these cycles. Learning cycles can occur at various speeds and levels of scale but invariably consist of three core processes, namely (1) converting data to knowledge (D2K), (2) applying knowledge to influence performance (K2P), and (3) documenting changes in performance to generate new data (P2D). Technologies, policies and standards constitute the main infrastructures that support these cycles and the LHS. Similar to the NAM, Friedman et al. [10] also identify improving health and reducing costs and other harms as the primary goals of LHSs. Other authors have provided alternative views on the LHS learning cycle, either in the number of cycle stages or their supporting infrastructures [13, 27,28,29].

Two frameworks that pay particular attention to LHS infrastructures and activities are the frameworks of Psek et al. [30] and Lessard et al. [13]. Psek et al. [30] describe the framework used within Geisinger Health System, which comprises nine components, as follows: data and analytics, people and partnerships, patient and family engagement, ethics and oversight, evaluation and methodology, funding, organisation, prioritisation, and deliverables. For their part, Lessard et al. [13] recently proposed an LHS architectural framework, or high-level blueprint, intended to guide health system actors in decisions about the design and implementation of context-adapted LHSs. Their framework comprises six decision layers that reflect common LHS dimensions identified in the literature, namely (1) the performance layer (e.g. strategic goals pursued by the LHS), (2) the scientific layer (e.g. the learning cycles and activities undertaken in the LHS), (3) the organisational layer (e.g. governance models and organisational structures), (4) the data layer (e.g. the ways data is collected, used and shared), (5) the information technology (IT) layer (e.g. the IT systems in place), and (6) the ethics and security layer (e.g. the ethical and privacy measures adopted). In addition to these more global frameworks are efforts to conceptualise specific infrastructures within the LHS, notably its technological structures [31,32,33,34,35,36].

Each of the frameworks described above helped us establish a comprehensive view of LHSs. However, some processes related to learning and improvement remained unclear and we noted that relatively few authors drew from existing theoretical literature in developing their frameworks, including important conceptual precursors such as the works on learning organisations by Senge [37]. In some cases, it was also evident that the Canadian healthcare context necessitated different considerations with respect to the values or structures underpinning LHSs. In the sections that follow, we expand on these issues and describe the framework developed at INESSS that builds on these previous works.

LHS definition and framework elements

As noted recently by Lavis et al. [21], the term ‘learning health system’ is preferable to ‘learning healthcare system’ in Canadian contexts given the language commonly used in this country and our emphasis on other determinants of health outside of the realm of healthcare. We thus define LHSs as dynamic health ecosystems where scientific, social, technological, policy, legal and ethical dimensions are synergistically aligned to enable cycles of continuous learning and improvement to be routinised and embedded across the system, thus enhancing value through an optimised balance of impacts on patient and provider experience, population health and health system costs. In line with population health approaches, we see LHSs influencing and being influenced by the complex environments in which they evolve. These ecosystems of change can be characterised by their level and scale. Three levels can be defined – (1) the microsystem level, which features the organisations and units that produce health and social services; (2) the mesosystem level, where service continuums and joint action programmes are defined; and (3) the macrosystem level, where decisions about population-level planning and overall system performance occur [38]. Similarly, LHSs can vary in their scale, operating locally, regionally, nationally or internationally. This conceptualisation implies that local or regional LHSs can evolve alongside or within broader LHSs, with linkages between LHSs or between actors at various system levels. The framework for value-creating LHSs is depicted in Fig. 1 and consists of four elements, namely (1) core values, (2) pillars and accelerators, (3) processes, and (4) outcomes.

Fig. 1
figure 1

Conceptual framework for value-creating learning health systems

Core values

Core values that should underpin LHSs have been identified previously and include accessibility, adaptability, cooperative and participatory leadership, governance, inclusiveness, person focused, privacy, scientific integrity, transparency, and value in healthcare [39]. However, in Canada and other countries, implementation of LHSs may be challenged if these systems disregard other core societal values or health system objectives such as equity, fairness and solidarity [40,41,42]. These values can be reflected by meaningful efforts to engage diverse stakeholders in the LHS, empower groups with marginalised voices, promote a sense of collective responsibility for its activities and outcomes, and ensure that its impacts are fairly distributed and serve to reduce disparities in care experiences or population health [43]. Additionally, given the plural leadership in the Canadian health sector, spread among governments, professional groups and actors from other sectors, as well as the growing expectations around public input into healthcare [40], we refer to the value of ‘shared accountability’ rather than ‘governance’. Canadians further expect their health system to remain responsive to their evolving needs through innovation and collaboration [19, 44]. The value of ‘open innovation’ reflects this more collaborative approach to innovation that LHSs should strive to achieve [45]. Finally, we viewed ‘value in healthcare’ not as an underpinning value but rather as the driving motive for LHSs. Our list of core LHS values with their definitions appears in Table 1.

Table 1 Learning health system (LHS) core values

LHS pillars and accelerators

LHS pillars refer to the infrastructure, systems and resources that provide the foundational supports for LHSs, whereas accelerators represent specific supports that accelerate learning within these systems (i.e. create ‘rapid’ LHSs). We identified six main pillars – scientific, social, technological, policy, legal and ethical pillars, though some LHS supports could align with multiple pillars at the same time. Table 2 presents the elements within these pillars and examples drawn from the 37 LHS cases identified. Importantly, each of these pillars provides necessary but not sufficient elements needed to support the LHS. Indeed, what matters less is the presence of infrastructure and supports within an ecosystem, and more the synergy between these elements and how they can be connected or aligned to achieve LHS goals [21].

Table 2 Learning health system pillars and accelerators

The scientific pillar encompasses the range of scientific infrastructure, programmes and resources that support knowledge generation, sharing and application within the LHS and promote evidence-informed healthcare. This includes academic or research institutes, centres or groups that can nurture and mobilise scientific expertise relevant to the LHS. Entities specifically dedicated to advancing the LHS model (e.g. Kaiser’s LHS programme [46]) can accelerate progress towards more rapid LHSs. This pillar also includes training programmes and educational activities that build the individual and collective expertise needed for the LHS. Competencies thought to be critical for learning systems include systems science, data science, research methods for real-world contexts, implementation science, and participatory research and quality improvement (QI) approaches [69]. Having individuals that can master several of these competencies at once and work as embedded researchers [69] or knowledge brokers [70] should also accelerate learning in these systems. Funding agencies and programmes are also key components of the scientific pillar, with more flexible, rapid cycle and applied research funding programmes serving as accelerators [71].

The social pillar includes the actors and networks that interact within the LHS and the norms, culture and partnerships that establish its unique identity. LHSs are shaped and made successful by the combined efforts of the people within them, which may include healthcare providers, administrators, policy-makers, patients, community members, researchers, industry partners or other experts. Depending on the level and scale of the ecosystem, different social arrangements and mechanisms of communication and collaboration (e.g. teams, committees, virtual communities) can be adopted to ensure a deep and active engagement of members in the LHS. Indeed, LHSs have the potential to dismantle silos that frequently exist between actors from different disciplines or organisations from different sectors [47, 72]. Another transformative feature of LHSs is their emphasis on patient and community engagement [30, 73, 74], which can take many forms, as demonstrated in large-scale initiatives such as PCORnet® in the United States (https://pcornet.org) and the Canadian Institutes of Health Research’s signature SPOR (Strategy for Patient-Oriented Research) initiative in Canada [75]. Networks and learning communities that foster trusting relations between diverse stakeholders can nurture cultures in which learning and improvement is ingrained within their normal operations, though fully realising such culture shifts is considered one of the most challenging tasks of LHS implementation [76, 77].

The technological pillar is similarly central to LHSs and includes a wide range of health technologies, devices, and IT infrastructure and systems. The array of technologies relevant to the LHS has been explored by the NAM [54] but is constantly expanding and evolving. A distinctive feature of LHSs is their capacity to promote learning as a by-product of everyday care, which is only made possible through infrastructure that enables high-quality clinical data to be collected, aggregated, analysed and acted on. Some LHSs have been built around clinical registers housing uniformly collected data used to describe populations with specific diseases or characteristics and monitor their outcomes such as the registers used by ImprovingCareNow [32] or the Swedish Rheumatology Society [78]. In other LHSs, health data is gathered from electronic health record (EHR) systems (e.g. [30, 31, 36, 57, 63, 79]), patients’ personal health records (e.g. [31]) and/or research databases (e.g. [48, 80]). Data from millions of patients can be stored in centralised data warehouses where it can then be aggregated, linked with other forms of data, and then leveraged for system learning and improvement. Other platforms for integrating data based on federated or mediated approaches have also been established [35, 36, 54]. Hardware and software supporting the use of algorithms, machine learning, data mining and advances in artificial intelligence also offer unmistakable potential to identify new problems, examine trends in care, test solutions, and ultimately accelerate learning and innovation [81].

The policy pillar recognises that the goals pursued by an LHS cannot be achieved without adequate governance structures, policies, financing mechanisms and accountability measures. Leadership teams or steering committees play a pivotal role in setting the strategic directions for LHSs, establishing processes for fair and shared decision-making, negotiating roles and responsibilities, and identifying clear performance targets and deliverables that enhance value across the system. Early LHSs have introduced a variety of policies to support system governance, including policies on membership and regulating member actions, data quality, data ownership and use, security and privacy, and quality assurance [61, 63, 82]. Policies related to whether and how financial and other resources are shared and how financial sustainability of the LHS is ensured are also important elements of this pillar. Incentive systems and performance frameworks that foster greater alignment with LHS structures and processes (e.g. incentives for implementing EHR systems, value-based funding models) should also accelerate progress towards more rapid LHSs.

Legislators and regulators similarly have a role to play in creating the conditions required for effective LHSs. The legal pillar thus includes the laws, rules and regulations that guide or constrain the LHS and govern the conduct of its members. One of the most frequently discussed areas of legislation in the LHS literature is privacy legislation. For instance, in the United States, the Health Insurance Portability and Accountability Act (HIPAA) includes provisions around privacy that introduce safeguards to protect personal health information and define the procedures and conditions under which such information can be accessed or shared by different stakeholders [83]. While such legislation is essential for public trust in the LHS, it has also at times slowed or impeded research and improvement activities [73]. Numerous other laws and regulations, such as those that define institutional mandates, regulate relations between organisations and govern professional practice, may facilitate or limit progress towards learning systems.

Finally, the ethical pillar includes the ethical structures, frameworks and guidelines that support the LHS, notably by helping stakeholders manage data ethically and navigate the blurred boundaries between clinical practice, QI, research and innovation. Current ethical frameworks, which emphasise sharp distinctions between QI and research, and burdensome oversight for the latter, can significantly hinder the real-time learning and improvement processes that characterise the LHS [84]. Training for members of institutional and ethical review boards and ethical guidelines for data stewardship and protection are strategies needed to promote rapid learning cycles [30, 63]. Promising guidance on these issues has already been produced by Faden et al. [84].

LHS processes

Consistent with the work of Friedman [10, 85], we see the execution and routinisation of learning cycles as the fundamental processes of LHSs. Learning cycles have three phases – P2D, D2K and K2P [85]. The execution of these phases is driven by ‘communities of interest’, which comprise the core group of actors motivated to tackle a collective problem and align LHS pillars to achieve their goals. The speed at which communities of interest can execute whole learning cycles depends on various factors, including the nature of the problems and activities pursued as well as communities’ capacity to build or connect pillars and introduce accelerators. As LHS members gain experience with learning cycles, they can use technological, policy and other levers to routinise key processes within each phase, thus promoting more seamless transitions between phases and more efficient and impactful cycles overall.

Each learning cycle phase features its own set of distinct processes as well as a central management challenge. The P2D phase centres on the generation of practice-based data by providers, administrators, patients or other LHS actors collected through a variety of mechanisms. The central challenge of this phase is thus the management of this data. This includes the processes of designing and managing a data infrastructure, promoting good data governance, monitoring and ensuring data quality and security, facilitating data integration and interoperability, and establishing clear strategies for data access, storage and sharing. While IT experts, data scientists and researchers have a clear role here, the involvement of other stakeholders (e.g. clinicians, patients) is also essential for good data management. Participatory, user-centred design approaches can be used to help design data systems and processes that are less disruptive and more user-friendly and responsive to the needs of all LHS members [86].

The D2K phase of the learning cycle involves the conversion of data generated from routine care, research or QI to knowledge that can drive decision-making, improvement and innovation in the LHS. Knowledge management is thus the central challenge of this phase. From a knowledge management perspective, distinctions can be drawn between data (e.g. facts, symbols, statistics, signals), information (data given meaning, relevance or context) and knowledge (personalised information that individuals believe to be true) [87, 88]. Within the LHS, knowledge creation and learning depend on members’ ability to efficiently convert data to knowledge and subsequently use this knowledge to guide new data collection. This process is inherently social and iterative. It involves steps such as data analysis, synthesis, visualisation or verbalisation as well as protected time to collectively interpret data and establish shared meaning through sensemaking [89, 90]. This process may draw not only on explicit, codified forms of knowledge but also tacit knowledge rooted in members’ experiences. Indeed, models of organisational learning highlight the important interplay between tacit and explicit knowledge that occurs when individuals practice in their field, interact and engage in dialogue with others, and work to link their knowledge [89, 91].

In the K2P phase, the knowledge residing with communities of interest is applied to support practice innovation and improvement and ultimately deliver greater value. Managing change is thus the central challenge of this phase. The literature on change management, QI and the implementation of innovations is vast and ever expanding, spanning numerous disciplines. Points of convergence regarding key K2P processes includes processes related to making decisions about the nature of change, establishing a shared vision for change, and selecting change or implementation models or theories [92,93,94,95]. LHS leaders can prepare for change, such as by consulting partners and assessing readiness for change, identifying and minimising barriers to change, mobilising key stakeholders, soliciting the help of champions or change agents, and establishing a sense of urgency for change [94, 96, 97]. Taking action and implementing change involves the identification of new interventions or best practices that can be expected to add value, selecting from a wide range of change strategies, and potentially tailoring change strategies to particular contexts or target populations [98,99,100,101]. Communities of interest may endorse large transformations or prefer piloting innovations on a small scale or support rapid cycles of change in practice with an emphasis on quick, visible successes that can be communicated and celebrated [94, 95]. Finally, plans to institutionalise, sustain and scale-up change must be carefully considered. These plans should include strategies for monitoring change and evaluating its impacts, mobilising new partners and resources, rewarding new practices, and fostering an environment conducive to continuous learning and improvement [94,95,96,97, 102]. While such K2P processes may initially be conducted within more formal or planned QI initiatives or action research activities, LHSs should strive to achieve change processes that are increasingly emergent and continuous over time [10].

In addition to the processes linked to each learning cycle phase, several core processes are necessary in order for the LHS to achieve its ultimate aim, i.e. creating and improving value. In particular, the key actors making up a community of interest must be identified and given the opportunity to build a shared purpose and approach to working together. Next, these communities should establish robust processes for identifying, clarifying and eventually revisiting the specific problems that their members wish to address. Especially important is the need for systems thinking at this stage, including consideration of the interdependencies between members and the ‘big picture’ problems that require long-term solutions [37]. This is facilitated by critical reflection, one of the foundations for collective action, learning and improvement [103]. In contexts where time is often a scarce resource, LHS members must routinely protect time for group-based self-reflection where current practices, assumptions and solutions can be critically examined. Such reflection sets the stage for shared decision-making, in which partners work together to outline alternative courses of action, weigh their pros and cons, and make fair decisions given members’ preferences and priorities. The last core process relates to taking actions and ‘learning from doing’. The impacts of these actions should thus be monitored and reflected upon, as should the processes LHS members used to arrive at decisions and impacts, consistent with the idea of ‘double loop learning’ [104].

LHS outcomes

At INESSS, the raison d’être of learning cycles and LHSs is seen as the improvement of value for people. A critical task for communities of interest is thus to achieve an accepted definition of ‘value’ and track its improvement. While Porter’s views on value [2, 6] have shifted conversations on health system performance, they have not gone unchallenged and new ideas about how to define and operationalise the concept in health contexts have been proposed [105,106,107]. Informed by this debate, we argue that value is created when a more optimal and acceptable balance is achieved across four dimensions of health system performance, namely patients’ care experience, providers’ care experience, population health, and health system costs [108]. LHS members are thus encouraged to define, in operational terms, what progress in the pursuit of this quadruple aim looks like. To this end, we submit three propositions intended to support this challenging task.

First, value as a concept is both complex and relative, and as such its appreciation demands that multiple complimentary perspectives be considered. LHSs will often have diffuse power structures, with members having a myriad of legitimate interests. Reconciling these interests and identifying acceptable trade-offs in health system objectives is not always easy; however, fair and informed decisions can be achieved through participatory approaches and deliberative processes that mobilise the best available evidence alongside members’ diverse experiential and contextual knowledge. The inclusion of perspectives from patients and the public is particularly central and reflected in a growing movement towards the routine collection of patient-reported outcomes and experience measures within LHSs [30, 47, 58, 61, 62, 109]. LHSs should adopt transparent methods to allow these and other stakeholders in the LHS to identify the goals most meaningful to them, considering that some goals (e.g. improving population health) are highly valued in contexts like Canada. Ultimately, LHSs may identify multiple value-related indicators covering different dimensions of LHS performance that reflect both the shared and unique interests of its members [5].

A second proposition is that it is imperative to assess value in real-world contexts and throughout the life cycle of the innovations introduced to improve health and care. Innovations such as new clinical practices, programmes or technologies can offer great promise of improved value but the extent to which this promise is fully realised should be evaluated in diverse populations and care settings. LHSs can offer an ideal environment to examine whether innovations are reaching the right people in the right way at the right time, and whether this results in better care experiences and outcomes. Communities of interest should adopt long-lasting monitoring processes to ensure that value is demonstrated and maintained after taking actions assumed to be beneficial.

Third, a holistic appraisal of value requires a deep understanding of the trajectories of care experienced by different clinical populations. As Porter argues [2], value measurements should encompass the full range of services and activities that jointly determine success in meeting patients’ needs. Indeed, from a patient’s perspective, perceptions of value will often depend less on their experiences with a single intervention or provider but rather on an accumulation of experiences as they journey through multiple contacts with the health system. Poor continuity or integration of care along this journey reduces value through negative impacts on both individual care experiences and population health. LHSs focused on improving value should characterise the key stages and services within care trajectories for specific populations and then work with those populations and care providers to determine how value can be added at different points along those trajectories. Furthermore, as LHSs make progress in the integration and interoperability of their information systems, so too will progress be made in their ability to situate patients within a service continuum and use real-time health and cost data to seize opportunities for value improvement.

Discussion

With the introduction of the LHS concept, the NAM has provided a compelling vision for the optimisation of health systems worldwide. In this article, we describe a conceptual framework that is guiding work by INESSS to foster greater learning and improvement in Canada. This framework comprises four main components, notably LHS core values, pillars and accelerators, processes, and outcomes. We argue that LHSs serve primarily to improve value in health systems, based on definitions of value that account for the diverse interests and objectives of actors within communities of interest.

In Canada, recent reports have drawn attention to the LHS as a foundation for a higher performing healthcare system [19,20,21]. Still, there are many challenges that must be overcome to achieve this vision, notably at the level of LHS pillars. For example, Canada has made massive investments in its data infrastructure over the past decade, including substantial efforts to support EHR system adoption in primary care, yet this infrastructure remains plagued by problems of interoperability and the inability to link and aggregate data [21, 110,111,112]. Efforts to build national clinical registries or EHR-based research networks have also been slowed due to the multitude of provincial laws governing personal health information and their interpretation by ethics review boards [113, 114]. National funding for health research is not yet adapted to support rapid innovation cycles and only scant funding has been directed to change management and the scale and spread of innovations [71, 115]. Few mechanisms have been introduced to ensure strong patient involvement in health system design and priority-setting and the routine collection of patient-reported outcome measures and patient-reported experience measures is far from a reality in most health jurisdictions [21, 116]. With an inadequate socio-technical architecture, provincial health systems have been largely unable to establish a culture of learning and improvement and make progress towards the objectives of the quadruple aim [19, 21, 117, 118].

Despite these challenges, Canada still seems poised to make progress in LHS implementation over the next decade. The country features numerous prominent public agencies focused on health information and healthcare improvement whose missions seem well aligned with the notion of value-creating LHSs. INESSS has assumed a leadership role in mobilising support for these concepts, notably through its involvement in the Canadian Health Services and Policy Research Alliance (CHSPRA), which fosters collaboration, coordination and strategic investment among over 40 organisations funding and supporting health services and policy research [115]. In 2017, CHSPRA launched a training programme targeting doctoral and postdoctoral trainees that promotes embedded research within health agencies across the country. In this Health System Impact Fellowship programme, trainees develop an expanded set of competencies specifically intended to help them become scientific leaders within emerging LHSs [115]. Three authors of this paper were Health System Impact Fellows and our conceptual framework is currently being used to inform the evaluation of this pan-Canadian training programme. A CHSPRA LHS Working Group will also be using the framework to guide strategic planning of the implementation of LHSs in Canada, along with information gathered from its recently commissioned environmental scan on rapid-learning LHSs [21]. At a provincial level, our framework is informing INESSS initiatives such as the CoMPAS+ programme, which uses QI collaboratives to promote a culture of continuous QI for chronic disease prevention and management in Quebec primary care settings [119]. Already, several communities of interest have been formed to promote reflective practices around care for diabetes, chronic obstructive pulmonary disease and mental health in order to take actions to improve quality and value in primary care.

Novel contributions

Our conceptual framework presents several strengths relative to other frameworks available in the literature. Other frameworks either do not make clear distinctions between the structural, process and outcome components of LHSs [30] or emphasise a single component (e.g. processes or structures) over others (e.g. [27, 31, 32]). Our framework is more comprehensive and illustrates, in a novel way, how communities of interest can work to align the structures, processes and outcomes that are distinct to LHSs. Moreover, our framework explicitly identifies value creation and improvement as the fundamental goal to be pursued by these communities of interest. Our conceptualisation of value based on the quadruple aim is also substantively different than those proposed by Porter and others. We note that our framework was primarily intended to meet the needs of stakeholders within the Canadian health system. This is reflected in the core values that should underpin LHSs established in Canada, the use of language that recognises multiple determinants of health, and the importance of pursuing processes and outcomes in line with population health approaches. Finally, the research conducted to develop the framework led to the identification of 37 case examples of LHSs, a more comprehensive list than what has been found in other reviews and scans [11, 21].

Limitations

While our framework has its strengths, some limitations in our methods should be noted. First, our scoping review relied on structured searches of the literature but was not as exhaustive as a systematic review, making it possible that some articles or case examples were missed. In some countries, networks or systems may pursue similar processes or goals as in LHSs but not refer to themselves as learning systems. It would have been ideal to contact more key informants from different parts of Canada and other countries to gather feedback on the framework’s elements and identify additional case examples. How the framework may resonate in other contexts will be a focus of future work.

Conclusion

Health systems worldwide face numerous challenges with respect to performance, rising costs and the need to more rapidly integrate evidence and innovations. The LHS concept offers much promise to help these systems benefit from scientific and technological advancements in order to optimise learning and improvement. The conceptual framework for LHSs developed at INESSS is comprehensive and defines how the distinctive components of these health systems can work together in order to achieve a shared strategic goal – the creation and improvement of value for people. The framework is being used by INESSS to guide transformation in Quebec and Canada, and may provide a useful template for health system leaders internationally.

Availability of data and materials

Data sharing is not applicable to this article as no datasets were generated or analysed during the current study.

Abbreviations

CHSPRA:

Canadian Health Services and Policy Research Alliance

D2K:

data to knowledge

EHR:

electronic health record

INESSS:

Institut national d’excellence en santé et en services sociaux

IT:

information technology

K2P:

knowledge to practice

LHS:

learning health system

NAM:

National Academy of Medicine

P2D:

practice to data

QI:

quality improvement

References

  1. World Economic Forum. Value in Healthcare: Laying the Foundation for Health System Transformation. Geneva: World Economic Forum; 2017.

  2. Porter ME. What is value in health care? N Engl J Med. 2010;363(26):2477–81.

    Article  CAS  PubMed  Google Scholar 

  3. Dzau VJ, McClellan MB, McGinnis JM, Finkleman EM. Vital Directions for Health and Healthcare: An Initiative of the National Academy of Medicine. Washington, DC: National Academy of Medicine; 2017.

  4. Pendleton RC. We Won't Get Value-Based Health Care Until we Agree on What 'Value' Means. Harvard Business Review. 2018. https://hbr.org/2018/02/we-wont-get-value-based-health-care-until-we-agree-on-what-value-means. Accessed 15 May 2019.

  5. Wheeler SB, Spencer J, Rotter J. Toward value in health care: perspectives, priorities, and policy. N C Med J. 2018;79(1):62–5.

    PubMed  Google Scholar 

  6. Porter ME. A strategy for health care reform--toward a value-based system. N Engl J Med. 2009;361(2):109–12.

    Article  CAS  PubMed  Google Scholar 

  7. Institute of Medicine. Value in Health Care: Accounting for Cost, Quality, Safety, Outcomes and Innovation: Workshop summary. Washington, DC: IOM; 2010.

    Google Scholar 

  8. Institute of Medicine. Roundtable on Value and Science-Driven Health Care: The Learning Health System and its Innovation Collaboratives: Update Report. Washington, DC: IOM; 2011.

    Google Scholar 

  9. Institute of Medicine. Making a Difference: Roundtable Charter, Strategy, Tactics, Impact. Washington, DC: IOM; 2014.

    Google Scholar 

  10. Friedman CP, Rubin JC, Sullivan KJ. Toward an information infrastructure for global health improvement. Yearb Med Inform. 2017;26(1):16–23.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Budrionis A, Bellika JG. The learning healthcare system: where are we now? A systematic review. J Biomed Inform. 2016;64:87–92.

    Article  PubMed  Google Scholar 

  12. Foley T, Fairmichael F. The Potential of Learning Healthcare Systems. Newcastle: Institute of Health and Society; 2015.

    Google Scholar 

  13. Lessard L, Michalowski W, Fung-Kee-Fung M, Jones L, Grudniewicz A. Architectural frameworks: defining the structures for implementing learning health systems. Implement Sci. 2017;12(1):78.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Canadian Foundation for Healthcare Improvement. Healthcare Priorities in Canada: A Backgrounder. Ottawa: CFHI; 2014.

    Google Scholar 

  15. Alberta Health. Health System Outcomes and Measurement Framework. Edmonton: Alberta Health; 2014.

    Google Scholar 

  16. Bergevin Y, Habib B, Elicksen-Jensen K, Samis S, Rochon J, Denis JL, et al. Transforming regions into high-performing health systems toward the triple aim of better health, better care and better value for Canadians. Healthc Pap. 2016;16(1):34–52.

    Article  PubMed  Google Scholar 

  17. Health Quality Ontario. Quality Matters: Realizing Excellent Care for All. Toronto: HQO; 2017.

    Google Scholar 

  18. Canadian Institute for Health Information. A Performance Measurement Framework for the Canadian Health System. Ottawa: CIHI; 2013.

    Google Scholar 

  19. Forest PG, Martin D. Fit for Purpose: Findings and Recommendations of the External Review of the Pan-Canadian Health Organizations. Ottawa: Government of Canada; 2018.

  20. Lavis JN, Gauvin FP, Reid RJ, Bullock H, Wodchis WP, Hayes A. Rapid Synthesis: Creating a Rapid-Learning Health System in Ontario. Hamilton: McMaster Health Forum; 2018.

    Google Scholar 

  21. Lavis JN, Gauvin FP, Mattison CA, Moat KA, Waddell K, Wilson MG, et al. Rapid Synthesis: Creating Rapid-Learning Health Systems in Canada. Hamilton: McMaster Health Forum; 2018.

    Google Scholar 

  22. Martin D, Miller AP, Quesnel-Vallee A, Caron NR, Vissandjee B, Marchildon GP. Canada's universal health-care system: achieving its potential. Lancet. 2018;391(10131):1718–35.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Public Health Agency of Canada. What is the Population Health Approach? 2012. https://www.canada.ca/en/public-health/services/health-promotion/population-health/population-health-approach.html. Accessed 15 May 2019.

  24. Roy DA, Candas B, Litvak E, Boileau L. The necessary – but not sufficient – leadership of research to transform health systems. Healthcare Papers. 2016;16:S21–5.

    Article  Google Scholar 

  25. Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010;5:69.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Nwaru BI, Friedman C, Halamka J, Sheikh A. Can learning health systems help organisations deliver personalised care? BMC Med. 2017;15(1):177.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Greene SM, Reid RJ, Larson EB. Implementing the learning health system: from concept to action. Ann Intern Med. 2012;157(3):207–10.

    Article  PubMed  Google Scholar 

  28. Lowes LP, Noritz GH, Newmeyer A, Embi PJ, Yin H, Smoyer WE, et al. 'Learn from every patient': implementation and early results of a learning health system. Dev Med Child Neurol. 2017;59(2):183–91.

    Article  PubMed  Google Scholar 

  29. Fung-Kee-Fung M, Maziak DE, Pantarotto JR, Smylie J, Taylor L, Timlin T, et al. Regional process redesign of lung cancer care: a learning health system pilot project. Curr Oncol. 2018;25(1):59–66.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Psek WA, Stametz RA, Bailey-Davis LD, Davis D, Darer J, Faucett WA, et al. Operationalizing the learning health care system in an integrated delivery system. EGEMS. 2015;3(1):1122.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Mandl KD, Kohane IS, McFadden D, Weber GM, Natter M, Mandel J, et al. Scalable Collaborative Infrastructure for a Learning Healthcare System (SCILHS): architecture. J Am Med Inform Assoc. 2014;21(4):615–20.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Marsolo K, Margolis PA, Forrest CB, Colletti RB, Hutton JJ. A digital architecture for a network-based learning health system: integrating chronic care management, quality improvement, and research. EGEMS. 2015;3(1):1168.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Ainsworth J, Buchan I. Combining health data uses to ignite health system learning. Methods Inf Med. 2015;54(6):479–87.

    Article  CAS  PubMed  Google Scholar 

  34. Ovretveit J, Nelson E, James B. Building a learning health system using clinical registers: a non-technical introduction. J Health Organ Manag. 2016;30(7):1105–18.

    Article  PubMed  Google Scholar 

  35. Ethier JF, McGilchrist M, Barton A, Cloutier AM, Curcin V, Delaney BC, et al. The TRANSFoRm project: experience and lessons learned regarding functional and interoperability requirements to support primary care. Learning Health Systems. 2017;2(2):e10037.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Daniel C, Ouagne D, Sadou E, Paris N, Hussain S, Jaulent MC, et al. Cross border semantic interoperability for learning health systems: the EHR4CR semantic resources and services. Learning Health Systems. 2017;1:e10014.

    Article  PubMed  Google Scholar 

  37. Senge P. The Fifth Discipline: The Art and Practice of the Learning Organization. New York: Doubleday; 2006.

    Google Scholar 

  38. Alderwick H, Ham C, Buck D. Population Health Systems: Going Beyond Integrated Care. London: The King’s Fund; 2015.

    Google Scholar 

  39. Learning Health Community. Endorsers of the Core Values Underlying A National-Scale Person-Centered Continuous Learning Health System. http://www.learninghealth.org/corevalues/. Accessed 15 May 2019.

  40. Romanow R. Building on Values: The Future of Health Care in Canada. Government of Canada: Ottawa; 2002.

    Google Scholar 

  41. Fattore G, Tediosi F. The importance of values in shaping how health systems governance and management can support universal health coverage. Value Health. 2013;16(1 Suppl):S19–23.

    Article  PubMed  Google Scholar 

  42. Culyer AJ. Social Values in Health and Social Care. London: The King’s Fund; 2014.

    Google Scholar 

  43. Brooks D, Douglas M, Aggarwal N, Prabhakaran S, Holden K, Mack D. Developing a framework for integrating health equity into the learning health system. Learning Health Systems. 2017;1:e10029.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Advisory Panel on Healthcare Innovation. Unleashing Innovation: Excellent Healthcare for Canada. Report of the Advisory Panel on Healthcare Innovation. Ottawa: Government of Canada; 2015.

    Google Scholar 

  45. Wass S, Vimarlund V. Healthcare in the age of open innovation – a literature review. Health Inf Manag. 2016;45(3):121–33.

    PubMed  Google Scholar 

  46. Larson EB. Learning Health System Initiative Weaves Research into Care Delivery at KP Washington: Medium. 2017. https://medium.com/@KPWaResearch/learning-health-system-initiative-weaves-research-into-kaiser-permanente-washington-health-care-9afe1d4ed009. Accessed 15 Nov 2018.

  47. Pronovost PJ, Mathews SC, Chute CG, Rosen A. Creating a purpose-driven learning and improving health system: the Johns Hopkins Medicine quality and safety experience. Learning Health Systems. 2017;1:e10018.

    Article  PubMed  Google Scholar 

  48. Starren JB, Winter AQ, Lloyd-Jones DM. Enabling a learning health system through a unified enterprise data warehouse: the experience of the Northwestern University Clinical and Translational Sciences (NUCATS) Institute. Clin Transl Sci. 2015;8(4):269–71.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Kaiser Permanente. Catalyst K12 Scholar Program. https://www.kpwashingtonresearch.org/about-us/careers/catalyst-k12-washington-learning-health-system-scholar-program/. Accessed 15 Nov 2018.

  50. PCORnet Consortium, Daughtery SE, Wahba S, Fleurence R. Patient-powered research networks: building capacity for conducting patient-centered clinical outcomes research. J Am Med Inform Assoc. 2014;21:583–6.

    Article  Google Scholar 

  51. Noseworthy T, Wasylak T, O'Neill B. Strategic clinical networks in Alberta: structures, processes, and early outcomes. Healthc Manage Forum. 2015;28(6):262–4.

    Article  PubMed  Google Scholar 

  52. DARTNet Institute. Learning Communities. http://dartnet.info/LearningCommunities.htm. Accessed 15 Nov 2018.

  53. ImproveCareNow. ImproveCareNow Network Hub. https://www.improvecarenow.org/. Accessed 5 Aug 2019.

  54. Institute of Medicine. Digital Infrastructure for the Learning Health System: The Foundation for Continuous Improvement in Health and Health Care. Workshop Series Summary. Washington, DC: IOM; 2011.

    Google Scholar 

  55. PCORnet. About PCORnet. https://pcornet.org/. Accessed 5 Aug 2019.

  56. Marsolo K. In search of a data-in-once, electronic health record-linked, multicenter registry – how far we have come and how far we still have to go. EGEMS. 2013;1(1):1003.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Wallace PJ, Shah ND, Dennen T, Bleicher PA, Crown WH. Optum Labs: building a novel node in the learning health care system. Health Aff. 2014;33(7):1187–94.

    Article  Google Scholar 

  58. Amin W, Tsui FR, Borromeo C, Chuang CH, Espino JU, Ford D, et al. PaTH: towards a learning health system in the Mid-Atlantic region. J Am Med Inform Assoc. 2014;21(4):633–6.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Turley CB, Obeid J, Larsen R, Fryar KM, Lenert L, Bjorn A, et al. Leveraging a statewide clinical data warehouse to expand boundaries of the learning health system. EGEMS. 2016;4(1):1245.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Johnson LC, Melmed GY, Nelson EC, Holthoff MM, Weaver SA, Morgan TS, et al. Fostering collaboration through creation of an IBD learning health system. Am J Gastroenterol. 2017;112(3):406–8.

    Article  PubMed  Google Scholar 

  61. McGlynn EA, Lieu TA, Durham ML, Bauck A, Laws R, Go AS, et al. Developing a data infrastructure for a learning health system: the PORTAL network. J Am Med Inform Assoc. 2014;21(4):596–601.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Forrest CB, Margolis PA, Bailey LC, Marsolo K, Del Beccaro MA, Finkelstein JA, et al. PEDSnet: a national pediatric learning health system. J Am Med Inform Assoc. 2014;21(4):602–6.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Schilsky RL, Michels DL, Kearbey AH, Yu PP, Hudis CA. Building a rapid learning health care system for oncology: the regulatory framework of CancerLinQ. J Clin Oncol. 2014;32(22):2373–9.

    Article  PubMed  Google Scholar 

  64. Finney Rutten LJ, Alexander A, Embi PJ, Flores G, Friedman C, Haller IV, et al. Patient-centered network of learning health systems: developing a resource for clinical translational research. J Clin Transl Sci. 2017;1(1):40–4.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  65. Blumenthal D, Tavenner M. The ‘meaningful use’ regulation for electronic health records. N Engl J Med. 2010;363(6):501–4.

    Article  CAS  PubMed  Google Scholar 

  66. HealthIT.gov. Meaningful Use and MACRA. https://www.healthit.gov/topic/meaningful-use-and-macra/meaningful-use-and-macra . Accessed 15 Jan 2019.

  67. Burde H. The HITECH Act – An overview. Am Med Assoc J Ethics. 2011;13(3):172–5.

    Google Scholar 

  68. Yu PP. Perspectives on the implementation of an ethical rapid learning health system. J Oncol Pract. 2017;13(3):151–3.

    Article  PubMed  Google Scholar 

  69. Forrest CB, Chesley FD Jr, Tregear ML, Mistry KB. Development of the learning health system researcher core competencies. Health Serv Res. 2018;53(4):2615–32.

    Article  PubMed  Google Scholar 

  70. Lomas J. The in-between world of knowledge brokering. BMJ. 2007;334(7585):129–32.

    Article  PubMed  PubMed Central  Google Scholar 

  71. Zelmer J. Digital drivers in a learning health system: considerations for research innovation. Healthcare Papers. 2016;16(Special issue):36–41.

    Google Scholar 

  72. Deeny SR, Steventon A. Making sense of the shadows: priorities for creating a learning healthcare system based on routinely collected data. BMJ Qual Saf. 2015;24(8):505–15.

    Article  PubMed  PubMed Central  Google Scholar 

  73. Institute of Medicine. Best Care at Lower Cost: The Path to Continuously Learning Health Care in America. Washington, DC: IOM; 2013.

    Google Scholar 

  74. Rubin JC. Patient empowerment and the learning health system. Learning Health Systems. 2017;1:e10030.

    Article  PubMed  PubMed Central  Google Scholar 

  75. Canadian Institutes of Health Research. Evaluation of the Strategy for Patient-Oriented Research - Final Report. Ottawa: CIHR; 2016.

    Google Scholar 

  76. Morain SR, Kass NE, Grossman C. What allows a health care system to become a learning health care system: results from interviews with health system leaders. Learning Health Systems. 2017;1:e10015.

    Article  PubMed  Google Scholar 

  77. Reid RJ. Embedding research in the learning health system. Healthcare Papers. 2016;16(Special issue):30–5.

    Google Scholar 

  78. Eriksson JK, Askling J, Arkema EV. The Swedish Rheumatology Quality Register: optimisation of rheumatic disease assessments using register-enriched data. Clin Exp Rheumatol. 2014;32(5 Suppl 85):S147–9.

    Google Scholar 

  79. Delaney BC, Curcin V, Andreasson A, Arvanitis TN, Bastiaens H, Corrigan D, et al. Translational medicine and patient safety in Europe: TRANSFoRm – architecture for the learning health system in Europe. Biomed Res Int. 2015;2015:961526.

    Article  PubMed  PubMed Central  Google Scholar 

  80. Suarez-Mejias C, Martinez-Garcia A, Martinez-Maestre MA, Silvan-Alfaro JM, Moreno Conde J, Parra-Calderon CL. Learning healthcare system for the prescription of genetic testing in the gynecological cancer risk. Stud Health Technol Inform. 2017;235:96–100.

    PubMed  Google Scholar 

  81. Krumholz HM. Big data and new knowledge in medicine: the thinking, training, and tools needed for a learning health system. Health Aff. 2014;33(7):1163–70.

    Article  Google Scholar 

  82. Friedman CP, Wong AK, Blumenthal D. Achieving a nationwide learning health system. Sci Transl Med. 2010;2(57):57cm29.

    Article  PubMed  Google Scholar 

  83. U.S. Department of Health and Human Services (HHS). The HIPAA Privacy Rule 2018. https://www.hhs.gov/hipaa/for-professionals/privacy/index.html. Accessed 15 Jan 2019.

  84. Faden RR, Kass NE, Goodman SN, Pronovost P, Tunis S, Beauchamp TL. An ethics framework for a learning health care system: a departure from traditional research ethics and clinical ethics. Hastings Cent Rep. 2013;Spec No:S16–27.

    Article  PubMed  Google Scholar 

  85. Flynn AJ, Friedman CP, Boisvert P, Landis-Lewis Z, Lagoze C. The Knowledge Object Reference Ontology (KORO): a formalism to support management and sharing of computable biomedical knowledge for learning health systems. Learning Health Systems. 2018;2:e10054.

    Article  PubMed  PubMed Central  Google Scholar 

  86. Baek EO, Cagilty K, Boling E, Frick T. User-centered design and development. In: Spector JM, Merrill D, van Merrienboer J, editors. Handbook of Research on Educational Communications and Technology (3rd edition). Abingdon: Routledge; 2008.

    Google Scholar 

  87. Kakabadse NK, Kakabadse A, Kouzmin A. Reviewing the knowledge management literature: towards a taxonomy. J Knowl Manag. 2003;7(4):75–91.

    Article  Google Scholar 

  88. Alavi M, Leidner DE. Knowledge management and knowledge management systems: conceptual foundations and research issues. MIS Q. 2001;25(1):107–36.

    Article  Google Scholar 

  89. Choo CW. The knowing organization: how organizations use information to construct meaning, create knowledge and make decisions. Int J Inf Manag. 1996;16(6):329–40.

    Article  Google Scholar 

  90. Weick KE. Sensemaking in Organizations. Thousand Oaks: Sage Publications; 1995.

    Google Scholar 

  91. Nonaka I, Takeuchi H. The Knowledge-Creating Company. New York: Oxford University Press; 1995.

    Google Scholar 

  92. Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10:53.

    Article  PubMed  PubMed Central  Google Scholar 

  93. Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43(3):337–50.

    Article  PubMed  PubMed Central  Google Scholar 

  94. Dickson G, Lindstrom R, Black C, Van der Gucht D. Evidence-Informed Change Management in Canadian Healthcare Organizations. Ottawa: Canadian Health Services Research Foundation; 2012.

    Google Scholar 

  95. Iles V, Sutherland K. Organisational Change: A Review for Health Care Managers, Professionals, and Researchers. London: National Co-ordinating Centre for NHS Service Delivery and Organisation; 2001.

    Google Scholar 

  96. Kotter J. Leading Change. Cambridge: Harvard Business Review Press; 2012.

    Google Scholar 

  97. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.

    Article  PubMed  PubMed Central  Google Scholar 

  98. Leeman J, Birken SA, Powell BJ, Rohweder C, Shea CM. Beyond ‘implementation strategies’: classifying the full range of strategies used in implementation science and practice. Implement Sci. 2017;12(1):125.

    Article  PubMed  PubMed Central  Google Scholar 

  99. Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, Proctor EK, et al. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Serv Res. 2017;44(2):177–94.

    Article  PubMed  PubMed Central  Google Scholar 

  100. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21.

    Article  PubMed  PubMed Central  Google Scholar 

  101. Michie S. Theories and techniques of behaviour change: developing a cumulative science of behaviour change. Health Psychol Rev. 2012;6(1):1–6.

    Article  Google Scholar 

  102. Proctor E, Luke D, Calhoun A, McMillen C, Brownson R, McCrary S, et al. Sustainability of evidence-based healthcare: research agenda, methodological advances, and infrastructure support. Implement Sci. 2015;10:88.

    Article  PubMed  PubMed Central  Google Scholar 

  103. Schön D. The Reflective Practitioner. New York: Basic Books; 1983.

    Google Scholar 

  104. Argyris C, Schön D. Organizational Learning: A Theory of Action Perspective. Reading: Addison Wesley; 1978.

    Google Scholar 

  105. Ebbevi D, Forsberg HH, Essen A, Ernestam S. Value-based health care for chronic care: aligning outcomes measurement with the patient perspective. Qual Manag Health Care. 2016;25(4):203–12.

    Article  PubMed  PubMed Central  Google Scholar 

  106. Rollow W, Cucchiara P. Achieving value in primary care: the primary care value model. Ann Fam Med. 2016;14(2):159–65.

    Article  PubMed  PubMed Central  Google Scholar 

  107. Tseng EK, Hicks LK. Value based care and patient-centered care: divergent or complementary? Curr Hematol Malig Rep. 2016;11(4):303–10.

    Article  PubMed  Google Scholar 

  108. Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. Ann Fam Med. 2014;12(6):573–6.

    Article  PubMed  PubMed Central  Google Scholar 

  109. Bhandari RP, Feinstein AB, Huestis SE, Krane EJ, Dunn AL, Cohen LL, et al. Pediatric-Collaborative Health Outcomes Information Registry (Peds-CHOIR): a learning health system to guide pediatric pain research and treatment. Pain. 2016;157(9):2033–44.

    Article  PubMed  PubMed Central  Google Scholar 

  110. Peckham A, Rudoler D, Bhatia D, Fakim S, Allin S, Marchildon G. Accountable Care Organizations and the Canadian Context. Rapid Review (No. 9). Toronto: North American Observatory on Health Systems and Policies; 2018.

    Google Scholar 

  111. Canada Health Infoway. Canada Health Infoway Annual Report 2017–2018. Toronto: CHI; 2018.

    Google Scholar 

  112. Chang F, Gupta N. Progress in electronic medical record adoption in Canada. Can Fam Physician. 2015;61:1076–84.

    PubMed Central  Google Scholar 

  113. Noonan VK, Thorogood NP, Joshi PB, Fehlings MG, Craven BC, Linassi G, et al. Meeting the privacy requirements for the development of a multi-centre patient registry in Canada: the Rick Hansen Spinal Cord Injury Registry. Healthc Policy. 2013;8(4):87–99.

    PubMed  PubMed Central  Google Scholar 

  114. Kotecha JA, Manca D, Lambert-Lanning A, Keshavjee K, Drummond N, Godwin M, et al. Ethics and privacy issues of a practice-based surveillance system: need for a national-level institutional research ethics board and consent standards. Can Fam Physician. 2011;57(10):1165–73.

    PubMed  PubMed Central  Google Scholar 

  115. Tamblyn R, McMahon M, Nadigel J, Dunning B, Drake E. Health system transformation through research innovation. Healthcare Papers. 2016;16:8–19.

    Google Scholar 

  116. Canadian Institute for Health Information. Patient-Centred Measurement and Reporting in Canada: Launching the Discussion Toward a Future State. Ottawa: CIHI; 2017.

    Google Scholar 

  117. Farmanova E, Kirvan C, Verma J, Mukerji G, Akunov N, Phillips K, et al. Triple aim in Canada: developing capacity to lead to better health, care and cost. Int J Qual Health Care. 2016;28(6):830–7.

    PubMed  Google Scholar 

  118. Ryan BL, Brown JB, Glazier RH, Hutchison B. Examining primary healthcare performance through a triple aim lens. Healthc Policy. 2016;11(3):19–31.

    PubMed  PubMed Central  Google Scholar 

  119. Institut national d'excellence en santé et en services sociaux. Plan triennal d'activités 2016-2019. Québec: INESSS; 2016.

    Google Scholar 

Download references

Acknowledgements

The authors wish to thank Khalil Moqadem, Jean-Frédéric Levesque and the expert committee on learning health systems chaired by Lise Gauvin for their thoughtful insights and feedback regarding learning health systems and our conceptual framework. We also thank Julien Chevrier for his assistance with literature searches.

Funding

Matthew Menear, Marc-André Blanchette and Olivier Demers-Payette were supported by Health System Impact Fellowships awarded by the Canadian Institutes for Health Research (CIHR) and Fonds de recherche du Québec-Santé (FRQS). CIHR and FRQS had no role in the design of the study, in the collection, analysis and interpretation of data, or in the writing of the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

MM, MAB, ODP and DR all contributed to the conception of the work. All authors participated in the literature searches, interdisciplinary meetings and consultations with experts, and developed the conceptual framework. MM drafted the manuscript and MAB, ODP and DR substantively revised it. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Matthew Menear.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Learning health system case examples. (DOCX 200 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Menear, M., Blanchette, MA., Demers-Payette, O. et al. A framework for value-creating learning health systems. Health Res Policy Sys 17, 79 (2019). https://doi.org/10.1186/s12961-019-0477-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12961-019-0477-3

Keywords