- Open Access
- Open Peer Review
Addressing overuse of health services in health systems: a critical interpretive synthesis
Health Research Policy and Systemsvolume 16, Article number: 48 (2018)
Health systems are increasingly focusing on the issue of ‘overuse’ of health services and how to address it. We developed a framework focused on (1) the rationale and context for health systems prioritising addressing overuse, (2) elements of a comprehensive process and approach to reduce overuse and (3) implementation considerations for addressing overuse.
We conducted a critical interpretive synthesis informed by a stakeholder-engagement process. The synthesis identified relevant empirical and non-empirical articles about system-level overuse. Two reviewers independently screened records, assessed for inclusion and conceptually mapped included articles. From these, we selected a purposive sample, created structured summaries of key findings and thematically synthesised the results.
Our search identified 3545 references, from which we included 251. Most articles (76%; n = 192) were published within 5 years of conducting the review and addressed processes for addressing overuse (63%; n = 158) or political and health system context (60%; n = 151). Besides negative outcomes at the patient, system and global level, there were various contextual factors to addressing service overuse that seem to be key issue drivers. Processes for addressing overuse can be grouped into three elements comprising a comprehensive approach, including (1) approaches to identify overused health services, (2) stakeholder- or patient-led approaches and (3) government-led initiatives. Key implementation considerations include the need to develop ‘buy in’ from stakeholders and citizens.
Health systems want to ensure the use of high-value services to keep citizens healthy and avoid harm. Our synthesis can be used by policy-makers, stakeholders and researchers to understand how the issue has been prioritised, what approaches have been used to address it and implementation considerations.
Systematic review registration
Globally, health systems face the challenge of maximising value for money spent by maintaining or improving healthcare quality and efficiency in the face of shrinking or slow-growing budgets [1, 2]. Challenges in this area can be thought of in relation to underuse of beneficial services, misuse of services that provide benefits in some contexts but not others, and overuse of services [3, 4]. Overuse, and to some extent misuse, is referred to in the literature by many terms such as ‘too much medicine’, ‘low-value care’ , ‘inappropriate use’ , ‘obsolescence’ or ‘unnecessary care’ [5,6,7], but generally refers to “care that can lead to harm and consumes resources without adding value to patients” .
Compared with efforts to increase use of appropriate health services, efforts to address overuse have been minimal. However, increasing attention is being paid to this issue. This is partially attributable to the combination of slow-growing budgets and recognition that the wasteful use of public resources resulting from overuse limits the resources that can be deployed to address underfunded parts of health systems. Various studies have established the magnitude of the issue, finding that approximately a third of all patients (between 20% and 33%, depending on the study), receive treatments or services that the evidence suggests are unnecessary, ineffective or potentially harmful [9,10,11].
There are many examples focused on identifying overuse (e.g. health technology reassessment)  and/or addressing overuse (e.g. Choosing Wisely) . Yet, these initiatives to address overuse have been criticised as fragmented, not fully established, and not always applicable to real-world settings as implementation is difficult and evaluation results are challenging to attain [13, 14]. The limited progress towards addressing overuse is therefore perhaps unsurprising given the complex interplay of the rationale used across differing contexts for addressing overuse, the processes or approaches that could be used to address overuse and the many potential barriers to implementing such approaches. Therefore, the purpose of this study was to develop an in-depth understanding and framework of addressing overuse of health services in health systems. Our guiding objectives were framed based on key domains of policy development, focused on (1) the rationale and context for why overuse is prioritised on policy agendas as an issue to be addressed in health systems; (2) the processes and approaches, programmes and policies that can be or have been used to reduce overuse of health services in health systems; and (3) implementation considerations for addressing overuse at the system level.
We used a critical interpretive synthesis (CIS) approach paired with an integrated knowledge translation approach that included a stakeholder engagement process (a stakeholder dialogue) allowing us to refine and triangulate our findings based on the views and experiences of policy-makers, stakeholders and researchers involved in addressing overuse. Given that our methods are detailed in a peer-reviewed published protocol , we focus here on providing an outline of the key methodological features of CIS and how the stakeholder dialogue contributed to shaping our findings. In brief, a CIS has the core objective of developing a theoretical framework using insights and interpretation drawn from a wide spectrum of relevant empirical and non-empirical sources. Given this, we chose CIS for our methodological approach because it is ideal for questions which draw on literature that is not well developed or focused [16, 17] (as is with this issue), and because of its focus on developing frameworks which draw from a broad range of relevant sources (i.e. not just those that meet particular design or quality criteria).
Our approach adopted methods from traditional systematic reviews (e.g. systematic and transparent database searches and having two reviewers independently review search results) paired with purposive sample and inductive analysis. This included (1) developing a compass question that can evolve (in a transparent way) over the course of the review; (2) iteratively revising inclusion/exclusion criteria to reflect changes in the compass questions; (3) purposively sampling literature outside of the original search parameters to fill conceptual gaps; (4) including empirical and non-empirical documents that offer unique insights; (5) purposively sampling from the eligible articles to focus the analysis on those with the most relevance and insights; and (6) using an iterative approach to analysis of the extracted information from purposive sample articles to derive a framework. Our process therefore began with a broad idea of developing a framework and our process for doing so evolved according to themes identified from the literature and from our stakeholder engagement process.
We employed both an explicit and structured approach to searching and reviewing the indexed literature (similar to traditional systematic reviews) and an inductive approach that is typically associated with CIS. This ensured that the final sample of included papers was theoretically rich and relevant to our objectives. Specifically, we searched (in July 2014 and again in May 2015) 15 databases that index research literature on a diversity of subject domains. The detailed search strategy (Additional file 1) included terms used to describe overuse and efforts to address it (e.g. disinvestment, obsolescence, overuse), contextual terms (e.g. rationing, resource allocation) and limiting terms (e.g. health care, health). These searches were supplemented by a targeted search for literature about Choosing Wisely campaigns, and searches conducted to inform the development of an evidence brief to inform the stakeholder dialogue that we convened (see description below).
Two reviewers independently screened the retrieved titles and abstracts of all articles written in English or Spanish (languages spoken by the team) that focused on addressing overuse at a macro (i.e. national and sub-national) or meso (i.e. regions, organisations or networks) but not micro level (i.e. individual clinicians or teams of clinicians). Two reviewers then assessed the full text of any articles identified as ‘potentially relevant’. Articles were included in the final sample if they were deemed to provide clear insights into one or more of our three objectives. The included articles were conceptually mapped by one reviewer and checked for consistency by another. Any disagreements in categorisation between the reviewers were resolved before proceeding. Each article was identified as being relevant to at least one of our core areas of interest (i.e. context and rationale, processes and implementation) and mapped using frameworks relevant to these areas, which included (1) government agenda-setting (through Kingdon’s framework) ; (2) policy development (through the 3I + E framework derived from political science and relating to institutions, interests, ideas and external factors that affect policy-making) ; and (3) implementation and health system arrangements (through the Health Systems Evidence taxonomy of governance, financial, and delivery arrangements, and implementation strategies) . The specific categories included in each of these frameworks are described in detail in our published protocol .
The project leads (MEE and MGW) used conceptual mapping to select a purposive sample of articles for the final analysis. Our selection of the final sample followed a two-stage approach. Firstly, we included all systematic reviews and articles that we deemed to be conceptually rich, defined as having relevance to two or more of our areas of interest and to two or more of our analytical frameworks (i.e. those that spanned multiple research questions and the policy process stages). Additionally, we purposefully sampled three to five of the most conceptually rich articles from approaches that were the focus in a large number of articles (e.g. Choosing Wisely). Second, we reviewed the full text of remaining articles and included those that (1) explored a process or approach that were not yet captured in the first stage; (2) provided a complementary perspective to an approach or process that was already included; (3) captured a breadth of perspectives across different countries; (4) described evaluations of processes designed to address overuse; (5) integrated many different concepts into one manuscript; and (6) provided perspectives from disciplines outside of health. We prioritised the inclusion of empirical articles whenever possible.
Data extraction for articles included in the purposive sample was conducted by writing a 1–2 paragraph summary of key messages, documenting article characteristics and extracting findings according to variables included in the same frameworks we used to conceptually map articles. We used a constant comparative method for data analysis, which ensured the framework development drew from both the data provided from the research and the collective interdisciplinary skills and experience of the study team.
We supplemented our CIS with a stakeholder-engagement process to refine our understanding of themes emerging from the synthesis and support action from health-system leaders in Canada on the issue. Specifically, we convened a stakeholder dialogue with Canadian policy-makers, stakeholders and researchers who were purposefully selected by the research team based on their ability to bring unique insights to the issues and their ability to champion change following the dialogue (Wilson et al., Addressing Overuse of Health Services in Canada: Findings from a stakeholder dialogue with Canadian health-system leaders, submitted; ). In preparation for the dialogue, we developed an evidence brief that mobilised local and global evidence drawn from (1) our ongoing CIS, (2) searches for evidence relevant to the Canadian context, as well as systematic reviews relevant to the policy options included in the brief, and (3) insight from key informant interviews conducted with health system leaders and researchers in Canada and internationally to refine and triangulate our findings from the CIS.
For the stakeholder dialogue, we convened 19 participants, namely seven policy-makers, two managers, one healthcare professional, five researchers, and four representatives from national health system organisations (one participant from the United States and all others from Canada). The deliberations were thematically summarised in relation to the problem, elements of an approach to address the problem, implementation considerations and next steps. We used the results from the evidence brief and dialogue (Wilson et al., Addressing Overuse of Health Services in Canada: Findings from a stakeholder dialogue with Canadian health-system leaders, submitted; ) to triangulate the core constructs of our framework and to further understand contributing factors.
After duplicate records were removed, we screened 3545 references for eligibility. We excluded 3057 records due to lack of relevance and duplicates, leaving 488 potentially relevant articles (Fig. 1). After full-text review, we included 251 for conceptual mapping, from which we selected a purposive sample of 124 articles. In Additional file 2, we provide a list of the articles excluded during full-text review, those included for conceptual mapping, those included and excluded from the purposive sampling and the characteristics of included articles.
Most articles included in the conceptual mapping (76%; n = 192) were published between 2010 and 2015 (Table 1). The majority of articles addressed a process for addressing overuse (i.e. programmes and policies) (63%; n = 158) or political and health system context (60%; n = 151), followed by agenda-setting and prioritisation (27%; n = 67), implementation considerations (25%; n = 63), rationale (24%; n = 61) and policy development (17.5%; n = 44). Nearly all articles (94%; n = 235) had a specific country or region of focus, and usually only one country in each article (85%; n = 213), although a few had global focus (6%; n = 16). Additionally, nearly all articles focused on high-income countries (98%; n = 245).
Framework for addressing overuse of health services
The core constructs of our framework were supported by our analysis and through the stakeholder engagement process. We depict the core elements of the framework in Fig. 2 and describe the contributing factors related to each of the three constructs below.
Rationale and context for why overuse is prioritised to be addressed in health systems
Issues are typically prioritised for attention on government agendas through the emergence of a compelling problem or political factors . A variety of framings of the problem contributed to overuse gaining increased attention, which is driven by a range of contextual factors. We found that the problem is framed in relation to negative outcomes at the patient, system and global level. At the patient level, the problem of overuse can manifest as patient harms and/or low-quality care. For example, in the area of prescription medications, despite studies demonstrating high risks associated with prolonged use, there is substantial overuse of benzodiazepines among older adults, which can lead to higher rates of motor vehicle accidents, falls and hip fractures, potentially leading to hospitalisation and death [23, 24]. In addition, the use of low-value tests in low-risk populations can lead to false-positive results, and further unnecessary investigations exposing patients to harms such as side effects or interactions with other medications.
When magnified at the system level, overuse accounts for up to a third of patients receiving ineffective or harmful care [9,10,11]. This contributes to significant system-level fiscal constraints that can limit the scope of policy levers that policy-makers can use to strengthen health systems. In particular, they may have to forgo investments in underfunded parts of the system that could provide beneficial services and drugs . Lastly, overuse can lead to far-reaching negative outcomes at the global level (e.g. antibiotic overuse leading to antimicrobial resistance, which affects every country) .
We also identified four groupings of contextual factors that drive the issue, namely (1) culture at the societal, clinician and patient levels; (2) lack of agreement on framing or terminology to describe the issue; (3) health-system arrangements; and (4) a lack of evidence regarding optimal approaches to addressing overuse.
In Table 2, we outline the societal, clinician and patient factors, all of which can play a role in contributing to overuse of health services. At the societal level, the ideas that ‘more is better’  and ‘new is better’  are further entrenched by overall market forces creating increased demand for products, and which often exist without any counteracting force [29, 30]. At the clinician level, there is a prevailing culture of thoroughness [31, 32], fear of litigation and accusation of medical malpractice, fuelling overuse [28, 32]. There can also be a lack of awareness by some providers that they overuse health services, and blame-shifting to providers working in different specialties . Underpinning these factors are the difficulties encountered when changing established ways of providing care [28, 33]. Patient-level factors are also intertwined with the prevailing societal culture of ‘more is better’ and they may demand unnecessary treatments, which may be supported by poor health literacy and/or opportunities for meaningful engagement in their care to make informed judgments [9, 32]. Perhaps as a corollary, there can be a feeling that providers are ‘better’ if they do more .
The framing of efforts to address overuse also contributes to the problem and can lead to inertia among groups needing to take action. For example, the language of discontinuing and disinvesting, and the associated cost savings implied by these terms, may resonate with organisations and governments. In contrast, clinicians may react negatively to these terms believing infringement on their autonomy and ability to determine appropriateness of care for their patients. Patients may also equate these terms with their care being rationed, even when a service is replaced by a new one of similar value . Finally, depending on the political culture, politicians may want to avoid using these terms given the potential to be seen as reducing benefits for their constituents.
As outlined in Table 3, our analysis also points to overuse being driven by a complex interplay of system-level factors. At the delivery level, limited training or preparation of clinicians to addressing overuse , the minimal time that clinicians have with patients , a lack of awareness of recent evidence, fragmented delivery of services across the system that contributes to inefficient delivery of care  and co-dependence of service delivery, contribute to the problem . Similarly, many aspects of financial arrangements in health systems, such as financing systems, remunerating providers , and purchasing products and services , can drive overuse. Governance arrangements can contribute to overuse when there is a lack of role clarity, such as when physicians do not see themselves as resource stewards and therefore do not consider or discuss the financial implications of ordering various services with patients .
Finally, while numerous initiatives exist to address overuse (as outlined in the next section), there has been criticism that they are fragmented [14, 40, 41] and that the evidence available to inform decisions is minimally helpful or non-existent [42,43,44]. This has pointed to a need to address the issue in real-world settings, as opposed to controlled, purely academic studies. Additionally, initiatives to address overuse have not been well evaluated, with much of the literature emphasising that implementing them is difficult and that the intended impacts of reducing overuse are hard to achieve [40, 41, 45].
Processes and approaches to addressing overuse
We identified three elements of a potentially comprehensive approach to address the issue of overuse of health services, namely (1) transdisciplinary approaches to identify health services that are overused, (2) health-system stakeholder-led initiatives to address overuse and (3) government-led initiatives to address overuse. While these three processes are presented separately below, a comprehensive approach (Fig. 2) likely lies in synergistic efforts between stakeholders and governments to identify overuse and subsequently undertake collaborative efforts to address it.
In Table 4, we provide an overview of each element, the processes/components that the elements could include and examples. While it was beyond the scope of this synthesis to provide a comprehensive review of the evidence about the benefits, harms and costs of these processes, since many are comprised of large bodies of research, we provide a high-level overview of the evidence in our evidence brief  and in a separate publication (Wilson et al., Addressing Overuse of Health Services in Canada: Findings from a stakeholder dialogue with Canadian health-system leaders, submitted).
Transdisciplinary approaches to identify overused health services could draw on processes to (1) use the best available data, research evidence and guidelines; (2) conduct jurisdictional scans to identify services that have been overused in other health systems, and determine whether those services are being used locally; and (3) engage stakeholders and consumers to identify services that should be prioritised for full or partial de-implementation. We identified several examples, including NICE’s “do not do” recommendations ; the use of systematic reviews (e.g. Cochrane reviews)  or practice variation studies [46, 47]; conducting health technology assessments (or reassessments) [12, 48]; and programme budgeting and marginal analysis [49,50,51].
Once areas of overuse have been identified, two different approaches can be pursued separately or in tandem. The first approach is focused on stakeholder-led/bottom-up initiatives (many of which could be implemented in collaboration with governments) drawing on processes for (1) fostering better communication and shared decision-making between providers and patients based on evidence-based recommendations [52, 53]; (2) changing provider behaviour to address overuse [54,55,56,57]; (3) educating patients/citizens about needed health services [58,59,60]; and (4) developing mass-media campaigns to raise awareness on the issue [61,62,63]. The Choosing Wisely campaign, which targets clinicians, patients and other stakeholders in an effort to raise awareness about and support behaviour change to address overuse, is a notable example of a stakeholder-led approach given its prominence in the literature and because it has adopted several of these processes . Yet, the evidence about the impact of Choosing Wisely and other initiatives is limited.
Supporting behaviour change among clinicians is also important (Wilson et al., Addressing Overuse of Health Services in Canada: Findings from a stakeholder dialogue with Canadian health-system leaders, submitted; ). Such processes must first identify or diagnose the behaviours that need to change to address overuse through systematic/structured  or iterative/theory-based approaches (e.g. by using the Behaviour Change Wheel) [65, 66]. This step is essential to selecting the types of strategies that can support behaviour change and iteratively refine and tailor them to ensure they are combined to maximise impact .
The second approach, government-led/top-down, could draw on four types of processes, namely (1) revising lists of publicly financed products and services; (2) modifying remuneration for providers or incentivising consumers to prioritise the use of some products and services over others; (3) requiring prior authorisation for use of specific health services that are identified on a list of overused services; and (4) engaging stakeholders and consumers in decision-making processes. As with the stakeholder-led approaches, these could similarly be developed and implemented in collaboration with stakeholders as part of a comprehensive approach.
Numerous barriers were identified at the patient/citizen, clinician, organisation and health-system levels (Table 5). These include barriers at the level of the patient (e.g. the constant access to a plethora of information can be confusing and may fuel demand for unnecessary services) , citizens (e.g. they may view such approaches as rationing services, which may be politically unpalatable) , clinicians (e.g. they may resist interventions that they view as an encroachment on their autonomy and ability to generate income) [28, 69, 70], organisation (e.g. they may have competing interests, limiting willingness and/or ability to engage in collaborative approaches)  and systems (e.g. a lack of stakeholder awareness or political will) [34, 71].
Insights from the stakeholder dialogue
As stated above, our framework is based not only on findings from the literature, but also from a stakeholder dialogue convened with 19 health-system leaders in Canada, which we report on in detail elsewhere (Wilson et al., Addressing Overuse of Health Services in Canada: Findings from a stakeholder dialogue with Canadian health-system leaders, submitted; ). It is worth noting that dialogue participants emphasised particular components of the framework. For example, in relation to the challenges associated with addressing overuse, participants (which were provided a rationale and context for addressing it) emphasised the lack of common terminology that prevents a shared understanding of the issue, the complex and interrelated causes of overuse which make it challenging to comprehensively address, as well as differing political and system contexts that further complicate coordinated efforts to address overuse across Canada. In deliberating about approaches to address overuse, participants consistently identified the need for leaders to take ownership of the issues and to coordinate comprehensive efforts that include transdisciplinary approaches to identify and diagnose overuse combined with both stakeholder- and government-led efforts to address it. Finally, in terms of moving forward with actions to address overuse, participants emphasised the need for enhanced efforts to collect and share data and fostering synergistic efforts in ways to build a sustained commitment among stakeholders and policy-makers to address overuse.
Addressing the overuse of health services is a health-system issue that has gained increasing traction with policy-makers and stakeholders over the past decade. As our CIS emphasises, health service overuse is a complex issue. Numerous initiatives have been identified in different countries focusing on identifying and reducing common areas of overuse, yet they have not been well evaluated. Implementation is difficult and results are hard to identify and achieve. While numerous barriers exist, the biggest barrier may be the complex interplay between the societal culture of ‘more is better, ’ the competing priorities among different actors in the system, and the willingness of policy-makers to make politically difficult decisions.
This synthesis makes a significant contribution to the knowledge base on overuse and expands upon other work on the issue. Other reviews have had somewhat of a narrower focus (e.g. focusing on one element of the broader issue), while our synthesis tackles the broader issue of overuse [43, 72, 73]. Furthermore, while there are recent overviews of drivers of overuse, policy approaches and change levers which may address overuse [74, 75], our process was more comprehensive and grounded in an approach that paired a thorough and robust synthesis with a stakeholder-engagement process.
Several key implications can be derived from our analysis. Firstly, while addressing overuse is complex, there is much interest in its many components, including reducing patient harm and improving quality of care and health system efficiency. Given this, it seems to be an opportune time for health system stakeholders to capitalise on this interest and comprehensively address overuse. Secondly, addressing overuse will likely be most successful by combining transdisciplinary, systematic and transparent aspects to determine what is driving overuse and coordinating efforts from stakeholders and governments to address overuse. The replicative nature of current initiatives, originating from different parts of the health system but having the same overall goal, is redundant. A comprehensive, system-wide approach that is coordinated between relevant stakeholders should be the norm. Such synergistic efforts were emphasised during the stakeholder dialogue (Wilson et al., Addressing Overuse of Health Services in Canada: Findings from a stakeholder dialogue with Canadian health-system leaders, submitted; ). While our findings indicate that numerous initiatives have been implemented, there are limited evaluations of their impact, making it difficult to determine what works in different health and political system contexts. As such, more attention needs to be given to studying the impact of approaches to addressing overuse. This likely requires a commitment of policy-makers to ensure monitoring and evaluation is included as part of any system-level responses. Such commitment and investment will not only support efforts to address overuse, but will make possible policy responses that can be continually refined and optimised over time.
Finally, given that decisions to address overuse ultimately affect the types and quality of care received by patients, it will be important to engage them to address overuse. This could include greater involvement in clinical decision-making or broader citizen engagement to identify values and preferences for directions to take at a system level.
A key strength of this synthesis is that we used methodologies similar to those employed by systematic reviews to identify and select the articles, as well as purposive sampling of the literature to fill conceptual gaps and an iterative approach to the analysis. Thus, our analysis included insights from both empirical and non-empirical literature, which often provides helpful insights for complex policy questions. Furthermore, pairing our synthesis with stakeholder engagement allowed us to ‘road test’ and triangulate many concepts.
Some potential limitations are worth noting. As this is not a traditional systematic review but resembles more of a qualitative analysis, it could be viewed by some as being a subjective rather than objective assessment of the literature. However, we ensured that our process was systematic, transparent, robust and aligned with other examples of CISs by having at least two researchers independently conduct each stage and validating our findings through key informant interviews. Another potential limitation is that, given the prominence of overuse in the literature in the last several years, new articles are constantly being published (although this is not unique to our review). We attempted to address this by monitoring key sources for literature (e.g. through relevant listservs), updating our search, and including findings from the evidence brief that we produced after the final set of searches.
Our work can be utilised by policy-makers, stakeholders and researchers to gain insight about the prioritisation of overuse and the structure and implementation of initiatives used to address it. These approaches can support stakeholders to address overuse and improve health system effectiveness and efficiency. Moreover, our findings point to the need to foster comprehensive approaches to address overuse, including coordinated efforts among many stakeholders (including citizens and patients) to identify and determine what is driving overuse, identify the types of actions that are needed to address it, and evaluate the impacts of such approaches. Without such comprehensive approaches, overuse of health services will remain a significant issue and continue to strain health systems and limit policy-makers’ ability to invest in areas that remain underserved.
Critical interpretive synthesis
Rich G. Shrinking budgets, improving care: Simplify processes and engage with patients. BMJ. 2010;340:c1251.
Zalmanovitch Y, Vashdi DR. Shrinking budgets, improving care: Trade-offs are unavoidable. BMJ. 2010;340:c1259.
Chassin MR, Galvin RW. The urgent need to improve health care quality. Institute of Medicine National Roundtable on Health Care Quality. JAMA. 1998;280:1000–5.
Bhatia RS, Levinson W, Lee DS. Low value cardiac testing and Choosing Wisely. BMJ Qual Saf. 2015;24(2):89–91.
Elshaug AG. Building the Evidence Base for Disinvestment from Ineffective Health Care Practices: A Case Study in Obstructive Sleep Apnoea Syndrome. Thesis (PhD). Adelaide: University of Adelaide, School of Population Health and Clinical Practice; 2007.
Garner S, Docherty M, Somner J, Sharma T, Choudhury M, Clarke M, et al. Reducing ineffective practice: Challenges in identifying low-value health care using Cochrane systematic reviews. J Health Serv Res Policy. 2013;18:6–12.
Moynihan R. Too much medicine? Almost certainly. BMJ. 2002;324:859–60.
Levinson W, Kallewaard M, Bhatia RS, Wolfson D, Shortt S, Kerr EA, et al. ‘Choosing Wisely’: A growing international campaign. BMJ Qual Saf. 2015;24:167–74.
Cassell CK, Guest JA. Choosing wisely: Helping physicians and patients make smart decisions about their care. J Am Med Assoc. 2012;307:1801–2.
Grol R. Successes and failures in the implementation of evidence-based guidelines for clinical practice. Med Care. 2001;39:II46–54.
Smith M, Saunders R, Stuckhart L, JM MG. In: Institute of Medicine, editor. Best Care at Lower Cost: The Path to Continuously Learning Health Care in America. Washington, DC: National Academies Press; 2012.
Noseworthy T, Clement F. Health technology reassessment: Scope, methodology, & language. Int J Technol Assess Health Care. 2012;28:201–2.
Leggett L, Noseworthy TW, Zarrabi M, Lorenzetti D, Sutherland LR, Clement FM. Health technology reassessment of non-drug technologies: Current practices. Int J Technol Assess Health Care. 2012;28:220–7.
Colla CH, Morden NE, Sequist TD, Schpero WL, Rosenthal MB. Choosing wisely: Prevalence and correlates of low-value health care services in the United States. J Gen Intern Med. 2015;30:221–8.
Wilson MG, Ellen ME, Lavis JN, Grimshaw JM, Moat KA, Shemer J, et al. Processes, contexts and rationale for disinvestment: A protocol for a critical interpretive synthesis. Syst Rev. 2014;3:143.
Dixon-Woods M, Cavers D, Agarwal S, Annandale E, Arthur A, Harvey J, et al. Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups. BMC Med Res Methodol. 2006;6:35.
Boyko JA, Lavis JN, Abelson J, Dobbins M, Carter N. Deliberative dialogues as a mechanism for knowledge translation and exchange in health systems decision-making. Soc Sci Med. 2012;75:1938–45.
Wilson MG, Lavis JN. Dialogue Summary: Addressing Overuse of Health Services in Canada. Hamilton: McMaster Health Forum; 2015.
Lazar H, Forest PG, Lavis JN, Church J. Paradigm Freeze: Why It Is So Hard to Reform Health Care in Canada? Kingston and Montreal: McGill-Queen’s University Press; 2014.
Lavis JN, Wilson MG, Moat KA, Hammill AC, Boyko JA, Grimshaw JM, et al. Developing and refining the methods for a one-stop shop for research evidence about health systems. Health Res Policy Syst. 2015;13:1.
Ellen ME, Wilson MG, Grimshaw JM, Lavis JN. Evidence Brief: Addressing Overuse of Health Services in Canada. Hamilton: McMaster Health Forum; 2015. https://www.mcmasterforum.org/docs/default-source/product-documents/evidence-briefs/overuse-health-services-in-canada-eb.pdf?sfvrsn=2. Accessed 23 May 2018.
Kingdon JW. Agendas, Alternatives and Public Policies (Longman Classics Edition), Second Edition edn. New York: Addison-Wesley Educational Publishers Inc.; 2010.
Bashir K, King M, Ashworth M. Controlled evaluation of brief intervention by general practitioners to reduce chronic use of benzodiazepines. Br J Gen Pract. 1994;44:408–12.
Cumming RG, Le Conteur DG. Benzodiazepines and risk of hip fractures in older people. CNS Drugs. 2003;17:825–37.
Elshaug AG, Moss JR, Lttlejohns P, Karnon J, Merlin TL, Hiller JE. Identifying existing health care services that do not provide value for money. Med J Aust. 2009;190:269–73.
Shallcross LJ, Davies DS. Antibiotic overuse: A key driver of antimicrobial resistance. Br J Gen Pract. 2014;64:604–5.
Colla CH. Swimming against the current-what might work to reduce low-value care? N Engl J Med. 2014;371:1280–3.
Scott IA, Elshaug AG. Foregoing low-value care: How much evidence is needed to change beliefs? Intern Med J. 2013;43:107–9.
Prasad V, Ioannidis JP. Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices. Implement Sci. 2014;9:1.
Elshaug AG, Bessen T, Moss JR, Hiller JE. Addressing “waste” in diagnostic imaging: Some implications of comparative effectiveness research. J Am Coll Radiol. 2010;7:603–13.
Emanuel EJ, Fuchs VR. The perfect storm of overutilization. JAMA. 2008;299:2789–91.
Perry Undem Research/Communication. Unnecessary Tests and Procedures In the Health Care System: What Physicians Say About The Problem, the Causes, and the Solutions. Philadelphia: The ABIM Foundation; 2014.
Banta HD, Thacker SB. The case for reassessment of health-care technology - once is not enough. JAMA. 1990;264:235–40.
Henshall C, Schuller T, Mardhani-Bayne L. Using health technology assessment to support optimal use of technologies in current practice: The challenge of “disinvestment”. Int J Technol Assess Health Care. 2012;28:203–10.
Gravel K, Légaré F, Graham I. Barriers and facilitators to implementing shared decision-making in clinical practice: A systematic review of health professionals’ perceptions. Implement Sci. 2006;1:16.
Blumenthal-Barby JS. “Choosing wisely” to reduce low-value care: A conceptual and ethical analysis. J Med Philos. 2013;38:559–80.
Robinson S, Glasby J, Allen K. ‘It ain’t what you do it’s the way that you do it’: Lessons for health care from decommissioning of older people’s services. Health Soc Care Commun. 2013;21:614–22.
Fendrick AM, Smith DG, Chernew ME. Applying value-based insurance design to low-value health services. Health Aff (Millwood). 2010;29:2017–21.
Reuben DB, Cassel CK. Physician stewardship of health care in an era of finite resources. JAMA. 2011;306:430–1.
Daniels T, Williams I, Robinson S, Spence K. Tackling disinvestment in health care services. The views of resource allocators in the English NHS. J Health Organ Manage. 2013;27:762–80.
Robinson S, Dickinson H, Freeman T, Williams I. Disinvestment in health-the challenges facing general practitioner (GP) commissioners. Public Money Manage. 2011;31:145–8.
Garner S, Littlejohns P. Disinvestment from low value clinical interventions: NICEly done? BMJ. 2011;343:d4519.
Polisena J, Clifford T, Elshaug AG, Mitton C, Russell E, Skidmore B. Case studies that illustrate disinvestment and resource allocation decision-making processes in health care: A systematic review. Int J Technol Assess Health Care. 2013;29:174–84.
Colla CH, Mainor AJ, Hargreaves C, Sequist T, Morden NE. Interventions aimed at reducing use of low-value health services: A systematic review. Med Care Res Rev. 2017;74(5):507–50.
Chamberlain CA, Martin RM, Busby J, Gilbert R, Cahill DJ, Hollingworth W. Trends in procedures for infertility and caesarean sections: Was NICE disinvestment guidance implemented? NICE recommendation reminders. BMC Public Health. 2013;13:112.
Leape LL, Park R, Solomon DH, Chassin MR, Kosecoff J, Brook RH. Does inappropriate use explain small-area variations in the use of health care services? JAMA. 1990;263:669–72.
Chen CL, Lin GA, Bardach NS, Clay TH, Boscardin WJ, Gelb AW, et al. Preoperative medical testing in medicare patients undergoing cataract surgery. N Engl J Med. 2015;372:1530–8.
MacKean G, Noseworthy T, Elshaug AG, Leggett L, Littlejohns P, Berezanski J, et al. Health technology reassessment: The art of the possible. Int J Technol Assess Health Care. 2013;29:418–23.
Mitton C, Dionne F, Donaldson C. Managing healthcare budgets in times of austerity: The role of program budgeting and marginal analysis. Appl Health Econ Health Policy. 2014;12:95–102.
Mitton CR, Donaldson C. Setting priorities and allocating resources in health regions: Lessons from a project evaluating program budgeting and marginal analysis (PBMA). Health Policy. 2003;64:335–48.
Mortimer D. Reorienting programme budgeting and marginal analysis (PBMA) towards disinvestment. BMC Health Serv Res. 2010;10:288.
Légaré F, Turcotte S, Stacey D, Ratté S, Kryworuchko J, Grahaim I. Patients’ perceptions of sharing in decisions: A systematic review of interventions to enhance shared decision making in routine clinical practice. Patient. 2012;5:1–19.
Durand MA, Carpenter L, Dolan H, Bravo P, Mann M, Bunn F, et al. Do interventions designed to support shared decision-making reduce health inequalities? A systematic review and meta-analysis. PLoS One. 2014;9:e94670.
Giguère A, Légaré F, Grimshaw J, Turcotte S, Fiander M, Grudniewicz A, et al. Printed educational materials: Effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2012;10:CD004398.
Forsetlund L, Bjørndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf F, Davis D, Odgaard-Jensen J, Oxman AD. Continuing education meetings and workshops: Effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2009;15(2):CD003030.
O’Brien MA, Rogers S, Jamtvedt G, Oxman AD, Odgaard-Jensen J, Kristoffersen DT, et al. Educational outreach visits: Effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2007;(4):CD000409. https://doi.org/10.1002/14651858.CD000409.pub2.
Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: Effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;(6):CD000259.
Edwards AGK, Evans R, Dundon J, Haigh S, Hood K, Elwyn GJ. Personalised risk communication for informed decision making about taking screening tests. Cochrane Database Syst Rev. 2006;(2):CD001865.
Smerecnik CM, Mesters I, Verweij E, de Vries NK, De VH. A systematic review of the impact of genetic counseling on risk perception accuracy. J Genet Couns. 2009;18:217–28.
Stacey D, Légaré F, Lewis K, Barry MJ, Bennett CL, Eden KB, Holmes-Rovner M, Llewellyn-Thomas H, Lyddiatt A, Thomson R, Trevena L. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2017;(4):CD001431.
Grilli R, Ramsay C, Minozzi S. Mass media interventions: Effects on health services utilisation. Cochrane Database Syst Rev. 2002;(1):CD000389. https://doi.org/10.1002/14651858.CD000389.
Maher CA, Lewis LK, Ferrar K, Marshall S, De Bourdeaughuij I, Vandelanotte C. Are health behavior change interventions that use online social networks effective? A systematic review. J Med Internet Res. 2014;16:e40.
LaCroix JM, Snyder LB, Huedo-Medina TB, Johnson BT. Effectiveness of mass media interventions for HIV prevention, 1986–2013: A meta-analysis. J Acquir Immune Defic Syndr. 2014;66:S329–40.
Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, et al. A checklist for identifying determinants of practice: A systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013;8:35.
Michie S, van Stralen M, West R. The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42.
French S, Green S, O’Connor D, McKenzie J, Francis J, Michie S, et al. Developing theory-informed behaviour change interventions to implement evidence into practice: A systematic approach using the Theoretical Domains Framework. Implement Sci. 2012;7:38.
Grimshaw J, Eccles M, Lavis J, Hill S, Squires J. Knowledge translation of research findings. Implement Sci. 2012;7:50.
Ahmad F, Hudak PL, Bercovitz K, Hollenberg E, Levinson W. Are physicians ready for patients with Internet-based health information? J Med Internet Res. 2006;8(3):e22.
Gerdvilaite J, Nachtnebel A. Disinvestment. Overview of disinvestment experiences and challenges in selected countries. Wien: Ludwig Boltzmann Institut fu¨r Health TechnologyAssessment; 2011. http://eprints.hta.lbg.ac.at/926/#. Accessed 23 May 2018.
PerryUndem Research/Communication. Unnecessary Tests and Procedures In the Health Care System. Philadelphia: ABIM Foundation; 2014.
Donaldson C, Bate A, Mitton C, Dionne F, Ruta D. Rational disinvestment. QJM. 2010;103:801–7.
Morgan DJ, Dhruva SS, Wright SM, Korenstein D. 2016 Update on medical overuse: A systematic review. JAMA Intern Med. 2016;176:1687–92.
Keyhani S, Falk R, Howell EA, Bishop T, Korenstein D. Overuse and systems of care: A systematic review. Med Care. 2013;51(6):503–8.
Elshaug AG, Rosenthal MB, Lavis JN, Brownlee S, Schmidt H, Nagpal S, et al. Levers for addressing medical underuse and overuse: Achieving high-value health care. Lancet. 2017;390(10090):191–202.
Saini V, Garcia-Armesto S, Klemperer D, Paris V, Elshaug AG, Brownlee S, et al. Drivers of poor medical care. Lancet. 2017;390(10090):178–90.
Haas M, Hall J, Viney R, Gallego G. Breaking up is hard to do: Why disinvestment in medical technology is harder than investment. Aust Health Rev. 2012;36:148.
Ibargoyen-Roteta N, Gutierrez-Ibarluzea I, Asua J, Benguria-Arrate G, Galnares-Cordero L. Scanning the horizon of obsolete technologies: Possible sources for their identification. Int J Technol Assess Health Care. 2009;25:259–4.
Mayer J, Nachtnebel A. Identifying ineffective interventions and health technologies: models and their implementation. Wien: Ludwig Boltzmann Institut für Health Technology Assessment; 2013. http://eprints.hta.lbg.ac.at/1014/1/HTA-Projektbericht_Nr.68.pdf. Accessed 23 May 2018.
Wolfson D, Santa J, Slass L. Engaging physicians and consumers in conversations about treatment overuse and waste: A short history of the Choosing Wisely campaign. Acad Med. 2014;89:990–5.
Cadogan SL, Browne JP, Bradley CP, Cahill MR. The effectiveness of interventions to improve laboratory requesting patterns among primary care physicians: A systematic review. Implement Sci. 2015;10:167.
Tannenbaum C, Martin P, Tamblyn R, Benedetti A, Ahmed S. Reduction of inappropriate benzodiazepine prescriptions among older adults through direct patient education: The EMPOWER cluster randomized trial. JAMA Intern Med. 2014;174:890–8.
Gonzales R, Corbett KK, Wong S, Glazner JE, Deas A, Leeman-Castillo B, et al. “Get smart Colorado”: Impact of a mass media campaign to improve community antibiotic use. Med Care. 2008;46:597–605.
Bernal-Delgado E, Campillo-Artero C, Garcia-Armesto S. Health services supply and the economic crisis: either we fund goods and services according to their value or we become bankrupt. SESPAS report 2014. [in Spanish]. Gac Sanit. 2014;28(Suppl 1):69–74.
Volpp KG, Loewenstein G, Asch DA. Choosing Wisely: Low-value services, utilization, and patient cost sharing. JAMA. 2012;308:1635–6.
Ginsburg M. Value-based insurance design: consumers' views on paying more for high-cost, low-value care. Health Affairs. 2010;29(11):2022–6.
We would also like to acknowledge members of the Polinomics review group in the Centre for Health Economics and Policy Analysis at McMaster University for their thoughtful feedback on an earlier version of this manuscript.
The synthesis working group members include Sarah Garner, Roberto Grilli, Justin Peffer, Kevin Samra, Joshua Shemer and Terry Sullivan.
This project has been funded by the Canadian Institutes of Health Research through a Knowledge Synthesis Grant (grant number 315602). The funder had no role in the design of the study and collection, analysis, and interpretation of data or in writing the manuscript.
Availability of data and materials
All data generated or analysed during this study are included in this published article and its supplementary information files.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.