Skip to main content

Do clinical guidelines reduce clinician dependent costs?

Abstract

Clinician dependent costs are the costs of care that are under the discretion of the healthcare provider. These costs include the costs of drugs, tests and investigations, and discretionary outpatient visits and impatient stays. The purpose of this review was to summarize recent evidence, relevant to both developed and developing countries on whether evidence based clinical guidelines can change hospitals variable costs which are clinician dependent, and the degree of financial savings achieved at hospital level. Potential studies for inclusion were identified using structured searches of Econlit, J-Stor, and Pubmed databases. Two reviewers independently evaluated retrieved studies for inclusion. The methodological quality of the selected articles was assessed using the Oxford Centre for Evidence- Based Medicine (CEBM) levels of evidence. The results suggest that 10 of the 11 interventions were successful reducing financial costs. Most of the interventions, either in modeling studies or real interventions generate significant financial saving, although the former reported higher savings because the studies assumed 100 percent compliance.

Peer Review reports

Introduction

Globally, health care expenditures have increased tremendously in the last decade raising concerns over their sustainability[1–4]and value for money. This increased investment is being made by both households and governments and represents a potential pool of resources that could be used elsewhere in the economy[2, 4]. Such an increase in expenditure if resulting in improved health status would appear to be justified. However, there are concerns that extra spending on health is not yielding the anticipated health returns[1, 5, 6]. Therefore, there is an increasing interest in maximizing the efficiency of health care spending while at the same time increasing the effectiveness of service provision. One commonly used approach to improving the effectiveness of health care is to develop guidelines for the health care workers based on the best available evidence of what works[7–9]. Often such guidelines aim to improve outcomes through use of optimal treatment approaches and to reduce or limit costs by therapies or procedures. The degree to which guidelines work to change practices depends usually on the extent to which health workers change their behaviour in response to the guidelines as suggested in the Grimshaw 2004 review[7].

The cost consequence of such interventions has received less attention in the literature. The degree to which costs can be expected to change in response to clinical guideline adoption will depend on both the responsiveness of health worker behaviour, and on the share of patient costs that are attributable to decisions made by health workers. We have coined the term "clinician-dependent costs"to describe the costs of care that are under the discretion of the healthcare provider. These costs include the costs of drugs, tests and investigations, and discretionary outpatient visits and inpatient stays. Changes in CDCs may arise from interventions such as clinical guidelines that aim to alter health workers use of available resources. We are therefore interested in examining the evidence that supports or refutes the proposition that CDCs can be altered by interventions aimed at changing health worker practices.

Methods

This review aimed to address the question of whether and to what degree could interventions change costs that are clinician dependent. The particular focus was on studies reporting interventions designed to act through clinicians' behaviour change. We did not include studies describing the modeled difference in costs of care after assuming one drug or combination of drugs were substituted by an alternative drug or combination of drugs of equal or varying efficacy. Similarly we did not include studies that reported the cost-difference (or cost effectiveness difference) between alternative drug regimens whose efficacy was being compared in randomized controlled trials. Rather the focus was on interventions that aimed at influencing the clinician to follow a recommended process or procedure expected to influence CDCs. In this case the effect on costs was influenced by both the actual cost of the resources used and the degree to which the clinician opts to follow the advised procedures. Specifically this paper examines the degree of financial savings attributed to the interventions identified together with the resultant magnitude expressed as the proportionate reduction in total or consumable costs.

Potential studies for inclusion were identified by direct searches of the online databases such as; PubMed, J-Stor and Econlit and the grey literature to ensure a comprehensive literature review. The grey literature was sought at several libraries including those of the Kenya Medical Research Institute, Kenya Institute for Public Policy Research and Analysis, Institute of Policy Analysis and Research and the African Population and Health Research Center, Searches were also conducted through the websites of: The World bank, Department for International Development, United States Agency for International Development, Policy Project- Kenya, Health Policy Initiative and German Agency for Technical Co-operation (GTZ). Literature retrieved for the period 1995 to 2010 using the following combination of search terms:

â–  Clinical guidelines and cost savings

â–  Clinical prescribing behaviour and costs

â–  Costs, decision making and prescribing variation

â–  Prescription behaviour and costs

â–  Prescribing behaviour and financial/costs savings

The titles and abstracts of the retrieved articles were read by two independent reviewers and those that met the pre-inclusion criteria were selected (Additional file 1, Tables S1 and S2). The methodological quality of the selected articles describing interventions was assessed using the Oxford Centre for Evidence Based Medicine (CEBM) levels of evidence, which rank the validity of evidence in a hierarchy of levels, with systematic reviews as level 1 (strong evidence) and expert opinions as level 5 (weak evidence)[10] (Additional file 1, Table S3).

Results

The search terms used provided the following hits in PubMed, J-Stor and Econlit. In total 874 titles were screened, with 67 papers being reviewed. On reviewing these articles only 16 were considered for this structured review because they were truly related to our study question. The papers are described in Tables 1, 2 and 3 and in Additional file 1; Tables S1 and S2. Four studies report on models reflecting the anticipated effects of an intervention only ("modeling studies"). Eleven report the results of true intervention studies ("intervention studies") we present and discuss all of these studies.

Table 1 Modeling studies
Table 2 Intervention studies (Change in cost due to change in actual guidelines)
Table 3 Intervention studies (Change in costs due to moving from incorrect to correct management)

Study context and design

This review included a total of 15 studies, 4 being modeling studies and 11 being intervention studies. Intervention studies included examined changes in CDCs after implementation of an intervention aimed at changing clinician prescribing behaviour and are the main focus of this report. Study setting varied with 10 of 11 intervention studies conducted in high income countries and only one in low income setting[11]. All of the modeling studies (4) were conducted in low income countries[12–15] (see Table 1).

The study designs of intervention studies included comparative before and after studies[16–21], randomized trials[11, 22] a comparative study (with a non-random allocation of study units)[23, 24], and cluster randomized trials[25, 26]. Of these the randomized trials were expected to provide the highest quality data with which to answer the question posed. The modeling studies are based on secondary data and all compared to theoretical scenarios with or without a complete change of clinical practice[12–15].

The level of evidence for economics and decision analysis as provided by the Oxford Centre for Evidence Based Medicine is provided in Additional file 1, Table S3. These criteria were used to evaluate the 11 intervention studies that were included in this structured review. A concise summary for both modeling and intervention studies containing information on study design, setting, intervention, the degree of financial saving attributed to the intervention and level of evidence are provided in Tables 1, 2 and 3 immediately after the main text.

Interventions

The interventions reported by studies included in this structured review varied to a high degree although all interventions aimed at, or modeled changes in clinician behaviour through the use of clinical practice guidelines.

Interventions included: introduction of integrated management of childhood illness (IMCI)[11] clinical guidelines, a multifaceted intervention to improve preventive care delivered by nurses[24], a multidisciplinary clinical pathway for oxygen management[22], a multifaceted intervention to promote early switching from intravenous to oral acetaminophen for post-operative pain[17], introduction of new antibiotic protocols is the treatment of pneumonia[19], an educational intervention to decrease use of selected expensive medications[20], use of clinical pathway designed to manage community acquired pneumonia more efficiently than with conventional therapy[25], use of commercially available prescribing system with integrated clinical decision support and evidence based message capability[23], clinical pathways for patients undergoing total laryngectomy[18], inpatient diabetes management program[16] and evaluation of educational outreach visits by community pharmacists[26] on the effectiveness of guidelines. These interventions aimed at changing clinician behaviour either through training, prompts, feedback, supervision or a combination of this process.

For example, the IMCI intervention study in Tanzania involved an eleven day training period of which 30% of the time was spent on clinical practice with one follow up visit by an IMCI supervisor that occurred one month after training. This intervention changed prescribing behaviour which resulted in lower costs per child for the total resources used in treatment but increased drug costs[11]. In another study of a multifaceted intervention to improve preventive care delivered by nurses, the intervention was in the form of training[24], which covered an orientation session, medical office computer systems, medical practice management, prevention in primary care, evidence based medicine, and facilitator and audit skills development. The intervention was more expensive but more effective than any other attempts to modify primary care practice, since this intervention was targeted at changing the entire practice and not just physician behavior for a number of preventive measures and as a result more time was spent on site and more visits were required[24]. The study further suggests that the results of this study suggests that the results of this study can be considered an underestimate of the true potential costs savings given that not all the costs associated with inappropriate and appropriate preventive care were considered. Moreover, this study was an efficacy trial and as a consequence there is potential for reducing the cost of the intervention through efficiency improvements such as increasing the number of practices per facilitator as well as savings in administration and training through economies of scale. Another example comprises an intervention included in the study on multidisciplinary clinical pathway for oxygen management[22] which involved teaching sessions and individualized audit and feedback about oxygen ordering and monitoring. This intervention changed prescribing and monitoring practices but resulted in greater resource use, arguably improving the quality of care, with individual audit and feedback provided by the research nurse being most instrumental in achieving change[22]. The intervention on promoting early switch from intravenous to oral acetaminophen for postoperative pain included a local consensus process, short educational presentation, posters displayed in all nurses' offices, and feedback of practices six months after implementation of guidelines. This intervention leads to a reduction in irrational prescriptions. The final example of an intervention involved new antibiotic protocols which recommended the use of amoxicillin or erythromycin as a first line therapy for exacerbations of chronic obstructive airways disease (COAD). The protocols were effective because they resulted in significant reduction in costs, attributed to a shorter duration of therapy.

The studies based on modeling behavior change covered topics including: adherence to a practice guideline around malaria microscopy to overcome malaria over diagnosis[12] and appropriate implementation of a set of clinical practice guidelines in the form of the integrated management of childhood illness (IMCI) approach[13–15].

Effectiveness of interventions and Compliance with guidelines

The success of any intervention aimed at altering clinician prescribing depends on compliance which translates to the effectiveness in changing health worker behavior. In a systematic review on effectiveness and efficiency of guideline dissemination and implementation strategies, clinical guidelines were found to result in observed improvements in care and absolute improvements in performance[7]. However, although the review reported significant effects of interventions the standardized mean differences in practice from intervention to control ranged from 0.9 to 6. This represents the magnitude of the change attributed to the intervention, including information on statistical significance. A summary of interventions and standardized mean differences is provided in Table 4 immediately after the main text and the information is obtained from Grimshaw (2004)[7]. In Table 4, standardized mean differences are not provided in some of the columns because there was insufficient data to facilitate its calculation.

Table 4 Effects of clinical guidelines as provided by standardized mean differences

This review further evaluates the success of interventions that are aimed at reducing clinician dependent costs, and thus generate some financial savings to the health system. On this note, interventions as opposed to modeling studies will be considered because they did not assume a high degree of compliance and they were more pragmatic. However, 10 out of the 11 interventions included in this review brought out the desired effect (See Table 5: as suggested by the reported degree of financial savings ranging from 6% to 57%). Only one study did not report any savings, and further suggested that multidisciplinary clinical pathway for oxygen management actually increased the costs of care by utilizing more resources[27]. In addition, an important element that deserves comment is the cost quality trade-off.

Table 5 Degree of Financial savings

Effects on Costs

The effects of interventions on clinician dependent costs, together with the cost areas forming the denominators, are presented in Table 5 immediately after the main text. Several studies have reported the degree of financial savings arising from certain interventions aimed at improving clinicians' prescribing behavior[11–15, 17, 19, 20, 22, 24–26]. The studies which modeled the effect of changing health worker behavior present degrees of financial savings on CDC's limited to drug costs ranging from 26 to 80 percent. On the other hand, 10 of 11 true interventions studies, whose denominations varied from total drug costs to total health systems costs, reported financial savings ranging from 6 to 57 percent. Some studies don't provide clear information on whether they included intervention costs or not making the analysis rather difficult as evident in Table 5. However, in the study on a multidisciplinary clinical pathway for oxygen management an increase in total health systems costs by 116 percent[22] was reported whereas in the study of IMCI in Tanzania although an overall health system cost saving was reported this was despite an increase in drug costs by 61 percent[11].

Discussion

In this section, prominent issues that surface from the reviewed studies are discussed. The variation in the denominator used in the costing approaches has clear implications when interpreting the resultant degree of financial saving. For example, financial savings presented as a percent of total drug costs may suggest a high degree of success of the intervention. However, such savings may be much less significant as financial savings presented as a percent of total health systems costs. The latter would obviously be preferred because it encompasses the total health system consequences as opposed to dealing with only drug costs. Furthermore, total health systems costs will include the marginal cost of the intervention which has implications on the output. We were able to identify only three of 8 studies that included total health systems costs when reporting the net savings. The variation in cost denominator used in currently published work therefore makes it very hard to compare or contrast different interventions and, other than suggesting generally positive results in terms of financial savings, limits the ability of current work to inform policy more generally. In the particular case evaluating the introduction of IMCI guidelines the change in perspective of the analysis, from direct resource cost savings to total health system costs results in a completely different interpretation of the impact of the intervention.

There are several determinants of cost savings which are highlighted in the studies included in this review. Some of these determinants are: minimizing laboratory tests and procedures, increasing diagnostic specificity, generic prescribing, use of cheaper and effective drugs, and increasing local financial responsibility (with the example of joining fund holding practices or primary care groups in a developed country). However, several issues stood out with respect to changing clinician dependent costs.

The "room" or threshold to reduce costs

There is a possibility that studies are only conducted and reported in areas where they already feel that costs are unreasonably high[11, 17, 19, 20, 24, 25], hence making it more likely that their intervention will work. This bias serves to show that clinical guidelines will always reduce costs, whereas there are many other reasons why guidelines may be helpful in improving quality of care. It is imperative that reduction of costs of financial savings should not be the goal of an intervention, rather issues such as quality of care.

The uptake of the clinical guidelines

Modeling studies assume a 100 percent success rate whereas the intervention studies have a success rate of less than 100 percent. This gives intervention studies greater appeal for use in policy making because they use real life scenarios. Furthermore, cost effectiveness studies of various interventions would be desired provided quality of care is not disregarded. In this review, one real intervention study evaluating the multidisciplinary clinical pathway for oxygen management led to an increase in health care costs, but improved the quality of care significantly[22]. Besides, there is possibility that studies are conducted for interventions that people think will generate cost savings leading to the distinct possibility of not only publication bias but research initiation bias.

The cost quality trade-off

Minimization of costs through use of cheap or poor quality resources may compromise health care quality. An optimal balance is required based on cost effectiveness of the particular intervention. It is necessary to compare the costs of an intervention with the effectiveness in order to justify resource use[28].

Conclusions

This review is aimed at establishing the degree of financial saving on clinician dependent costs brought about by clinical guidelines. However, there was relatively little specific literature on the cost consequences of approaches to improving clinical practice despite the broad literature exploring means to change clinician behavior and improve practice. The methodological quality of the selected articles was assessed using the Oxford Centre for Evidence- Based Medicine (CEBM) levels of evidence and in general the quality of studies (summarized in Tables 1,2,3,5 and Additional file 1, Tables S1 and S2) was reasonably high and included several randomized controlled intervention trials. Eleven of the twelve interventions were successful in that they generated some financial savings (Table 5) however there is a possibility of publication bias in this regard plus the possibility that cost analyses are only undertaken if it can reasonably be expected that costs will be reduced. Although studies that involved a purely modeling approach often suggested significant cost reductions, they based these estimates on unrealistic assumptions of compliance or health worker behavior change and are consequently assigned a low level of evidence. These studies are likely to overestimate potential savings (Table 3). This drawback could be addressed by conducting sensitivity analysis with different compliance rates and emphasizing that the results are based on modeling assumptions closest to observed degrees of practice change.

References

  1. Bodenheimer T: High and rising health care costs. Part 1: seeking an explanation. Annals of International Medicine. 2005, 142 (10): 847-54.

    Article  Google Scholar 

  2. Kenya Ro: Kenya National Health Accounts 2001-2002. 2002, Government Printer: Nairobi, M.o. Health, Editor.

    Google Scholar 

  3. Morreim E: Cost containment and the standard medical care. California Law Review. 1987, 75 (5): 1719-1763. 10.2307/3480490.

    Article  PubMed  Google Scholar 

  4. Kenya Ro: Kenya National Health Accounts 2005-06. 2009, Government Printer: Nairobi, M.o. Health, Editor.

    Google Scholar 

  5. Kirigia JME, A Sambo GL, Munguti N, Liambila W: Using data envelopment analysis to measure the technical efficiency of public health centers in Kenya. Journal of Medical Systems. 2004, 28 (2):

  6. Kirigia JME, A Sambo GL: Measurement of Technical Efficiency of Public Hospitals in Kenya: Using Data Envelopment Analysis. Journal of Medical Systems. 2002, 26 (1):

  7. Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technology Assessment, NHS R&D HTA Programme. Edited by: N.H. Service. 2004

    Google Scholar 

  8. Grol R, Dalhuijsen J, Thomas S, Veld C, Rutten G, Mokkink H: Attributes of clinical guidelines that influence use of guidelines in general practice: observational study. British Medical Journal. 1998, 317 (26): 858-861.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. WHO: Hospital care for children: Guidelines for the management of common illnesses with limited resources. 2005, Geneva: World Health Organization

    Google Scholar 

  10. Philips B, Ball C, Sackett D, Badenoch D, Straus S, Haynes B, Dawes M: Levels of evidence and grades of recommendation. 2001, Center for Evidence- Based Medicine: Oxford

    Google Scholar 

  11. Adam T, Manzi F, Schellenberg JA, Mgalula L, De Savigny D, Evans DB: Does the Integrated Management of Childhood Illness cost more than routine care? Results from the United Republic of Tanzania. Bulletin of the World Health Organization. 2005, 81 (12): 886-95.

    Google Scholar 

  12. Zurovac D, Larson BA, Akhwale W, Snow RW: The financial and clinical implications of adult malaria diagnosis using microscopy in Kenya. Tropical Medicine and International Health. 2006, 11 (8): 1185-94. 10.1111/j.1365-3156.2006.01674.x.

    Article  CAS  PubMed  Google Scholar 

  13. Boulanger LL, Lee LA, Odhacha A: Treatment in Kenyan rural health facilities: projected drug costs using the WHO-UNICEF Integrated Management of Childhood Illness (IMCI) guidelines. Bulletin of the World Health Organization. 2004, 81 (12): 886-95.

    Google Scholar 

  14. Kolstad PR, Burnham G, Kalter HD, Kenya-Mugisha N, Black RE: Potential implications of the Integrated Management of Childhood Illness (IMCI) for hospital referaal and pharmaceutical usage in western Uganda. Tropical Medicine and International Health. 1998, 3 (9): 691-9. 10.1046/j.1365-3156.1998.00290.x.

    Article  CAS  PubMed  Google Scholar 

  15. Khan MM, Saha KK, Ahmed S: Adopting Integrated Management of Childhood Illness Module at local level in Bangladesh: Implications for recurrent costs. Journal of Health Population and Nutrition. 2002, 20 (1): 42-50.

    Google Scholar 

  16. Newton CA, Young S: Financial implications of glycemic control: results of an inpatient diabetes management program. Endocrine Practice. 2006, 12 (3):

  17. Ripouteau C, Conort O, Lamas JP, Auleley GR, Hazebroucq G: Effects of multifaceted intervention promoting early switch from intravenous to oral acetaminophen for postoperative pain: controlled, perspective, before and after study. British Medical Journal. 2000, 321:

    Google Scholar 

  18. Hanna E, Schultz S, Doctor D, Vural E, Stern S, Suen J: Development and implementation of a clinical pathway for patients undergoing total laryngectomy. Archives of Otolaryngology- Head & Neck Surgery. 1999, 125: 1247-1251.

    Article  CAS  Google Scholar 

  19. Boyter AC, Davey PG, Hudson SA, Clark RA, Lipworth BJ: Evaluation of an antibiotic prescribing protocol for treatment of acute exacerbations of chronic obstructive airways disease in a hospital respiratory unit. Journal of Antimicrobial Chemotherapy. 1995, 36: 403-409. 10.1093/jac/36.2.403.

    Article  CAS  PubMed  Google Scholar 

  20. Roth EJ, Plastaras TC, Mullin SM, Fillmore J: A simple institutional educational intervention to decrease use of selected expensive medications. Archives of Physical Medicine and Rehabilitation. 2001, 82:

    Google Scholar 

  21. Bharat P, Safiullah A: Effects of an educational outreach campaign (IMPACT) on depression management delivered to general practitioners in one primary care trust. Mental Health in Family Medicine. 2009, 6: 155-62.

    Google Scholar 

  22. Wong C, Visram F, Cook D, Griffith L, Randall J, O'Brien B, Higgins D: Development, dissemination, implementation and evaluation of a clinical pathway for oxygen therapy. Canadian Medical Association Journal. 2000, 162 (1): 29-33.

    CAS  PubMed  PubMed Central  Google Scholar 

  23. McMullin ST, Longergan TP, Rynearson CS: Twelve- month drug cost savings related to use of an electronic prescribing system with integrated decision support in primary care. Journal of Managed Care Pharmacy. 2005, 11 (4):

  24. Hogg W, Baskerville N, Lemelin J: Cost savings associated with improving appropriate and reducing inappropriate preventive care: cost- consequence analysis. BMC Health Services Research. 2005, 5 (1): 20-10.1186/1472-6963-5-20.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Palmer CS, Zhan C, Elixhauser A, Halpern MT, Rance L, Feagan BG, Marrie TJ: Economic assessment of the community acquired pneumonia intervention trial employing levofloxacin. Clinical Therapeutics. 2000, 22 (2):

  26. Watson W, Gunnel D, Peters T, Brookers S, Sharp D: Guidelines and educational outreach visits from community pharmacists to improve prescribing in general practice: a randomised controlled trial. Journal of Health Services Research and Policy. 2001, 6 (4): 2007-213.

    Article  Google Scholar 

  27. Stewart-Brown S, Surender R, Bradlow J, Coulter A, Doll H: The effects of fundholding in general practice on prescribing habits three years after introduction of the scheme. British Medical Journal. 1995, 9 (311): 1543-1547.

    Article  Google Scholar 

  28. Drummond MF, Sculper MJ, Torrence GW, O'Brien BJ, Stoddart GL, ed: Methods for Economic Evaluation of Health Care Programmes. 2005, Oxford University Press: Oxford, 3

Download references

Acknowledgements

This manuscript is published with the permission of Director, Kenya Medical Research Institute.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to George Kosimbei.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

GK was responsible for literature search, selection of specific literature and production of the manuscript. KH was responsible for reviewing the draft manuscript, together with providing valuable comments and contributions. ME assisted in the selection of specific literature and provided significant comments in the development of the manuscript together with the funds which facilitated the production of this manuscript. All the authors read and approved the final manuscript.

Electronic supplementary material

12961_2010_193_MOESM1_ESM.DOC

Additional File 1: Table S1. Levels of evidence for economic and decision analysis as provided by the Oxford Centre for Evidence- Based Medicine Table S2 Summary of studies included in the systematic review (Real interventions) Table S3 Summary of studies included in the systematic review (Modeling studies). (DOC 80 KB)

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Kosimbei, G., Hanson, K. & English, M. Do clinical guidelines reduce clinician dependent costs?. Health Res Policy Sys 9, 24 (2011). https://doi.org/10.1186/1478-4505-9-24

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1478-4505-9-24

Keywords