- Open Access
- Open Peer Review
Systematic review of methods for evaluating healthcare research economic impact
© Yazdizadeh et al; licensee BioMed Central Ltd. 2010
- Received: 24 July 2009
- Accepted: 2 March 2010
- Published: 2 March 2010
The economic benefits of healthcare research require study so that appropriate resources can be allocated to this research, particularly in developing countries. As a first step, we performed a systematic review to identify the methods used to assess the economic impact of healthcare research, and the outcomes.
An electronic search was conducted in relevant databases using a combination of specific keywords. In addition, 21 relevant Web sites were identified.
The initial search yielded 8,416 articles. After studying titles, abstracts, and full texts, 18 articles were included in the analysis. Eleven other reports were found on Web sites. We found that the outcomes assessed as healthcare research payback included direct cost-savings, cost reductions in healthcare delivery systems, benefits from commercial advancement, and outcomes associated with improved health status. Two methods were used to study healthcare research payback: macro-economic studies, which examine the relationship between research studies and economic outcome at the aggregated level, and case studies, which examine specific research projects to assess economic impact.
Our study shows that different methods and outcomes can be used to assess the economic impacts of healthcare research. There is no unique methodological approach for the economic evaluation of such research. In our systematic search we found no research that had evaluated the economic return of research in low and middle income countries. We therefore recommend a consensus on practical guidelines at international level on the basis of more comprehensive methodologies (such as Canadian Academic of Health Science and payback frameworks) in order to build capacity, arrange for necessary informative infrastructures and promote necessary skills for economic evaluation studies.
- Economic Impact
- Economic Benefit
- Healthcare Research
- Mental Health Research
- Healthcare Delivery System
Healthcare research can expand the frontiers of science, save human lives, and improve quality-of-life. One of the most fundamental challenges is the appropriate allocation of public and private funds to this research sector. The 2008 'Global Ministerial Forum on Research for Health' in Mali hosted ministers and representative councils from 59 countries. This forum concluded that each country should allocate 2% of Health Ministry funds to healthcare research . Despite agreement that there is a need to increase funding for healthcare research, it remains difficult to convince governments and the private sector to invest in such research, especially in developing countries, which have limited financial resources. In recent years, investors and researchers have focused on the presumed benefits of healthcare research projects, so it is now necessary for health research systems to consider costs and benefits.
A reduction in healthcare research funding is likely given the current economic crisis, particularly in countries that have previously been unable to allocate sufficient funds for this purpose. In fact, before many countries can attain suitable public health standards, they will be faced with reductions in research funds, making it even more difficult to attain the required standards. The WHO 'Financial Crisis and Global Health' report emphasizes that healthcare research is not a luxury, but is rather vital for meeting the needs of the healthcare sector in times of economic crisis . Therefore, we suggest that every country should evaluate the economic benefits of healthcare research to secure sufficient funds for this endeavor. The current study was designed to identify available methods of measuring the economic impact of healthcare research.
An electronic search of English-language articles was conducted in numerous bibliographic databases in March of 2009 using a combination of keywords: health research, health system research, medical research, payback, impact, assessment, evaluation, research utilization, rate of return, internal rate of return and net present value. The databases searched were PubMed, CINAHL, Dissertation and Thesis, Urban History, Leicester, Australian Digital Thesis Program, DART-Europe E-theses Portal, and the University of Michigan's OAlster service.
Canadian Institute of Health Research
Research Unit for Research Utilization
Organization for Economic Cooperation and Development
Canadian Health Services Research Foundation
Health Economic Research Group (HERG)
University of Houston System
Pacific Research Institute
UNC School of Public Health
University of Texas
Health Research Council of New Zealand
Rural Health Research Gateway
Primary Health Care Research and Information Service (PHC RIS)
We identified 8,416 articles in our electronic search. In primary screening that considered title and abstract (if there was an abstract), we identified 208 potentially relevant articles and subsequently requested the full texts, of which 196 were accessible. The secondary screening, which examined the full texts, yielded 18 relevant articles. We identified 11 other reports by searching Web sites (Table 1).
Selection of studies reviewed in this study
For priority setting before doing the project
Karnon J, Planning the efficient allocation of research funds: an adapted application of a non-parametric Bayesian value of information analysis,2002 
Townsend J, Prioritisation of health technology assessment. The PATHS model: methods and case studies,2003 
Coyle D, The assessment of the economic return from controlled clinical trials. A framework applied to clinical trials of colorectal cancer follow-up,2003 
Fleurence RL, Setting priorities for research,2004 
Claxton KP, Using value of information analysis to prioritise health research: some lessons from recent UK experience, 2006 
Fleurence RL, Setting priorities for research: a practical application of 'payback' and expected value of information,2007 
For estimation of the economic impact after doing the project
Exceptional Returns: The Economic Value of America's Investment in Medical Research.2000 
Exceptional Returns the Value of Investing in Health R&D in Australia,2003 
Exceptional Returns: The Value of Investing in Health R&D in Australia II,2005 
Medical Research: What's it worth? Estimating the economic benefits from medical research in the UK. Evaluation Forum,2008
Hanney S, Proposed methods for reviewing the outcomes of health research: the impact of funding by the UK's 'Arthritis Research Campaign',2004 
Wooding S, Payback arising from research funding: evaluation of the Arthritis Research Campaign,2005 
Kwan P, A systematic evaluation of payback of publicly funded health and health services research in Hong Kong,2007 
Wooding S, Policy and practice impacts of research funded by the Economic and Social Research Council, A case study of the Future of Workprogramme, approach and analysis,2007 
Nason E, Health Research- Making an Impact, The Economic and Social Benefits of HRB Funded Research,2008 
Kalucy L, Exploring the impact of primary health care research. Primary Health Care Research and Information Service, 2009 
Introducing the framework
Buxton M, How can payback from health research be assessed, 1996 
Canadian Institutes of Health Research, Developing a CIHR Framework to Measure The Impact of Health Research,2005 
Kuruvilla S, Describing the impact of health research: a Research Impact Framework 
Canadian Academy of Health Sciences, Making an Impact, A Preferred Framework and Indicators to Measure Returns on Investment in Health Research,2009 
Theoretic discussion about economic impact
Croxson, B, Routine monitoring of performance: what makes health research and development different, 2001 
Peipert, J.F, The economic value of medical research: is it worth the investment, 2002 
Sajal K. Chattopadhyay, Economics of Prevention: The Public Health Research Agenda, 2004 
Michele S. Garfinkel, A Societal Outcomes Map for Health Research and Policy,2006 
Anthony P. Weiss, Measuring the Impact of Medical Research:Moving From Outputs to Outcomes, 2007 
What methods can be used to assess the economic impacts of research?
What economic outcomes can be attributed to research?
How can healthcare status be described by financial indicators?
When should we evaluate the economic benefits of research?
What methods can assess the economic impacts of research?
Two methods can be used to assess the economic impacts of healthcare research; these are macroeconomics and case studies. Macroeconomic studies examine the relationship between the costs of conducting research and benefits gained at macro level and calculate the overall return but do not specify the process (in epidemiological studies; an 'ecologic study' is identical to a 'macroeconomic study'). Examples of such studies are the exceptional return reports prepared in America in 2000 , similar studies in Australia in 2003 and 2005 [10, 11] and the study of "Medical Research: What's it worth? Estimating the economic benefits from medical research in the UK in 2008".
The American report considered mortality and increased life expectancy as outcomes of research . The Australian studies reviewed nationwide mortality and morbidity and the association between research investment and economic benefits. The main limitation of such studies is the presence of multiple confounding factors and the attribution problem.
In addition to showing the overall return rate, the UK study 'Medical Research - What's it worth? is an example of a study that calculates factors such as lag time, and which estimates the economic returns of individual treatments .
Case studies examine the impact of specific healthcare research, investigate the details of return and propose ideas for increasing it. To evaluate healthcare research in case studies, researchers have defined frameworks that classify the impact of healthcare research in various dimensions, one of which is economic impact. The frameworks identified in this study and the economic outcomes proposed are as follows:
The Payback framework
This framework was introduced by the "Health Economics Research Group" (HERG) of Brunel University in the UK in 1996, and was completed over several years [13–16]. One aspect of the framework was 'Broader economic benefits'. In this area, the authors defined broader economic benefits as "benefits resulting from commercial utilization of research innovations", and "benefits resulting from healthy workforce and reduction of days off work". This framework was examined in seven studies performed in the United Kingdom, Ireland, The Netherlands, and Hong Kong that were slightly modified according to local conditions and requirements [17–20]. Some studies considered 'worker stress reduction', 'public health promotion', 'mental health promotion', 'reduction of the unemployed', 'higher productions', and 'increasing equity' as economic benefits. Another study considered the following aspects as economic benefits: recruiting and keeping high-quality researchers, establishing or re-activating new companies, employing people in laboratories, increasing international funds, attracting external investment, continuing to invest in foreign companies, attracting funds for future research, introducing the country as a center-of-excellence, international recognition, facilitating access to current and available scientific recognition, identification of groups at risk for intervention, and research advancements in healthcare delivery systems and planning.
Interestingly, some of these factors carry meaningful economic benefits only at national level, and cannot be considered of significance on an international scale. All cited studies indicated the appropriateness and practicality of using the payback framework.
This approach has also been used in the design of the 'Canadian Institutes of Health Research'  and the 'Canadian Academy of Health Science' frameworks . This illustrates that the payback framework can cover all aspects of healthcare research.
Canadian Institutes of Health Research framework 
This version of the payback framework was introduced by the 'Canadian Institutes of Health Research' in 2005. Here, the economic impacts of healthcare research are classified into four domains: commercial benefits, direct cost-savings, human capital, and the value of life and health.
The framework also describes how these domains are measured. In the commercial benefits domain, the major indicators are number and types of patents, spin-off companies and licenses for intellectual property generated, and financial returns from intellectual rights. In the direct cost-savings domain, Estimating the economic value of innovations created by health research, and (in the human capital domain), calculation of the reduction in production losses resulting from illness and/or injury, are the major indicators. In the value of life and health domain, the main indicator is the economic value of the extra years of life gained through novel treatments.
Research impact framework 
This framework was introduced in 2006. Here, also, multiple dimensions have been described for assessing the impact of research, two of which account for economic benefits. These are 'service impact' and 'societal impact'. 'Service impact' refers to cost savings in healthcare delivery systems ('limitation and effectiveness of costs'). The 'societal impact' refers to economic benefits at the macro level, such as the commercial benefits of producing and selling products, selling more effective procedures to industry, transfer of healthcare programs to the private sector, and the benefits of healthy workplaces and healthy lifestyles ('macro-economic impacts').
Canadian Academy of Health Sciences 
Activity impact indicators:
◦ Licensing returns: money spent in obtaining licenses and/or certificates, considering the association between these materials and specific research.
◦ Product sales revenues: benefits of product sales, which are dependent on multiple factors.
◦ Valuation of spin-out companies: portfolio values of spin-out companies and sales of such companies.
Health benefit indicators: the value of results in terms of healthcare benefits, as measured by the Quality Adjusted Life Years (QALYs) scale.
Well-being indicators: levels of social well-being, non-isolation of individuals, and several other indicators.
Social benefit indicators: extent of changes in socio-economic because of healthcare research.
Indicators defined for measuring economic benefits of health research in available frameworks
• benefits resulting from commercial utilization of research innovations
• benefits resulting from healthy workforce and reduction of days off work
Canadian Institute of Health Research framework 
• commercial benefits
• human investments
• the value of life and health
Research impact 
• limitation and effectiveness of costs
• macro-economic impacts
Canadian Academic of Health Science Framework 
• Research activity benefits
• Commercial benefits
• Health benefits
• Well-being benefits
• Social benefits
What economic outcomes are attributable to research?
Healthcare research can benefit both human health and the economy, and the improvement in human health can be described by economic indicators. Multiple definitions and classifications have been proposed to explain the direct economic benefits of healthcare research, such as direct cost-savings resulting from research-driven innovation, cost-savings in service delivery systems, and benefits from commercial development of products and technologies [10, 17, 24]. Criteria such as death reduction, increase in lifespan, reduction of diseases, and increase in quality-of-life and life expectancy are used to assess health status. In the UK study 'Medical Research - What's it worth?' the QALYs gained and impact on the GDP of the UK (the 'spillover effect') that resulted from cardiovascular and mental health research were considered as outcomes in study of the economic impact of medical research .
Different methods have been proposed to identify the impact of healthcare research on human health for the purpose of differentiating it from other factors. One proposal is the study of short-term effects of specific efforts, such as cardiovascular research. Such research can include diagnostic and therapeutic studies on targeted patient populations, or preventative research on nutrition and lifestyle in apparently healthy targeted populations. The time horizon and target population should be considered in addressing the attribution problem. Thus, 'reduced mortality after myocardial infarction' may be used as an outcome of diagnostic and therapeutic research, and 'overall reduction of cardiovascular disease mortality' over an extended period of time may be used in preventative studies. The latter criterion may be influenced by behavioral changes and improved lifestyle, which lead to disease reduction, but not necessarily to reduced mortality .
An attribution of 50% is considered acceptable in some studies, and a sensitivity analysis of 30-70% has been used to reflect the uncertainty in the estimate . However, one study showed that, with cardiovascular disease, one-third of the reduced mortality was attributable to aggressive treatments, one-third to pharmacologic developments, and one-third to behavioral changes . Thus, when measuring the return of pharmacologic research on cardiovascular disease, it could be considered that only one-third of mortality and morbidity reduction may be attributed to pharmacologic developments.
How can healthcare status be described by financial indicators?
Once the health status outcome is determined, it is necessary to describe this by use of financial indicators. Methods such as 'individual willingness-to-pay', a 'productivity approach' (e.g. additional earnings of cancer survivors [11, 27], and 'maximum funds provided by the health delivery system to obtain one health unit'  have been used.
When should we evaluate the economic benefits of research?
There is no general consensus on the timeframe needed to assess the economic benefits of healthcare research, but some researchers have proposed 3-5 years as appropriate . After examining various studies, the 'Medical Research - What's it worth?' study in 2008 suggested 10-25 years (average: 17 years) for cardiovascular research and 9-14 years (average: 12 years) for mental health research as the average time from research to health impact . However, the duration will depend on the type of study, the expected impact and the particular circumstances of each individual country.
Various methods and approaches are used for the economic assessment of healthcare research. There are two basic methods for studying such benefits: macroeconomic evaluation of the relationship between funds spent on research and economic benefits, and case studies which examine a single research or program.
It is often difficult to attribute an observed change in public health as causally related to funding for healthcare research, especially in macroeconomic studies. This is one of the rationales for case studies and for employing specific frameworks that facilitate the evaluation process. Among the available frameworks, the payback framework  has been used as a basis for all other frameworks, and has been employed more than any other model. The Canadian Academy of Health Science (CAHS) framework  is one novel proposed approach, the suitability and practicality of which have not yet been examined, although it does provide a more complete and comprehensive overview of the economic impact of healthcare research. It must be kept in mind that each of the available frameworks was designed for specific reasons.
A review of all relevant studies indicates that attribution of economic benefits to healthcare research requires that the impacts of interventions are measured. In fact, in such studies, research results should be attributed to a decision or change in behavior of a target group, and, next, the impact of the decision or behavioral change should be measured. Therefore, consideration of the implementation of results is very important in assessing the benefits of healthcare research .
Another important consideration is the cost of implementing interventions. For evaluation of the economic impact of healthcare research, two types of costs must be considered: the cost of conducting research, and the cost of implementing research results. Regarding the cost of research, combined indicators can be used to describe costs and benefit. Thus, combined indicators such as 'net present value', 'return on investment', and 'benefit-cost ratio' can be used . For healthcare research to provide economic benefits, results must be implemented, but it is unclear whether the costs of implementing such results should be considered in evaluating the final economic benefits. Some researchers believe that the expense of implementing research results should be considered in evaluation of the economic benefits of such research because high expense is of little benefit for patients who are near death; research on novel care techniques has fewer benefits than research on preventative methods; and theoretical estimates have shown that, for specific gender and age groups, the benefits of prolonging life are less than curative expenditures . The authors believe that it is only logical and necessary to take into account the cost of implementation of research in valuing healthcare research whose ultimate goal is to improve community's health.
In the studied reports, the sections on evaluation of the economic impacts of healthcare research are often the weakest, perhaps because of the absence of appropriate data. In fact, in most studies the researchers simply forecast economic impact, and do not actually measure outcomes. In some cases, data from other related or unrelated healthcare sectors can be used, but this information is not always available or complete. Thus, separate studies are needed to evaluate the economic benefits of healthcare research. Also, to facilitate the evaluation of the economic impacts of such research, the criteria used to define benefits and the sources of necessary information should be clearly identified from the beginning.
The indicators used to assess the economic impacts of healthcare research depend on the type of study. Thus, research projects can be classified as etiologic, interventional, policy analysis, health service, theoretical, methodological or healthcare system studies . Based on the type of study, the expected economic impact, the time required to assess the impact, and comprehensive and practical indicators, should be clearly defined and specified. To facilitate economic evaluation, we suggest that researchers add sections to their reports in which the expected economic impacts are explicitly stated.
Another important issue is consideration of the benefits from domestic and foreign investment in healthcare research. Some interventions, technologies, and drugs used in a country actually result from research conducted in other countries, so not all economic benefits can be classified as domestic. The 'Medical Research - What's it worth?' study has used citations to relevant clinical guidelines to calculate the attribution of developments made in cardiovascular and mental health research in the UK to medical research worldwide . The potential benefits of local investment in the research results of other countries should not be overlooked. Studies conducted to implement the research results from overseas (effectiveness studies), or investment in developing a drug that is produced in another country, can both be considered as investment in local research (the 'spillover effect').
Care must be taken in interpreting economic evaluation studies on health research. Be it positive or negative, these results may be the effect of various methodology flaws that over-represent or under-represent the true effects of research, and should be taken into account while interpreting their results. The economic benefits of healthcare research may be assessed incorrectly in the following cases: absence of valid, reliable and operational indicators for measuring economic benefits; use of incorrect and incomplete data. Even if it is proven that the investment return is low or negligible, it is still necessary to assess economic benefits, because this can indicate a waste of resources and the weaknesses should be identified using the assessment results and consequently be corrected.
Healthcare research strategies have undergone significant changes over the past 20 years. Previously, 'capacity building' was a significant focus, and this led to healthcare research methodology workshops, especially in the 1980s. Next, identification of the '10/90 gap' (10% of worldwide expenditure on healthcare research is devoted to problems that primarily affect the poorest 90% of the population) led to re-prioritization of research focus. Since then, the gap between research and the effects on human health have been identified, and knowledge translation was considered one of the main strategies of healthcare research in 2004, as emphasized in the Bamako Forum of 2008 . Now that the world has entered an economic crisis, we suggest that it is important that the economic outcomes of research should play a pivotal role in healthcare research.
We found no reports on the research payback of low and middle income countries who have less financial resources (and allocate a smaller share of their GDP to health and its relevant researches) in our systematic review. This may partly be due to publication bias, but lack of the necessary infrastructure and skills for performing research payback studies in such countries is no doubt another reason. We suggest that international organizations, such as the World Health Organization and 'The Alliance for Health Policy and Systems Research' or other global initiatives seek to propagate, facilitate, and compare healthcare research economic evaluation throughout the world. Frameworks that have introduced more appropriate components (such as CAHS and payback frameworks) can be considered as the basis in this respect, and practical guidelines for capacity building and arranging necessary informative infrastructures should be introduced to better protect health research in these countries.
This movement should be launched with the aim of 'compiling a standard methodology on the basis of objectives, information, and available facilities in developed and developing countries', 'preparation and dissemination of tools required for measuring economic outcomes of health research', and 'specification of the expected economic outcomes'. This will help us to achieve the goals agreed upon at the Bamako Global Ministerial Forum on Research for Health in 2008.
Dr Reza Majdzadeh is the Director of 'Knowledge Utilization Research Center'.
This project was conducted with the financial support of Tehran University of Medical Sciences' Vice Chancellor for Research through contract no. 132/8680. We hereby acknowledge their support. We would also like to thank Katayoun Maleki for translating the manuscript.
- Global Ministerial Forum on Research for Health: Strengthening Research for Health, Development, and Equity. [cited 2009/07/15], [http://www.globalforumhealth.org/Media-Publications/Publications/Report-from-Bamako-Strengthening-Research-for-Health-Development-and-Equity]
- World Health Organization: The financial crisis and global health, Report of a high-level consultation. 2009, [http://www.who.int/mediacentre/events/meetings/2009_financial_crisis_report_en_.pdf]Google Scholar
- Karnon J: Planning the efficient allocation of research funds: an adapted application of a non-parametric Bayesian value of information analysis. Health Policy. 2002, 61 (3): 329-47. 10.1016/S0168-8510(02)00007-6.View ArticlePubMedGoogle Scholar
- Claxton KP, Sculpher MJ: Using value of information analysis to prioritise health research: some lessons from recent UK experience. Pharmacoeconomics. 2006, 24 (11): 1055-1068. 10.2165/00019053-200624110-00003.View ArticlePubMedGoogle Scholar
- Coyle D, Grunfeld E, Wells G: The assessment of the economic return from controlled clinical trials. A framework applied to clinical trials of colorectal cancer follow-up. European Journal of Health Economics. 2003, 4 (1): 6-11. 10.1007/s10198-002-0142-5.View ArticlePubMedGoogle Scholar
- Fleurence RL, Torgerson DJ: Setting priorities for research. Health Policy. 2004, 69 (1): 1-10. 10.1016/j.healthpol.2003.11.002.View ArticlePubMedGoogle Scholar
- Fleurence RL: Setting priorities for research: a practical application of 'payback' and expected value of information. Health Economics. 2007, 16 (12): 1345-57. 10.1002/hec.1225.View ArticlePubMedGoogle Scholar
- Townsend J, Buxton M, Harper G: Prioritisation of health technology assessment. The PATHS model: methods and case studies. Health Technology Assessment. 2003, 7 (20): 1-82.View ArticleGoogle Scholar
- Murphy K, Topel R: The Economic Value of Medical Research. Paper presented at the. 1999, December Conference on the Economic Value of American's Investment in Medical Research. As presented in Exceptional Returns: The Value of America's Investment in Medical ResearchGoogle Scholar
- The Australian Society for Medical Research: Exceptional Returns the Value of Investing in Health R&D in Australia. 2003, [http://www.asmr.org.au/Except.pdf]Google Scholar
- The Australian Society for Medical Research: Exceptional Returns: The Value of Investing in Health R&D in Australai II. 2008, [http://www.asmr.org.au/ExceptII08.pdf]Google Scholar
- Health Economics Research Group, RAND Europe: Medical Research: What's it worth? Estimating the economic benefits from medical research in the UK. 2008, London:UK Evaluation ForumGoogle Scholar
- Buxton M, Hanney S: How can payback from health research be assessed?. Health Serv Res Policy. 1996, 1: 35-43.Google Scholar
- Hanney S, Davies A, Buxton M: Assessing benefits from health research projects: can we use questionnaires instead of case studies?. Research Evaluation. 1999, 8 (3): 189-199. 10.3152/147154499781777469.View ArticleGoogle Scholar
- Stephen RH, Jonathan G, Steven W, Martin JB: Proposed methods for reviewing the outcomes of health research: the impact of funding by the UK's 'Arthritis Research Campaign'. Health Research Policy and System. 2004, 2 (1): 4-10.1186/1478-4505-2-4.View ArticleGoogle Scholar
- Wooding S, Hanney S, Buxton M, Grant J: Payback arising from research funding: evaluation of the Arthritis Research Campaign. Rheumatology. 2005, 44 (9): 1145-56. 10.1093/rheumatology/keh708.View ArticlePubMedGoogle Scholar
- Nason E, Janta B, Hastings G, Hanney S, O'Driscoll M, Wooding S: Health Research- Making an Impact, The Economic and Social Benefits of HRBFunded Research. 2008, Irland: Health Research Board, [http://www.hrb.ie/uploads/tx_hrbpublications/Health_Reseach-Making_an_Impact.pdf]Google Scholar
- Kwan P, Johnston J, Fung AY, Chong DS, Collins RA, Lo SV: A systematic evaluation of payback of publicly funded health and health services research in Hong Kong. BMC Health Serv Resh. 2007, 7: 121-10.1186/1472-6963-7-121.View ArticleGoogle Scholar
- Primary Health Care Research and Information Service: Exploring the impact of primary health care research. Edited by: Kalucy L, Jackson-Bowers E, McIntyre E, Hordacre A-L, Reed R. 2009, [http://www.phcris.org.au]Google Scholar
- Wooding S, Nason E, Klautzer L, Rubin J, Hanney S, Grant J: Policy and practice impacts of research funded by the Economic and Social Research Council: A case study of the Future of Work programme, approach and analysis. RAND Corporation. 2007, RAND Coporation, [http://www.rand.org/pubs/technical_reports/2007/RAND_TR435.pdf]Google Scholar
- Candian Institute of Health Research: Developing a CIHR Framework to Measure the Impact of Health Research. 2005, [http://www.cihr-irsc.gc.ca/e/documents/meeting_synthesis_e.pdf]Google Scholar
- Canadian Academy of Health Sciences: Making an Impact, A Preferred Framework and Indicators to Measure Returns on Investment in Health Research. 2009, [http://www.cahs-acss.ca/e/pdfs/ROI_FullReport.pdf]Google Scholar
- Kuruvilla S, Mays N, Pleasant A, Walt G: Describing the impact of health research: a Research Impact Framework. BMC Health Services Research. 2006, 6: 134-10.1186/1472-6963-6-134.View ArticlePubMedPubMed CentralGoogle Scholar
- Wells R, Whitworth JA: Assessing outcomes of health and medical research: do we measure what counts or count what we can measure?. Australia & New Zealand Health Policy. 2007, 4: 14-View ArticleGoogle Scholar
- Siegler M, Weisfeld A, Cronin D: Is medical research cost effective? Response to Murphy and Topel. Perspectives in Biology & Medicine. 2003, 46 (3 Suppl): S129-37.View ArticleGoogle Scholar
- Silverstein SC: What does economic research tell us about the economic benefits of investments in medical and health research and training?. 2005, [http://www.asbmb.org/uploadedFiles/Advocacy/Economic%20Benefits%20of%20Research%20Investments%20(Silverstein,%20SC).pdf]Google Scholar
- Brown ML, Nayfield SG, Shibley LM: Adjuvant therapy for stage III colon cancer: economics returns to research and cost-effectiveness of treatment. J Natl Cancer Inst. 1994, 86 (6): 424-430. 10.1093/jnci/86.6.424.View ArticlePubMedGoogle Scholar
- Hanney S, Mugford M, Grant J, Buxton M: Assessing the benefits of health research: lessons from research into the use of antenatal corticosteroids for the prevention of neonatal respiratory distress syndrome. Social Science & Medicine. 2005, 60 (5): 937-47.View ArticleGoogle Scholar
- Kamper Jorgensen F, Arber S, Berkman L, Mackenbach J, Rosenstock L, Teperi J: International Evaluation of Swedish Public Health Research: Part 3. Scandinavian Journal of Public Health. 2005, 46-84. 10.1080/14034950510033282. supp 65Google Scholar
- World Health Organization: World Report on Knowledge for Better Health: Strengthening Health Systems. Geneva. 2004, [http://www.who.int/rpc/meetings/pub1/en]Google Scholar
- Majdzadeh R, Nejat S, Fotouhi A, Malekafzali H: Iran's Approach to Knowledge Translation. Iranian Journal of Public Health. 2009, 38 (Supp 1.1): 58-60.Google Scholar
- Croxson B, Hanney S, Buxton M: Routine monitoring of performance: what makes health research and development different?. Journal of Health Services & Research Policy. 2001, 6 (4): 226-232.View ArticleGoogle Scholar
- Peipert JF: The economic value of medical research: is it worth the investment?. Obstetrics & Gynecology. 2002, 99 (5 Pt 1): 835-840.Google Scholar
- Chattopadhyay SK, Carande-Kulis VG: Economics of prevention: the public health research agenda. J Public Health Manag Pract. 2004, 10 (5): 467-471.View ArticlePubMedGoogle Scholar
- Garfinkel MS, Sarewitz D, Porter AL: A societal outcomes map for health research and policy. American Journal of Public Health. 2006, 96 (3): 441-446. 10.2105/AJPH.2005.063495.View ArticlePubMedPubMed CentralGoogle Scholar
- Weiss AP: Measuring the impact of medical research: moving from outputs to outcomes. American Journal of Psychiatry. 2007, 164 (2): 206-214. 10.1176/appi.ajp.164.2.206.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.