Scientometric trends and knowledge maps of global health systems research
Health Research Policy and Systems volume 12, Article number: 26 (2014)
In the last few decades, health systems research (HSR) has garnered much attention with a rapid increase in the related literature. This study aims to review and evaluate the global progress in HSR and assess the current quantitative trends.
Based on data from the Web of Science database, scientometric methods and knowledge visualization techniques were applied to evaluate global scientific production and develop trends of HSR from 1900 to 2012.
HSR has increased rapidly over the past 20 years. Currently, there are 28,787 research articles published in 3,674 journals that are listed in 140 Web of Science subject categories. The research in this field has mainly focused on public, environmental and occupational health (6,178, 21.46%), health care sciences and services (5,840, 20.29%), and general and internal medicine (3,783, 13.14%). The top 10 journals had published 2,969 (10.31%) articles and received 5,229 local citations and 40,271 global citations. The top 20 authors together contributed 628 papers, which accounted for a 2.18% share in the cumulative worldwide publications. The most productive author was McKee, from the London School of Hygiene & Tropical Medicine, with 48 articles. In addition, USA and American institutions ranked the first in health system research productivity, with high citation times, followed by the UK and Canada.
HSR is an interdisciplinary area. Organization for Economic Co-operation and Development countries showed they are the leading nations in HSR. Meanwhile, American and Canadian institutions and the World Health Organization play a dominant role in the production, collaboration, and citation of high quality articles. Moreover, health policy and analysis research, health systems and sub-systems research, healthcare and services research, health, epidemiology and economics of communicable and non-communicable diseases, primary care research, health economics and health costs, and pharmacy of hospital have been identified as the mainstream topics in HSR fields. These findings will provide evidence of the current status and trends in HSR all over the world, as well as clues to the impact of this popular topic; thus, helping scientific researchers and policy makers understand the panorama of HSR and predict the dynamic directions of research.
With the approach of 2015, many countries intend to hasten their efforts towards meeting the Millennium Development Goals (MDGs), and meanwhile they have already began discussing the post-MDGs health roadmap . In recent years, evidence about the progress towards the MDGs has moved the health systems topic to the center stage, especially in low- and middle-income countries [1, 2]. The poor state of health systems in most parts of the developing world is considered one of the greatest barriers for the MDGs to be met, even in some high-income countries such as the US, which has a large percentage of the population without any access to health care due to the inequitable arrangements of social protection. The importance of health systems as part of the global health agenda and in terms of the World Health Organization’s (WHO) response is being reflected in the 11th General Programme of Work (2006–2015) and the Medium-term Strategic Plan (2008–2013). Good health systems not only play a critical important role in improving health, but are widely recognized as being vital elements in the social fabric of every society. They are not only critical for the treatment and prevention of ill-health, but are the central strategies in addressing health inequity and wider social injustice . Well-functioning health systems facilitate the achievement of good health with the efficient use of the available resources. This is achieved by critically increasing the effective responses to the developing public health emergencies by addressing the burden of diseases, ill health, and poverty as a result of communicable and non-communicable diseases and cancers. Effective health systems enable the responsiveness towards legitimizing the expectations of citizens and fairness of financing. By helping in producing effective good health, health systems can also contribute to economic growth .
Health systems have existed in some form for over 100 years, when individuals and eventually governments became interested in organizing health systems to protect their population’s health and treat their diseases . However, the concept of health systems is defined in various ways . Generally, health systems can be defined by what they seek to do and achieve, or as the elements by which they are comprised. On the one hand, the WHO defined health systems as “all organizations, people and actions whose primary intent is to promote, restore or maintain health” . This definition includes the efforts to address the determinants of health along the direct activities to improve health. Health systems are therefore more than the pyramid of publicly owned facilities that deliver personal health services. On the other hand, definitions of health systems have been based mainly on the utility of achieving health outcomes . The WHO’s building blocks approach is the most popular classification and is widely accepted and used by researchers and decision makers. They conceptualize health systems in the functional or instrumental terms of its constituent “hardware” – service delivery, health workforce, information, medical products, vaccines and technologies, financing, leadership, and governance [5, 7]. Therefore, the WHO’s building blocks definition is used herein. Although these building blocks help to clarify the essential functions of health systems, the efforts to address health systems should recognize the interdependence of each part. The building blocks alone do not constitute a system any more than a pile of bricks constituting a functioning building . It is the multiple relationships and interactions among the blocks – how one affects and influences the others and in turn gets affected by them – that convert these blocks into a system . The “software” – by which we mean the ideas and interests, values and norms, and affinities and power that guide actions and underpin the relationships among system actors and elements – are also critical to the overall health systems performance [7, 9]. As such, health systems may be understood through the arrangement and interaction of their parts, and how they enable the system to achieve the purpose for which it was designed [5, 8].
The current surge in activities and researches around health systems is encouraging. Funding has increased in recent years [10, 11] with organizations strengthening health systems such as the Global Alliance for Vaccines and Immunizations and the Global Fund to fight AIDS, tuberculosis, malaria, and other such diseases. Meanwhile, new initiatives have been launched to address some of the bottlenecks to scale up essential health interventions and strengthen some components of health systems [11–13], such as the Implementation Research Platform, the Taskforce on Innovative International Financing for Health Systems, the Evidence-Informed Policy Network, the Canadian-Funded Catalytic Initiative, the Norwegian Government Support to the Results-Based Financing Initiative, the US President’s Emergency Plan for AIDS Relief, and Providing for Health, which is supported by Germany and France. Furthermore, several health systems partnerships have recently emerged, including the Alliance for Health Policy and Systems Research (AHPSR), the Global Health Workforce Alliance, the Health Metrics Network, and the International Health Partnership, among others. In particular, the establishment of the AHPSR in 1999, as a partnership hosted by the WHO, marked an important milestone in the field of health systems . It not only legitimized health systems research (HSR) by demonstrating strong commitment and investment of human and financial resources by the WHO and global funding agencies, but it also provided a platform for international partnership and collaboration and created an identity for this growing field.
Recent studies also have called for intensified investment, methods development, and capacity building in the assessment and research that accompanies health systems investment, ultimately strengthening the implementation processes. AHPSR have published the Role and Promise of Policy and Systems Research, Sound Choices: Enhancing Capacity for Evidence Informed Health Policy, Systems Thinking for Health Systems Strengthening, and most recently HPSR: A Methodology Reader in order to strengthen health systems. PLoS Medicine commissioned three articles on the state-of-the-art in HSR [7, 18, 19]. Three Policy Forum articles that were authored by a diverse group of global health academics had critically examined the current challenges of the field and set out what is needed to build up the capacity in HSR to support the local policy development and health systems strengthening, especially in low- and middle-income countries. In addition, during the past decade, a series of conferences and task forces on health research, such as the International Conference on Health Research for Development, Bangkok, 2000, and ministerial meetings in Mexico City in 2004 and Bamako in 2008, had a strong focus on practical and operational questions, which was frequently framed as HSR. The First Global Symposium on HSR, held in Montreux, Switzerland, in November 2010 was the most recent of a succession of conferences and task force deliberations that have spun off a series of debates about the nature of the field and the future directions it should take . The most prominent ones were the launch of the 2010 WHO’s Research for Health Strategy, the Organization of Global Symposia on Health Systems Research in Montreux, Switzerland, and in Beijing, China, and the establishment of a society of health systems researchers known as Global Health Systems. Now, with the launch of the Strategy on HSR on 1 November 2012, the WHO is helping to institutionalize HSR and facilitate evidence-informed decision-making. However, support currently focuses on disease-specific funding for the control of diseases such as HIV/AIDS, tuberculosis, and malaria. Yet, it is increasingly recognized that only limited and short-term gains can be made unless the broader health systems infrastructure is strengthened along large scale interventions that have been introduced [2, 20].
Overall, high level meetings and community level advocacy groups have highlighted the challenges that lie ahead: the post-MDGs global health agenda, burgeoning non-communicable diseases, achieving universal health coverage, and strengthening fragile health systems in low- and middle-income countries . Therefore, the consensus on the importance of strong health systems is welcomed. However, because of the importance and high growth rate of HSR both in theory and practice, there have been few attempts or efforts to map global health systems research that is related in context. Without clarity on future directions, focus, and energy this could all dissipate and the global health decision makers could be at a crossroads. Meanwhile, the process of developing an HSR study begins with identifying the topic of focus – the issue or problem you want to investigate – and the related questions. Thus, it is important to identify common trends faced by all health systems, which ultimately allow us to spell out suggestions for reform and change.
The main purpose of this study is to evaluate the global progress and quantitatively assess the current research trends on HSR. A comprehensive scientometric analysis and substantial discussion of research progress in HSR were provided so that specific attempts were employed in order to i) summarize significant publication patterns in HSR with basic statistics as well as advanced analysis, ii) evaluate research performance from multiple perspectives such as year of publication, subject category, journals, countries/regions, and institutes as well as authors [22, 23], and iii) present the research foci about international HSR from multiple angles. Moreover, citation data were used as a scientometric tool to indicate the intellectual impact of the research outputs.
As a strictly selected abstract database, Web of Science (WoS), including Science Citation Index Expanded, Social Sciences Citation Index, and Arts and Humanities Citation Index, has long been recognized as the most authoritative scientific and technical literature indexing tool providing data on the most important areas in science and technology research, especially about medicine. Furthermore, the WoS database includes the world’s most important journals in relation to healthcare science, health policy, and systems research. The majority of high quality articles on healthcare science research are indexed by WoS. In addition, as a citation database, WoS provides enough search fields, such as keywords, country, organization, author, and references, which are all very important for literature analysis, especially for scientometric analysis [24, 25]. Therefore, we conducted a systematic search through the WoS database. The search strategy has been built on previous literature reviews with similar objectives [10, 13, 26–28], with further refinements and iterative testing of individual search terms. The six building blocks of health systems, as defined by the WHO, were used to define the scope of this search (details of search terms and the search strategy are available in Additional file 1). Literatures were included if they met the following criteria: for the purpose of this study, HSR included the system-level research directly targeting one or more of the six health system building blocks and their sub-components as defined by the WHO. A total of 35,819 publications were identified from 1900 to 2012. The retrieved papers were downloaded from WoS as text files and were converted to a database using the Thomson Data Analyzer, which was also used to clean and analyze data. Papers originating from England, Scotland, Northern Ireland, and Wales were grouped under the United Kingdom heading, while those from Hong Kong, Macao, and Taiwan were categorized each independently and are not included under the China heading.
Following the best international practices, ‘evaluative scientometrics’ was selected for this study. Scientometrics is a method by which the state of science and technology can be observed through the overall production of scientific literature at a given level of specialization. This tool provides an approach for situating a country in relation to the world, an institution in relation to a country, and individual scientists in relation to their peers. Scientometric indicators are equally suitable for macro-analysis (e.g., a given country’s share in global output of scientific literature over a given period) and micro-studies (e.g., a specified institute’s role in producing articles in a particular field or specialty of science) . In this paper, the distribution of document types, language, year of publication, subjects, journals, countries, institutions, authors, highly multiple cited papers, high frequency keywords, and cluster analysis, as well as collaboration of the subjects, countries, institutions, and authors were thoroughly examined. The total local citation score (TLCS) and the total global citation score (TGCS) were also calculated in this paper. TLCS is the number of times a set of papers included in a collection that has been cited by other papers within the collection. TGCS is the number of times a set of papers included in a collection has been cited in the WoS. The average global citation score (AGCS) is the mean value of TGCS, which also indicates the average citation times of articles in HSR areas. TLCS and TGCS have been the key indicators capable of evaluating the relevance of each research paper in our sample. Meanwhile, an approach considering the average citation per year was also used (TLCS/t and TGCS/t). TLCS/t is the total local citation score per year from the time the research papers’ publication to the end of the sample period, and TGCS/t is the total global citation score per year from the research papers’ publication to the end of the sample period . In addition, the impact factor and H-index are also used to assess the quality of journals. Finally, Thomson Data Analyzer , HistCite , and VOSviewer  software were employed to analyze the publications for knowledge mapping.
The term ‘co-author’ is used to denote the appearance of multiple writers simultaneously in one paper, and also reflects the collaboration of different institutes, regions, or countries [33, 34]. The higher the strength of these co-authorships, the closer the relationship among them. Collaboration between countries was determined by the author description, where the term ‘independent’ was assigned if no collaboration was present. ‘Co-words’ refers to the phenomenon that two or more keywords occur simultaneously in one article or one field, where the number of times being cited is called the frequency or strength of co-words . ‘Cluster analysis’ is a collective term covering a wide variety of techniques for delineating natural groups or clusters in data sets . It aims to group a set of objects in such a way that objects in the same group (called a cluster) are more similar (in some sense or another) to each other than to those in other groups (other clusters). During the process, many algorithms and software were used. This study is based on the relationship between countries, institutions, authors, and keywords through a certain algorithm to find the core groups among them by VOSviewer software. It has recently been used in many fields, including machine learning, pattern recognition, image analysis, information retrieval, and bioinformatics [37, 38]. Knowledge mapping technology was also referred to as visualization technology, which includes data gathering, survey, exploring, discovery, conversation, disagreement, gap analysis, education, and synthesis. It aims to track the loss and acquisition of information and knowledge, personal and group competencies and proficiencies, show knowledge flows, appreciate the influence of intellectual capital due to staff loss, and assist with team selection and technology matching. Knowledge mapping can not only externalize networks of cognitive relationships and renders them in graphic form, but could also describe a newly evolving interdisciplinary area of science . In this study, co-author, co-word, and cluster analysis methods were used to analyze the collaboration among several research organizations through visualization or knowledge mapping technology [40, 41].
Results and discussion
There were 35,819 total HSR-related papers in the Science Citation Index Expanded, Social Sciences Citation Index, and Arts and Humanities Citation Index databases used for this study, distributed over 17 different document types . There were 28,787 research articles comprising 80.37% of the total productions, followed by reviews (2,555; 7.13%), proceedings papers (2,121; 5.92%), editorial material (2,031; 5.67%), meeting abstracts (1,054; 2.94%), letters (531; 1.48%), book reviews (454; 1.27%), and news items (224; 0.63%). Other document types with fewer papers were omitted. Following the conventions used in other scientometric studies, further analysis of articles was restricted, which were peer-reviewed and represent original scientific development. Publications of all other types were thus removed from the analysis of this article.
Global publication trends
The publication trends in annual papers in HSR from 1981 to 2012 are shown in Figure 1, indicating that the developing process of HSR could be divided into three stages in accordance with the growth pattern of literature. The first stage is the infancy period from 1900 to 1990, the second stage is the slow development period from 1991 to 2000, and the third stage is the rapid growth period from 2001 to 2012. During the past decades, WoS papers on HSR that were produced in the 1980s were far less than 100 and mounted up to more than 4,000 in 2012. Meanwhile, WoS articles on HSR exceeded 3,000 papers in 2012. It can be seen from Figure 1 that not many researchers paid attention to the few HSR papers published before 1990, and few proceedings reported the progress of the related work. After 2001, the WoS annual number of publications has grown exponentially, indicating that research has recently garnered more attention (Figure 1).
Subject categories of publication
Based on the classification of subject categories in the Journal Citation Report of WoS, the publication output data of HSR during the last century was distributed in 140 subject categories. The top 10 productive subject categories are shown in Table 1.
HSR was mainly located in the fields of public, environmental and occupational health, health care sciences and services, and general internal medicine as shown in Table 1. Meanwhile, more and more studies have focused on nursing, pharmacology and pharmacy, and surgery. Moreover, psychology, biomedical social sciences, and business and economics also played important roles, where investigators have studied factors and interventions that influence the health of populations. In addition, Table 1 also indicates that research in the above mentioned fields began relatively early. HSR in the subjects of environmental and occupational health and general internal medicine had occupied a dominant position in the earlier stages, while in the past two decades the study of health care sciences and services has gradually exceeded that of general internal medicine. Finally, the number of scientific articles per category has exhibited a trend of rapid growth during the last decade, which indicates that HSR is in a rapid development stage and subsequently needs more efforts (Table 1).To represent the relationship more synthetically between categories, the subjects’ categories co-occurrence network was drawn and visualized in Figure 2. Figure 2 shows that, in the scientific network map of HSR, these subjects are clustered into five subject category groups and shown with different colors. It suggests that HSR is an interdisciplinary area and includes medicine (such as general and internal medicine, surgery, nursing, cardiovascular system and cardiology, infectious diseases, oncology, and other diseases), public-environmental and occupational health, health care sciences and services, pharmacology and pharmacy, economics, sociology (biomedical social sciences, social issues, social work, medical ethics, government and law, public administration), information science and technology (medical informatics, computer science, engineering, information science and library science), and psychology (psychiatry, neurosciences, and neurology). Since health economics is a central discipline of HSR, the analyses most centrally falling within HSR include works that focus on financing (Figure 2).
Core journals of publication
Thomson Reuters’ WoS covers research published in more than 12,000 scientific journals and conference proceedings, and is presently one of the most extensive sources of research and development outputs. HSR output was published in 3,674 journals, where the top 10 journals with more than 200 articles are displayed in Table 2. These top 10, or 0.27% out of the 3,674 journals, had published 2,969 or 10.31% of the total 28,787 articles and received 5,229 local citations and 40,271 global citations. There was a high concentration on HSR publications in these top journals, where approximately one third of the articles are found in the top 60 most productive journals, a phenomenon that follows Bradford’s law  and is consistent with observations in other fields.
Major publication outlets of HSR include Social Science & Medicine, Health Policy, and Health Affairs. Health Affairs ranked first both in quantity and quality with the highest TLCS, TLCS/t, TGCS, TGCS/t, AGCS, impact factor, and H-index, followed by Social Science & Medicine. Moreover, Health Policy ranked third both in TLCS and TGCS, while Health Policy and Planning had a relative high TLCS/t and TGCS/t. In addition, Medical Care has a high AGCS and impact factor, which reflects the high quality of articles published in it. Since Social Science & Medicine, Health Policy, Health Affairs, and Medical Care published health systems-related papers in the early stages, they constitute the most important journals during the development process of HSR (Table 2).
Countries of publication and collaboration
The publication indicators for the 20 most productive countries/territories in HSR are presented in Table 3. Of these 20 productive countries/territories, 11 were from Europe, 3 from North America, 3 from Asia, 1 from South America, 1 from Oceania, and 1 from Africa. Meanwhile, 16 of these countries are members of the Organization for Economic Co-operation and Development (OECD), while the others are ‘emerging economies’ (such as Brazil, China, and India). Thus, we hypothesize that the economic development and scientific investment has contributed much to the distribution, where all the entire major industrialized countries (G7 countries: USA, UK, Germany, Canada, Italy, France, and Japan) are among the countries within the OECD list. The pattern of publication domination by OECD countries, especially the G7 countries, took place in most scientific fields , which reflects the high economic activity and academic level of these countries .
USA ranked the first in HSR productivity among all countries, with the highest number of articles. The UK published the second highest ratio of articles, followed by Canada, Germany, Australia, and Brazil, while the number of publications for other countries was all below 1,000. Table 3 shows information about the TLCS, TGCS, and AGCS of research articles from the top 20 countries in the global field of HSR. We can observe that USA had the highest TLCS and TGCS, followed by the UK and Canada in turn. The US, Switzerland, and the UK were the front ranking countries in AGCS, showing their superiority in HSR. Denmark and Sweden ranked 15th and 12th in issuing number of articles, respectively, and were the top five in AVGS, which indicates the high average quality of these articles. Brazil ranked 6th in issued volumes with the lowest AGCS, which might indicate considerable problems with the quality of Brazilian issued articles, and the same was the case with Germany and Spain (Table 3).When analyzing the collaboration patterns of the 50 most productive countries/territories with VOSviewer in Figure 3, it was found that some countries/territories with similar properties tend to cooperate in the form of small groups of collaborators, which were clustered into four major of countries/territories: the African and the Americas group (red), European group (green), Asian and Pacific group (purple), and Canada (yellow), each of which usually has several core countries/territories. For example, Australia, China, and Japan are in the core position of the Asian and Pacific group, and Germany and Netherlands are in the core position of the European group. Moreover, apart from the African and the Americas group, the US and UK positions are globally centralized in HSR and can also be observed by their pivotal role in the national collaboration networks as seen in Figure 3. USA and the UK cooperate frequently with other countries/regions and stand in the core position of the entire network, receiving in return mutual benefits from their knowledge transfer among health systems researchers. Other nations, such as Ethiopia, Bangladesh, Portugal, and South Korea, are in the peripheral layer. These countries/territories have less cooperation with other countries/regions, and they are in the outermost layer of the entire cooperation network. As a result, the top two productive countries have carried out most of the international collaborations with other countries in the HSR field (Figure 3).
Institutes of publication and collaboration
The contributions of different institutes are assessed herein by the institutes’ affiliations and with at least one author in the published papers. The top 25 institutes with over 200 papers are ranked by their published articles. From Table 4, we find that Harvard University performed well, and was the most powerful institution in HSR. Harvard University has published 768 articles, i.e., ranking first, followed by University of Toronto, University of Washington, University of Michigan, UCSF, and UCLA. Harvard University was the highest ranking in TLCS and TGCS with more than one thousand citations, followed by WHO, UCSF, and UCLA. Moreover, the WHO has the highest AVGS, followed by UCLA, Center for Disease Control, and UCSF. Harvard University is considered the leading institute in paper quantity, while WHO is the leading institution in article quality. In addition, according to Table 4, 16 institutions are from USA and 3 were Canadian, 1 from the UK, 1 Australian, 1 Brazilian, and 1 Swedish. WHO ranked seventh in the world and also played an important role in HSR reflecting the overall strength of North American and European institutions in this field. International organizations such as the WHO and institutions in the ‘emerging economies’ (such as University of São Paulo) also appear in the productive groups, which reflects that HSR has attracted global attention (Table 4).As in the case with countries/territories, institutions are considered as central participators in institutional collaborations’ networks. When analyzing the collaboration patterns of the 50 most productive institutions with VOSviewer (Figure 4), we found that three major clusters of institutions were generated. The largest cluster was made up of two American institutes’ groups: Harvard University, UCSF, UCLA, University of Michigan, and University of Washington were at the core position of the sub-clusters, respectively. Canadian institutions constituted a similar cluster, and University of Toronto was the core institution of this group. In contrast, the third cluster was made up of institutions form different countries (such as the UK, Australia, Sweden, Brazil) and organizations (such as the WHO). The WHO plays the bridge in increasing the collaboration among these countries and institutions. Thus, the American and Canadian institutions and the WHO are in the core status of the correspondent clusters (Figure 4).
Authors of publications and collaborations
Consistently with observations in other fields, a small group of productive authors contributed to a significant share of publications in HSR. For example, the top 200 or 0.25% of authors had produced 3,195 or 11.10% of the total health systems articles. The 20 most productive authors identified in the area of HSR and the over 20 published papers are listed in Table 5. These 20 authors together contributed to the publication of 628 papers, i.e., an average of 31.40 papers per author, which accounted for a 2.18% share in the cumulative worldwide publication output during the period 1900–2012. The most productive authors in HSR were McKee M with 48 articles, followed by Valenstein M, McCarthy JF, Christensen RD, Henry E, and Tanner M. Considering the quality/impact of papers, these 20 most productive authors have received a total of 13,918 citations for the 628 papers they have published with an average of 22.16 citations per article. Murray CJL’s 26 works had 1,407 global citations score, followed by Piette JD, Miller DR, Davis K, Starfield B, and Frenk J. With regards to the local citations score, Murray CJL had the highest local citations score of 248, followed by Frenk J, McKee M, and Piette JD. Moreover, in the AGCS, which is sorted in descending order, Murray CJL ranked first, followed by Piette JD, Miller DR, Starfield B, Davis K, and Chopra M. Considering the fact that older articles are likely to have more citations, we also calculated the TLCS/t and TGCS/t of every author (Table 5). There was a high proportion of American researchers (17 out of 23) in the top 20 list, which suggests that there are many active researchers conducting health systems studies in the USA, a country with high health expenditures (Table 5).
We also analyzed the collaboration patterns of the 50 most productive authors with VOSviewer, and the collaboration map is presented in Figure 5. We noticed that several authors tended to cooperate with a small group of collaborators, generating five major clusters of authors, each usually had one or two core authors. Others were singles in the productive authorship collaboration network. According to the social network analysis, it proved that the research collaboration in HSR is not tight. The component analysis found that five research groups can be regarded as the backbone in this field. Therefore, researchers in HSR should strengthen their collaboration to improve the development and academic level of this field (Figure 5).
Citation of research papers
The total citation count obtained from the WoS database shows that the total time that a particular article was cited by other research work is listed in this database. The number of citations does not necessarily indicate the quality of a paper, but it is a measure of its impact and/or visibility in this field. The top 11 most frequent cited articles that were selected (LCS ≥48 times) from 1900 to 2012 are listed in Table 6. The most frequent cited article was ‘The De Facto US Mental and Addictive Disorders Service System’. ‘Epidemiologic Catchment Area Prospective 1-Year Prevalence Rates of Disorders and Services’ written in 1993 by Regier DA from the National Institutes of Health of USA, has been cited 1,183 times since being published in the journal Archives of General Psychiatry, which vastly exceeds the citation of other articles. Meanwhile, Evans T from the WHO had the highest contribution (No. 10 and 11) of articles among the 11 most frequently cited articles, which also exhibited its predominance. In addition, among the top 11 cited papers, USA contributed to 7 and Switzerland 3 articles, respectively, and Brazil, a developing country and an ‘emerging economy’, held 1. The WHO published 3 articles and ranked first among all institutions, which reflects its dominant position in the HSR (Table 6).
Keywords and co-words analysis
To locate the most popular research topics and their trends, the distribution of authors’ keywords and keywords-plus was investigated. As for author keywords analysis, they offer information about research trends from the view of researchers, and they have proved to be important in monitoring the development of science . Keywords-plus supplies additional search terms extracted from articles’ titles cited by authors in their bibliographies and footnotes . Therefore, the topic of papers can be obtained from the authors’ keywords and keywords-plus by cluster analysis. Hence, we performed keyword analysis to gain insights about HSR trends and frontiers.
Distribution of author keywords
Examination of author keywords in this study period revealed that, altogether, 29,480 author keywords were used, among which 21,658 (73.47%) keywords appeared only once, and 3,188 (10.81%) keywords appeared twice. The high percentage of only once author’s keywords probably indicated to the lack of continuity in research and a wide disparity in research focus. Another reason was that these keywords might not be standard or widely accepted by researchers. Author keywords appearing in articles that refer to HSR were calculated, and the top 60 author keywords were used and clustered with VOSviewer from 1900 to 2012 (Figure 6). The top three most frequently used keywords were ‘health policy’, ‘epidemiology’, and ‘health care’, which was highly accorded with the research trend as we know. The 60 author keywords were divided into four groups, and represent the hot research areas of HSR.
Group 1 (red) includes health policy and analysis research such as policy design and implementation [48–50], challenges of health policy and health technology [51, 52], health care system reforms and performance monitoring [53–56] (i.e., China), metropolitan and regional health planning , priority setting and agendas [58, 59], policy of financial access and equity . New health policies represent the efforts in introducing deliberate and purposeful changes within health systems. Ideas and concepts’ analysis are related to such policy and are important parts of HSR. When seeking support for better policy implementation, it is critical that we understand the factors that influence the policy outcomes. Through understanding the nature of the policy and the processes of policy changes we could gain new insights that help to explain how health systems actors and the relationships of power and trust among them influence health systems performance. Health systems and sub-systems research includes health systems frameworks [60, 61], health systems management [62, 63], health systems strengthening [13, 17, 21], health systems evaluation [48, 64], accessibility, equality and efficiency of health systems [65–67], primary care system , public health systems [69–71], and mental health systems [72–74]. Healthcare and services research (i.e., Brazil) include accessibility, equality and efficiency of healthcare [75, 76], primary healthcare and mental healthcare [49, 73, 74, 77–79], managed care and integrated care [80–82], healthcare innovation [83, 84], health care delivery models [85, 86], responsiveness to health services [53, 87], influencing demand for care [88, 89], financial question of healthcare [48, 90]. Health includes health measurement and evaluation [91, 92], health promotion , health accessibility and equality [94–96].
Group 2 (green) includes epidemiology and economics of communicable diseases, such as HIV, tuberculosis, and malaria, and non-communicable diseases, such as hypertension, diabetes, cancer, obesity, global diseases [4, 21, 97], especially in elderly and children, and developing countries.
Group 3 (yellow) includes primary care research, training and education [98–100], quality of care [101, 102], quality improvement , patient safety improvement and management , primary care expenditure , general practitioner , contribution of primary care to health systems and health , primary care reform and evaluation, family medicine [107, 108], health literacy [67, 109, 110], chronic disease management , and integrated care.
Group 4 (blue) includes health economics and health costs, health expenditure control [112, 113], health economic evaluation [114, 115], costs of disease and care, economic burden of disease [4, 58]. Pharmacy of hospital includes pharmacy practice in hospital [116, 117], pharmacy residency in hospital [118, 119], pharmacy practice model [120, 121], monitor of health-system pharmacy [122, 123], and access, quality, and safety of medicines . These four groups contain eight topics, which are the major hotspots in all HSR topics and are thus considered to be the basic academic trends as shown in Figure 6.
Distribution of keywords-plus
As supplies of author keywords, we also examined the co-occurrence relationships among the top 60 high frequency keywords-plus and the co-word networks were visualized using VOSviewer (Figure 7). With the analysis of keywords-plus, again, the top three most frequently used keywords-plus were ‘care’, ‘United States’, and ‘mortality’. The similarities between author keywords and keywords-plus could be listed. Similarly to the map of author keywords, ‘policy’, ‘system’, ‘health’, ‘care’, ‘health care’, ‘services’, ‘epidemiology’, ‘prevention’, ‘risk factors’, ‘mortality’, ‘children’, ‘adults’, ‘insurance’, ‘primary care’, ‘education’, ‘quality of life’, ‘access’, ‘cost-effectiveness’, ‘costs’, ‘developing-countries’, and ‘medicine’ also appeared in the top 60 most frequently used keywords (Figure 6). ‘Meta-analysis’ and ‘randomized controlled trial’ were not in the map of top author keywords, but also had significant roles in the map. That means these analytical methods were frequently used in HSR. Moreover, ‘disorders’ and ‘schizophrenia’ show that mental health research was also a hot topic in recent years. In addition, research interests that are related to the USA received relatively more attention. Finally, there were clearly increasing research interests in ‘efficacy’ as well as in topics related to ‘community’, ‘physicians’, and ‘women’ judging by the relatively higher ranking of these keywords. They represented the research emphasis of HSR (Figure 7).
In this study, we have provided a supplemental evaluation of the status of HSR. Our analysis confirms that papers in HSR have increased rapidly during the last 20 years, and most notably in the last 8 years. In total, there were 28,787 research articles published in 3,674 journals listed in 140 SCI subject categories. Research in the fields of HSR have mainly focused on public, environmental and occupational health, health care sciences and services, and general and internal medicine. All output has been concentrated in several journals such as Social Science and Medicine, Health Policy, Health Affairs, and BMC Health Services Research. Hence, these journals are the core journals and play important roles during the knowledge dissemination and exchange in HSR.
The HSR output is distributed unevenly by countries, institutes, and authors. OECD countries, especially the G7 countries, have published the majority of articles. In addition, USA, UK, and Canada stand in the core of international collaborative networks. Thus, they promote the creation, transmission, and sharing of knowledge in HSR fields. China, a developing country, also plays an important role in the country’s collaborative network category. Furthermore, American and Canadian institutions, and the WHO have made great advances in paper research production, citation, and cooperation, along with the overall great strengths and good development prospects. Meanwhile, the most frequently cited articles come from the USA and Switzerland, during which American-authored papers had contributed the most to this field. Brazil, a developing country and as an emerging economy, also held one. The WHO published three articles and ranked first among all institutions, reflecting its dominant position in the HSR. McKee M, from the London School of Hygiene & Tropical Medicine published the most articles. However, most of the productive authors are from American institutes, such as University of Michigan. Finally, it could be concluded that the USA and its universities and academic institutions play a dominant role in the production, collaboration, citation, and high quality of articles.
HSR is an interdisciplinary area and includes medicine, public-environmental and occupational health, health care sciences and services, pharmacology and pharmacy, economics, sociology, information science and technology, and psychology. Whilst health economics is a central discipline of HSR, the analyses most centrally fell within HSR, including work that focuses on financing. Its current hotspots center on health policy and analysis research, health systems and sub-systems research, healthcare and services research, epidemiology/economics of communicable and non-communicable global diseases, primary care research, health economics and health costs, pharmacy of hospital, and health (such as health measurement and evaluation, health promotion, health accessibility and equality). Meanwhile, the main topics found from the analysis of keywords-plus are in accordance with authors’ keywords analysis results. Further, ‘meta-analysis’, ‘randomized controlled-trial’, ‘disorders’, ‘schizophrenia’, ‘United States’ ‘physicians’, and ‘women’, which were not in the top author keywords map, but also had significant roles in the keywords-plus map. Hence, these topics are also hot topics in HSR. Furthermore, from the perspective of citation, most researchers that have studied health systems have concentrated on the topics of health outcomes (i.e., health outcomes measurement), responsiveness to health systems (i.e., trust and satisfaction), leadership and governance (i.e., priority setting, performance monitoring and accountability arrangements), health financing and health expenditure (i.e., catastrophic health expenditure, and protected from financial catastrophe), health services and quality of care (i.e., access, quality, safety, and continuity), health performance assessment (i.e., framework), health information systems (i.e., electronic medical record), and health workforce. In addition, more and more attention has been paid to the developing countries, especially the ‘emerging economies’ (such as Brazil and China).
These findings will provide evidence of the current status and trends in HSR all over the world, as well as clues to the impact of this popular topic, thus helping scientific researchers understand the panorama of HSR, and predict the dynamic directions of research. Therefore, based on these findings, policy makers could understand the status and positions of their countries or institutions, and the directions of HSR all over the world. Thus, they could spell out suggestions for HSR or reform directions. For example, they could develop post-MDG global health agendas, set health systems priorities areas, strengthen fragile blocks of health systems, and learn successful lessons from abroad to achieve universal health coverage. Meanwhile, the process of developing an HSR study begins with identifying the topic of focus – the issue or problem you want to investigate – and the related questions. Hence, with the help of these findings, researchers could select their research directions or topics, cooperative institutions and partners, and even choose academic achievements’ platform exchange. In addition, because HSR is defined by the topics and the questions it addresses rather than the disciplinary perspective or the particular approach to data collection and analysis it adopts, the distribution of research subjects and hot topics will help people to understand the concepts of health systems.
The results presented herein can provide evidence about the current status and future trends in HSR, as well as clues to the impact of this hot topic. However, they could not present the research foci of HSR simultaneously from multiple angles. For example, we could not clearly present the research features of journals, countries, institutions, or authors in one knowledge map. Further, we could not show the evolution pathway of HSR from different angles, such as the topic changes with time. Thus, future efforts are needed to describe the features of journals, countries, institutes, and authors, specifically the performance changes of processes in health systems areas.
average global citation score
Alliance for Health Policy and Systems Research
Health Systems Research
Millennium Development Goals
Organization for Economic Co-operation and Development
total global citation score
total local citation score
World Health Organization’s
Web of Science.
Ghaffar A, Tran NT, Reddy KS, Kasonde J, Bajwa T, Ammar W, Ren M, Rottingen JA, Mills A: Changing mindsets in health policy and systems research. Lancet. 2013, 381: 436-437. 10.1016/S0140-6736(12)61858-3.
Mills A: Health policy and systems research: defining the terrain; identifying the methods. Health Policy Plan. 2012, 27: 1-7. 10.1093/heapol/czr006.
Irwin A, Valentine N, Brown C, Loewenson R, Solar O, Brown H, Koller T, Vega J: The Commission on social determinants of health: tackling the social roots of health inequities. Plos Medicine. 2006, 3: e106-10.1371/journal.pmed.0030106.
Atun R: Health systems, systems thinking and innovation. Health Policy Plan. 2012, 27 (Suppl 4): iv4-8.
WHO: Everybody’s Business: Strengthening Health Systems to Improve Health Outcomes. 2007, WHO’s framework for action. Geneva: World Health Organization
WHO: The world health report 2000: health systems: improving performance. 2000, Geneva: World Health Organization
Sheikh K, Gilson L, Agyepong IA, Hanson K, Ssengooba F, Bennett S: Building the field of health policy and systems research: framing the questions. PLoS Med. 2011, 8: e1001073-10.1371/journal.pmed.1001073.
Adam T, de Savigny D: Systems thinking for strengthening health systems in LMICs: need for a paradigm shift. Health Policy Plan. 2012, 27 (Suppl 4): iv1-3.
AHPSR: Health Policy and Systems Research. A Methodology Reader. Edited by: Gilson L. 2011, Geneva: World Health Organization
Bennett S, Adam T, Zarowsky C, Tangcharoensathien V, Ranson K, Evans T, Mills A: From Mexico to Mali: progress in health policy and systems research. Lancet. 2008, 372: 1571-1578. 10.1016/S0140-6736(08)61658-X.
Sundewall J, Swanson RC, Betigeri A, Sanders D, Collins TE, Shakarishvili G, Brugha R: Health-systems strengthening: current and future activities. Lancet. 2011, 377: 1222-1223. 10.1016/S0140-6736(10)60679-4.
Frenk J: The global health system: strengthening national health systems as the next step for global progress. PLoS Medicine. 2010, 7: e1000089-10.1371/journal.pmed.1000089.
Adam T, Hsu J, de Savigny D, Lavis JN, Rottingen JA, Bennett S: Evaluating health systems strengthening interventions in low-income and middle-income countries: are we asking the right questions?. Health Policy Plan. 2012, 27 (Suppl 4): iv9-19.
Ghaffar A, Tran N, Kieny MP, Etienne C: Putting health policy and systems research on the map. Bull World Health Organ. 2012, 90: 797-797A. 10.2471/BLT.12.113118.
AHPSR: Strengthening Health Systems: the Role and Promise of Policy and Systems Research. 2004, Geneva: Alliance for Health Policy and Systems Research
AHPSR: Sound Choices: Enhancing Capacity for Evidence-Informed Health Policy. 2007, Geneva: Alliance for Health Policy and Systems Research, World Health Organization
Savigny De DAT: Systems Thinking for Health Systems Strengthening. 2009, Geneva: Alliance for Health Policy and Systems Research, World Health Organization
Bennett S, Agyepong IA, Sheikh K, Hanson K, Ssengooba F, Gilson L: Building the field of health policy and systems research: an agenda for action. PLoS Med. 2011, 8: e1001081-10.1371/journal.pmed.1001081.
Gilson L, Hanson K, Sheikh K, Agyepong IA, Ssengooba F, Bennett S: Building the field of health policy and systems research: social science matters. PLoS Med. 2011, 8: e1001079-10.1371/journal.pmed.1001079.
Travis P, Bennett S, Haines A, Pang T, Bhutta Z, Hyder AA, Pielemeier NR, Mills A, Evans T: Overcoming health-systems constraints to achieve the Millennium Development Goals. Lancet. 2004, 364: 900-906. 10.1016/S0140-6736(04)16987-0.
Swanson RC, Cattaneo A, Bradley E, Chunharas S, Atun R, Abbas KM, Katsaliaki K, Mustafee N, Mason Meier B, Best A: Rethinking health systems strengthening: key systems thinking tools and strategies for transformational change. Health Policy Plan. 2012, 27 (Suppl 4): iv54-61.
Enachescu C, Postelnicu T: Patterns in journal citation data revealed by exploratory multivariate analysis. Scientometrics. 2003, 56: 43-59. 10.1023/A:1021946506987.
Faba-Perez C, Guerrero-Bote VP, De Moya-Anegon F: Data mining in a closed Web environment. Scientometrics. 2003, 58: 623-640.
Boyack KW, Klavans R, Borner K: Mapping the backbone of science. Scientometrics. 2005, 64: 351-374. 10.1007/s11192-005-0255-6.
Pouris A, Pouris A: Scientometrics of a pandemic: HIV/AIDS research in South Africa and the World. Scientometrics. 2011, 86: 541-552. 10.1007/s11192-010-0277-6.
Samb B, Evans T, Dybul M, Atun R, Moatti JP, Nishtar S, Wright A, Celletti F, Hsu J, Kim JY, Brugha R, Russell A, Etienne C, World Health Organization Maximizing Positive Synergies Collaborative Group: An assessment of interactions between global health initiatives and country health systems. Lancet. 2009, 373: 2137-2169.
Ritz LS, Adam T, Laing R: A bibliometric study of publication patterns in access to medicines research in developing countries. South Med Rev. 2010, 3: 2-6.
Adam T, Ahmad S, Bigdeli M, Ghaffar A, Rottingen JA: Trends in health policy and systems research over the past decade: still too little capacity in low-income countries. Plos One. 2011, 6: e27263-10.1371/journal.pone.0027263.
Thulasi K, Arunachalam S: Mapping of cholera research in Indian using HistCite. Ann Lib Inf Stu. 2010, 57: 310-326.
Wang L, Pan Y: Research frontiers and trends in graphene research. New Carbon Materials. 2010, 25: 401-408.
Lucio-Arias D, Leydesdorff L: Proceedings of ISSI 2007. 11th International Conference of the International Society for Scientometrics and Informetrics. A Validation Study of HistCite™ Using the Discoveries of Fullerenes and Nanotubes. Madrid, Spain: CSIC, 25–27 June 2007
van Eck NJ, Waltman L: Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics. 2010, 84: 523-538. 10.1007/s11192-009-0146-3.
Mutschke P: Mining networks and central entities in digital libraries. A graph theoretic approach applied to co-author networks. Advances in Intelligent Data Analysis V. Volume 2810. Edited by: Berthold MR, Lenz HJ, Bradley E, Kruse R, Borgelt C. 2003, Berlin: Springer Verlag, 155-166.
Knapp J: What is a co-author?. Representations. 2005, 89: 1-29. 10.1525/rep.2005.89.1.1.
Leydesdorff L: Why words and co-words cannot map the development of the sciences. J Amer Soc Inf Sci. 1997, 48: 418-427. 10.1002/(SICI)1097-4571(199705)48:5<418::AID-ASI4>3.0.CO;2-Y.
Anderberg MR: Cluster analysis for applications. 1973, New York: Academic Press
Eisen MB, Spellman PT, Brown PO, Botstein D: Cluster analysis and display of genome-wide expression patterns. Proc Natl Acad Sci U S A. 1998, 95: 14863-14868. 10.1073/pnas.95.25.14863.
Ketchen DJ, Shook CL: The application of cluster analysis in strategic management research: an analysis and critique. Strategic Management J. 1996, 17: 441-458. 10.1002/(SICI)1097-0266(199606)17:6<441::AID-SMJ819>3.0.CO;2-G.
Tinga N, De N, Vien HV, Chau L, Toan ND, Kager PA, Vries PJ: Little effect of praziquantel or artemisinin on clonorchiasis in Northern Vietnam. A pilot study. Trop Med Int Health. 1999, 4: 814-818. 10.1046/j.1365-3156.1999.00499.x.
Dang Y, Zhang YL, Hu PJH, Brown SA, Chen HC: Knowledge mapping for rapidly evolving domains: a design science approach. Decision Support Systems. 2011, 50: 415-427. 10.1016/j.dss.2010.10.003.
Zhang SL, Wang JP, Zhao YJ: Proceedings of the 7th National Conference on Functional Materials and Applications (FMA 2010 E-BOOK). Analysis of International Proprietary Technology Development of Solid State Lighting Material. 2010, 984-992.
Campanario JM, Carretero J, Marangon V, Molina A, Ros G: Effect on the journal impact factor of the number and document type of citing records: a wide-scale study. Scientometrics. 2011, 87: 75-84. 10.1007/s11192-010-0333-2.
Wang CD, Wang Z: Evaluation of the models for Bradford’s law. Scientometrics. 1998, 42: 89-95. 10.1007/BF02465014.
Suk FM, Lien GS, Yu TC, Ho YS: Global trends in Helicobacter pylori research from 1991 to 2008 analyzed with the Science Citation Index Expanded. Eur J Gastroenterol Hepatol. 2011, 23: 295-301. 10.1097/MEG.0b013e3283457af7.
Arunachalam S, Doss MJ: Mapping international collaboration in science in Asia through coauthorship analysis. Current Science. 2000, 79: 621-628.
Li LL, Ding GH, Feng N, Wang MH, Ho YS: Global stem cell research trend: Bibliometric analysis as a tool for mapping of trends from 1991 to 2006. Scientometrics. 2009, 80: 39-58. 10.1007/s11192-008-1939-5.
Garfield E: KeyWords PlusTM: ISIS breakthrough retrieval method. 1. Expanding your searching power on current-contents on diskette. Current Contents. 1990, 32: 5-9.
Belaid L, Ridde V: An implementation evaluation of a policy aiming to improve financial access to maternal health care in Djibo district, Burkina Faso. Burkina Faso. BMC Pregnancy Childbirth. 2012, 12: 143-10.1186/1471-2393-12-143.
Santos MC, Tesser CD: A method for the implementation and promotion of access to comprehensive and complementary primary healthcare practices. Cien Saude Colet. 2012, 17: 3011-3024. 10.1590/S1413-81232012001100018.
Wald H, Richard A, Dickson VV, Capezuti E: Chief nursing officers’ perspectives on Medicare’s hospital-acquired conditions non-payment policy: implications for policy design and implementation. Implement Sci. 2012, 7: 78-10.1186/1748-5908-7-78.
Gadelha CA, Costa LS: Health and development in Brazil: progress and challenges. Rev Saude Publica. 2012, 46 (Suppl 1): 13-20.
Silva HP, Petramale CA, Elias FT: Advances and challenges to the Brazilian policy of health technology management. Rev Saude Publica. 2012, 46 (Suppl 1): 83-90.
Kowal P, Naidoo N, Williams SR, Chatterji S: Performance of the health system in China and Asia as measured by responsiveness. Health. 2011, 3 (10): 638-646. 10.4236/health.2011.310108.
Wagstaff A, Yip W, Lindelow M, Hsiao WC: China’s health system and its reform: a review of recent studies. Health Economics. 2009, 18: S7-S23. 10.1002/hec.1518.
Yip W, Mahal A: The health care systems of China and India: Performance and future challenges. Health Affairs. 2008, 27: 921-932. 10.1377/hlthaff.27.4.921.
Liu Y, Rao K, Wu J, Gakidou E: China's health system performance. Lancet. 2008, 372: 1914-1923. 10.1016/S0140-6736(08)61362-8.
Ianni AM, Monteiro PH, Alves OS, Morais Mde L, Barboza R: Metropolitan and regional health planning: dilemmas of the Pact for Health in the Baixada Santista Metropolitan Area, Sao Paulo State, Brazil. Cadernos De Saude Publica. 2012, 28: 925-934. 10.1590/S0102-311X2012000500011.
Ranson MK, Bennett SC: Priority setting and health policy and systems research. Health Res Policy Syst. 2009, 7: 27-10.1186/1478-4505-7-27.
Gonzalez-Block MA: Health policy and systems research agendas in developing countries. Health Res Policy Syst. 2004, 2: 6-10.1186/1478-4505-2-6.
van Olmen J, Marchal B, Van Damme W, Kegels G, Hill PS: Health systems frameworks in their political context: framing divergent agendas. Bmc Public Health. 2012, 12: 774-10.1186/1471-2458-12-774.
Gruskin S, Ahmed S, Bogecho D, Ferguson L, Hanefeld J, Maccarthy S, Raad Z, Steiner R: Human rights in health systems frameworks: what is there, what is missing and why does it matter?. Glob Public Health. 2012, 7: 337-351. 10.1080/17441692.2011.651733.
Hadizadeh F, Yazdani S, Ferdosi M, Haghdoost AA, Rashidian A, Hadadgar A, Monajemi AR, Tofighi S, Sabzghabaee AM, Adibi P: How can we motivate medical sciences students to learn health system management? A report of the first national Olympiad on managerial reasoning and decision-making. J Res Med Sci. 2012, 17: S253-S258.
Chaves LDP, Tanaka OY: Nurses and the assessment in health system management. Revista Da Escola De Enfermagem Da Usp. 2012, 46: 1274-1278. 10.1590/S0080-62342012000500033.
Schneider H: Introduction to Health Systems Research and Evaluation. Masters in Public Health course powerpoint slides. 2011, Cape Town: University of Cape Town
Steinberg AG, Barnett S, Meador HE, Wiggins EA, Zazove P: Health care system accessibility. J Gen Internal Med. 2006, 21: 260-266. 10.1111/j.1525-1497.2006.00340.x.
Jones AM, Rice N, Robone S, Dias PR: Inequality and polarisation in health systems' responsiveness: a cross-country analysis. J Health Econ. 2011, 30: 616-625. 10.1016/j.jhealeco.2011.05.003.
Volandes AE, Paasche-Orlow MK: Health literacy, health inequality and a just healthcare system. American J Bioethics. 2007, 7: 5-10.
Macinko J, Starfield B, Shi L: The contribution of primary care systems to health outcomes within Organization for Economic Cooperation and Development (OECD) countries, 1970–1998. Health Serv Res. 2003, 38: 831-865. 10.1111/1475-6773.00149.
Ingram RC, Scutchfield D, Charnigo R, Riddell MC: Local Public Health System Performance and Community Health Outcomes. Amer J Preventive Med. 2012, 42: 214-220. 10.1016/j.amepre.2011.10.022.
Hunter JC, Yang JE, Petrie M, Aragon TJ: Integrating a framework for conducting public health systems research into statewide operations-based exercises to improve emergency preparedness. Bmc Public Health. 2012, 12: 680-10.1186/1471-2458-12-680.
Dilley JA, Bekemeier B, Harris JR: Quality Improvement Interventions in Public Health Systems A Systematic Review. Amer J Prev Med. 2012, 42: S58-S71. 10.1016/j.amepre.2012.01.022.
Liu J, Ma H, He YL, Xie B, Xu YF, Tang HY, Li M, Hao W, Wang XD, Zhang MY, Ng CH, Goding M, Fraser J, Herrman H, Chiu HF, Chan SS, Chiu E, Yu X: Mental health system in China: histoty, recent 210 service reform and future challenges. World Psychiatry. 2011, 10: 210-216.
Maass J, Mella C, Risco L: Current challenges and future perspectives of the role of governments in the psychiatric/mental health systems of Latin America. Inter Rev Psychiatry. 2010, 22: 394-400. 10.3109/09540261.2010.500876.
Hendryx M: State mental health funding and mental health system performance. J Mental Health Policy Econ. 2008, 11: 17-25.
van de Ven W, Beck K, Buchner F, Schokkaert E, Schut FT, Shmueli A, Wasem J: Preconditions for efficiency and affordability in competitive healthcare markets: Are they fulfilled in Belgium, Germany, Israel, the Netherlands and Switzerland?. Health Policy. 2013, 109: 226-245. 10.1016/j.healthpol.2013.01.002.
Garcia LP, Sant'Anna AC, de Magalhaes LCG, Aurea AP: Healthcare expenses of Brazilian families living in metropolitan areas: composition and trends during the period from 1995 to 2009. Ciencia Saude Coletiva. 2013, 18: 115-128. 10.1590/S1413-81232013000100013.
Moghadam MN, Sadeghi V, Parva S: Weaknesses and Challenges of Primary Healthcare System in Iran: A Review. Interl J Health Plann Manag. 2012, 27: e121-e131. 10.1002/hpm.1105.
Sollazzo A, Berterretche R: The Integrated National Healthcare System in Uruguay and the challenges for Primary Healthcare. Ciencia Saude Coletiva. 2011, 16: 2829-2840. 10.1590/S1413-81232011000600021.
Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, Glass JE, York JL: A Compilation of Strategies for Implementing Clinical Innovations in Health and Mental Health. Med Care Res Rev. 2012, 69: 123-157. 10.1177/1077558711430690.
Shapiro J: The future of healthcare systems – Rigid managed care programmes should never replace systems that allow flexibility. Br Med J. 1997, 315: 953-953. 10.1136/bmj.315.7113.953.
Norfolk E, Hartle J: Nephrology Care in a Fully Integrated Care Model: Lessons from the Geisinger Health System. Clin J Amer Soc Nephrol . 2013, 8: 687-693. 10.2215/CJN.08460812.
Monroe CD, Chin KY: Specialty Pharmaceuticals Care Management in an Integrated Health Care Delivery System with Electronic Health Records. J Managed Care Pharmacy. 2013, 19: 334-344.
Thakur R, Hsu SHY, Fontenot G: Innovation in healthcare: issues and future trends. J Business Res. 2012, 65: 562-569. 10.1016/j.jbusres.2011.02.022.
Riehle MA, Hyrkas K: Improving quality in healthcare – current trends and innovations. J Nursing Management. 2012, 20: 299-301. 10.1111/j.1365-2834.2012.01434.x.
Pressman AR, Lo JC, Chandra M, Ettinger B: Methods for Assessing Fracture Risk Prediction Models: Experience With FRAX in a Large Integrated Health Care Delivery System. J Clinical Densitometry. 2011, 14: 407-415. 10.1016/j.jocd.2011.06.006.
LeMay NV, Bocock PJ: Building a national model for knowledge exchange in Malawi: findings from a health information needs assessment. J Health Commun. 2012, 17 (Suppl 2): 64-78.
Peters DH, Kanjilal B: Health insurance & responsiveness to communities & patients: The future of health systems in India. Indian J Medical Res. 2011, 133: 9-10.
Subramanian U, Sutherland J, McCoy KD, Welke KF, Vaughn TE, Doebbeling BN: Facility-level factors influencing chronic heart failure care process performance in a national integrated health delivery system. Medical Care. 2007, 45: 28-45. 10.1097/01.mlr.0000244531.69528.ee.
Clarke G, Lynch F, Spofford M, DeBar L: Trends influencing future delivery of mental health services in large healthcare systems. Clin Psychol Sci Pract. 2006, 13: 287-292. 10.1111/j.1468-2850.2006.00040.x.
Monson SP, Sheldon JC, Ivey LC, Kinman CR, Beacham AO: Working Toward Financial Sustainability of Integrated Behavioral Health Services in a Public Health Care System. Families Systems Health. 2012, 30: 181-186.
Warner P: Statistical methods used in the development of a health measurement scale. J Family Plann Reprod Health Care. 2012, 38: 179-181. 10.1136/jfprhc-2012-100400.
Ikeda N, Shibuya K, Hashimoto H: Improving Population Health Measurement in National Household Surveys: A Simulation Study of the Sample Design of the Comprehensive Survey of Living Conditions of the People on Health and Welfare in Japan. J Epidemiol. 2011, 21: 385-390. 10.2188/jea.JE20100102.
Van Beurden EK, Kia AM, Zask A, Dietrich U, Rose L: Making sense in a complex landscape: how the Cynefin Framework from Complex Adaptive Systems Theory can inform health promotion practice. Health Promot Int. 2013, 28: 73-83. 10.1093/heapro/dar089.
King ML: Affordability, Accountability, and Accessibility in Health Care Reform implications for cardiovascular and pulmonary rehabilitation. J Cardiopulmonary Rehab Prev. 2013, 33: 144-152. 10.1097/HCR.0b013e31828f5602.
Han YL, Wei JH, Song XM, Sarah BJ, Wen CM, Zheng XY: Accessibility of Primary Health Care Workforce in Rural China. Asia-Pacific J Pub Health. 2012, 24: 833-847. 10.1177/1010539511403801.
Balabanova D, Roberts B, Richardson E, Haerpfer C, McKee M: Accessibility and affordability of health care in the former Soviet Union. Eur J Pub Health . 2012, 22: 25-26.
Font JC, Sato A: Health systems futures: the challenges of technology, prevention and insurance. Futures. 2012, 44: 696-703. 10.1016/j.futures.2012.04.009.
Gould DA: Primary-Care Provider Reflections on Research and Training From Special Issue on Ethical Quandaries When Delivering Integrated Primary Care. Families Systems Health. 2013, 31: 108-109.
Stewart M, Reid G, Brown JB, Burge F, DiCenso A, Watt S, McWilliam C, Beaulieu MD, Meredith L: Development and Implementation of Training for Interdisciplinary Research in Primary Health Care. Acad Med. 2010, 85: 974-979. 10.1097/ACM.0b013e3181dbe31f.
D'Adamo M, Short Fabic M, Ohkubo S: Meeting the health information needs of health workers: what have we learned?. J Health Commun. 2012, 17 (Suppl 2): 23-29.
D'Urzo A: Is the family physician an accomplice in the development of the ‘primary care gap’? The importance of high quality real-life primary care respiratory research. Primary Care Respiratory J. 2013, 22: 1-3. 10.4104/pcrj.2013.00006.
Mold JW, Lawler F, Schauf KJ, Aspy CB: Does patient assessment of the quality of the primary care they receive predict subsequent outcomes? An Oklahoma Physicians Resource/Research Network (OKPRN) study. J Amer Board Family Med. 2012, 25: E1-E12. 10.3122/jabfm.2012.04.120106.
Callahan CM: Quality improvement research on late life depression in primary care. Medical Care. 2001, 39: 772-784. 10.1097/00005650-200108000-00004.
Morello RT, Lowthian JA, Barker AL, McGinnes R, Dunt D, Brand C: Strategies for improving patient safety culture in hospitals: a systematic review. Bmj Quality Safety. 2013, 22: 11-18. 10.1136/bmjqs-2011-000582.
Simo J, Gervas J: Health expenditure on primary care in Spain: not enough to provide attractive services to patients and health professionals. SESPAS Report 2012. Gaceta Sanitaria. 2012, 26: 36-40.
Ambresin AE, Patton GC, Sawyer SM, English DR, Haller DM, Sanci LA: Training general practitioners to assess young peoples mental health needs: impact on general practitioner's detection of mental health issues. J Adolesc Health. 2013, 52: S9-S10.
Craig N: Certification in family medicine: worth it for a general practitioner?. Canadian Family Physician. 2011, 57: 986-987.
Lucan SC, Barg FK, Bazemore AW, Phillips RL: Family medicine, the NIH, and the medical-research roadmap: perspectives from inside the NIH. Fam Med. 2009, 41: 188-196.
Nishita C, Browne C: Advancing Research in Transitional Care: Challenges of Culture, Language and Health Literacy in Asian American and Native Hawaiian Elders. J Health Care Poor Underserved. 2013, 24: 404-418. 10.1353/hpu.2013.0025.
Kapadia-Kundu N, Sullivan TM, Safi B, Trivedi G, Velu S: Understanding health information needs and gaps in the health care system in Uttar Pradesh, India. J Health Commun. 2012, 17 (Suppl 2): 30-45.
Comino EJ, Davies GP, Krastev Y, Haas M, Christl B, Furler J, Raymont A, Harris MF: A systematic review of interventions to enhance access to best practice primary health care for chronic disease management, prevention and episodic care. Bmc Health Services Res. 2012, 12: 415-10.1186/1472-6963-12-415.
Siskou O, Kaitelidou D, Papakonstantinou V, Liaropoulos L: Private health expenditure in the Greek health care system: Where truth ends and the myth begins. Health Policy. 2008, 88: 282-293. 10.1016/j.healthpol.2008.03.016.
Barros AJD, Santos IS, Bertoldi AD: Can mothers rely on the Brazilian health system for their deliveries? An assessment of use of the public system and out-of-pocket expenditure in the 2004 Pelotas Birth Cohort Study, Brazil. Bmc Health Services Res. 2008, 8: 57-10.1186/1472-6963-8-57.
Wagstaff A, Culyer AJ: Four decades of health economics through a bibliometric lens. J Health Econ. 2012, 31: 406-439. 10.1016/j.jhealeco.2012.03.002.
Mann GH, Thomson R, Jin C, Phiri M, Vater MC, Sinanovic E, Squire SB: The role of health economics research in implementation research for health systems strengthening. Intern J Tuberculosis Lung Disease. 2011, 15: 715-721. 10.5588/ijtld.10.0749.
Pedersen CA, Schneider PJ, Scheckelhoff DJ: ASHP national survey of pharmacy practice in hospital settings: dispensing and administration – 2011. Amer J Health Syst Pharm. 2012, 69: 768-785. 10.2146/ajhp110735.
Pedersen CA, Schneider PJ, Scheckelhoff DJ: ASHP national survey of pharmacy practice in hospital settings: monitoring and patient education – 2012. Amer J Health Syst Pharm. 2013, 70: 787-803. 10.2146/ajhp120777.
Daniels CE, Pettit NN: Survey of institutions with multiple pharmacy residency programs. Amer J Health Syst Pharm. 2013, 70: 431-434. 10.2146/ajhp120475.
Al-Qadheeb NS, Alissa DA, Al-Jedai A, Ajlan A, Al-Jazairi AS: The First International Residency Program Accredited by the American Society of Health-System Pharmacists. Am J Pharmaceutical Education. 2012, 76 (10): 190-10.5688/ajpe7610190.
Manasse HR: Health-system pharmacy’s imperative for practice model change. Amer J Health Syst Pharm . 2012, 69: 972-978. 10.2146/ajhp110740.
Alsultan MS, Khurshid F, Mayet AY, Al-jedai AH: Hospital pharmacy practice in Saudi Arabia: Dispensing and administration in the Riyadh region. Saudi Pharmaceut J. 2012, 20: 307-315. 10.1016/j.jsps.2012.05.003.
Pedersen CA, Schneider PJ, Scheckelhoff DJ: ASHP national survey of pharmacy practice in hospital settings: prescribing and transcribing – 2010. Amer J Health Syst Pharm. 2011, 68: 669-688. 10.2146/ajhp100711.
Pedersen CA, Schneider PJ, Scheckelhoff DJ: ASHP national survey of pharmacy practice in hospital settings: Monitoring and patient education – 2009. Amer J Health Syst Pharm. 2010, 67: 542-558. 10.2146/ajhp090596.
Ali GKM: Accessibility of medicines and primary health care: the impact of the revolving drug fund in Khartoum State. African J Pharm Pharmacol. 2009, 3: 70-77.
Sincere thanks go to the assistance of the Centre for Health Statistics Information, Ministry of Health, People’s Republic of China. The authors are also grateful to Chris Scarf, Bobai Nathan D, Li-xiang Li, Gang Yao, and Gerard Joseph White for their helpful discussions and suggestions. The authors would also like to thank anonymous reviewers for their valuable comments.
This work was supported by the Centre for Health Statistics Information, Ministry of Health, People’s Republic of China.
The authors declare that they have no competing interests.
LY initiated and designed the study, she also obtained the funding. QY, PHL and ZYL were involved in the data collection and analysis. QY participated in the study design, collected the data, and conducted the data analysis and the writing of the manuscript. PHL contributed to the design and analysis of the data and prepared the manuscript. ZYL contributed to the data analysis and revision of the manuscript. KC, FL, SQC, LYH and TAY edited the paper. All authors were involved in the interpretation of data and have read and given final approval of this paper.
Qiang Yao, Kai Chen, Peng-hui Lyu contributed equally to this work.
Electronic supplementary material
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Yao, Q., Chen, K., Yao, L. et al. Scientometric trends and knowledge maps of global health systems research. Health Res Policy Sys 12, 26 (2014). https://doi.org/10.1186/1478-4505-12-26
- Global trend
- Health systems research
- Knowledge mapping
- Web of Science