Skip to main content

Respective healthcare system performances taking into account environmental quality: what are the re-rankings for OECD countries?

Abstract

Background

Efficiency analyses have been widely used in the literature to rank countries regarding their health system performances. However, little place has been given to the environmental aspect: two countries with the same characteristics could experience completely different healthcare system outcomes just because they do not face the same environmental quality situation, which is a major determinant of the health of inhabitants.

Methods

Using a stochastic frontier model, this paper analyses the effect of environmental quality on health system outcomes in OECD countries, measured by life expectancy at birth.

Results

We show that the healthcare system performance ranking of OECD countries changes significantly, depending on whether the environmental index is taken into account.

Conclusions

These findings, once again, underline the critical importance of the environment when addressing population health issues. In general, our results can be aligned with the messages of the One Health approach literature.

Peer Review reports

Introduction

Since the beginning of this century, there has been a growing body of literature on the issue of health system efficiency. This notion reflects the best way for a country to take advantage of several inputs or factors such as health infrastructures, number of nurses or physicians, the level of education and so on to produce the best health output for its population. With this in mind, countries could therefore be compared with respect to their “performance” (the extent to which the goal of an efficient use of inputs is achieved). For instance, in 2014, per capita, the United States of America was 35% richer and spent almost twice more on health than France, but the life expectancy at birth was almost 4 years longer in France than in the United States [1].

In the same period, the research devoted to the environment in health system performance studies is tiny, despite the extensive literature that documents the relationship between environment quality and population health status [2]. Pollution is one of the major causes of disease and was responsible for 9 million premature deaths around the world in 2015 [3]. Conversely, preserving ecosystems, such as green forests, extends life expectancy by improving air quality.

A study by WHO [4] in 2000 was the first to propose an assessment and ranking of all national health system performances [5]. The approach used was to estimate a fixed-effect panel data model, with education and health expenditure as health inputs, to assess time-invariant country health system inefficiency. This generated much debate and several authors afterwards suggested alternative methods, such as data envelopment analysis [6] or stochastic frontier analysis [7], to correct the shortcomings of the WHO seminal study.

Nevertheless, none of these studies includes environmental quality as a factor in the process of creating and maintaining population health. In addition, ranking the efficiencies of health systems could give an incomplete picture of the external challenges and opportunities a healthcare system has to deal with. That is, for an aggregate health output such as life expectancy, a country could perform better than another with the same characteristics, including proper use of factors, just because it has better environmental assets that improve air quality and contribute to reducing deaths. Contrarily, it is more challenging to foster health in an area where air pollution is endemic and a proportion of the population does not have access to adequate sanitation facilities. Yet the relationship between environmental quality and health is well documented in the literature. For instance, Ebenstein et al. [8] claim that China’s modest longevity gains (compared to its neighbours) at the beginning of this century was due to the poor environmental quality, that acted as a countervailing force. They show that a rise of 100 µg/m3 in particulate matter concentration in the air results in a 1.5 year shorter newborn lifespan in that country, all else equal. Hence, a health system performance assessment that leaves aside the environmental dimension may underestimate the healthcare system efficiency of countries facing harsh environmental conditions, or otherwise, overestimate the efficiency of countries with a good environment.

In this paper, we analyse the effects of environment quality on the healthcare system performances of OECD countries. Moreover, our aim is to highlight the changes in health system rankings and performances when taking into account the environment, with respect to the WHO-like healthcare system performance league table.Footnote 1

Our starting point will be the seminal analysis provided by the WHO in 2000, which has generated a lot of interest in health system efficiency (see Tandon et al. [5] and WHO [4]). This analysis offered a ranking of 191 national health systems over the period 1993–1997. Although the WHO paper only included health expenditure and education as health inputs, the critics first focused on the estimation method, and rapidly suggested strong enrichment. That is why Hollingsworth and Wildman [6], with the same data, used alternative estimation methods such as data envelopment analysis (DEA) or stochastic frontier analysis (SFA). By doing so, they relaxed the underlying assumption of the panel data model used by the WHO, that is, at least one country is perfectly efficient. However, the criticisms about time-invariant efficiency and the sample heterogeneity were not addressed.

As Hollingsworth and Wildman [6] mentioned, OECD countries, mainly defined as rich countries, could have a different health behaviour compared with other countries. For example, Joumard et al. [9], using simple panel data regression and DEA, argued that healthcare resources do not produce the same “value for money” across OECD countries, but they neglected heterogeneity in behaviour. We depart from these papers by assuming that a part of a country’s inefficiency depends on some random factors, introduced into the SFA model. In that respect, we are close to Ogloblin [7], who analysed health system performances in 78 countries. He included in a SFA model a wide range of health inputs and made the distinction between factors that could directly influence health status (total health spending, the level of education, lifestyle factors), and those that mainly affect the process of producing health, not health status itself (such as income, the share of public health spending in total health expenditure).

In the same vein, de Cos and Moral-Benito [10] investigated the effect of health system institutional arrangements (the capacity of patients to choose an insurer, the scope of basic health insurance, the presence of healthcare price regulation and so on) on their performances for 29 OECD countries. To that purpose, they firstly built a time-invariant SFA model to assess health system efficiencies. Afterwards, they regressed health system characteristics on the obtained efficiency scores. The same type of two-step approach has been used more recently by See and Yen [11] to explore the contribution of people’s happiness towards the healthcare system performances of 121 countries. They carried out a DEA analysis from which they extracted countries’ efficiency scores. The latter was regressed in a second step against a happiness index. Even though the two-step approach is fairly intuitive and popular, especially in the hospital efficiency literature, the validity of this method remains questionable [12,13,14]. As Kumbhakar et al. [15] suggested, that approach in two steps is biased due to a model mis-specification at the first step. That is why we use a single-step estimation in this paper. Finally, the channel of environmental quality as an explanatory factor of health system efficiency has not been explored in the literature, to the best of our knowledge.

This paper aims to contribute to the health system efficiency literature by highlighting the role of the environment in the process of producing health. For this purpose, we first build a baseline stochastic frontier model (SFA) with no environmental dimension, that estimates the distance between the actual level of health outcome and the potential maximum level the country can reach given its health inputs. In a second approach, we include environmental quality as an input of the health production process. Then we are able to compare model efficiency score estimations with and without the environmental dimension. Environmental quality is measured by the Environmental Performance Index (EPI) of the Yale Center for Environmental Law and Policy, that assesses countries’ performances in environmental goal attainment [16]. Regarding the health system output, we consider life expectancy at birth for its availability and its fairly intuitive interpretation [9]. After this benchmark model, other health output measures will be reviewed, such as life expectancy at 60 years, potential years of life lost, and avoidable mortality.

Our results indicate that the environment is an important factor when assessing health system efficiencies. Indeed, in the environmental model estimation, the magnitude of the effects of health inputs such as income per capita or health expenditure per capita are modified compared with the environment-free model. In regards to efficiency scores, the WHO-like model, that does not include the environment, underestimates (or overestimates) the performances of countries at the bottom (or top) of efficiency distribution, as these countries display a better (or poorer) ranking and efficiency score in the environmental SFA model. The underlying mechanism is that less well performing countries (in terms of health system efficiency) also display poor environmental quality. Hence, their health frontier, which is the potential maximum level of output, tends to be overestimated. Conversely, well-endowed countries, environmentally speaking, such as Sweden or Denmark, do not perform well in the environmental model in comparison with their scores in the WHO-like model because their estimated frontier is lower than their actual frontier, given their better environmental quality.

The remainder of the paper proceeds as follows. Section “The health production function” describes the theoretical rationale of the stochastic frontier analysis (SFA). The section “determinants of health outcomes” presents the data and the variables used in the model. The “Results” section displays the results on the estimated health production function, the “Discussion” discusses these findings and the “Conclusion” concludes.

The health production function

The health production function refers to the relationship between a health output such as life expectancy at birth, and the inputs that generated it (health expenditures, and so on). Thus, to characterize that function, a first task is to identify which measures of health system outcomes and inputs to consider. That is based on health economics literature and is the focus of the “Determinants of health outcomes” section. More importantly, it is to describe the manner or the functional form by which inputs and outputs are put together. Stochastic frontier analysis (SFA) is one of the ways of doing this while studying health system inefficiencies.

A stochastic frontier analysis applied to health systems

In this subsection, we present the SFA econometric model, and we define how to measure efficiency. It is worth mentioning that in this paper, we focus on the technical efficiency, that is, the highest level of output health systems can achieve given their inputs, as described in Fig. 1.

Fig. 1
figure 1

Technical and allocative efficiencies

Let yit denote the actual health outcome, for instance life expectancy at birth, and xit the inputs to the healthcare system. Let us also assume that the health production function can be represented by a Cobb–Douglas functionFootnote 2 and that some inefficiencies exist in the process of producing health outcomes. Therefore, the observed health outcome is defined byFootnote 3:

$$y_{it} = f\left( {x_{it} ,\beta )\exp (v_{it} - \, u_{it} } \right) = Ax_{it}^{\beta } \exp (v_{it} - u_{it} )$$
(1)

vit represents random errors or shocks that can affect the health production function. They are independent and identically distributed (iid) and follow a normal distribution N (0, σ2). uit is the inefficiency term, a non-negative iid term following a truncated normal distribution N +(µit, σ2).

Because uit is non-negative and vit is a zero-mean error, the (estimated) technical efficiency, TEit, expressed in percentage, is given byFootnote 4Footnote 5:

$$TE_{it} = exp( - \,\hat{u}_{it} )\quad {\text{where}}\;\hat{u}_{it} \, = \,E(u_{it} |v_{it} \, - \,u_{it} ).$$

The econometric model equation is obtained by a log-transformation of the production function (1):

$$Y_{it} = \alpha + \beta X_{it} - u_{it} + v_{it}$$
(2)

where α = ln(A), Yit = ln(yit) and Xit = ln(xit). Therefore, the estimation for the frontier value is:

$$FE = \exp (\hat{\alpha } + \hat{\beta }X_{it} )$$

The inefficiency in the process of producing health, uit, may depend on a set of other factors Zit and the mean µit can be expressed as µit = λ Zit and we haveFootnote 6:

$$u_{it} = \lambda Z_{it} + w_{it}$$
(3)

where wit is an iid truncated normal error N (0, σ2). The truncation point is − λ Zit. λ represents inefficiency elasticities with respect to Zit.

Scope of the analysis

The core of the paper will consist in making two successive estimations of the SFA econometric model described in the section “A stochastic frontier analysis applied to health systems”, with and without the consideration of the environment in the analysis. The model without the environment will be called model 1, while the model with is model 2. We are not intending, with this work, to analyse the causal relationship in the process of producing health at the country level. As is common in the efficiency literature, estimated parameters of the model refer to association and not causation [10, 12, 14]. Another assumption underlying efficiency analyses is that the process of producing the output does not differ a lot across the countries analysed [6, 20]. Since our sample is made up primarily of rich countries at advanced stages of development, we can assume that this assumption is justified [14, 21]. This was one of the main criticisms made of the WHO seminal analysis that included 193 countries, with very heterogeneous healthcare systems [6, 12].

Another important question is what distinguishes variables in the frontier and in the inefficiency term. Ogloblin [7] argues that the former should have a direct impact on the output, whereas factors having an indirect effect on health output are relegated in the inefficiency term. Even though this definition is widely accepted, it is still not clear while reviewing the literature which variables to include in the inefficiency term or in the frontier [10, 14, 22, 23]. In this paper, we will follow the classification by Ogloblin [7], even though this does not rule out a further analysis on variables selection.

Determinants of health outcomes

In this section, we describe the components of the health production function, as known from previous studies, and afterwards, we give some descriptive statistics of all variables.

Health inputs in the literature

Factors that directly affect health outcomes are included in the frontier analysis. These variables influence the process of production of health [7]. In the spirit of a SFA, we also have to include variables that enter as inputs of the healthcare system, but affecting health outcomes only indirectly, by acting on system performances. Bearing this distinction in mind, the following variables could potentially influence the level of health system outcomes and are therefore included in the frontier analysis.

Health expenditures It is quite evident that the amount of money devoted to healthcare is a direct determinant of health. The larger it is, the higher the life expectancy at birth is in a given country. It is expressed in per capita in current PPP.Footnote 7

Education It is well established in the literature that education is a causal factor of the health status [24,25,26]. In short, a high education level is associated with better outcomes as educated people are more likely to adopt healthier behaviours such as having a healthy diet and exercising. Education is measured in this analysis for each country by the average number of completed years of education of the population aged 25 years and older.

Alcohol consumption There is a causal relationship between alcohol consumption and health status. In 2016, the harmful use of alcohol was responsible for 3 million deaths around the world [27]. It is also associated with an increased risk of diabetes, stroke and deaths due to cardiovascular diseases [28]. Hence, the higher the alcohol consumption, the lower the health system outcome. It is measured by the number of litres of pure alcohol consumed by an adult in a year. In addition to alcohol consumption, we could have considered the use of tobacco as a lifestyle determinant of health. However, due to the lack of data, we have not included this variable in our analysis.

Obesity prevalence There is also considerable evidence in the literature that obesity is associated with an increased risk of diabetes, high blood pressure and cardiovascular diseases. It affects not only physical but also mental health [29]. Therefore, we can expect lower longevity in a country associated with a higher prevalence of obesity. The prevalence of obesity is defined in this analysis as the percentage of the population with a body mass index (BMI) larger or equal to 30 kg/m2.

Some factors are also important for health because they shape healthcare system performances; they must be included in the SFA as possible determinants of efficiency/inefficiencies. They comprise the following variables.

GDP per capita There is a consensus in the literature that income is positively related to health status; this becomes trivial when studying the socioeconomic gradient in health at the microeconomic level (comparing households in between). However, at the macroeconomic level, income per se may not affect health directly, but, preferably, by way of giving more efficiency to healthcare spending.Footnote 8This is because having higher incomes gives access to better sanitary conditions, better functioning of the inputs of the healthcare sector and could finance cutting-edge medical facilities, with an influence on healthcare spending efficiency. That is why this variable is included in the inefficiency term, as in [30] or [7].

Share of public health expenditure This is the main indicator of the importance public authorities grant to health. However, the effect of the share of public health expenditure in total health spending on health measures is not clear from the literature. For instance, while Linden and Ray [31] find a positive relationship between the share of public health spending and life expectancy, Berger and Messer [32] instead suggest the first is associated with an increased mortality. However, Greene [12] finds no statistically significant effect of the share of publicly financed health services on healthcare production efficiency. The two effects could compete. On the one hand, a greater share of public health spending is associated with more access to health, especially for people at the bottom end of income distribution. On the other hand, it is also related to more administrative burdens, complexity and inefficiency. On this point, we are agnostic and we will rely on data to show the effect on health.

Out-of-pocket expenditure Measured by the share of total health spending supported by households, it is also an important feature of a country’s health system. A higher share of out-of-pocket expenditure is associated with lower health system output as it could discourage the demand for healthcare, especially for low-income individuals. Therefore, it could affect the efficiency of healthcare systems.

EPI In model 2 (see later), we will also include the Environmental Performance Index, constructed by the Yale Center for Environmental Law and Policy. This will be presented in a special section.

Data treatment

The data used in this paper come primarily from the OECD statistical database. The share of public health expenditure has been drawn from the World Development Indicators (WDI) of the World Bank. The WHO database has provided the prevalence of obesity for each country. The mean years of schooling for each country comes from the UNESCO database. Our sample is made up of all OECD countries, except Colombia, that joined the organization in 2020. That corresponds to 36 countries observed from 2007 to 2016. Except for variables expressed in percentage or in a 0–100 scale, all the variables included in the model have been log-transformed to interpret parameter estimations as elasticities. Some of them had a few missing values and we used a simple country linear trend model to impute variables. This applies to around 5% of observations in our database.

Estimations were made using STATA V14. The database is available in csv format by clicking this weblink: “dataset” (see with the technical service of Springer Nat)”.

Descriptive statistics

For a first glimpse at the health production process, we present some summary statistics of all the variables included in the stochastic frontier analysis in Table 1. Over the period of study, life expectancy at birth is on average 80 years, and varies from 70.8 years in Latvia in 2007 to 84.1 years in Japan in 2016. These figures indicate a health output distribution skewed towards lower values, and correspond to developed countries. Thus, on average, the GDP per capita is around US$ 36 000 and can even reach more than three times this amount in Luxembourg.

Table 1 Summary statistics

It is noteworthy that Mexico, the poorest country over the period of study, does not perform well in terms of health system outcomes (with a life expectancy at birth of just 74.5 years). In addition, it is one of the countries with the lowest health expenditure per capita, maybe because the share of health expenditure supported by patients is very high (52.5%). The United States, the country with the highest health spending per capita (US$ 9904) but a longevity below the average (78.6 years), slightly decreased their high out-of-pocket health expenditure during the period of observation, as the Affordable Care Act came into effect in 2014. Before that reform, the United States was in the lower tail of the distribution of the share of public health expenditures.

Regarding lifestyle, the United States is the country where obesity is the most prevalent (36.2%) whereas the Japanese are the slimmest of our sample (2.9%). Estonia, with 14.8 L of pure alcohol consumed by an adult in a year, is the country with the highest alcohol consumption in our sample. This is associated with a lifespan well below the average, just 76 years. Finally, with 14.81 years of schooling on average in 2015, Canada is the country with the highest level of education, and this is associated with a life expectancy at birth of 81.3 years over the period, above the sample average.

The environmental performance index

There is a large body of literature, both theoretical and empirical studies, that supports the existence of a positive relationship between environment quality and health [2, 3, 33, 34]. The environmental performance index (EPI) is an indicator that was produced in 2008 by the Yale Center for Environmental Law and Policy that evaluates and ranks countries with respect to their performance in environmental goal attainment. The index is made up of two components: environmental health and ecosystem vitality [16]. The first component measures threats to environmental health and includes indicators such as fine particles exposure and access to improved sanitation or drinking water. The ecosystem vitality gauges natural resources and ecosystem services. It encompasses indicators such as the percentage of forest lost, the intensity of methane and CO2 emissions and the percentage of species living in a protected area [16].

The EPI ranges from 0 to 100, with 100 being the highest possible score in achieving environmental goals. Over the period 2007–2016, the average score is 83.43, with a standard deviation of 5.61 (Table 2). The EPI distribution is concentrated and the minimal score, reached by Turkey in 2008, is rare. This country is also the least well performing with respect to the environment in 2015 and 2016. The top five countries of the EPI distribution in 2015 (Finland, Iceland, New Zealand, Sweden, the United Kingdom), all have an above-average life expectancy. Let us also note that the United States is ranked outside the top 20, both in 2015 and in 2016, largely due to their poor performance in terms of ecosystem vitality.

Table 2 Summary statistics of the environmental performance index

Results

The validity of SFA models

Prior to estimating efficiency models, we have to check whether SFA models are suitable for our data. In other words, we test whether this model brings more meaningful information compared with a standard model, especially the ordinary least squares (OLS) simple linear model. From Equation (2), we can deduce that if the stochastic model is the right one, then the residuals of a standard OLS model (with Xit as independent variables) are skewed to the left, given the asymmetry of the distribution of inefficiency uit.

The residuals of the simple OLS model are plotted in Fig. 2a, as well as the density of a standard normal distribution. The skewness of residuals distribution is −0.398, indicating skewness to the left, which is confirmed by the P-value (0.0038) of the skewness test. This validity test depends on the health output indicator, life expectancy at birth. We will check other health outcomes at the end of this section, by following the same approach.

Fig. 2
figure 2

The normal distribution and OLS model residuals

The SFA model estimation – the baseline model

Table 3 reports the results of the stochastic frontier analysis (Equation 2). First, in a model with no environmental dimension (model 1), alcohol consumption, the prevalence of obesity and the amount of resources a country has devoted to health are the main determinants of the frontier of the health production function. A rise by 1% of the number of litres of pure alcohol consumed in a year is associated with a decline by 0.018% of the longevity on average in our countries sample over the period 2007–2016. This represents 5 days of life lost for a country with an average lifespan. Similarly, being overweight shows a detrimental effect on the maximum potential health output, as a 1-percentage-point increase of the prevalence of obesity goes along with a fall by 0.001% of the longevity. Concerning health spending, the more a country invests in health, the more its health output is improved. An increase by 1% of health expenditure is associated with a rise by 0.011% of the frontier of life expectancy at birth. Last, in our regressions made on macrodata, it seems that the level of education is not an important factor for the health outcome, as it is not statistically significant. This may be because our sample is made up of rich countries, that almost all have a high level of education. Therefore, education would not appear as an explanatory factor of the observed differences in life expectancy across countries.

Table 3 Estimates of the stochastic frontier model with out-of-pocket expenditures

Regarding health system inefficiencies, all factors are statistically significant to explain healthcare system performance across countries. The level of income seems to be the main factor of the performance of health systems. In our sample, the richer a country is, the more efficient its healthcare system is, over the period of study. Wealthy countries benefit from more medical facilities, both public and private, and they are well equipped in terms of cutting-edge medical technology that preserves life. Conversely, a higher share of out-of-pocket expenditure in total health spending is related to lower performances of healthcare systems. Indeed, this could dissuade ill people, especially the poor, to go to hospital when necessary. They consult a health service only when they are at an advanced stage of the disease, with a reduced chance of recovery. Surprisingly, a wider public health system is associated with more inefficiencies. This result may support the criticism of public intervention that creates inefficiencies by overlooking individual preferences, and that suffers from a lack of innovation compared with the private sector.

As aforementioned, these results may depend on the choice of the health output measure. Some critics have said that life expectancy at birth is not a good health measure because it encompasses a lot of the country history and does not give the full picture of recent health system improvements. We will test other health output measures at the end of this section.

As a benchmark, model 1, like Tandon et al. [5], does not include environmental quality, that the literature considers as an important determinant of health. Hence, taking it into account may change the efficiency estimation or the maximum attainable health output.

Taking environment into account

Starting from model 1, but in view of including the environment in the frontier analysis, we can add the environmental performance index (EPI) either in the frontier (model 2) or in the inefficiency term uit (model 3). Table 3 indicates that both models are statistically significant to explain the countries’ life expectancy at birth over the period of study. Putting aside the EPI, the same factors highlighted by model 1 remain significant when the environmental quality is considered, even though the magnitude of their effects is modified.

Environmental models

The EPI is statistically significant in both models 2 and 3. This means that environmental quality is a relevant factor when studying OECD countries health system performances. With EPI in the frontier, a ten-point increase of the environmental quality index goes along with a rise by 0.01% of life expectancy at birth. This represents 3 days of longevity gain for a country like France.Footnote 9 Therefore, all else equal, a country that preserves ecosystems and promotes renewable energy can reach a higher maximum health output. On the other hand, with the environmental quality in the inefficiency term, the same policy reduces the health system inefficiency.

Turning to health inputs effects, the elasticity of health output with respect to alcohol consumption is greater in models 2 (0.024) and 3 (0.023), compared with model 1. Obesity prevalence has the same effect on health whether the environmental quality is included or not, whereas compared with the model without environmental quality, the effect of health spending is lower in model 2 (0.009) and higher in model 3 (0.013). The effects of education are still negative, decreasing and not statistically significant even when the environment is considered.

Regarding the inefficiency term, including environment lessens the elasticity related to GDP per capita. From 0.184 in the model with no environmental consideration, it falls to 0.144 in model 3. The magnitude of the effects of the share of public expenditure and of out-of-pocket expenditure are almost unchanged from model 1 to models with environmental quality. Let us also mention that including the environmental quality mainly affects the income effect in the inefficiency term, and alcohol consumption and health spending in the frontier. Finally, the frontier productivity factor is greater in environmental models compared with the model with no environment dimension. We have the opposite pattern with the inefficiency-related productivity factor.

Environment in the frontier or in the inefficiency

Now we have to choose which model best takes into account environmental quality. In other words, is assuming that environmental quality affects the frontier more consistent with data, compared with assuming that the environment influences the health systems inefficiencies? To answer this question, we have to check the amount of information brought by each model. This is measured by information criteria, where the most used are the Akaike and Bayesian information criteria (AIC and BIC, respectively). The more meaningful model is the one that has the lowest value for the criterion considered. Therefore, Table 4 suggests that it is the model with environment quality affecting the maximum potential output that better fits our data, either using AIC or BIC. Hence, it is model 2 that we will use in the next subsection to assess healthcare system performances when environmental quality is included.

Table 4 Model comparison statistics with life expectancy at birth

Ranking healthcare system efficiencies

Figure 3 ranks OECD countries with respect to their health system efficiency scores in 2016, with and without environmental quality considered. We have chosen the 2016 estimations because it is the latest available year. For each of the two econometric models, we have the corresponding ranking along with histograms in descending order of the heath system efficiency. The figure suggests that countries at the top are close in terms of health performance whether the environmental dimension is added or not, although sizable changes start to occur at the middle and at the bottom of the distribution. From the figure, we also learn that health system efficiencies decrease more rapidly at the bottom of the distribution.

Fig. 3
figure 3

Health system efficiencies (%) with life expectancy at birth as health output in 2016

The environmental model – model 2 The league table derived from the environmental model displays a more concentrated distribution of health system performances compared with the one from the model without environmental consideration: efficiency scores range from 92.82% to 99.89%. Comparing the rankings of model 2 with model 1, 11 out of 36 countries have the same ranking and 15 countries climb in the league table when environmental quality is included. In the same time, only ten countries have a higher health system efficiency score in the environmental model. In short, it seems that adding the environment mainly modifies the inefficiency gap in the middle of the distribution, and that countries at the bottom tend to gain slightly in terms of (measured) efficiency. For instance, the United States falls by three positions in the ranking and France has the same ranking with a lower efficiency score. In the same time, Belgium, previously 24th, gains four places. The greatest rank improvement comes from South Korea (+6), whereas Scandinavian countries are the most disadvantaged by the environmental model, with Sweden (−7), Norway (−4) and Denmark (−3). Mexico, Turkey and Poland are at the bottom in model 1 but tend to gain efficiency in model 2 (while still remaining at the bottom of the ranking).

Until now, we have considered life expectancy at birth as the measure of the health system output. The main advantages of this indicator are its availability and its quite intuitive interpretation. However, there is a debate in the literature on the best indicator that captures the global health status of a population, and each potential candidate presents some flaws [9]. That is why we consider other health output indicators for SFA models in the next subsection.

Other health outcomes

One could have chosen other available health indicators to use in the SFA, such as life expectancy at 60, potential years of life lost, and avoidable mortality. In this section, we rapidly comment on the results when using such alternatives.

Life expectancy at 60 years With this health output, the residuals of a standard linear OLS model are skewed towards the left, as indicated by the skewness statistics equal to −0.188 < 0 (Fig. 2b). Contrary to the case with life expectancy at birth, all the variables in the SFA model are statistically significant factors of the health output (Table 5), including education (with a quadratic term). In the inefficiency term, the effects of income and of the share of public expenditure are greater compared to the SFA model with longevity at birth.

The environmental model with the EPI in the frontier becomes the preferred model, because best supported by the data (Table 8). With this health output, health systems are overall less efficient in 2016 than previously, as just around 10 countries display less than 1% of inefficiency compared with around 25 in the rankings with life expectancy at birth (Fig. 5). Similarly, the least performing country in the environmental-free model has a much lower efficiency score, 82.95% compared with 91.93%. It is also noteworthy that including the environmental dimension results in a more concentrated distribution of efficiencies. It would seem that the environment-free model overestimates the health performances of countries at the top of the ranking, and underestimates those of countries at the bottom. Sweden, Finland and Denmark are the most penalized by adding the environmental dimension, whereas Mexico are Turkey are the most advantaged.

Potential years of life lost (PYLL) This indicator attributes a higher weight to younger age deaths. Unlike the previous health output indicators, the PYLL is a negative output of the health system, that is, the smaller it is, the more efficient the healthcare system. Hence, a SFA model with this indicator would be valid if the residuals of the standard linear OLS model are skewed towards the right, which is the case here with a skewness statistic of 0.751 > 0 (Fig. 2c).

As with longevity at birth, the SFA model still suggests a negative relationship between the average years of schooling and the health status, even though education is not statistically significant (Table 6). All the other health inputs in the frontier are relevant to explain the difference in PYLL across countries over time. Including the environment in the frontier is the best environmental model as suggested by Table 9. Turning to the health systems ranking in 2016, the best performing country is Luxembourg, in which the observed PYLL is 1.79% greater than the minimal possible level of output according to the environment-free model (Fig. 6). Countries at the bottom and at the top of the league are almost the same than as with the other health output indicators. However, it is noteworthy that the United States is now among the bottom five countries in terms of health system efficiency, whatever the model considered. Belgium (+9) and South Korea (+7) are the countries whose rankings improve the most when moving from model 1 to the environmental model. At the other end of the scale, like in the previous subsection, Sweden (−7) and Denmark (−8) rankings fall the most.

Avoidable mortality According to the OECD, it is the number of deaths that could be avoided through public health and prevention intervention. Like PYLL, the smaller it is, the better it is for the national healthcare system. The residuals of the linear model are skewed towards the right, with a skewness statistic of 0.594 > 0 (Fig. 2d).

In the environment-free SFA model, the prevalence of obesity does not appear significant (as well as the frontier intercept), unlike the model with other health output measures (Table 7). The level of education is significant and the return to education is negative and increases with the years of education. Last, including the environment mainly lessens the importance of income in the health production process. Incidentally, with preventable mortality as a health output, the environmental model that is best supported by the data is model 3, that considered that environmental quality directly affects health system inefficiencies (Fig. 10).

Concerning the health system performance league table in 2016, Luxembourg still has the most efficient health system (Fig. 7). Comparing the environmental model with the environment-free benchmark model, the bottom five remain the same, whereas Switzerland and Italy are pushed out of the top five in 2016 in the environmental model. In the same way, except for Turkey and Mexico, all the countries in the bottom ten of the (in)efficiency scale come closer to their frontiers when environmental quality is taken into account. In contrast, only four countries in the top ten reduce the gap with their minimal potential health output in the environmental model.

Once again, it seems that not taking into account the environment underestimates the healthcare system performance of countries at the bottom of the efficiency distribution, since those countries are those doing poorly in terms of environmental quality. Indeed, the correlation coefficient between health system ranks in the environment-free model and the variation in the environmental model is positive, as presented in Table 11, whatever the health system output indicator. In a consistent way, the maximum potential health output of countries such as Mexico and Turkey, is overestimated in the baseline model because it does not take into account the harsher environmental conditions these countries have to cope with (Figs. 4, 8, 9, and 10).

Fig. 4
figure 4

The frontier of the health system (in years) with life expectancy at birth as the health system output in 2014

Until now, we have just described and presented the results of the stochastic frontier analysis. In the “Discussion” section, we will analyse and discuss these results to highlight the message from including environment in analysing health systems performances.

Discussion

In this paper, we introduced a multicountry–multiperiod indicator of environment quality in a stochastic frontier analysis of the OECD health systems, and we tested how it impacts their measured performances. We obtained that the indicator was highly significant as a direct factor of the populations’ health outcome and that the rankings of countries in terms of health system efficiency could be substantially modified by these considerations. The foundation of the paper can be linked to the “One Health” approach, defined by the WHO as “an approach to designing and implementing , policies, legislation and research in which multiple sectors communicate and work together to achieve better public health outcomes” [35]. The One Health approach particularly emphasizes the multiple interactions that human health has with the environment for the cases of respiratory diseases due to zoonoses (of which COVID 19 is probably one [36]), but in general it recognizes that the health of people is closely interconnected to the health of the planet [37], or at least to the quality of the local environment where people live [38]. An interconnection we confirm in the framework we use, and this could be the main finding of our own contribution.

As expected, better environmental quality is associated with higher health system outcomes, whether the EPI is included in the frontier or in the inefficiency term. When the EPI is considered as a health frontier determinant, a country with a higher environmental quality displays a higher maximum potential health output compared with the environment-free model, all else equal. By contrast, a country with harsh environmental conditions has a lower health frontier in the environmental model. Among variables included in the model, the GDP per capita is the one whose coefficient changes the most (by decreasing) when the environmental dimension is taken into account. Through the data analysis, we probably have a substitution effect in the main channels by which population health is created: the effects on health of some environmental quality components such as the level of pollution, heavy metal soil contamination or forest preservation, that were correlated with country incomes, now go through the environmental index.

We can also go a little further in the study of health system performances: let us first note that all the nonenvironmental variables included in the inefficiency term are significant to explain differences in country performances. Considering life expectancy at birth as the health output, larger shares of healthcare directly paid by households and the relative importance of the public health sector are associated with more inefficiencies. Indeed, greater out-of-pocket expenditure may discourage people’s demand for healthcare. The negative association between the size of the public health sector and health system efficiency may be explained by the failures of a government-run system to properly take into account individual preferences or by the complexity and the administrative burden associated with the public sector. However, the relationship becomes positive with PYLL or preventable mortality as health system outputs, maybe because a well-developed public health sector goes in tandem with better access to health for disadvantaged people, who are also more difficult to care for. Equity will then compete with (’measured’) efficiency.

Regarding the health system performance league table, Western European countries such as Luxembourg, France and Norway are well represented in the top of the ranking. In contrast, Eastern European countries such as Hungary and Latvia performed poorly in terms of health system efficiency in 2016, both in the baseline and the environmental models. That could be explained by the significant weight of GDP per capita as estimated by both models. However, as already noted, the effect of income is mitigated once the environment has been included in the picture. That is why some top-performing countries in the baseline model such as Luxembourg and Switzerland have lower efficiency scores in the environmental model. Let us also note that countries with high environmental quality such as France and Australia are well represented at the top of the scale of the efficiency score in the baseline model. On the contrary, Turkey, Mexico, Hungary and Poland, that are not doing well in terms of environmental quality, are also those improving their ranking the most in the environmental model, compared with the baseline one. We find the same relationship when it comes to the distance to the frontier, that is, countries with highest efficiency scores are those which move furthest away from their frontier in the environmental model compared to the baseline one. Therefore, a ranking from an environment-free model, like the one used by the WHO, overestimates performances of countries endowed with good environmental quality, and belittles those with poor environmental quality, because these unlucky countries do not benefit from the environmental conditions that favor high health output levels.

This research has some limitations that should be acknowledged. The main limitation is probably the duration of the analysis period (10 years). A longer duration would not only have offered more statistical power in the analysis, but also allowed the introduction and study of more lagged effects, with the EPI in particular. Discussions could be opened about the selection of variables that are used in the SFA model: both inputs and outputs, although we decided to follow the conventional literature and the available data. For the inputs, the mix of money-assessed variables and of quantitative ones is debatable, but it was impossible to have only quantitative inputs when doing such a large scale international comparison (for example, counting the number of GPs, specialists, nurses, etc. is a nonsense since they do not have the same roles and missions depending on the healthcare system). To discuss the issue of the appropriate outcomes, we simply decided to alternate various candidates, studying whether there were large changes associated with certain outcomes (as a sensitivity analysis).

Conclusions

The aim of this analysis was to study the effect of the environment on health system efficiency for OECD countries over the period 2007–2016. For that purpose, we estimate and compare stochastic frontier models with and without an environmental dimension. We find that the environment, when taken into account, is a major determinant of the health production function as it significantly affects the elasticities related to other health factors such as obesity, alcohol or the GDP per capita. Country health system ranking and efficiency scores are also altered. Compared with an environmental model, a baseline model with no environmental dimension underestimates countries at the bottom of the distribution. That is because such a model does not take into account the harsher environmental conditions least performing countries have to cope with to produce health. This analysis once again underlines the critical importance of the environment, for both policy-makers and researchers, when tackling health issues.

See Tables 5, 6, 7, 8, 9, 10, 11 and Figs. 5, 6, 7, 8, 9, 10

Availability of data and materials

Data are available on internet (free of charge)

Notes

  1. See WHO [4].

  2. For the sake of simplicity, a Cobb–Douglas production function has been chosen. One could have assumed a more general function such as a transcendental logarithmic one and the underlying rationale still holds.

  3. See Battese and Coelli [17].

  4. \(\hat{\mu}\) means an estimated value.

  5. uˆit = E(uit vituit) is the estimator of Jondrow et al. [18].

  6. See Battese and Coelli [19].

  7. PPP: Purchasing power parity.

  8. We tested the alternative view of introducing gross domestic product (GDP) per capita in the frontier (as a direct factor); this alternative manner was statistically dominated, giving a P-value > 0.05 for the GDP per capita variable.

  9. The estimated health frontier for France is 81.7 years.

  10. See European Observatory on Health Systems and Policies [20].

References

  1. Organization for Economic Co-operation and Development. Health at a glance 2019: OECD and G20 indicators. Paris: OECD Publishing; 2019.

    Google Scholar 

  2. Evans MF, Smith VK. Do new health conditions support mortality—air pollution effects ? J Environ Econ Manag. 2005;50(3):496–518.

    Article  Google Scholar 

  3. Landrigan PJ, Fuller R, Acosta NJR, Adeyi O, Arnold R, Basu NN, Baldé AB, Bertollini R, Bose-O’Reilly S, Boufford JI, Breysse PN, Chiles T, Mahidol C, Coll-Seck AM, Cropper ML, Fobil J, Fuster V, Greenstone M, Haines A, Hanrahan D, Hunter D, Khare M, Krupnick A, Lanphear B, Lohani B, Martin K, Mathiasen KV, McTeer MA, Murray CJL, Ndahimananjara JD, Perera F, Potocˇnik J, Preker AS, Ramesh J, Rockström J, Salinas C, Samson LD, Sandilya K, Sly PD, Smith KR, Steiner A, Stewart RB, Suk WA, Schayck OCPv, YadamaYumkellaZhong GNKM. The Lancet Commission on pollution and health. Lancet. 2018;391(10119):462–512.

    Article  PubMed  Google Scholar 

  4. World Health Organization. The World Health Report 2000: health systems: improving performance. World Health Organization. Google-Books-ID: luqgKK2euxoC. 2000.

  5. Tandon A, Murray C, Lauer J, Evans D. Measuring overall health system performance for 191 countries. Global Programme on Evidence for Health Policy Discussion Paper No. 30. 2000.

  6. Hollingsworth B, Wildman J. The efficiency of health production: reestimating the WHO panel data using parametric and non-parametric approaches to provide additional information. Health Econ. 2003;12(6):493–504.

    Article  PubMed  Google Scholar 

  7. Ogloblin CJAE. Health care efficiency across countries: a stochastic frontier analysis. Appl Econ Int Dev. 2011;11(1):5–14.

    Google Scholar 

  8. Ebenstein A, Fan M, Greenstone M, He G, Yin P, Zhou M. Growth, pollution, and life expectancy: China from 1991–2012. Am Econ Rev, 2015;105(5):226–31.

    Article  Google Scholar 

  9. Joumard I, André C, Nicq C, Chatal O. Health status determinants: lifestyle, environment, health care resources and efficiency. Technical Report 627, OECD Publishing. 2008.

  10. de Cos PH, Moral-Benito E. Determinants of health-system efficiency: evidence from OECD countries. Int J Health Care Finance Econ. 2014;14(1):69–93.

    Article  PubMed  Google Scholar 

  11. See KF, Yen SH. Does happiness matter to health system efficiency? A performance analysis. Health Econ Rev. 2018;8(1):33.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Greene W. Distinguishing between heterogeneity and inefficiency: stochastic frontier analysis of the World Health Organization’s panel data on national health care systems. Health Econ. 2004;13(10):959–80.

    Article  PubMed  Google Scholar 

  13. Rosko MD, Mutter RL. Stochastic frontier analysis of hospital inefficiency: a review of empirical issues and an assessment of robustness. Med Care Res Rev. 2008;65(2):131–66.

    Article  PubMed  Google Scholar 

  14. Wranik D. Healthcare policy tools as determinants of health-system efficiency: evidence from the OECD. Health Econ Policy Law. 2012;7:197.

    Article  PubMed  Google Scholar 

  15. Kumbhakar S, Wang H-J, Horncastle AP. A practitioner’s guide to stochastic frontier analysis using stata. Cambridge: Cambridge Books, Cambridge University Press; 2015.

    Book  Google Scholar 

  16. Wendling Z, Emerson J, Esty D, Levy M, de Sherbinin A. 2018 Environmental Performance Index (EPI). January 2018. https://doi.org/10.13140/RG.2.2.34995.12328.

  17. Battese GE, Coelli TJ. Frontier production functions, technical efficiency and panel data : with application to paddy farmers in India. J Prod Anal. 1992;3(1):153–69.

    Article  Google Scholar 

  18. Jondrow J, Knox Lovell CA, Materov IS, Schmidt P. On the estimation of technical inefficiency in the stochastic frontier production function model. J Econ. 1982;19(2):233–8.

    Article  Google Scholar 

  19. Battese GE, Coelli TJ. A model for technical inefficiency effects in a stochastic frontier production function for panel data. Empir Econ. 1995;20(2):325–32.

    Article  Google Scholar 

  20. Cylus J, Papanicolas I, Smith P C, editors. Health system efficiency: how to make measurement matter for policy and management. European Observatory Health Policy Series. European Observatory on Health Systems and Policies, Copenhagen (Denmark). 2016.

  21. Spinks J, Hollingsworth B. Cross-country comparisons of technical efficiency of health production: a demonstration of pitfalls. Appl Econ. 2009;41(4):417–27.

    Article  Google Scholar 

  22. O’Donnell C, Nguyen K. Review of efficiency measurement methodologies to inform hospital resource allocation decisions in NSW: a rapid review. Technical report, Sax Institute. 2011.

  23. Varabyova Y, Schreyögg J. International comparisons of the technical efficiency of the hospital sector : panel data analysis of OECD countries using parametric and non-parametric approaches. Health Policy. 2013;112(1):70–9.

    Article  PubMed  Google Scholar 

  24. Barcellos SH, Carvalho LS, Turley P. Distributional Effects of Education on Health. Working Paper 25898, National Bureau of Economic Research. 2019.

  25. Cutler DM, Lleras-Muney A. Education and health: evaluating theories and evidence. Working Paper 12352, National Bureau of Economic Research. 2006.

  26. Schillinger D, Barton LR, Karter AJ, Wang F, Adler N. Does literacy mediate the relationship between education and health outcomes ? A study of a low-income population with diabetes. Public Health Rep. 2006;121(3):245–54.

    Article  PubMed  PubMed Central  Google Scholar 

  27. World Health Organization. Global status report on alcohol and health 2018. World Health Organization. Google-Books-ID: qnOyDwAAQBAJ. 2019.

  28. O’Keefe EL, DiNicolantonio JJ, O’Keefe JH, Lavie CJ. Alcohol and CV Health: Jekyll and Hyde J-Curves. Prog Cardiovasc Dis. 2018;61(1):68–75.

    Article  PubMed  Google Scholar 

  29. Dixon JB. The effect of obesity on health outcomes. Mol Cell Endocrinol. 2010;316(2):104–8.

    Article  CAS  PubMed  Google Scholar 

  30. Varvarigos D. Environmental degradation, longevity, and the dynamics of economic development. Environ Resour Econ. 2010;46(1):59–73.

    Article  Google Scholar 

  31. Linden M, Ray D. Life expectancy effects of public and private health expenditures in OECD countries 1970–2012: panel time series approach. Econ Anal Policy. 2017;56:101–13.

    Article  Google Scholar 

  32. Berger M, Messer J. Public financing of health expenditures, insurance, and health outcomes. Appl Econ. 2002;34(17):2105–13.

    Article  Google Scholar 

  33. Ngami A, Seegmuller T. Pollution and growth: the role of pension in the efficiency of health and environmental policies. Int J Econ Theory. 2019;17(4):390–415.

    Article  Google Scholar 

  34. Raffin N, Seegmuller T. Longevity, pollution and growth. Math Soc Sci. 2014;69:22–33.

    Article  Google Scholar 

  35. World Health Organization. One Health. https://www.who.int/news-room/q-a-detail/one-health. Accessed 17 Sept 2021. 2017.

  36. Amuasi JH, Walzer C, Heymann D, Carabin H, Huong LT, Haines A, Winkler AS. Calling for a COVID-19 One Health Research Coalition. Lancet (London, England). 2020;395(10236):1543–4.

    Article  CAS  PubMed  Google Scholar 

  37. Deem SL, Lane-deGraaf KE, Rayhel EA. Introduction to One Health : an interdisciplinary approach to planetary health. 1st ed. Hoboken, NJ: Wiley-Blackwell; 2019.

    Google Scholar 

  38. Dao TM-c, Fu BSN. Community and environment as determinants of health: The One Health concept. In The Routledge handbook of public health and the community. Routledge; 2021, pp. 10–20.

Download references

Acknowledgements

We thank Thomas Seegmuller whose remarks and suggestions greatly helped to improve this paper. We thank Cate Evans for English editing. We also thank the French National Research Agency for its financial support (ANR-17-EURE-0020 and ANR-16-CE03-0005). This paper has also benefited from the comments of the participants at the 7th annual conference of the French Association of Environmental and Resource Economists (Grenoble).

Funding

The project leading to this publication has received funding from the French government under the “France 2030” investment plan managed by the French National Research Agency (reference: ANR-17-EURE-0020) and from Excellence Initiative of Aix-Marseille University—A*MIDEX.

Author information

Authors and Affiliations

Authors

Contributions

All authors have contributed equally. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Bruno Ventelou.

Ethics declarations

Ethics approval and consent to participate

Not applicable (macro-data).

Consent for publication

All authors consent.

Competing interests

Authors declare they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

In this figure ,Footnote 10 the actual input mix (X1, X2) is at C, while the output level is equal to the one at T. The health system is inefficient because it can produce the same level of output with the input mix at T. Therefore, the technical efficiency can be measured by the ratio: TE = OT/OC.

The allocative efficiency implies producing the same level of output at the lowest cost. It can be measured by: AE = OA/OT.

See Tables 5, 6, 7, 8, 9, 10, 11 and Figs. 5, 6, 7, 8, 9, 10

Table 5 Estimates of the stochastic frontier model with life expectancy at 60 years
Table 6 Estimates of the stochastic frontier model with potential years of life lost
Table 7 Estimates of the stochastic frontier model with preventable mortality
Table 8 Model comparison statistics with life expectancy at 60 years
Table 9 Model comparison statistics with potential years of life lost
Table 10 Model comparison statistics with preventable mortality
Table 11 Spearman correlation coefficients
Fig. 5
figure 5

Health system efficiencies (%) in 2016 with life expectancy at 60 years as health system output

Fig. 6
figure 6

Health systems inefficiencies (%) in 2016 with potential years of life lost as health system output

Fig. 7
figure 7

Health system inefficiencies (%) in 2016 with preventable mortality as health system output

Fig. 8
figure 8

The frontier of the health system (in years) with life expectancy at 60 years as the health system output in 2016

Fig. 9
figure 9

The frontier of the health system with potential years of life lost as the health system output in 2016

Fig. 10
figure 10

The frontier of the health system with preventable mortality as the health system output in 2016

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ngami, A., Ventelou, B. Respective healthcare system performances taking into account environmental quality: what are the re-rankings for OECD countries?. Health Res Policy Sys 21, 57 (2023). https://doi.org/10.1186/s12961-023-01005-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12961-023-01005-6

Keywords