- Open Access
A framework for explaining the role of values in health policy decision-making in Latin America: a critical interpretive synthesis
Health Research Policy and Systems volume 18, Article number: 100 (2020)
Although values underpin the goals pursued in health systems, including how health systems benefit the population, it is often not clear how values are incorporated into policy decision-making about health systems. The challenge is to encompass social/citizen values, health system goals, and financial realities and to incorporate them into the policy-making process. This is a challenge for all health systems and of particular importance for Latin American (LA) countries. Our objective was to understand how and under what conditions societal values inform decisions about health system financing in LA countries.
A critical interpretive synthesis approach was utilised for this work. We searched 17 databases in December 2016 to identify articles written in English, Spanish or Portuguese that focus on values that inform the policy process for health system financing in LA countries at the macro and meso levels. Two reviewers independently screened records and assessed them for inclusion. One researcher conceptually mapped the included articles, created structured summaries of key findings from each, and selected a purposive sample of articles to thematically synthesise the results across the domains of agenda-setting/prioritisation, policy development and implementation.
We identified 5925 references, included 199 papers, and synthesised 68 papers. We identified 116 values and developed a framework to explain how values have been used to inform policy decisions about financing in LA countries. This framework has four categories – (1) goal-related values (i.e. guiding principles of the health system); (2) technical values (those incorporated into the instruments adopted by policy-makers to ensure a sustainable and efficient health system); (3) governance values (those applied in the policy process to ensure a transparent and accountable process of decision-making); and (4) situational values (a broad category of values that represent competing strategies to make decisions in the health systems, their influence varying according to the four factors).
It is an effort to consolidate and explain how different social values are considered and how they support policy decision-making about health system financing. This can help policy-makers to explicitly incorporate values into the policy process and understand how values are supporting the achievement of policy goals in health system financing.
The protocol was registered with PROSPERO, ID=CRD42017057049.
Every health system in the world embodies values that guide health policy decisions [1,2,3]. Values, defined as “principles, or criteria, for selecting what are good (or better, or best) among objects, actions, ways of life, and social and political institutions and structures” , are essential at all stages of the policy process, ranging from the prioritisation of some issues over others on a government’s agenda to the development of policy options to address an issue and the implementation of selected policy options. When governments or institutions more generally set agendas and develop and implement policies, they also legitimise and promote certain values over others, making value-laden decisions about health systems .
Although values underpin the goals pursued in health systems and often the means for achieving them, including how health systems and particular health policies benefit the population, it is often not clear how values are incorporated into policy decision-making about health systems. This is perhaps not surprising given the complexity of decision-making about health systems, the wide range of values prioritised (and advocated for) by different stakeholders, and the many ways in which values can drive policy decisions as well as the reality that policy-makers often do not want to be explicit about the values used in the policy decision-making process . Clarity may be all the more necessary in the resource-constrained health systems of low- and middle-income countries, where the values guiding how to get cost-effective treatments to those who need them and to achieve a better health status of their populations can have particular direct impacts .
Specifically in Latin America, the identification of values used in the policy decision-making process is an emerging field, with a paucity of evidence about the role of values and how they inform the prioritisation, development and implementation of policies in different contexts. Latin America has a vibrant history of political fluctuations – in the last 30 years, political contexts have spanned the spectrum from authoritarian governments to democracies led by right-, centre- or left-aligned governments. The region faces several challenges in the financing of its healthcare systems. The total health expenditure as a percentage of GDP ranges between 5% and 9%, with publicly funded health expenditure being below 6% for many countries in the region . Despite these circumstances, there is little evidence about how this context influences the values chosen to guide policy decision-making about both health systems financing and arrangements. Indeed, in our preliminary search for this synthesis, to the best of our knowledge, no systematic review has specifically focused on values in Latin American health systems.
Given the paucity of synthesised evidence, we focused on understanding how and under what conditions societal values inform decisions about health system financing. Insights in this field could help policy-makers and stakeholders to understand how values are being incorporated into the policy decision-making process and, potentially, to make changes to better support the more explicit use of values in health systems policy-making in Latin America.
We used critical interpretive synthesis (CIS), a methodology oriented to theory building through combining the process of conducting a systematic review with the qualitative research inquiry. The CIS was selected for this review given its appropriateness to answer research questions that need to draw on a heterogeneous body of literature that is not particularly well developed or focused [8, 9], which is the case with the literature related to the use of values to inform the policy decision-making process about health-system financing in Latin American countries . The CIS approach is based on analysing the perceptions and interpretations drawn from a wide range of relevant sources to develop a framework that explains the phenomenon being studied. Moreover, the CIS approach is not based on a prespecified design or quality of documents but rather on the relevance of papers to the theory .
For our CIS design, we used an explicit and structured search of the indexed literature followed by a more inductive purposive selection of papers from the pool of relevant documents to include in the analysis. We also adopted an iterative approach to refining the research question to carry out additional searches to fill conceptual gaps that emerged during the analysis . The primary purpose of the synthesis was to explain how factors may influence the way in which policy-makers in Latin America use values to make decisions about financing in their health systems and under what conditions values come to be influential in the policy-making process.
In December 2016, we searched 17 databases to identify the relevant literature (Applied Social Sciences Index and Abstracts, CINAHL, Embase, HealthSTAR, Health Systems Evidence, International Political Science Abstracts, LEYES, LILACS, MEDLINE, PAIS International, ProQuest Political Science, PsycINFO, SciELO, Social Science Abstracts, Sociological Abstracts, Web of Science Core Collection from Thomson Reuters, and Worldwide Political Science Abstracts). Collectively, these databases index literature from a diverse range of subject domains, which allowed us to identify articles addressing a broad spectrum of situations in which values inform decision-making about health system financing.
The search strategy was comprised of a controlled vocabulary including the National Library of Medicines MeSH terms, EMTREE terms and keywords. In general, our search combined terms related to the region of interest (e.g. Latin America) with contextual or intervention terms related to the topic area (i.e. health-system financing and financial arrangements) and with terms related to the main area of interest (i.e. values). In addition, we searched the websites of WHO, Pan American Health Organization (PAHO) and World Bank to identify additional published and unpublished literature. Lastly, we conducted purposive searches to identify the literature to fill conceptual gaps that emerged during our inductive process of synthesis and analysis (e.g. to understand how policy-makers address values like right to health, equity or universality).
The search strategy was developed in consultation with an experienced librarian and then peer-reviewed using the PRESS checklist before being finalised (see Supplementary material 1 for the detailed search strategy).
We included all empirical and non-empirical articles, without date range limits, written in English, Portuguese or Spanish, that focus on what authors considered ‘values’, ‘principles’ or ‘goals’ of health-system financing. Those values must inform the policy process in Latin American countries at the macro (i.e. supranational, national and sub-national) and meso (i.e. administrative regions, healthcare organisations) levels but not at the micro level (i.e. clinical decision-making by health professionals).
Reference reviewing and article selection
Step 1 – reviewing
One researcher (CMV) reviewed and assessed the titles and abstracts of all references captured by our search strategy to exclude those references that did not address the topic of interest or a Latin American country. Second, two researchers (CMV and IDF) assessed the titles and abstracts of the remaining references to classify them as potentially relevant or to exclude them; any disagreement at this stage was addressed by including the reference in the next step. Third, we retrieved the full text of all potentially relevant articles, which were then reviewed independently in duplicate by two researchers (CMV and IDF) to make a final assessment of whether they were relevant, and hence included in the sample frame from which we drew our purposive sample for the synthesis. Any disagreement at this stage was resolved by consensus. A table of studies excluded at this stage was prepared to document the reasons for exclusion (see Supplementary material 2 for details of articles excluded).
Step 2 – conceptual mapping and purposive sampling
We conceptually mapped the included papers using a structured form. The form included categories for document features and for variables of interest, including setting/country, research/non-research, value(s) addressed or discussed, government agenda-setting factors drawn from Kingdon’s framework , and policy development and implementation factors drawn from the 3I + E (institutions, interests, ideas and external factors) framework (see Supplementary material 3 for details of frameworks) .
We then used this mapping exercise to identify areas that were conceptually rich and areas where there appear to be conceptual gaps, which served to guide our selection of a purposive sample of relevant papers. The purposive sample was selected based on the following criteria: (1) articles were conceptually rich, defined as articles that addressed two or more factors included in the conceptual mapping and which describe and discuss policy decisions in depth; (2) articles captured a breadth of perspectives across different Latin American countries; and (3) articles that provided perspectives from different periods of time. The principal investigator (CMV) performed the conceptual mapping as well as the assessment of which papers are likely to offer important conceptual insights and the countries of focus to select a conceptually rich set of papers for inclusion in the analysis. However, all 207 papers were used to develop the framework.
In addition to categorising the included articles, we extracted relevant data from all the full papers by developing a summary of key findings and conclusions related to our compass question and the frameworks used for the analysis. A log-book was kept by CMV, consisting of organised memos that document emerging themes used in the synthesis of findings phase.
Synthesis of findings
To allow for an interpretive synthesis, we used qualitative methods to analyse and synthesise data from a purposively selected set of included studies. Although this synthesis included an element of aggregation (i.e. identifying those findings that recurred most frequently across included studies), the primary function of this synthesis was interpretation. To do this, we used a constant comparative method throughout our analysis to develop an explanatory framework of how and under what conditions Latin American countries use values to make decisions about health system financing, which allowed us to ensure that our framework was grounded in the data from the included papers. For the analysis, factors that influence or explain how values are used and under what conditions these values inform the agenda-setting, policy development and implementation process of health system financing were used as independent (explanatory) variables whereas the use of the value in the policy process was the dependent variable.
The electronic database search yielded 6481 published articles. After removing duplicates, 5925 articles remained for screening; from these, we excluded 5528 records due to a lack of relevance and duplicates. Of the 397 full-text articles screened, 199 met the inclusion criteria; 8 papers were purposively identified to fulfil gaps of our theoretical framework, yielding a total of 207 papers that were conceptually mapped (see Supplementary material 4 for details of all conceptually mapped articles, including whether they were later purposively sampled after full-text review).
Of the 207 included articles, 141 were written in English, 46 in Spanish and 19 in Portuguese. Articles focused on health systems of countries in South America (n = 84), Central America (n = 36), Central and South America (n = 14) or with a general scope in Latin America (n = 73) (Fig. 1). Brazil was the country most commonly addressed (22%; n = 45), followed by Mexico (14%; n = 28), Chile (11%; n = 22), Colombia (10%; n = 20) and Costa Rica (5%; n = 10) (Fig. 2). From the 79 articles that reported on findings from primary research, 12 were systematic reviews, 49 were quantitative studies, 26 were qualitative studies, and 4 used mixed methods [14,15,16,17,18]. The most common types of papers among the non-research articles were discussion papers (38%; n = 49) and situation analyses (23%; n = 30) (Table 1). From this list of 207 included articles, we selected 77 papers to include in our purposive sample for data synthesis (Fig. 3).
We identified 116 values in the 207 papers included (see Supplementary material 5 for the list and frequency of values identified). We found from this that stakeholders and policy-makers in Latin America call a great variety of things ‘values’ in their writings, including the right to health, equity, universality, sustainability, decentralisation, feasibility, privatisation, primary healthcare, Millennium Development Goals, and many more. Further, these values describe concepts that are quite different from each other, such as principles, strategies, instruments, specific goals, elements of a policy, or beliefs about the health system.
Development of a framework
We developed a framework to explain how values have been used to inform policy decisions about health system financing in Latin America (Table 2). The tension in developing such a framework is that values can be used as ends or means . Therefore, values can be articulated as desirable outcomes to be achieved in the long term or used as concrete strategies or actions to achieve these desirable goals. Considering this, we have organised a framework according to four categories of values (Fig. 4) – (1) goal-related values (i.e. guiding principles that pursue the best healthcare for all and according to their needs, namely universality, equity, quality and solidarity); (2) technical values (i.e. those incorporated into the instruments and strategies adopted by decision-makers to ensure a sustainable and efficient health system); (3) governance values (i.e. those applied in the policy process to ensure a transparent and accountable process of decision-making); and (4) situational values (i.e. a broad category of values that represent competing strategies to make decisions in the health systems). We also identified four conditions under which situational values come to be influential in policy decision-making about health system financing in Latin America, namely (1) when aligned with policy legacies; (2) when aligned with the interests of influential groups; (3) when aligned with the ideology of the government; and (4) when aligned with international influences.
How values are used
In describing these values, we provide interpretation (based on the literature identified from our searches) about how each is used to better understand their role in informing policy decisions (Table 2).
We developed this category with those values more commonly identified as guiding principles of health systems in the papers reviewed [21,22,23,24,25]. We made a distinction in this category between the core and intermediate values to be able to highlight that the core values of equity, quality, solidarity and universality, are those that best represent societal expectations for the health system. Additionally, these core values each contribute to the broader principle of the right to health, which is an important and ongoing matter of debate in Latin America (e.g. the increase of ‘tutelas’ in Colombia) [21, 38,39,40].
Despite core values being very important in health systems and commonly considered, they have different meanings or connotations depending on the perspective of each government. For example, universality is a value of almost every health system in Latin America  and a principle promoted by WHO [3, 42, 43]. However, while universality has been prioritised as a key goal, there is no consensus on its meaning and scope [29, 41, 44–46] and, therefore, it is not possible to design a common indicator to measure it or even agree on the extent to which it can be achieved  (Table 3).
With regards to intermediate values, we propose that they are necessary factors in achieving goals. The role that intermediate values play in policy decision-making about health system financing varies based on the context of each country because they represent intermediate steps to achieving the goals of the health system. For example, Colombia and Costa Rica have declared universality as a guiding value of their health systems but, according to the perspective of each government, they have prioritised different intermediate values; for example, availability in Colombia and accessibility in Costa Rica .
Given that the right to health has deep and wide connotations and that the procedures, technologies, services and programmes that come to satisfy it are increasing in number and costs day by day, governments must define reasonable limits to ensure the achievement of goals. Those limits and the instruments to ensure that goal-related values are successfully reached should be defined by technical and rational rules that assure the efficiency of the resource allocation. In this regard, technical values like austerity, effectiveness, evidence, feasibility, planning, prioritisation, rationality or sustainability, are essential elements to the extent that they help to organise the health system to be durable over time. Sustainability is not by itself a final goal of the health system but a means for attaining health for all according to their needs.
The seriousness of health policy decision-making requires that the procedures for making decisions reflect values like accountability, social participation, stewardship and transparency. Governance values are not final goals of the health system but promote the principle of legitimacy in health policy development and implementation. For example, accountability and transparency have progressively begun to appear as essential values in Latin America [25, 27, 28, 63, 75] and they have been emphasised as imperative goals for addressing corruption [35, 47]. Governance values do not, on their own, achieve other goals or the materialisation of the right to health, but their presence in the policy decision-making process allows citizens to ensure that core values are considered in each policy decision.
Situational values are values that become important in specific circumstances. These values reflect policy legacies, changes in the balance of organised forces, interests of influential groups, ideological positions, changes in the national mood or international influences. We propose that situational values are not the ultimate goal of the health system. However, some situational values become tremendously important for a country at particular points in time and governments could incorporate them into technical or governance categories or even misrepresent their role and feverously pursue them as though they were a goal of the health system.
For example, at the end of the 80s and 90s, virtually all countries in Latin America began the process of reforming their health systems and pursued values promoted by the World Bank and the Inter-American Development Bank, including privatisation, competitiveness and market [20, 25, 28, 29, 45, 57, 85]. Reformers maintained that privatisation would improve other high standard values like accessibility, efficiency, equity, quality and social participation [35, 30, 47, 59, 81, 86, 87].
This situational values category is complex because different competing values belong here and there is no consensus about the legitimacy of those values. For example, some governments highlight decentralisation and others pursue centralisation; some countries promulgate compulsoriness and others ask for voluntariness; and some endorse public financing whereas others prefer privatisation. Countries that implemented private health insurance models commonly asserted competitiveness, privatisation, market, targeting, cost-containment and efficiency as the most appropriate mechanisms to achieve universality in a liberal, market-oriented society [19–21, 25, 28–30]. Those values are identified in the health system reforms of Brazil [21, 31–33], Chile [29, 32], Colombia [21, 32–34], Costa Rica  and Mexico [20, 28, 36, 37]. However, when we examined the strategies followed by more public financing-oriented governments, other values like public financing, primary healthcare and centralisation appeared (e.g. Bolivia, Cuba, Ecuador, Venezuela) [26, 81,82,83,84].
The conditions under which values are used
Each category of values was analysed according to three stages of the policy process (i.e. agenda-setting, policy development and implementation) by considering the factors included in Kingdon’s agenda-setting framework and the 3I + E framework described in the methods section (Table 3).
Values are used to frame problems in health systems and to prioritise issues on government agendas; they also shape how some issues gain prominence in the government agenda given that this is a precursor for identifying policy options.
When governments compare their indicators based on the goals they hope to achieve with similar indicators or expectations from other countries, such comparisons are important factors in framing an issue as one that warrants a government’s attention when those comparisons result in negatively framed goal-related values (e.g. lack of universality/solidarity, inequity, bad quality or vulnerability to the right to health) [23, 25, 27, 28, 47–50]. Governments also pay attention to problems that are framed in relation to inefficiency or as threats to the fiscal sustainability of health systems [22,23,24,25, 28, 38, 62, 63] and, more recently, to problems regarding corruption, lack of social participation or deficiencies in accountability.
Problems in health systems might also be defined in such a way that feedback from situational influences positions a specific strategy or value on the government agenda. Situational factors such as the promulgation of international policies (e.g. Millennium Development Goals) or the neoliberal reforms in the 80s and 90s might influence how policy-makers define problems to be consistent with the discourse of international agencies.
Policy alternatives that are aligned with the goals and perspectives of policy-makers are more likely to be considered and chosen. For example, a government addressing equity from a utilitarian perspective might be more interested in policies focused on providing financial protection to citizens than in policies focused on achieving gender equity [24, 29, 32, 37, 47, 57,58,59].
Technical values play an important role in policy development given that they are used as pragmatic instruments to develop and select policies that might be feasible and guarantee the sustainability of the health system. For example, effectiveness and cost-effectiveness have been significant values to make decisions about benefits plans, coverage of drugs or technologies, and development of clinical guidelines [45, 68, 69].
Governance values come to play a role because they are related to how elected officials and civil servants pay attention to societal groups’ demands for transparency and stewardship of the policy process. Policy-makers incorporate these values because they think it is the right way to make the decision-making process more efficient or because donors explicitly demand them . We found that governance values are regularly used at the end of the policy development as a strategy to improve the social acceptability of the policy chosen. For example, many authors critique that governments are looking for social participation to reinforce the symbolic identification of health with democracy and not because they think that social participation would improve health system performance .
Situational values come to be influential when the policy option is aligned to (1) influential policy legacies (e.g. the financing structure of the health system, public versus private); (2) interests of influential groups; (3) the ideology of the government (e.g. left versus right); or (4) international recommendations or requirements.
As in others domains of the socio-political life in Latin America, values underlying the orientations of the current governing party (e.g. left versus right) are reflected in policy decision-making about health system financing (Table 3) [35, 88]. For example, when Brazil and Chile are followed over time, it is possible to identify values that represent the neoliberal ideology during the dictatorships and right-wing governments  but when those countries moved towards social-democratic governments, the prevailing values were right to health, equity, prevention and interculturality [33, 89].
Policies aligned with the values of international agencies/donors, their recommendations or requirements, are more likely to be chosen [30, 64, 90]. Several included papers highlight the role that the World Bank and the International Monetary Fund had in health systems reforms in Latin America and other low- and-middle-income countries worldwide. For example, the set of values promoted by these agencies in the 80s and 90s were adopted by Latin American countries by the diffusion of ideas or by coercion to access to loans [47, 59]. Other agencies, such as WHO, PAHO and the United Nations, have also influenced the set of values that are considered in decisions about health system financing. One of the mechanisms of influence is by national governments framing their health problems based on reports issued by these agencies [47, 48] and introducing and prioritising new values into the policy process based on these framings. The other mechanism is adopting strategies recommended by these international agencies to achieve those values [77, 91].
Despite the strong influence of international agencies over decision-making in Latin America, policy legacies are also important in the policy process and the values aligned with those legacies (e.g. the financing structure of the health system, public versus private) come to be influential. For example, while the World Bank promoted residual universalism, each Latin American country implemented policies to address universality in ways that were most aligned with the priorities of the governing party, policy legacies and the national mood. As a result, it is possible to identify a mix of traditional forms of universalism for workers and their dependents as well as minimal universalism for the unemployed, indigenous and vulnerable populations (e.g. Colombia) [29, 36, 57, 82].
Policies aligned with interests or the values of organised groups (doctors, patients, private sector) can also be influential. In some cases, influence can emerge from interest groups having strong connections to the government (e.g. pharmaceutical companies) and, in others, it can be driven by public opinion that is aligned with the interests of a group of patients or organisations/coalitions of doctors. Alternatively, influence can be driven by interest groups that are positioned in a way that can help to achieve other goals like accountability or help to assure the effectiveness of medical interventions. For example, the value of being evidence-based has been promoted by organisations of doctors and researchers, and it is an important technical value to ensure that health systems deliver cost-effective interventions and that decisions are made rationally.
Core goals-related values are the most common factors to evaluate the global performance of health systems, even for policies that do not explicitly pursue the achievement of those goals. Intermediate values are also considered as desirable and measurable surrogate outcomes of the health system and might be preferred by policy-makers because they are more attainable [16, 37, 54,55,56, 60].
Governments also consider technical values in the phase of policy implementation because values like efficacy, financial protection or sustainability can help them to achieve a better performance of the health system and help to gain accountability, transparency and trust in decision-making. The incorporation of new technical values, free of international pressures, is a phenomenon consistent with the development of technical capacities within the countries and the economic growth of Latin America.
Governance values have been used as indicators of how authority in the health system is exercised. Those values are used to monitor the performance of the government and the engagement of the citizens and interest groups into the policy process. Values such as accountability and transparency have progressively begun to appear as essential values for policy implementation [25, 27, 28, 63, 75] and are emphasised as imperative goals against corruption [33, 47].
Situational values are not only used to prioritise policies to be implemented when aligned with specific situational influences, but also for the evaluation of the successful implementation of particular initiatives of a government, the adoption of foreign policies (policy transfer), to extend the power of some interest groups and to measure the level of progress in the implementation of a specific model of health system financing. For example, decentralisation was a value frequently identified in the papers reviewed and, in fact, in the 80s and 90s many governments considered decentralisation as a goal of health systems [32, 47, 88]. Although decentralisation implied strategies that differed in scope, in the number of functions transferred, levels of government involved, and the participation or not of private organisations (i.e. deconcentration, delegation, devolution and privatisation) , this strategy was prioritised to be implemented for virtually all countries in the region.
This review and the framework that emerged from the analysis are an effort to consolidate and explain how and under what conditions different social values are considered and how they support policy decision-making about health system financing in Latin America. We propose that the values considered in the policy process can be characterised in four ways, namely (1) goal-related values (i.e. guiding principles of the health system); (2) technical values (those incorporated into the instruments adopted by policy-makers to ensure a sustainable and efficient health system); (3) governance values (those applied in the policy process to ensure a transparent and accountable process of decision-making); and (4) situational values (a broad category of values that represent competing strategies to make decisions in the health systems). This theoretical framework is represented in Fig. 4, which can be thought of as a heuristic that can be used to identify the four categories of values and the conditions in which values are used in different stages of the policy process.
These categories of values come to be influential in government agenda-setting by framing the problems in specific ways, by prioritising some health issues in the government agenda, or by giving legitimacy to the process of agenda-setting . In policy development, values are used as pragmatic instruments to inform policy development, influence what policy options are more likely to be chosen, and to improve the acceptability of the policy options that are selected . In policy implementation, values influence which policies are more likely to be prioritised for implementation, used as indicators for evaluating the general performance of the health system, and used as indicators of good governance and as strategies against corruption.
We identified that values vary over the time, affected by different factors as governments and regimes change and as health systems reform. Our analysis of these variations is reflected on the framework we propose, with four conditions under which values influence policy decision-making about health system financing, namely (1) when aligned with policy legacies (e.g. the financing structure of the health system, public versus private); (2) when aligned with interests of influential groups; (3) when the policy option is aligned with government ideology (e.g. left versus right); and (4) when aligned with international recommendations or requirements.
In relation to the broader literature, we share two findings with the study of Giacomini et al. about values in the Canadian health system and we build on sets of values that have been outlined by international agencies. The first similar finding to Giacomini et al. is that stakeholders and policy-makers use ‘values’ to refer to many things, including different principles, strategies, instruments, specific goals, elements of a policy or beliefs about the health system. The second finding aligned with Giacomini et al. is that the contradictions about values are not between people for or against equity, but between people who prioritise equity and those who prioritise sustainability, or between people promoting policies addressing equity from an egalitarian approach and those who promote policies developed from a utilitarian or Rawlsian perspective .
In relation to core sets of values that have been previously articulated, our searches did not identify previous studies that developed a framework explaining the role of values in policy decision-making in Latin America, although WHO and the International Covenant on Economic, Social and Cultural Rights (ICESCR) have promoted the idea of a core set of values. These organisations prioritise values that guarantee “the enjoyment of the highest attainable standard of physical and mental health” . The values (‘essential elements’) promoted by WHO and ICESCR are availability, accessibility, acceptability, quality and the delivery of healthcare free of any discrimination. Our framework shares the core value of quality but we propose that availability as well as accessibility and acceptability are components or intermediate steps to achieve the four most significant values needed to achieve the right to health.
There were two strengths and one potential limitation of this critical interpretive synthesis that are worth noting. The first strength is that the CIS was an appropriate methodological approach to synthesise heterogeneous sources of literature, empirical and conceptual papers considering or displaying debates about values in Latin American health systems, and articles discussing policies in health system financing. Second, the structured and systematic electronic search and the method of purposive sampling allowed us to be rigorous and transparent in the process of answering our research question.
One potential limitation of the study was that terms used in the literature were diverse and at times vague. Therefore, the search strategy may not have captured all the terms and concepts related to this topic. However, we performed a rigorous process of inclusion assessment independently of the papers identified in the searches in duplicate by two researchers to guarantee that different concepts, approaches and reflections of values were considered.
The results of our study are useful not only for policy-makers and stakeholders in Latin America but also for others in many countries that have implemented similar health system reforms. Both can use this framework to identify and understand how values have been and are being used in the process of prioritisation, policy development and implementation in light of the changing historical/political conditions. Additionally, policy-makers could use the framework to focus their policies according to their objectives (i.e. to achieve important goals, improve efficiency, gain legitimacy or respond to external influences). On the other hand, stakeholders interested in influencing policy agendas could use this framework to identify which values support or compete with the issues they want to prioritise and the policies that they think should be used to address them and/or how to make them more technically sound or socially supported.
The framework developed in this CIS can be used to analyse data or compare findings in future studies about the role of values in policy decision-making about health system financing in Latin American countries as well as in a different priority health policy domain (e.g. delivery arrangements or governance arrangements), in a different jurisdiction (e.g. developed countries, other low- and middle-income countries) or in a different policy field (e.g. education, child policy, social policy).
Future testing of this theoretical framework through case studies, cross-country comparisons or other methods that analyse specific financing decisions in Latin American health systems could be beneficial to identify gaps in the framework, additional mechanisms by which values are persuasive or other conditions under which values influence the policy process.
The study of values in the policy decision-making process in Latin America is an emerging field. Our effort to synthesise current information and to develop a framework that explains their role in health system financing is a unique contribution to the body of knowledge in this field and provides an opportunity to explore the role of values in different policy decisions and jurisdictions.
Availability of data and materials
All data generated or analysed during this study are included in this published article and its supplementary information files.
- 3I + E:
Institutions, interests, ideas and external factors
Critical interpretive synthesis
International Covenant on Economic, Social and Cultural Rights
Pan-American Health Organization
Hoffman SJ, Røttingen J, Lavis JN, Edge JS, Frenk J. Background Paper on Conceptual Issues Related to Health Systems Research to Inform a WHO Global Strategy on Health Systems Research Sara Bennett. 2012;(February):1–72.
Veillard JHM, Brown AD, Bariş E, Permanand G, Klazinga NS. Health system stewardship of National Health Ministries in the WHO European region: Concepts, functions and assessment framework. Health Policy (New York). 2011;103(2–3):191–9.
World Health Organization. The World Health Report 2008. primary health Care - Now more than ever. Geneva: World Health Organization; 2008. p. 148. Available from: http://www.who.int/whr/2008/whr08_en.pdf.
Schwartz B. The Creation and Destruction of Value. Am Psychol. 1990;45(1):7–15.
Kenny N, Giacomini M. Wanted: A new ethics field for health policy analysis. Health Care Anal. 2005;13(4):247–60.
Giacomini M, Hurley J, Gold I, Smith P, Abelson J. ‘ Values ’ In Canadian Health Policy Analysis : What Are We Talking About ? Ottawa; 2001. Available from: http://www.cfhi-fcass.ca/migrated/pdf/researchreports/ogc/giacomini_final.pdf.
Kanavos P, Parkin GC, Kamphuis B, Gill J. Latin America Healthcare System Overview. A comparative analysis of fiscal space in healthcare; 2019.
Dixon-Woods M, Cavers D, Agarwal S, Annandale E, Arthur A, Harvey J, et al. Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups. BMC Med Res Methodol. 2006;6(1):35 Available from: http://bmcmedresmethodol.biomedcentral.com/articles/10.1186/1471-2288-6-35.
Wilson MG, Ellen ME, Lavis JN, Grimshaw JM, Moat KA, Shemer J, et al. Processes, contexts, and rationale for disinvestment: a protocol for a critical interpretive synthesis. Syst Rev. 2014;3(1):143 Available from: http://www.systematicreviewsjournal.com/content/3/1/143.
Moat KA, Lavis JN, Abelson J. How contexts and issues influence the use of policy-relevant research syntheses: a critical interpretive synthesis. Milbank Q. 2013;91(3):604–48 Available from: http://www.ncbi.nlm.nih.gov/pubmed/24028700. [cited 2016 Oct 15].
Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: a critical review. NCRM Working Paper Series. London, United Kingdom; 2009. (NCRM Working Paper Series; vol. 01). Report No.: 01/09.
Kingdon JW. Agendas, Alternatives, and Public Policies. Updated Se. Boston: Pearson Education, Inc; 2011. p. 273.
Lazar H, Forest P-G, Lavis JN, Church J. Paradigm Freeze: Why It Is So Hard to Reform Health Care in Canada. First edit. Lazar H, Forest P-G, Lavis JN, Church J, editors. Montreal: McGill-Queen’s Press; 2013. p. 416. Available from: http://www.amazon.ca/Paradigm-Freeze-Reform-Health-Canada/dp/1553393244/ref=sr_1_1/187-9642731-5108839?s=books&ie=UTF8&qid=1439655593&sr=1-1. [cited 2015 Aug 15].
Palmer N, Mueller DH, Gilson L, Mills A, Haines A. Health financing to promote access in low income settings-how much do we know? Lancet. 2004;364(9442):1365–70.
Oxman AD, Fretheim A. Can paying for results help to achieve the Millennium Development Goals? A critical review of selected evaluations of results-based financing. J Evid Based Med. 2009;2(3):184–95.
Glassman A, Duran D, Fleisher L, Singer D, Sturke R, Angeles G, et al. Impact of conditional cash transfers on maternal and newborn health. J Health Popul Nutr. 2013;31(4):S48–66.
Pega F, Liu SY, Walter S, Lhachimi SK. Unconditional cash transfers for assistance in humanitarian disasters: effect on use of health services and health outcomes in low- and middle-income countries. Cochrane Database Syst Rev. 2015;(9):62.
Alvarez FN, Leys M, Rivera Mérida HE, Escalante GG. Primary health care research in Bolivia: systematic review and analysis. Health Policy Plan. 2016;31(1):114–28.
Tobar F, Drake I, Martich E. Alternativas para la dopcion de politicas centradas en el acceso a medicamentos. Rev Panam Salud Publica. 2012;32(6):457–63 Available from: http://www.scielosp.org/pdf/rpsp/v32n6/a10v32n6.pdf.
Lakin JM. The End of Insurance? Mexico’s Seguro Popular, 2001 - 2007. J Health Polit Policy Law. 2010;35(3):313–52.
Cotlear D, Gomez-Dantes O, Knaul F, Atun R, Barreto IC, Cetrángolo O, et al. Overcoming social segregation in health care in Latin America. Lancet. 2015;385(9974):1248–59 Available from: http://libaccess.mcmaster.ca/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=107782010&site=ehost-live&scope=site.
Mendes A, Leite MG, Marques RM. Discutindo uma Metodologia para a Alocação Equitativa de Recursos Federais para o Sistema Único de Saúde. Saude E Soc. 2011;20(3):673–90.
Vargas I, Vazquez ML, Jane E. Equidad y reformas de los sistemas de salud en Latinoamerica. Cad Saude Publica. 2002;18(4):927–37.
Solla JJSP, dos Reis AAC, Soter APM, Fernandes AS, de Palma JJL. Mudanças recentes no financiamento federal do Sistema Único de Saúde: atenção básica à saúde. Rev Bras Saude Matern Infant. 2007;7(4):495–502 Available from: http://libaccess.mcmaster.ca/login?url=http://search.proquest.com/docview/58762359?accountid=12347.
Araujo GTB, Caporale JE, Stefani S, Pinto D, Caso A. Is equity of access to health care achievable in Latin America? Value Health. 2011;14(5):S8–12.
Keck CW, Reed GA. The curious case of Cuba. Am J Public Health. 2012;102(8):e13–22.
Arredondo A, Orozco E, Aviles R. Evidence on equity, governance and financing after health care reform: lessons for Latin American countries. Saude E Soc. 2015;24(Supl 1):162–75.
Knaul F, Frenk J. Health insurance in Mexico: achieving universal coverage through structural reform. Health Aff. 2005;24(6):1467–76 Available from: http://libaccess.mcmaster.ca/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=106388537&site=ehost-live&scope=site.
Urriola R. Chile: Protección social de la Salud. Rev Panam Salud Publica. 2006;20(4):273–86.
Temporão JG. O mercado privado de vacinas no Brasil: a mercantilização no espaço da prevenção. Cad Saude Publica. 2003;19(5):1323–39.
Collins C, Araujo J, Barbosa J. Decentralising the health sector: issues in Brazil. Health Policy (New York). 2000;52(2):113–27.
González GG. Las reformas sanitarias y los modelos de gestión. Rev Panam Salud Pública. 2001;9(6):406–12.
Esteves RJF. The quest for equity in Latin America: a comparative analysis of the health care reforms in Brazil and Colombia. Int J Equity Health. 2012;11:1–6.
Ruiz F, Amaya L, Venegas S. Progressive segmented health insurance: Colombian health reform and access to health services. Health Econ. 2007;16(1):3–18.
Vargas-Fuentes M. Privatizacion de servicios publicos. El caso de los servicios de salud en Costa Rica. Salud Publica Mex. 1993;35(2):186–93.
Frenk J. Comprehensive policy analysis for health system reform. Health Policy (New York). 1995;32(1):257–77.
Infante A, de la Mata I, Lopez-Acuna D. Reforma de los sistemas de salud en America Latina y el Caribe: situacion y tendencias. Rev Panam Salud Publica. 2000;8(1):13–20 Available from: http://libaccess.mcmaster.ca/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=107153469&site=ehost-live&scope=site.
Atun R, de Andrade LOM, Almeida G, Cotlear D, Dmytraczenko T, Frenz P, et al. Health-system reform and universal health coverage in Latin America. Lancet. 2015;385(9974):1230–47 Available from: http://libaccess.mcmaster.ca/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=107782009&site=ehost-live&scope=site.
Zúñiga FA. Isapres, tribunal constitucional y distribucion del derecho a cuidado sanitario. Rev Med Chil. 2013;141(4):514–8.
Stolkiner A. Derechos humanos y derecho a la salud en América Latina: la doble faz de una idea potente. Med Soc. 2010;5(1):89–95.
Abiiro GA, De Allegri M. Universal health coverage from multiple perspectives: a synthesis of conceptual literature and global debates. BMC Int Health Hum Rights. 2015;15(1):17 Available from: http://bmcinthealthhumrights.biomedcentral.com/articles/10.1186/s12914-015-0056-9.
WHO. WHA58.33. Sustainable health financing , universal coverage and social health Insurance, World Health Organization Resolutions and Decisions Resolutions and Decision of the 58th World Health Assembly; 2005. p. 139–40.
WHO. The World Health Report: Health Systems Financing. Geneva: WHO; 2010. Available from: http://www.who.int/healthsystems/topics/financing/healthreport/whr_background/en.
Clark MA. The Meanings of Universal Health Care in Latin America. J Health Polit Policy Law. 2015;40(1):221–6 Available from: http://libaccess.mcmaster.ca/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=103777020&site=ehost-live&scope=site.
del Guzmán-Urrea MP. Deficiencia en los diagnósticos de las reformas sanitarias de los anos noventa en Améica Latina. Rev Panam Salud Publica. 2009;25(1):84–92.
O’Connell T, Rasanathan K, Chopra M. What does universal health coverage mean? Lancet (Lond). 2014;383(9913):277–9 Available from: http://www.ncbi.nlm.nih.gov/pubmed/23953765. [cited 2017 Sep 18].
Homedes N, Ugalde A. Why neoliberal health reforms have failed in Latin America. Health Policy (New York). 2005;71(1):83–96 Available from: http://libaccess.mcmaster.ca/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=106529041&site=ehost-live&scope=site.
Knaul F, Arreolo-Ornelas H, Mendez O, Martinez A. Justicia financiera y gastos catastroficos en salud: impacto del Seguro Popular de Salud en Mexico. Salud Publica Mex. 2005;47(supl 1):S54–65.
Montenegro RA, Stephens C. Indigenous health in Latin America and the Caribbean. Lancet. 2006;367(9525):1859–69 Available from: http://libaccess.mcmaster.ca/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=106334414&site=ehost-live&scope=site.
Castro A, Savage V, Kaufman H. Assessing equitable care for Indigenous and Afrodescendant women in Latin America. Rev Panam Salud Publica. 2015;38(2):96–109 Available from: http://libaccess.mcmaster.ca/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=110966437&site=ehost-live&scope=site.
Laurell AC. What does Latin American social medicine do when it governs? The case of the Mexico City government. Am J Public Health. 2003;93(12):2028–31.
Bachelet M. Towards universal health coverage: applying a gender lens. Lancet. 2015;385(9975):e25–6 Available from: http://libaccess.mcmaster.ca/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=107783068&site=ehost-live&scope=site.
Espinoza MA, Cabieses B. Equidad en salud y evaluacion de tecnologias sanitarias en Chile. Rev Med Chil. 2014;142(S1):S45–9.
Tangcharoensathien V, Mills A, Palu T. Accelerating health equity: The key role of universal health coverage in the Sustainable Development Goals. BMC Med. 2015;13(101):1–5 Available from: http://www.biomedcentral.com/bmcmed/.
Avila-Burgos L, Cahuan-Hurtado L, Montañez-Hernández J, Servan-Mori E, Aracena-Genao B, del Río-Zolezzi A. Financing Maternal Health and Family Planning: Are We on the Right Track? Evidence from the Reproductive Health Subaccounts in Mexico, 2003-2012. PLoS One. 2016;11(1):e0147923.
Kruk ME, Galea S, Prescott M, Freedman LP. Health care financing and utilization of maternal health services in developing countries. Health Policy Plan. 2007;22:303–10.
Mesa-Lago C. Social Security in Latin America: Pension and Health Care Reforms in the Last Quarter Century. Lat Am Res Rev. 2007;42(2):181–201 Available from: http://libaccess.mcmaster.ca/login?url=http://search.proquest.com/docview/218158382?accountid=12347.
Backman G, Hunt P, Khosla R, Jaramillo-Strouss C, Fikre BM, Rumble C, et al. Health systems and the right to health: an assessment of 194 countries. Lancet (Lond). 2008;372(9655):2047–85 Available from: http://www.ncbi.nlm.nih.gov/pubmed/19097280. [cited 2017 Sep 18].
Almeida C. Reforma de sistemas de servicios de salud y equidad en América Latina y el Caribe: algunas lecciones de los años 80 y 90. Cad Saüde Pública. 2002;18(4):905–25.
Vega J, Frenz P. Latin America: Priorities for universal health coverage. Lancet. 2015;385:e31–2.
Martinelli KG, dos Santos Neto ET. Nogueira da Gama SG, Oliveira AE. Access to prenatal care: inequalities in a region with high maternal mortality in southeastern Brazil. Cien Saude Colet. 2016;21(5):1647–57.
Zúñiga FA. Isapres, tribunal constitucional y distribución del derecho a cuidado sanitario. Rev Med Chil. 2013;141(4):514–8.
Lloyd-Sherlock P. When social health insurance goes wrong: Lessons from Argentina and Mexico. Documento de Trabajo No 56. Buenos Aires: Centro Interdisciplinario para el estudio de políticas públicas; 2007. Report No.: 56.
Flynn M. Brazilian pharmaceutical diplomacy: social democratic principles versus soft power interests. Int J Health Serv. 2013;43(1):67–89.
Vargas-Zea N, Castro H, Rodríguez-Páez F, Téllez D, Salazar-Arias R. Colombian Health System on its Way to Improve Allocation Efficiency — Transition from a Health Sector Reform to the Settlement of an HTA Agency ´. Value Health Reg Issues. 2012;1(58):218–22.
Gragnolati M, Lindelow M, Couttolenc B. Twenty years of health system reform in Brazil: an assessment of the sistema unico de saude. Washington DC: World Bank; 2013. p. 131. Available from: http://libaccess.mcmaster.ca/login?url=http://search.proquest.com/docview/1448770054?accountid=12347.
Lloyd-Sherlock P. Health sector reform in Argentina: a cautionary tale. Soc Sci Med. 2005;60(8):1893–903.
Homedes N, Ugalde A, Forns JR. The World Bank, pharmaceutical policies, and health reforms in Latin America. Int J Health Serv Planning Adm Eval. 2005;35(4):691–717.
Rizo-Rios P, Rivera AG, Oropeza IR, Ramirez OC. The Update of the Mexican Health Care Formulary and Supply Catalog in the Context of the Health Technology Assessment. Value Health Reg Issues. 2014;5(C):29–34 Available from: http://www.journals.elsevier.com/value-in-health-regional-issues/.
Rowlinson EE, Etienne KA, Leon JS, Halkyer P, Smith ER, Mamani N, et al. Cost-effectiveness of rotavirus vaccination in Bolivia from the state perspective. Vaccine. 2011;29(38):6704–11.
Arredondo A, Orozco E, De Icaza E. Evidences on weaknesses and strengths from health financing after decentralization: lessons from Latin American countries. Int J Health Plann Manag. 2005;20(2):181–204.
Kim MK, Blendon RJ, Benson JM. What is driving people’s dissatisfaction with their own health care in 17 Latin American countries? Health Expect. 2013;16(2):155–63 Available from: http://libaccess.mcmaster.ca/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=104284734&site=ehost-live&scope=site.
Frenk J. Leading the way towards universal health coverage: A call to action. Lancet. 2015;385(9975):1352–8 Available from: http://www.journals.elsevier.com/the-lancet/.
Schlesser M, Puertas B. Assessing community health among indigenous populations in Ecuador with a participatory approach: implications for health reform. J Community Health. 2001;26(2):133–47.
Kohler JC, Mitsakakis N, Saadat F, Byng D, Martinez MG. Does Pharmaceutical Pricing Transparency Matter? Examining Brazil’s Public Procurement System. Glob Health. 2015;11:1–13.
Fryatt R, Mills A, Nordstrom A. Financing of health systems to achieve the health Millennium Development Goals in low-income countries. Lancet (Lond). 2010;375(9712):419–26.
Campbell J, Buchan J, Cometto G, David B, Dussault G, Fogstad H, et al. Human resources for health and universal health coverage: fostering equity and effective coverage. Bull World Health Organ. 2013;91(11):853–63.
Ugalde A. Physicians’ control of the health sector: professional values and economic interests. Findings from the Honduran health system. Soc Sci Med. 1980;14A(5):435–44.
Mosquera PA, Hernandez J, Vega R, Labonte R, Sanders D, Dahlblom K, et al. Challenges of implementing a primary health care strategy in a context of a market-oriented health care system: the experience of Bogota, Colombia. Int J Health Plann Manage. 2014;29(4):e347–67 Available from: http://libaccess.mcmaster.ca/login?url=http://search.proquest.com/docview/1665157547?accountid=12347.
Garcia-Subirats I, Vargas I, Mogollón-Perez AS, De PP, Da SMRF, Unger JP, et al. Barriers in access to healthcare in countries with different health systems. A cross-sectional study in municipalities of central Colombia and north-eastern Brazil. Soc Sci Med. 2014;106:204–13 Available from: http://www.elsevier.com/locate/socscimed.
Hartmann C. Postneoliberal Public Health Care Reforms: Neoliberalism, Social Medicine, and Persistent Health Inequalities in Latin America. Am J Public Health. 2016;106(12):2145–51 Available from: http://libaccess.mcmaster.ca/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=119428798&site=ehost-live&scope=site.
Muntaner C, Guerra-Salazar RM, Rueda S, Armada F. Challenging the neoliberal trend: the Venezuelan health care reform alternative. Can J Public Health. 2006;97(6):I–19 Available from: http://libaccess.mcmaster.ca/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=106005297&site=ehost-live&scope=site.
Torres-Vigil I, Aday LA, de Lima L, Cleeland CS. Wath predicts the quality of advanced cancer care in Latin America? A look at five countries: Argentina, Brazil, Cuba, Mexico, and Peru. J Pain Symptom Manag. 2007;34(3):315–27 Available from: http://libaccess.mcmaster.ca/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=106002503&site=ehost-live&scope=site.
Artaraz K. New Latin American networks of solidarity? ALBA’s contribution to Bolivia’s National Development Plan (2006-10). Glob Soc Policy. 2011;11(1):88–105 Available from: http://libaccess.mcmaster.ca/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=104887526&site=ehost-live&scope=site.
Augustovski F, Garcia Marti S, Pichon Riviere A, Rubinstein A. Universal coverage with rising healthcare costs; health outcomes research value in decision-making in Latin America. Expert Rev Pharmacoeconomics Outcomes Res. 2011;11(6):657–9.
Morgan LM. International politics and primary health care in Costa Rica. Soc Sci Med. 1990;30(2):211–9.
Madrid Y, Velásquez G, Fefer E. The economics of pharmaceuticals and health sector reform in the Americas. Pan Am J Public Health. 1998;3(5):343–50.
Frenk J, Gonzalez-Block MA. Primary care and reform of health systems: A framework for the analysis of Latin American experiences. Health Serv Manag Res. 1992;5(1):32–43 Available from: http://libaccess.mcmaster.ca/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=104715040&site=ehost-live&scope=site.
Paraje G, Vásquez F. Health equity in an unequal country: the use of medical services in Chile. Int J Equity Health. 2012;11(81):1–16 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3544610&tool=pmcentrez&rendertype=abstract.
Fiedler JL. Recurrent cost and public health care delivery: the other war in El Salvador. Soc Sci Med. 1987;25(8):867–74.
Frenk J, Gomez-Dantes O, Knaul FM. The democratization of health in Mexico: financial innovations for universal coverage. Bull World Health Organ. 2009;87(7):542–8 Available from: http://libaccess.mcmaster.ca/login?url=http://search.proquest.com/docview/58831644?accountid=12347.
United Nations. The International Covenant on Economic, Social and Cultural Rights: United Nations, Resolution 2200A (XXI) New York: United Nations; 1966. p. 8.
This research was not funded.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Vélez, C.M., Wilson, M.G., Lavis, J.N. et al. A framework for explaining the role of values in health policy decision-making in Latin America: a critical interpretive synthesis. Health Res Policy Sys 18, 100 (2020). https://doi.org/10.1186/s12961-020-00584-y
- Latin America
- Critical interpretive synthesis
- Policy decision-making