Skip to main content

Industry-sponsored clinical research outside high-income countries: an empirical analysis of registered clinical trials from 2006 to 2013

Abstract

Background

Industry-sponsored clinical trials, in the past performed almost exclusively in more developed countries, now often recruit participants globally. However, recruitment from outside high-income countries may not represent the ultimate target population for the intervention. Clinical trial registries provide an opportunity to quantify and examine the type of clinical research performed in various geographic regions. We sought to characterize industry-sponsored randomized controlled trials conducted in high-income countries and to compare these trials to those performed outside high-income countries.

Methods

Clinical trial data on all industry-funded randomized controlled trials conducted between 2006 and 2014 were obtained from the registry ClinicalTrials.gov. Trials were classified according to their study sites as conducted in high or non-high income countries, and data on trial characteristics were collected.

Results

Of 22,511 relevant trials, a total of 6,085 (27.0 %) trials included study sites outside a high-income country, and 2,045 (9.1 %) were conducted exclusively outside high-income countries. Of country groups, Central Europe had the greatest number of trials (3,127), followed by Eastern Europe (2,075). The percentage of trials with study sites outside high-income countries remained relatively constant over the study period. Studies with sites outside high-income countries tended to recruit more participants (median enrolled participants 265 vs. 71, P <0.001), to be longer (median study duration 20 vs. 13 months, P <0.05), and to study more advanced phase interventions (Phase 3 or 4 trial 58 % vs. 33 %, P <0.001).

Conclusions

More than a quarter of industry-sponsored trials include participants from outside high-income countries and this rate remained stable over the 7-year study period. Trials conducted outside high-income countries tend to be larger, have a longer duration, and study later phase interventions compared to studies performed exclusively in high-income countries.

Peer Review reports

Background

Industry-sponsored clinical research has traditionally been performed in high-income countries, given the established research infrastructure and the geographic location of major pharmaceutical companies. Over recent decades, however, globalization has led to the extension of industry-sponsored clinical research outside higher income regions [13], with approximately one-third of large company-sponsored phase III trials being conducted exclusively outside the United States of America. Indeed, the total number of countries contributing results in major clinical trial publications between 1995 and 2005 has doubled [4, 5].

A number of factors contribute to the trend towards more international study sites. First, the global burden of disease is predominantly centred outside higher income regions, potentially accelerating trial recruitment for the large sample sizes required [68]. Secondly, increasingly complex regulatory environments in higher-income regions may slow down trial initiation and performance [9]. Thirdly, trials conducted in certain non-higher income countries, such as Russia, Argentina or China, may cost half the price of trials performed in the United States or Western Europe [10]. Finally, recognition of the growing market share of less-developed regions may provide added incentive to have drugs tested and approved in these countries [11].

This shift is not without controversies. Due to varying regulatory and legal environments, clinical trials performed outside high-income countries are presumed to be different in design and conduct [12, 13]. Clinical trial results from outside high-income countries may not be applicable to high-income countries due to differences in treatment effect sizes, rates of publication biases, and genetically different populations [1, 3, 1218]. Additionally, ethical concerns about trial conduct outside higher income regions persist, including access to study interventions after trials are concluded and research misconduct [2, 5, 18].

Our aim was to describe current patterns regarding the globalization of industry-sponsored clinical trials, including the number of trials performed in different geographic regions and the collaboration between these regions. Our secondary aim was to characterize and compare trials performed in high- and non-high-income countries.

Methods

Study design

We performed a cross-sectional analysis of industry-sponsored clinical trials registered in ClinicalTrials.gov. This registry is a USA-based registry of clinical trials that represents as many as 86 % of all trial registrations [19]. It has been used to assess various aspects of clinical research activity, including correlation with disease burden, quality of clinical trials, and publication bias [2022].

We identified all interventional trials with any funding by industry with a start date between January 1, 2006 and February 19, 2014 (date of data download). Trials studying a drug, device, biologic or dietary supplement, and employing a randomized design were selected. Trials without information on study location were excluded. Ethical approval was not obtained, given the nature of the study.

Data extraction

We extracted data for each trial on study start and completion dates, allocation strategy, masking, trial phase, estimated enrolment number, major condition group, participant age eligibility, funding source, study site locations and number of sites, completion status, and posting of trial results. Information was collected on both lead and secondary funding sources. Condition groups were defined by the investigators for easily-defined conditions with a large disease burden (Additional file 1).

Country classification

Countries were geographically classified according to the categorization used in the Global Burden of Disease project which classifies countries into 21 regions and these regions into five major geographic groups (Fig. 1), available at http://ghdx.healthdata.org/country_profiles [23]. The major groups are Asia, Africa/Middle East, Europe (non-Western), Americas, and High-income regions. The regions classified as High-income are High-income Asia Pacific, High-income North America, Australasia, and Western Europe. We considered all countries falling into one of these regions as high-income and all others as non-high income.

Fig. 1
figure 1

Global map of regions and major geographic groups

This categorization allows for both geographic and economic stratification, and is consistent with both World Bank income-based definitions and established clinical research infrastructure [13]. Countries were classified based on all the study sites listed in the registry record. Trials with study sites in both income regions were included in both.

Data analysis

Descriptive analyses were performed quantifying study sites and trials and describing trial characteristics by region and major geographic group. Differences were compared with χ2 and Mann–Whitney tests. Time series analysis was performed with regression analysis. All statistical analyses were performed with R (R: A Language and Environment for Statistical Computing, version 3.1.1, Vienna Austria, 2014).

Results

There were 41,149 industry-funded, interventional trials registered in ClinicalTrials.gov with start dates during the study period. Of these, 22,511 were randomized and information on study site location was included (Fig. 2).

Fig. 2
figure 2

Flowchart of included trials

A total of 2,045 (9.1 %) trials were conducted exclusively in non-high-income countries and an additional 4,040 (17.9 %) included sites in both high- and non-high-income countries (Table 1). The remainder of the trials (73.0 %) were conducted exclusively in high-income countries. Central Europe represented the less-developed country region with the greatest number of trials (N = 3127), followed by Eastern Europe (N = 2075) and East Asia (N = 1742). When adjusted for population, the country regions Central Europe, Southern Latin America, and Southern Sub-Saharan Africa represented the non-high-income regions with the greatest number of trials (Table 1).

Table 1 Clinical trial sites among industry-sponsored trials registered in ClinicalTrials.gov

In terms of number of study sites, 23 % of all sites were outside high-income countries. Trials conducted in Asia were the most likely to recruit exclusively outside high-income countries (42.1 % of all trials with sites in Asia) followed by the Americas (19.8 %).

Among the major geographic groups, Europe (non-Western) had the highest rate of collaboration with the high-income regions, with 91.3 % of trials conducted having a high-income collaborating site, while trials with sites in Asia had the lowest rate, with 57.9 % of trials including a site in a high-income region. Among the country regions, trials in Eastern sub-Saharan Africa, East Asia, and Western sub-Saharan Africa were most frequently conducted without collaborating sites in high-income countries, while trials with study sites in Southern Latin America, Oceania, and Andean Latin America had the highest rates of collaboration with high-income countries (Fig. 3).

Fig. 3
figure 3

Percentage of trials performed in non-high income regions with a collaborating site in a high-income country

Figure 4 shows trends in the rate of trials with study sites in the different geographic groups. The percentage of trials with study sites in non-high-income regions remained relatively constant over the study period (Fig. 4a). Similarly, there were no trends in the percentage of trials performed exclusively within non-high-income major geographic groups, although there was some fluctuation in rates, especially for the Americas and Asia (Fig. 4b). At the same time, decreases were observed in the percentage of trials with any study site in the Americas (P = 0.02) and in the Middle East/Africa (P = 0.01; Fig. 4c). Europe (non-Western) remained the non-high-income geographic group with the highest participation in trials, followed by Asia and the Americas.

Fig. 4
figure 4

Temporal trends in trial performance by geographic group. a Percentage of trials performed in high and non-high-income geographic groups from 2006 to 2013; (b) Percentage of trials performed exclusively outside high-income major geographic group; (c) Percentage of trials performed with at least one study site outside the high-income geographic group. There were significant decreases in trials performed with sites in Middle East/Africa or the Americas (P = 0.01 and 0.02, respectively)

Trials performed in high- and non-high-income countries (Table 2) differed. For trials performed exclusively within one of the five major geographic groups, those performed outside high-income regions enrolled significantly more participants than trials in the high-income group. Trials performed exclusively in the Americas, Middle East/Africa, or Asia were less likely to use double-blinding compared to those performed in high-income regions. A greater proportion of trials in the Americas, Asia, and Europe (non-Western) had industry as a lead sponsor, and all four non-high-income geographic groups were more likely to study late phase interventions than the high-income group.

Table 2 Characteristics of industry-sponsored clinical trials performed exclusively within one major geographic group a

Additionally, trials performed with at least one study site in a non-high-income country had a larger median number of sites (25 vs. 1, P <0.001), enrolled a greater median number of participants (265 vs. 71, P <0.001), and were more likely to have industry as the lead funder (94.6 % vs. 80.8 %, P <0.001) compared to trials with sites exclusively in high-income countries (Table 3). Trials with sites in non-high-income countries were also more likely to be phase 3 or 4 trials (58.0 % vs. 32.9 %, P <0.001) and have a longer median duration (20.3 months vs. 13.2 months, P <0.05) than trials performed in more-developed countries. The proportion of trials with sites outside high-income regions was highest for trials studying diabetes (54.4 % of trials), with healthy volunteer studies having just 9.9 % of trials conducted with a site outside a high-income region (Table S1, Additional file 1). Of the 1,236 trials performed in children, 537 (43.4 %) had a site outside a high-income country with similar trends existing regarding rate of double-blinding, advanced phase, and study size when compared with all other trials (Additional file 1: Table S2).

Table 3 Characteristics of industry-sponsored clinical trials by study site income level

Discussion

We found that more than a quarter of trials registered in ClinicalTrials.gov are recruiting participants in non-high-income countries, with the majority of these trials enrolling in both high- and non-high-income countries. Of the non-high-income geographic groups, Europe (non-Western) and Asia have the greatest proportion of trials.

Trials performed in different regions of the world differ substantially; those conducted in non-high-income countries recruit from a greater number of study sites and study more advanced-phase interventions. Trials with sites in non-high-income countries also tend to recruit more subjects when compared to those conducted exclusively in high-income countries, indicating that subjects from non-high-income countries may contribute substantially to trial results. This is consistent with the limited prior work examining potential differences in trial characteristics conducted in high- and non-high-income countries [2426].

There are a number of factors underlying the ongoing trend of recruiting participants from non-high-income countries. The lower cost is likely a key driver, as evidenced by the high number of sites and large trial sizes among trials conducted in non-high-income regions such as Europe (non-Western) and Asia [10]. In addition, the ease of recruitment of treatment-naïve patients with chronic disease makes non-high-income countries appealing for subject recruitment [27].

Anthropological analyses of international research have described three phases, where the first is a massive influx of research infrastructure into a non-high-income region, the second an increase in the regulatory environment with more stringent oversight, and the third, a shift towards specific demands about the nature of the proposed research by local researchers and patients [28]. It is uncertain where on this continuum research activity currently lies among the regions examined, but the relatively stable activity in the regions may indicate that they may have entered the second or third phases with greater local involvement. Prior studies documenting substantial increases in trial activity in many of these non-high-income regions up through 2005 would further support this possibility [4, 5].

A number of factors should be considered when extrapolating trial results from non-high-income clinical settings to high-income countries. For one, ethical standards differ by region, despite the existence of international frameworks, leading to potential exploitation of participants [1, 29]. Streamlining regulatory oversight across regions would allow for the maintenance of trial standards, negating the search for more lax regions in which to perform studies. In addition, prior work suggests that non-high-income countries have larger effect sizes for interventional studies, raising concerns that the populations in high-income countries may not experience the benefits predicted by premarket trials [13]. One postulated reason for this effect size difference is the narrow targeting of treatment-naïve patients with advanced phase interventions in non-high-income countries.

One of the limitations of this study is that there is no definitive classification for high- and non-high-income countries and, while we used a widely accepted categorization scheme, some of the countries may have been classified differently using other approaches. In addition, the accuracy of the data provided in ClinicalTrials.gov relies on investigators and we were not able to verify the information. There is also missing data in the registry, although we encountered only a small proportion of missing information for the variables of interest. Finally, although ClincialTrials.gov is the largest and most comprehensive trial registry, it is possible that some trials were not registered or were registered in other, country-specific registries. However, this likely represents a very small number of trials since all pharmaceutical companies seeking Food and Drug Administration approval of a drug (which is required for marketing in the USA) must register their trials in the ClinicalTrials.gov registry.

Conclusions

More than a quarter of all pharmaceutical company trials recruit participants from non-high-income nations. The percentage of trials in non-high-income countries remained stable over the seven-year study period. There are a number of differences in the design and conduct of trials in high and non-high-income countries, including trials in non-high-income countries enrolling more participants and studying later phase interventions. The scientific implications of participant recruitment from these diverse geographic regions and of the differences in trial characteristics in different regions warrant further exploration.

References

  1. Lang T, Siribaddana S. Clinical trials have gone global: is this a good thing? PLoS Med. 2012;9(6), e1001228.

    Article  PubMed  PubMed Central  Google Scholar 

  2. MacMahon S, Perkovic V, Patel A. Industry-sponsored clinical trials in emerging markets: time to review the terms of engagement. JAMA. 2013;310(9):907–8.

    Article  CAS  PubMed  Google Scholar 

  3. Lorenzo C, Garrafa V, Solbakk JH, Vidal S. Hidden risks associated with clinical trials in developing countries. J Med Ethics. 2010;36(2):111–5.

    Article  PubMed  Google Scholar 

  4. Khin NA, Yang P, Hung HM, Maung UK, Chen YF, Meeker-O’Connell A, et al. Regulatory and scientific issues regarding use of foreign data in support of new drug applications in the United States: an FDA perspective. Clin Pharmacol Ther. 2013;94(2):230–42.

    Article  CAS  PubMed  Google Scholar 

  5. Glickman SW, McHutchison JG, Peterson ED, Cairns CB, Harrington RA, Califf RM, et al. Ethical and scientific implications of the globalization of clinical research. N Engl J Med. 2009;360(8):816–23.

    Article  CAS  PubMed  Google Scholar 

  6. Lozano R, Naghavi M, Foreman K, Lim S, Shibuya K, Aboyans V, et al. Global and regional mortality from 235 causes of death for 20 age groups in 1990 and 2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380(9859):2095–128.

    Article  PubMed  Google Scholar 

  7. Pereira TV, Horwitz RI, Ioannidis JP. Empirical evaluation of very large treatment effects of medical interventions. JAMA. 2012;308(16):1676–84.

    Article  CAS  PubMed  Google Scholar 

  8. Siontis GC, Ioannidis JP. Risk factors and interventions with statistically significant tiny effects. Int J Epidemiol. 2011;40(5):1292–307.

    Article  PubMed  Google Scholar 

  9. Yusuf S. Randomized clinical trials: slow death by a thousand unnecessary policies? CMAJ. 2004;171(8):889–92. discussion 892–883.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Kaitin KI. The landscape for pharmaceutical innovation: drivers of cost-effective clinical research. Pharm Outsourcing. 2010;2010:3605.

    PubMed  PubMed Central  Google Scholar 

  11. Imran M, Najmi AK, Rashid MF, Tabrez S, Shah MA. Clinical research regulation in India-history, development, initiatives, challenges and controversies: Still long way to go. J Pharm Bioallied Sci. 2013;5(1):2–9.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Smith R. Publishing research from developing countries. Stat Med. 2002;21(19):2869–77.

    Article  PubMed  Google Scholar 

  13. Panagiotou OA, Contopoulos-Ioannidis DG, Ioannidis JP. Comparative effect sizes in randomised trials from less developed and more developed countries: meta-epidemiological assessment. BMJ. 2013;346:f707.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Zhang D, Freemantle N, Cheng KK. Are randomized trials conducted in China or India biased? A comparative empirical analysis. J Clin Epidemiol. 2011;64(1):90–5.

    Article  PubMed  Google Scholar 

  15. Vickers A, Goyal N, Harland R, Rees R. Do certain countries produce only positive results? A systematic review of controlled trials. Control Clin Trials. 1998;19(2):159–66.

    Article  CAS  PubMed  Google Scholar 

  16. O’Connor CM, Fiuzat M, Swedberg K, Caron M, Koch B, Carson PE, et al. Influence of global region on outcomes in heart failure beta-blocker trials. J Am Coll Cardiol. 2011;58(9):915–22.

    Article  PubMed  Google Scholar 

  17. Goldstein DB, Tate SK, Sisodiya SM. Pharmacogenetics goes genomic. Nat Rev Genet. 2003;4(12):937–47.

    Article  CAS  PubMed  Google Scholar 

  18. Ana J, Koehlmoos T, Smith R, Yan LL. Research misconduct in low- and middle-income countries. PLoS Med. 2013;10(3), e1001315.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Viergever RF, Ghersi D. The quality of registration of clinical trials. PLoS One. 2011;6(2), e14701.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Zarin DA, Tse T, Williams RJ, Califf RM, Ide NC. The ClinicalTrials.gov results database–update and key issues. N Engl J Med. 2011;364(9):852–60.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. Bernardez-Pereira S, Lopes RD, Carrion MJ, Santucci EV, Soares RM, de Oliveira AM, et al. Prevalence, characteristics, and predictors of early termination of cardiovascular clinical trials due to low recruitment: insights from the ClinicalTrials.gov registry. Am Heart J. 2014;168(2):213–9.

    Article  PubMed  Google Scholar 

  22. Bourgeois FT, Olson KL, Ioannidis JP, Mandl KD. Association between pediatric clinical trials and global burden of disease. Pediatrics. 2014;133(1):78–87.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Global Health Data Exchange: Country Profiles http://ghdx.healthdata.org/country_profiles

  24. Fiuzat M, Califf RM. Conduct of clinical trials in acute heart failure: regional differences in heart failure clinical trials. Heart Fail Clin. 2011;7(4):539–44.

    Article  PubMed  Google Scholar 

  25. Shirotani M, Kurokawa T, Chiba K. Comparison of global versus Asian clinical trial strategies supportive of registration of drugs in Japan. J Clin Pharmacol. 2014;54(7):753–64.

    Article  PubMed  Google Scholar 

  26. Nair SC, Ibrahim H, Celentano DD. Clinical trials in the Middle East and North Africa (MENA) Region: grandstanding or grandeur? Contemp Clin Trials. 2013;36(2):704–10.

    Article  PubMed  Google Scholar 

  27. Emerging Markets Clinical Trials: Eastern Europe (PH145); Cutting Edge Information. North Carolina; 2010. https://www.cuttingedgeinfo.com/research/clinical-development/central-eastern-europe-trials/. Accessed June 2, 2015.

  28. Petryna A. When experiments travel: clinical trials and the global search for human subjects: Princeton university press. Princeton, NJ: Princeton University Press; 2009.

    Book  Google Scholar 

  29. ICH – Harmonization for Better Health. International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use. Efficacy guidelines. http://www.ich.org/products/guidelines/efficacy/article/efficacy-guidelines.html. Accessed June 2, 2015.

Download references

Funding

NIH R21AG043715-01A1. Funding source provided salary support to FB and KM and had no involvement in data collection or analysis, manuscript writing, or decision to submit for publication.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Srinivas Murthy.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

SM was involved in the study design, data acquisition and analysis, and manuscript creation. KM was involved in study design and final manuscript approval. FB was involved in study design, data acquisition and analysis, and final manuscript approval.

Additional file

Additional file 1: Table S1.

Subgroup analyses of major conditions. Cardiovascular is defined as studies meeting search criteria for conditions involving coronary artery disease, cardiac dysfunction, or known risk factors for the above such as hypercholesterolemia and hypertension. Psychiatric trials were defined as studies meeting search criteria for common psychiatric disorders. Diabetes, asthma, and COPD were searched using their respective terms. Table S2. Trials involving children, defined as listed maximum age <19, or if listed maximum age above 19, median age <19. If no maximum age listed, trial assumed to involve adults. Figure S1. Top 10 pharmaceutical companies and studies with sites outside high-income regions, as defined by total revenues at Forbes.com.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Murthy, S., Mandl, K.D. & Bourgeois, F.T. Industry-sponsored clinical research outside high-income countries: an empirical analysis of registered clinical trials from 2006 to 2013. Health Res Policy Sys 13, 28 (2015). https://doi.org/10.1186/s12961-015-0019-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12961-015-0019-6

Keywords