Skip to main content

Health research capacity of professional and technical personnel in a first-class tertiary hospital in northwest China: multilevel repeated measurement, 2013–2017, a pilot study



To explore the health research capacity (HRC) and factors associated with professional and technical personnel (PTP) in a first-class tertiary hospital in northwest China.


We collected the repeated measurement data from a first-class tertiary hospital in northwest China between 2013 and 2017. HRC of PTP was assessed by a comprehensive evaluation system and measured by research capacity score (RCS). The participants were divided into research group (RCS >0) and comparison group (RCS = 0); participants of the comparison group were selected by two-stage stratified random sampling. Multilevel model for repeated measures was used to investigate the potential factors associated with HRC.


A total of 924 PTP were included (308 in the research group and 616 in the comparison group). This study found consistent growth in RCS and associated 95% CIs for the hospital during 2013 and 2017. The linear multilevel model showed PTP with a doctorate degree had higher RCS than those with a master’s degree (β, 1.74; P <0.001), bachelor’s degree (β, 2.02; <0.001) and others without a degree (β, 2.32; P <0.001). Furthermore, the PTP with intermediate (β, 0.13; = 0.015), vice-high (β, 0.27; P = 0.001) and senior (β, 0.63; P <0.001) professional titles had higher RCS than those with junior positions. Compared with PTP in the administration, those in paediatrics had higher RCS (β, 0.28; P = 0.047) though similar to PTP in other departments. PTP with an administrative position had a higher RCS than those in non-administrative positions (β, 0.26; P <0.001). The RCS increased with the research fund (β, 0.15; P <0.001). However, no associations were found between RCS and sex, age, ethnic, graduate school or technical type.


HRC with associated variation of PTP for the hospital in northwest China increasingly improved and degree, professional title, administrative position, and research fund were related to HRC of PTP. Multi-central prospective studies are needed to clarify the potential relationship of related factors and HRC of PTP.

Peer Review reports


Health research provides new knowledge that can be transferred into practice [1], creates advanced care environments [2], enhances the support available to patients and their families [3], and has been described as the missing link in the development of high-quality, evidence-based healthcare for the population [4]. Research outputs from hospitals have grown faster than those from universities, especially since 2006/2007 [5] and hospitals engaged in research have been recognised as providing better patient care [6]. Physician-scientists play a unique and critical role in health research [7]. Furthermore, with evidence-based practice spreading worldwide, professional and technical personnel (PTP) are responsible for delivering high-quality care based on the best evidence [8]. Therefore, the health research capacity (HRC) of PTP plays vital role in health research.

In recent years, studies on HRC have focused on nursing [9,10,11], midwifery [12], pharmacists [13] and other healthcare areas. However, developing high-quality hospital-based research is needed in our health system as well as for various PTP [14]. In addition, different approaches and indexes have been used to assess the HRC for nursing [10, 15,16,17] and salary sources, research funding, time spent in research, bibliometric analyses and other non-comprehensive indexes have been used to evaluate the HRC among other PTPs [10, 18,19,20]. However, there is no standardised method for measuring research capacity [18].

Based on a hospital's ability to provide medical care, medical education and conduct health research, hospitals in China are designated as primary, secondary or tertiary institutions [21]. Tertiary hospitals perform a larger role with regard to medical education and scientific research and serve as medical hubs providing care to multiple regions and are superior to primary hospitals and secondary hospitals [22, 23]. Furthermore, based on the level of service provision, size, medical technology, medical equipment, and management and medical quality, these three grades are further subdivided into three subsidiary levels, resulting in a total of nine levels. A first-class tertiary hospital is more specialized than any other level.

To date, no research has focused on hospitals of northwest China, where the HRC of PTP is in its initial and developmental stage. Therefore, herein, we chose all of the PTP in a Chinese first-class tertiary hospital of northwest China as the research objective. Health delivery systems vary considerably between different countries; thus, the HRC was assessed by a comprehensive evaluation system specific for China [24]. Additionally, some studies in HRC among other medical staff have been cross-sectional studies [2, 25], whereas others have used multiple linear regression analysis [26, 27], which ignores delayed effects [28] and long-term nature of scientific research [29]. Therefore, this study adopted the multilevel repeated measurement model [30, 31] to explore the HRC and factors associated with all PTP in a first-class tertiary hospital in northwest China.


Data source

The present study was based on data of the official figures from a first-class tertiary hospital in northwest China. Ethics approval was granted by the Institutional Ethics Committee of the Gansu Provincial Hospital. We selected PTP of the hospital as the research objective and collected the characteristics of participants and the information of HRC between 2013 and 2017.

Assessment of HRC

HRC was assessed by a comprehensive evaluation system and measured by research capacity score (RCS). The evaluation system was adopted by Hongwei Fan et al. in 2015 [24, 32, 33] based on the Delphi method and the selected 38 experts have rich experience in scientific research management, basic research, clinical research and other fields. The evaluation system covers the information of research capacity with associated weight score. After two rounds of the Delphi consulting, the scientific evaluation system was established and included 6 first-level indicators and 28 second-level indicators. The details of the evaluation system are included in Additional file 1. The mean of expert authority coefficients was 0.879, the Kendall's W coefficient of two rounds of the Delphi consulting were 0.79 and 0.83 [24]. The evaluation system had good reliability and validity (Cronbach’s α = 0.950) [32]. The information of research capacity contains obtained research projects, research awards, patents, published scientific papers, monographs and the number of trained students [24].

The RCS of participants is equal to the summary of the weight score in HRC. Considering the delayed effect [28] and long-term nature of scientific research [29], this study collected the RCS of the participants per year from 2013 to 2017.

Participants and randomisation

This study divided the participants into the research group (n = 308) and a comparison group (n = 1871) based on the RCS. The PTP whose RCS was greater than zero in the 5-year period belonged to the research group and the other participants belonged to the comparison group. The proportion of degree types (doctor, nurse, technician, pharmacists and other PTP) of all the PTP for the hospital was different from those of the research group and there were significant differences among technical types in sex, degree and other factors. To balance the number of participants between the two groups and reduce the potential bias caused by the different characteristics of PTP, a two-stage stratified random sampling method was adopted to determine the comparison group.

Two-stage stratified random sampling was performed as follows: (1) the PTP in the comparison group were stratified into five levels based on the degree type of research group: doctor, nurse, technician, pharmacists and other PTP; and (2) we selected each level in a 1:2 ratio (research group versus comparison group), and 616 participants were randomly selected from the comparison group as the research objective. Therefore, a total sample of 924 professional technical personnel was included in this study. Figure 1 shows the flow of PTP sampling and ascertainment.

Fig. 1

Sampling and ascertainment of professional and technical personnel

Data management

We developed a study manual of operations to standardise all screening and data management, which was used to train all researchers in this study.

The information of participant-level characteristics included basic demographic characteristics (sex, age, ethnic, birthplace, etc.); the latest degree information (highest degree, graduate school, length since graduation, etc.); and the latest work information (department, technical type, title, whether in an administrative position or not, etc.). The repeated measurement of scientific research information (in the 5 years 2013–2017) included the number of obtained research projects, research awards, research fund or patents; published scientific papers or monographs, and the number of trained students.

Highest degree containing doctor, master, bachelor and others (without a degree). Graduate school of PTP includes foreign university, 985/211 university, common university, and others. (985/211 university means one of the universities participating in either Project 211 or Project 985, financed by the government of the People’s Republic of China to build world-class universities for the 21st century; universities in projects 985 or 211 are first class universities in China [34].) Common university means the full-time university besides a foreign university or a 985/211 university, and other universities containing adult education, network education and other various part-time courses. Degree type includes doctors, nurses, medical technicians, pharmacists and others (other professional and technical types such as accountant, economist, etc.).

Statistical analysis

For continuous variables, data were reported either as the mean ± standard deviation (SD) or the median with interquartile range (IQR) according to normality tests (Shapiro–Wilk and Shapiro–Francia tests for normality). Categorical variables were expressed as frequencies and percentages. Pearson's χ2, two-sample t test and Kruskal–Wallis rank test were used to compare the difference of participant-level characteristics between the two groups.

Taking delayed effect [28] and long-term of scientific research [28] into account, we repeated the measurement of research capacity of PTP from 2013 to 2017. Thus, the traditional multiple regression model is not suitable. Furthermore, repeated measurement ANOVA could not handle the covariates well as it regarded random effects as useless parameters, which leads to information loss [35]. Therefore, we used multilevel models for repeated measures to investigate the potential factors associated with HRC for PTP and to accommodate data structured hierarchically [31]. We used linear multilevel models with random intercepts for continuous measures of HRC, and a two-level variance structure with repeated assessment measures nested within PTP. Multicollinearity in the predictors can affect the results of multilevel models. Multilevel variance inflation factor, a form of analysis used in multilevel modelling, was used to assess multicollinearity among predictors; variables with multilevel variance inflation factor values over 10 indicate potential collinearity problems [36,37,38]. All of the main effects and interactions were assessed using P values from Wald tests.

Covariates included in the final model were (1) sex, age and ethnicity for basic demographic characteristics; (2) highest degree and graduate school for degree information; (3) technical type, title, department, whether holding an administrative position or not for work information; and (4) the amount of research funded each year between 2013 and 2017 for research information.

Data from these analyses were reported as coefficients with 95% confidence intervals (CIs). For all statistical tests, a two-tailed a level of 0.05 was used. Statistical analyses and preparation of figures were performed using Stata, version 13.0 (Stata Corp., College Station, TX, USA) and MLwiN, version 2.30.


Characteristics of participants

A total of 924 PTP were included (308 in the research group, 616 in the comparison group). The average age was 44.84 ± 8.51 years for the PTP in the research group and 37.71 ± 8.90 years for the comparison group. Approximately 44.26% (409) of participants were male.

Table 1 shows the participant-level characteristics in the research and comparison groups. The HRC were significantly different among participants of different ages (P <0.001), highest degree (P <0.001), graduate school (P = 0.003), length since graduation (P <0.001), professional title (P <0.001), administrative position (P <0.001) and research funding (P <0.001) between the two groups. However, no differences were found in sex, ethnicity and other participant-level characteristics.

Table 1 Participant-level characteristics in the two groups

The trend of HRC over time

Figure 2 shows the trend of health RCS with the associated 95% CIs of the first-class tertiary hospital from 2013 to 2017. The results showed consistent growth in RCS during 2013 and 2017, and there was a sharp rise in 2015. In addition, although the number of PTP in the hospital had increased gradually over the past 5 years, the 95% CIs of the RCS widened significantly, indicating that the variation in the HRC of the PTP increased dramatically.

Fig. 2

The trend of health research capacity for all participants

HRC at participant level

Figure 3 shows the median P25 and P75 of RCS of PTP with different characteristics. The results showed that men PTP had higher RCS but greater IQR than women PTP; the Han nationality and minority participants had similar RCS, but the RCS of Han nationality participants had bigger IQR; RCS increased with the educational degree of participants, but IQR decreased with the educational degree of participants; those graduated from foreign universities had the highest RCS but greatest IQR than others, followed by those graduated from 985/211 universities, common universities and other schools.

Fig. 3

The research capacity score of participants stratified by characteristics*. *: C, Comparison group; R, Research group; P25, the first quartile; P75, the third quartile; Position, in administrative positions

The participants with doctorate degrees had the highest RCS and those with pharmacist, nurse and medical degrees had similar RCS, but participants with doctor and pharmacist degrees had the greatest IQR and those with nursing degrees had the smallest IQR. Participants with senior titles had the highest RCS, followed by those with vice-high, junior and intermediate title, though participants with senior titles had the greatest IQR, followed by those with vice-high, intermediate and junior title. Participants in paediatrics had the highest RCS but the greatest IQR than others. Finally, those in administrative positions had higher RCS but greater IQR than those in non-administrative positions.

Multilevel repeated measurement model for HRC

Figure 4 presents the results of the multilevel repeated measurement model for the factors associated with HRC of PTP. All of the multilevel variance inflation factors ranged from 1.018 to 4.357 (details are included in Additional file 2), suggesting the absence of potential collinearity problems with these results. After controlling for the potential confounders, the HRC of PTP was related to degree, professional title, department, whether in an administrative position and research fund.

Fig. 4

Two-level repeated measurement model for the factors associated with health research capacity

Participants with a doctorate’s degree had higher RCS than those with a master’s degree (β, 1.74; 95% CI 1.04–2.45; P <0.001), bachelor’s degree (β, 2.02; 95% CI 1.31–2.73; P <0.001) and others without a degree (β, 2.32; 95% CI 1.47–2.98; P <0.001). Furthermore, participants with intermediate (P = 0.015), vice-high (P = 0.001) and senior (P <0.001) professional titles had 0.13 (95% CI 0.03–0.23) points, 0.27 (95% CI 0.12–0.42) points and 0.63 (95% CI 0.40–0.80) points more than those with junior title on average. Compared with participants in administrative roles, those in paediatrics had higher RCS (β, 0.28; 95% CI 0.00–0.57; P = 0.047) but similar to those in other departments. Participants in administrative positions had a higher RCS than those in non-administrative positions (β, 0.26; 95% CI 0.12–0.40; P <0.001). The RCS increased with the research fund (β, 0.15; 95% CI 0.14–0.16; P <0.001). However, no associations were found between RCS and sex, age, ethnicity, graduate school or technical type of participants.


This study found steady growth in HRC of the first-class tertiary hospital during 2013 and 2017, with a sharp rise in 2015. In addition, the HRC of PTP increased with degree, professional title and research fund; those in administrative positions had better HRC than those in non-administrative positions. However, no association was found between graduate school and HRC.

The first-class tertiary hospital showed consistent growth in the HRC with associated variation during 2013 and 2017. Some factors might explain the consistent growth of HRC. Firstly, hospital managers have realised the importance of scientific research; thus, some internal incentives were used to promote research [39, 40]. Secondly, the PTP have undergone scientific training to improve their HRC [41, 42]. Thirdly, talents with excellent HRC have been recruited in hospital; however, this may also increase the variation in the HRC of PTP as recruited talents with superior capacity and positive attitude towards research would more easily gain more academic resources and subsequently improve the HRC. Such a trend seemed similar to Matthew effect [43], leading to increasing internal differences.

This study found that the HRC of PTP increased with the academic degree of PTP. Previous research in young Japanese nursing faculty showed that a doctorate degree was the most vital predictor of the number of publications [44] and researchers found that master’s degree was the crucial factor for research participation for nurses [45], similar to what we have observed herein because more academic training and research sources are critical components of the development of a research career [46]. Since participants who graduate from better universities will have better education and research resources and may carry this on to their working environments [47]; however, we found no correlation between graduate school and HRC. A study found that the training and work environments but not the prestige of their doctoral institution drove researcher productivity [48], similar to that observed herein. Degree and graduate school were often used as a measure of scientific capacity [49]; therefore, our results may provide a perspective for hospital administrators for what may be considered when bringing in talents and improving hospital research capacity.

A positive correlation was found between research funding and HRC of PTP, similar to a previous study suggesting a positive correlation between the funding support and research success [20]. As reported in previous studies, limited funding was one of the highest-ranking barriers to conducting research [50] and restricted collaboration between institutions [51]. Furthermore, the better funding support is a potential factor to build capacity of research [52, 53]. In order to obtain long-term and adequate research funding, researchers may be encouraged to set research agenda, focused on important issues and collaboration [54, 55], and then strengthed the HRC. A study in Bangladesh showed that the provision of un-earmarked core funding may be a potential mechanism for building research capacity [56]. On the other hand, PTP with higher HRC are more likely to get research funding, for example, attracting supported fellows to obtain additional research funding [20].

The HRC increased with the professional title of participants. Similar to our results, a previous study found a positive correlation between professional titles and publications in traditional Chinese medicine clinical investigators [50]. Participants with superior research capacity more easily met the requirements of professional title promotion and higher professional titles may bring more academic resources, including funding [57, 58]. Furthermore, research funding is related to higher HRC as this study and previous studies have found [54, 55]. Therefore, there may be a mutual incentive effect between professional titles and HRC, and the interaction is worth further exploration.

A previous study found that holding an administrative position had no effect on the academic productivity in a university hospital radiology department [59]; this is in contrast to our study, which suggested that personnel in administrative positions showed better research capacity than those in non-administrative positions in a Chinese hospital. Firstly, the research hospital in this study is located in the northwest of China, and therefore the ‘steel bowl’ model still has an influence on the hospital. The ‘steel bowl’ model in hospitals can be summarised as follows [60]: (1) PTP are hired in tenure and enjoy lifetime job security and (2) salaries are set by the government regardless of the individual’s performance. Thus, most of the PTP lack motivation to persist; however, PTP in administrative positions are more competitive than those in non-administrative positions. Secondly, PTP in administrative positions hold stronger attitudes and knowledge/skills on evidence-based practice [61]. Thirdly, the support and dedication of administrative superiors are key factors of the excellent teamwork [62] and teamwork plays a vital role on research. Compared with PTP in non-administrative positions, those in administrative positions can obtain more support and dedication.

Strengths and limitations

This policy study was the first study on HRC and associated factors of PTP in a first-class tertiary hospital in northwest China. Furthermore, we used repeated measurement to handle the delayed effect and long-term characteristics of scientific research. However, there are some limitations to this study. Firstly, the nature of the study design, a retrospective study, will result in some biases and inaccuracies. In addition, for a retrospective design, the information in degree and work of participants during 2013–2017 was uncomplete, thus we chose the latest information. However, we used two-stage stratified random sampling to reduce the effect of information loss. Secondly, the results of this single-centre from northwest China, where the HRC of PTP is in its initial and developmental stage, might not be applicable to other clinical centres where the HRC of PTP is mature. Thirdly, the training, time spent on scientific research and attitudes towards research might influence the research capacity yet we could not collect such information. Fourthly, although the evaluation system this study adopted had good reliability and validity, the system was based on linear weight method, which may be difficult to objectively evaluate the scientific research capacity [63]. Finally, the proportion of the comparison group (RCS = 0) may influence on the result, but the data of this study does not apply to logistic multilevel repeated measurement model, thus we chose the linear multilevel model only.


HRC with associated variation of PTP for the hospital in northwest China increasingly improved in the past 5 years and the degree, professional title, administrative position and research fund were related to HRC of PTP. Multi-central prospective studies are needed to clarify the potential relationship of related factors and HRC of PTP.

Availability of data and materials

The datasets used and analysed during the current study are available from the corresponding author on reasonable request.



health research capacity


professional and technical personnel


research capacity score


interquartile range


confidence intervals


  1. 1.

    Grimshaw JM, Eccles M, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implementation Sci. 2012;7(50):1–17.

    Google Scholar 

  2. 2.

    Caminiti C, Iezzi E, Ghetti C, De’ Angelis G, Ferrari C. A method for measuring individual research productivity in hospitals: development and feasibility. BMC Health Serv Res. 2015;15:468.

    PubMed  PubMed Central  Article  Google Scholar 

  3. 3.

    Research in the behavioural and social sciences to improve cancer control and care: a strategy for development. A report of an expert group. European J Cancer 2004, 40(3):316–25.

  4. 4.

    Zwar NA, Weller DP, McCloughan L, Traynor VJ. Supporting research in primary care: are practice-based research networks the missing link? Med J Aust. 2006;185(2):110–3.

    PubMed  Article  Google Scholar 

  5. 5.

    Tijssen RJ, Winnink J. Twenty-first century macro-trends in the institutional fabric of science: bibliometric monitoring and analysis. Scientometrics. 2016;109(3):2181–94.

    PubMed  PubMed Central  Article  Google Scholar 

  6. 6.

    Whitworth A, Haining S, Stringer H. Enhancing research capacity across healthcare and higher education sectors: development and evaluation of an integrated model. BMC Health Serv Res. 2012;12:287.

    PubMed  PubMed Central  Article  Google Scholar 

  7. 7.

    Ley TJ, Rosenberg LE. The physician-scientist career pipeline in 2005. JAMA. 2005;294(11):13343–51.

    Article  Google Scholar 

  8. 8.

    Chen Q, Sun M, Tang S, Castro AR. Research capacity in nursing: a concept analysis based on a scoping review. BMJ Open. 2019;9(11):e032356.

    PubMed  PubMed Central  Article  Google Scholar 

  9. 9.

    McKee G, Codd M, Dempsey O, Gallagher P, Comiskey C. Describing the implementation of an innovative intervention and evaluating its effectiveness in increasing research capacity of advanced clinical nurses: using the consolidated framework for implementation research. BMC Nurs. 2017;16:21–34.

    PubMed  PubMed Central  Article  Google Scholar 

  10. 10.

    Gullick JG, West SH. Building research capacity and productivity among advanced practice nurses: an evaluation of the Community of Practice model. J Adv Nurs. 2016;72(3):605–19.

    PubMed  Article  Google Scholar 

  11. 11.

    Squires A. US nursing and midwifery research capacity building opportunities to achieve the United Nations sustainable development goals. Nursing Outlook. 2019;67(6):642–48.

  12. 12.

    Hauck YL, Lewis L, Bayes S, Keyes L. Research capacity building in midwifery: Case study of an Australian Graduate Midwifery Research Intern Programme. Women Birth. 2015;28(3):259–63.

    PubMed  Article  Google Scholar 

  13. 13.

    Nazer LH, Tuffaha H, Jaddoua S. A program to increase research productivity among hospital pharmacists. J Pharm Pract. 2017;30(3):336–41.

    PubMed  Article  Google Scholar 

  14. 14.

    Hong J, Xu J, Sun X. Young doctors and the pressure of publication. Lancet. 2013;381(9876):e10–1.

    PubMed  Article  Google Scholar 

  15. 15.

    Bäck-Pettersson S, Jensen KP, Kylén S, Sernert N, Hermansson E. Nurses’ experiences of participation in a research and development programme. J Clin Nurs. 2013;22(7-8):1103–11.

    PubMed  Article  Google Scholar 

  16. 16.

    Corchon S, Portillo MC, Watson R, Saracibar M. Nursing research capacity building in a Spanish hospital: an intervention study. J Clin Nurs. 2011;20(17-18):2479–89.

    PubMed  Article  Google Scholar 

  17. 17.

    Duffy JR, Culp S, Sand-Jecklin K, Stroupe L, Lucke-Wold N. Nurses’ research capacity, use of evidence, and research productivity in acute care: year 1 findings from a partnership study. J Nurs Admin. 2016;46(1):12–7.

    Article  Google Scholar 

  18. 18.

    Embi PJ, Tsevat J. Commentary: the relative research unit: providing incentives for clinician participation in research activities. Acad Med. 2012;87(1):11–4.

    PubMed  PubMed Central  Article  Google Scholar 

  19. 19.

    Petrak J, Sember M, Granic D. Assessing research productivity in Department of Internal Medicine, University of Zagreb, School of Medicine and University Hospital Centre Zagreb. Lijecnicki vjesnik. 2012;134(3-4):69–74.

    PubMed  Google Scholar 

  20. 20.

    Hiscock H, Ledgerwood K, Danchin M, Ekinci E, Johnson E, Wilson A. Clinical research potential in Victorian hospitals: the Victorian clinician researcher needs analysis survey. Intern Med J. 2014;44(5):477–82.

    CAS  PubMed  Article  Google Scholar 

  21. 21.

    Li X, Huang J, Zhang H. An analysis of hospital preparedness capacity for public health emergency in four regions of China: Beijing, Shandong, Guangxi, and Hainan. BMC Public Health. 2008;8(1):319.

    PubMed  PubMed Central  Article  Google Scholar 

  22. 22.

    The measures for the administration of the hospital grade. Accessed 3 May 2020.

  23. 23.

    Classification of Chinese Hospitals. Accessed 3 May 2020.

  24. 24.

    Hongwei F, Qi Z, Weidong H. Analysis of influential factors of doctors’ research ability of affiliated hospitals of medical university. Chinese Hosp Manage. 2015;08:53–5.

    Google Scholar 

  25. 25.

    Magesa SM, Mwape B, Mboera LE. Challenges and opportunities in building health research capacity in Tanzania: a case of the National Institute for Medical Research. Tanzania J Health Res. 2011;13(5 Suppl 1):427–43.

    Google Scholar 

  26. 26.

    Howard AJ, Ferguson M, Wilkinson P, Campbell KL. Involvement in research activities and factors influencing research capacity among dietitians. J Hum Nutr Dietetics. 2013;26(Suppl. 1):180–7.

    Article  Google Scholar 

  27. 27.

    Barbón OG, Barriga SF, Cazorla AL, Cepeda LG. Influence of seniority and total research hours on scientific production of university professors. Formación Universitaria. 2018;11(4):75–82.

    Article  Google Scholar 

  28. 28.

    Geuna A, Nesta LJJ. University patenting and its effects on academic research: the emerging European evidence. Res Policy. 2006;35(6):790–807.

    Article  Google Scholar 

  29. 29.

    Owens B. Long-term research: slow science. Nature. 2013;495(7441):300–3.

    CAS  PubMed  Article  Google Scholar 

  30. 30.

    Krull JL, MacKinnon DP. Multilevel modeling of individual and group level mediated effects. Multivariate Behav Res. 2001;36(2):249–77.

    CAS  PubMed  Article  Google Scholar 

  31. 31.

    Goldstein H. Multilevel Statistical Models. Chichester: Wiley; 2011.

  32. 32.

    Hongwei F, Jingjie L, Zhixue D, Qi Z, Weidong H. Establishment of research ability index system for assessing the affiliated hospitals of medical university. Chinese Hosp Manage. 2015;11:53–5.

    Google Scholar 

  33. 33.

    Hongwei F, Weidong H. An Analysis of Influential Factors for Nurses’ Research Ability of Affiliated Hospitals of Medical University. Chinese Hosp Manag. 2015;12:80–2.

    Google Scholar 

  34. 34.

    Project 211 and 985. Accessed 3 May 2020.

  35. 35.

    Park E, Cho M, Ki CS. Correct use of repeated measures analysis of variance. Korean J Lab Med. 2009;29(1):1–9.

    PubMed  Article  Google Scholar 

  36. 36.

    Clark PC Jr. The effects of multicollinearity in multilevel models. Dayton: Wright State University; 2013.

  37. 37.

    Burlison JD, Quillivan RR, Kath LM, Zhou Y, Courtney SC, Cheng C, Hoffman JM. A multilevel analysis of US hospital patient safety culture relationships with perceptions of voluntary event reporting. J Patient Safety. 2020;16(3):187–93.

  38. 38.

    de la Fuente J, Caballero FF, Verdes E, Rodríguez-Artalejo F, Cabello M, de la Torre-Luque A, Sánchez-Niubó A, María Haro J, Ayuso-Mateos JL, Chatterji S: Are younger cohorts in the USA and England ageing better? Int J Epidemiol. 2019;48(6):1906–13.

  39. 39.

    Yarris LM, Juve AM, Artino AR Jr, Sullivan GM, Rougas S, Joyce B, Eva K. Expertise, time, money, mentoring, and reward: systemic barriers that limit education researcher productivity-proceedings from the AAMC GEA Workshop. J Grad Med Educ. 2014;6(3):430–6.

    PubMed  PubMed Central  Article  Google Scholar 

  40. 40.

    Khullar D, Chokshi DA, Kocher R, Reddy A, Basu K, Conway PH, Rajkumar R. Behavioral economics and physician compensation--promise and challenges. New Engl J Med. 2015;372(24):2281–3.

    PubMed  Article  Google Scholar 

  41. 41.

    Shaffer JG, Mather FJ, Wele M, Li J, Tangara CO, Kassogue Y, Srivastav SK, Thiero O, Diakite M, Sangare M, et al. Expanding research capacity in Sub-Saharan Africa through informatics, bioinformatics, and data science training programs in Mali. Front Genet. 2019;10:331–44.

    PubMed  PubMed Central  Article  Google Scholar 

  42. 42.

    Byrne E, Donaldson L, Manda-Taylor L, Brugha R, Matthews A, MacDonald S, Mwapasa V, Petersen M, Walsh A. The use of technology enhanced learning in health research capacity development: lessons from a cross country research partnership. Glob Health. 2016;12(1):19–33.

    CAS  Article  Google Scholar 

  43. 43.

    Hojat M, Gonnella JS, Caelleigh AS. Impartial judgment by the “gatekeepers” of science: fallibility and accountability in the peer review process. Adv Health Sci Educ. 2003;8(1):75–96.

    Article  Google Scholar 

  44. 44.

    Oyama Y, Fukahori H, Miyashita M, Narama M, Kono A, Atogami F, Kashiwagi M, Okaya K, Takamizawa E, Yoshizawa T. Cross-sectional online survey of research productivity in young Japanese nursing faculty. Japan J Nurs Sci. 2015;12(3):198–207.

    Article  Google Scholar 

  45. 45.

    Smirnoff M, Ramirez M, Kooplimae L, Gibney M, McEvoy MD. Nurses’ attitudes toward nursing research at a metropolitan medical center. Appl Nurs Res. 2007;20(1):24–31.

    PubMed  Article  Google Scholar 

  46. 46.

    Henly SJ, Struthers R, Dahlen BK, Ide B, Patchell B, Holtzclaw BJ. Research careers for American Indian/Alaska native nurses: pathway to elimination of health disparities. Am J Public Health. 2006;96(4):606–11.

    PubMed  PubMed Central  Article  Google Scholar 

  47. 47.

    Malmgren RD, Ottino JM, Nunes Amaral LA. The role of mentorship in protege performance. Nature. 2010;465(7298):622–6.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  48. 48.

    Way SF, Morgan AC, Larremore DB, Clauset A. Productivity, prominence, and the effects of academic environment. Proc Natl Acad Sci USA. 2019;116(22):10729–33.

    CAS  PubMed  Article  Google Scholar 

  49. 49.

    McGee R Jr, Saran S, Krulwich TA. Diversity in the biomedical research workforce: developing talent. Mount Sinai J Med. 2012;79(3):397–411.

    Article  Google Scholar 

  50. 50.

    Feng S, Han M, Lai L, Wang SC, Liu JP. Research capacity at traditional Chinese medicine (TCM) centers in China: a survey of clinical investigators. Evid Based Complement Altern Med. 2017;2017:4231680.

    Google Scholar 

  51. 51.

    Varshney D, Atkins S, Das A, Diwan V. Understanding collaboration in a multi-national research capacity-building partnership: a qualitative study. Health Res Policy Syst. 2016;14:64.

    PubMed  PubMed Central  Article  Google Scholar 

  52. 52.

    Gonzalez Block MA, Mills A. Assessing capacity for health policy and systems research in low and middle income countries. Health Res Policy Syst. 2003;1(1):1–20.

    PubMed  PubMed Central  Article  Google Scholar 

  53. 53.

    Schlenker MB, Manalo E, Wong AM. Research productivity of Canadian ophthalmology departments in top 10 ophthalmology and vision science journals from 2001 to 2010. Can J Ophthalmol. 2013;48(1):46–55.

    PubMed  Article  Google Scholar 

  54. 54.

    Eddleston M. Encouraging high-quality clinical research in the tropics. Lancet. 1999;353(9159):1190.

    CAS  PubMed  Article  Google Scholar 

  55. 55.

    Marshall JC. Global collaboration in acute care clinical research: opportunities, challenges, and needs. Crit Care Med. 2017;45(2):311–20.

    PubMed  Article  Google Scholar 

  56. 56.

    Mahmood S, Hort K, Ahmed S, Salam M, Cravioto A. Strategies for capacity building for health research in Bangladesh: Role of core funding and a common monitoring and evaluation framework. Health Res Policy Syst. 2011;9:31.

    PubMed  PubMed Central  Article  Google Scholar 

  57. 57.

    Liu Y, Yang Z, Fan D. Professional title promotion among clinicians: a cross-sectional survey. Lancet. 2016;388:31.

    Article  Google Scholar 

  58. 58.

    Zhang Z. Statistical analysis on health management of National Social Science Fund Projects. Sci Technol Manage Res. 2015;35(7):52–7.

    Google Scholar 

  59. 59.

    Eschelman DJ, Sullivan KL, Parker L, Levin DC. The relationship of clinical and academic productivity in a university hospital radiology department. Am J Roentgenol. 2000;174(1):27–31.

    CAS  Article  Google Scholar 

  60. 60.

    Huang Y, Pang S-K, Yu S. Academic identities and university faculty responses to new managerialist reforms: experiences from China. Studies Higher Educ. 2018;43(1):154–72.

    Article  Google Scholar 

  61. 61.

    Zhou F, Hao Y, Guo H, Liu H. Attitude, knowledge, and practice on evidence-based nursing among registered nurses in traditional Chinese medicine hospitals: a multiple center cross-sectional survey in China. Evid Based Complement Altern Med. 2016;2016:5478086.

    Google Scholar 

  62. 62.

    Lin CF, Huang CI, Yang CM, Lu MS. The relationship between work environment satisfaction and retention intention among nursing administrators in Taiwan. J Nurs Res. 2019;27(5):e43.

    PubMed  PubMed Central  Article  Google Scholar 

  63. 63.

    Fei W, Jingbo W, Zhanpeng Y. Evaluation on hospital scientific research performance based on application in data envelopment analysis method. Hosp Admin J Chin PLArmy. 2019;26(06):579–83.

    Google Scholar 

Download references


Not applicable.


This work was supported by Research Projects of Gansu Provincial Hospital (Grant no. 17GSSY9-1 and 18GSSY7-3), the National Social Science Fund of China (Grant no. 19ZDA142), and Fundamental Research Funds for the Central Universities (Grant no. 18LZUJBWZX006 and Grant no.2019jbkyzy002): Evidence-based Social Science Research.

Author information




Kehu Yang and Min Zhang: study design, methodological advice, supervising the analysis and interpretation of the data, drafting and revising the manuscript. Peijing Yan, Yongfeng Lao and Zhengxing Lu: study design, collecting data, data cleaning, analysis and interpretation of the data, drafting and revising the manuscript. Xu Hui, Biao Zhou and Xinyu Zhu: collecting data, data entry, data cleaning and drafting the manuscript., Xiaojie Chen, Li Li and Zixuan Wang: interpreting of data and drafting and revising the manuscript. The author(s) read and approved the final manuscript.

Corresponding authors

Correspondence to Min Zhang or Kehu Yang.

Ethics declarations

Ethics approval and consent to participate

This study has been granted ethical approval from the Institutional Ethics Committee of the Gansu Provincial Hospital (No. 2019-203).

Consent for publication

Not applicable.

Competing interests

None declared.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: eTable 1

Scientific research capability evaluation system.

Additional file 2: eTable 2

Multilevel variance inflation factors of variables in the multilevel repeated measurement model.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Yan, P., Lao, Y., Lu, Z. et al. Health research capacity of professional and technical personnel in a first-class tertiary hospital in northwest China: multilevel repeated measurement, 2013–2017, a pilot study. Health Res Policy Sys 18, 103 (2020).

Download citation


  • Health research capacity; professional and technical personnel; Chinese hospital; multilevel repeated measurement