Skip to main content

Table 3 Rating and selection of indicators by participants to the Delphi survey

From: Identifying potential indicators to measure the outcome of translational cancer research: a mixed methods approach

 

Round 1

Round 2

Indicator

Feasibility

Validity

Status

Validity

Status

Number of clinical trials

81%

84%

Included

Included

Percentage of patients included in a clinical trial

77%

81%

Included

Included

Number of peer-reviewed publications

95%

81%

Included

Included

Number of citations

88%

85%

Included

Included

Number of public-private partnerships

75%

78%

Included

Included

Impact factor

96%

76%

Included

Included

Institutional h-index

92%

73%

Second round

83%

Included

Number of publications co-authored with another organisation

92%

72%

Second round

76%

Included

Mean number of citations per article

91%

69%

Second round

66%

Included

Number of highly cited publications

78%

67%

Second round

69%

Included

Number of publications in top-ranked journals

85%

65%

Second round

69%

Included

z-index

83%

71%

Second round

69%

Included

Number of publications with international collaboration

92%

67%

Second round

85%

Included

Number of biomarkers identified

33%

52%

Modified

58%

To be discussed

Citation of research in clinical guidelines

71%

71%

Second round

62%

To be discussed

Generation of clinical guidelines

74%

67%

Second round

54%

To be discussed

Citation of research in public health guidelines

60%

58%

Modified

50%

To be discussed

Number of patents

88%

65%

Second round

38%

Excluded

Number of patients in a clinical trial with a biomarker identification

56%

58%

Excluded

Number of biological samples collected

69%

50%

Excluded

Number of biological samples transmitted

42%

34%

Excluded

Number of hypotheses generated

46%

46%

Excluded

Number of diagnostic tests created

50%

45%

Excluded

Number of database generated

50%

38%

Excluded

Number of research projects ongoing

57%

29%

Excluded

Number of assays developed

0%

0%

Excluded

Number of visits to EXPASY server

75%

0%

Excluded

Clinicians’ awareness of research results

22%

36%

Excluded

Changes in clinical practices

21%

43%

Excluded

Contribution to reports informing policy makers

58%

35%

Excluded

Number of presentations at key selected conferences

60%

56%

Excluded

Citation in medical education books

42%

48%

Excluded

Number of conferences held

71%

38%

Excluded

Citation of research in the media

41%

28%

Excluded

Number of papers co-authored with the industry

74%

61%

Excluded

 

Citation of research in patents

79%

58%

Excluded

Patent h-index

52%

52%

Excluded

Number of patent citations

73%

48%

Excluded

Number of spin-off companies created

86%

43%

Excluded

Partnership-ability index

82%

50%

Excluded

Dependence degree (d-index)

67%

50%

Excluded

Proportion of long-distance collaborative publications

43%

0%

Excluded

Number of publications co-authored by an epidemiologist and biologist

52%

41%

Excluded

Age-weighted citation rate

71%

33%

Excluded

b-index

83%

43%

Excluded

Central index

60%

50%

Excluded

CH-index

50%

0%

Excluded

Crown indicator

33%

0%

Excluded

e-index

80%

50%

Excluded

g-index

100%

0%

Excluded

Hg-index

33%

0%

Excluded

j-index

75%

33%

Excluded

m-index

50%

25%

Excluded

m-quotient

67%

60%

Excluded

Mean normalised citation score

50%

33%

Excluded

Q2 index

25%

0%

Excluded

r-index

83%

33%

Excluded

SP-index

100%

50%

Excluded

w-index

71%

33%

Excluded

x-index

50%

0%

Excluded

  1. Percentage of participants rating the indicator in the top tertile (7–9/9). Included: the indicator is included in the final set. Excluded: the indicator is excluded from the selection. Second round: the indicator is submitted to the second round of rating. Modified: The indicator is submitted to the second round of rating with significant changes in the definition and/or methodology following the respondents’ comments. To be discussed: the methodology of the indicator will be discussed in the expert meeting.