Skip to main content

Advertisement

Table 3 Rating and selection of indicators by participants to the Delphi survey

From: Identifying potential indicators to measure the outcome of translational cancer research: a mixed methods approach

  Round 1 Round 2
Indicator Feasibility Validity Status Validity Status
Number of clinical trials 81% 84% Included Included
Percentage of patients included in a clinical trial 77% 81% Included Included
Number of peer-reviewed publications 95% 81% Included Included
Number of citations 88% 85% Included Included
Number of public-private partnerships 75% 78% Included Included
Impact factor 96% 76% Included Included
Institutional h-index 92% 73% Second round 83% Included
Number of publications co-authored with another organisation 92% 72% Second round 76% Included
Mean number of citations per article 91% 69% Second round 66% Included
Number of highly cited publications 78% 67% Second round 69% Included
Number of publications in top-ranked journals 85% 65% Second round 69% Included
z-index 83% 71% Second round 69% Included
Number of publications with international collaboration 92% 67% Second round 85% Included
Number of biomarkers identified 33% 52% Modified 58% To be discussed
Citation of research in clinical guidelines 71% 71% Second round 62% To be discussed
Generation of clinical guidelines 74% 67% Second round 54% To be discussed
Citation of research in public health guidelines 60% 58% Modified 50% To be discussed
Number of patents 88% 65% Second round 38% Excluded
Number of patients in a clinical trial with a biomarker identification 56% 58% Excluded
Number of biological samples collected 69% 50% Excluded
Number of biological samples transmitted 42% 34% Excluded
Number of hypotheses generated 46% 46% Excluded
Number of diagnostic tests created 50% 45% Excluded
Number of database generated 50% 38% Excluded
Number of research projects ongoing 57% 29% Excluded
Number of assays developed 0% 0% Excluded
Number of visits to EXPASY server 75% 0% Excluded
Clinicians’ awareness of research results 22% 36% Excluded
Changes in clinical practices 21% 43% Excluded
Contribution to reports informing policy makers 58% 35% Excluded
Number of presentations at key selected conferences 60% 56% Excluded
Citation in medical education books 42% 48% Excluded
Number of conferences held 71% 38% Excluded
Citation of research in the media 41% 28% Excluded
Number of papers co-authored with the industry 74% 61% Excluded  
Citation of research in patents 79% 58% Excluded
Patent h-index 52% 52% Excluded
Number of patent citations 73% 48% Excluded
Number of spin-off companies created 86% 43% Excluded
Partnership-ability index 82% 50% Excluded
Dependence degree (d-index) 67% 50% Excluded
Proportion of long-distance collaborative publications 43% 0% Excluded
Number of publications co-authored by an epidemiologist and biologist 52% 41% Excluded
Age-weighted citation rate 71% 33% Excluded
b-index 83% 43% Excluded
Central index 60% 50% Excluded
CH-index 50% 0% Excluded
Crown indicator 33% 0% Excluded
e-index 80% 50% Excluded
g-index 100% 0% Excluded
Hg-index 33% 0% Excluded
j-index 75% 33% Excluded
m-index 50% 25% Excluded
m-quotient 67% 60% Excluded
Mean normalised citation score 50% 33% Excluded
Q2 index 25% 0% Excluded
r-index 83% 33% Excluded
SP-index 100% 50% Excluded
w-index 71% 33% Excluded
x-index 50% 0% Excluded
  1. Percentage of participants rating the indicator in the top tertile (7–9/9). Included: the indicator is included in the final set. Excluded: the indicator is excluded from the selection. Second round: the indicator is submitted to the second round of rating. Modified: The indicator is submitted to the second round of rating with significant changes in the definition and/or methodology following the respondents’ comments. To be discussed: the methodology of the indicator will be discussed in the expert meeting.