Skip to main content

Table 3 Rating and selection of indicators by participants to the Delphi survey

From: Identifying potential indicators to measure the outcome of translational cancer research: a mixed methods approach

  Round 1 Round 2
Indicator Feasibility Validity Status Validity Status
Number of clinical trials 81% 84% Included – Included
Percentage of patients included in a clinical trial 77% 81% Included – Included
Number of peer-reviewed publications 95% 81% Included – Included
Number of citations 88% 85% Included – Included
Number of public-private partnerships 75% 78% Included – Included
Impact factor 96% 76% Included – Included
Institutional h-index 92% 73% Second round 83% Included
Number of publications co-authored with another organisation 92% 72% Second round 76% Included
Mean number of citations per article 91% 69% Second round 66% Included
Number of highly cited publications 78% 67% Second round 69% Included
Number of publications in top-ranked journals 85% 65% Second round 69% Included
z-index 83% 71% Second round 69% Included
Number of publications with international collaboration 92% 67% Second round 85% Included
Number of biomarkers identified 33% 52% Modified 58% To be discussed
Citation of research in clinical guidelines 71% 71% Second round 62% To be discussed
Generation of clinical guidelines 74% 67% Second round 54% To be discussed
Citation of research in public health guidelines 60% 58% Modified 50% To be discussed
Number of patents 88% 65% Second round 38% Excluded
Number of patients in a clinical trial with a biomarker identification 56% 58% Excluded – –
Number of biological samples collected 69% 50% Excluded – –
Number of biological samples transmitted 42% 34% Excluded – –
Number of hypotheses generated 46% 46% Excluded – –
Number of diagnostic tests created 50% 45% Excluded – –
Number of database generated 50% 38% Excluded – –
Number of research projects ongoing 57% 29% Excluded – –
Number of assays developed 0% 0% Excluded – –
Number of visits to EXPASY server 75% 0% Excluded – –
Clinicians’ awareness of research results 22% 36% Excluded – –
Changes in clinical practices 21% 43% Excluded – –
Contribution to reports informing policy makers 58% 35% Excluded – –
Number of presentations at key selected conferences 60% 56% Excluded – –
Citation in medical education books 42% 48% Excluded – –
Number of conferences held 71% 38% Excluded – –
Citation of research in the media 41% 28% Excluded – –
Number of papers co-authored with the industry 74% 61% Excluded –  
Citation of research in patents 79% 58% Excluded – –
Patent h-index 52% 52% Excluded – –
Number of patent citations 73% 48% Excluded – –
Number of spin-off companies created 86% 43% Excluded – –
Partnership-ability index 82% 50% Excluded – –
Dependence degree (d-index) 67% 50% Excluded – –
Proportion of long-distance collaborative publications 43% 0% Excluded – –
Number of publications co-authored by an epidemiologist and biologist 52% 41% Excluded – –
Age-weighted citation rate 71% 33% Excluded – –
b-index 83% 43% Excluded – –
Central index 60% 50% Excluded – –
CH-index 50% 0% Excluded – –
Crown indicator 33% 0% Excluded – –
e-index 80% 50% Excluded – –
g-index 100% 0% Excluded – –
Hg-index 33% 0% Excluded – –
j-index 75% 33% Excluded – –
m-index 50% 25% Excluded – –
m-quotient 67% 60% Excluded – –
Mean normalised citation score 50% 33% Excluded – –
Q2 index 25% 0% Excluded – –
r-index 83% 33% Excluded – –
SP-index 100% 50% Excluded – –
w-index 71% 33% Excluded – –
x-index 50% 0% Excluded – –
  1. Percentage of participants rating the indicator in the top tertile (7–9/9). Included: the indicator is included in the final set. Excluded: the indicator is excluded from the selection. Second round: the indicator is submitted to the second round of rating. Modified: The indicator is submitted to the second round of rating with significant changes in the definition and/or methodology following the respondents’ comments. To be discussed: the methodology of the indicator will be discussed in the expert meeting.
Back to article page

Health Research Policy and Systems

ISSN: 1478-4505

Contact us