| Long term evaluation period | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Indicators | Matovu et al 2013 [16] | Williams et al. 2010 [20] | Adams et al 2003 [10] | Laserson et al. 2005 [12] | Ali et al. 2012 [15] | Varkevisser et al. 2001 [13] | Buist and Parry 2013 [11] | Zachariah et al. 2011 [23] | Percentage of studies reporting on indicators | |
Study’s evaluation approach |  |  | ||||||||
 Evaluation framework used | Yes | NR | Yes | NR | Yes | NR | NR | NR | 37.5 | |
 Evaluation method (qualitative/quantitative) | Qual | Mixed | Qual | Quant | Quant | Quant | Quant | NA |  | |
 Details (Satisfaction survey/self-reported changes/pre- and post-skills test/research outputs survey) | Interviews | Program data | Focus Group | Questionnaire | Database and reports | Meetings and reports | Email Survey | NA |  | |
 Program evaluation period months | 36 | 48 | 60 | 84 | 96 | 168 | 204 | NR |  | |
Reviews measures of effectiveness of RCS, based on Cooke’s framework |  |  | ||||||||
 Improved confidence and skills | Evidence of knowledge and skills developed (e.g., improved post-test scores) | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | 100.0 |
Evidence of confidence building (e.g., trainees becomes trainers; obtained research-related jobs) | Yes | Yes | NR | NR | Yes | Yes | Yes | NR | 62.5 | |
Research undertaken after training (e.g., involvement in subsequent research) | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | 100.0 | |
 Research is close to practice | Practitioner and program staff involvement (e.g., nurse, manager trainees) | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | 87.5 |
Research relevant to or used in practice (e.g., reported changes in practice) | Yes | NR | Yes | Yes | NR | Yes | Yes | Yes | 75.0 | |
Patient-centred outcome measures used | Yes | No | NR | NR | NR | NR | No | NR | 12.5 | |
Action oriented methodologies used (e.g., research done on quality care) | Yes | NR | NR | NR | NR | NR | Yes | NR | 25.0 | |
 Research enhance by partnerships | Between novice and experienced researchers | Yes | Yes | No | NR | No | NR | No | No | 25.0 |
Inter-professional linkages (e.g., between researchers, policy makers, different disciplines) | Yes | Yes | No | NR | Yes | No | Yes | No | 50.0 | |
 Impactful dissemination | Publications in peer-reviewed journals | NR | NR | NR | NR | Yes | Yes | Yes | Yes | 50.0 |
Conference/workshop presentation | Yes | NR | NR | NR | Yes | NR | Yes | NR | 37.5 | |
Evidenced of applied research findings (e.g., changes in policy/practice reported) | Yes | NR | NR | Yes | NR | Yes | Yes | Yes | 62.5 | |
 Continuity and sustainability | Successful access of funding (grants/fellowships) | NR | NR | NR | NR | Yes | NR | Yes | Yes | 37.5 |
Enduring collaborations (e.g., relationship building between involved institutions to promote individual training) | Yes | Yes | NR | NR | Yes | Yes | Yes | NR | 62.5 | |
Continued mentorship and supervision | Yes | NR | No | Yes | Yes | NR | Yes | Yes | 62.5 | |
 Infrastructure for research | Institutional support for undertaking research | Yes | NR | NR | NR | NR | Yes | NR | NR | 25.0 |
Protected research time | NR | NR | NR | NR | NR | NR | NR | NR | 0.0 | |
Budget line | NR | NR | NR | NR | NR | NR | NR | NR | 0.0 | |
Mentorship and supervision structures | NR | NR | NR | NR | NR | NR | NR | NR | 0.0 |