Skip to main content

Table 5 Estimates from confirmatory factor analysis models

From: Development and validation of SEER (Seeking, Engaging with and Evaluating Research): a measure of policymakers’ capacity to engage with and use research

 

Separate modelsa

Full modela

Modified model (removal of item 2.3)a

Factor/items

b

(95% CI)

P value

b

(95% CI)

P value

b

(95% CI)

P value

1. Value individual places on using research

 1.1. Identify issues that require a policy or programme response

0.59

(0.50–0.68)

< 0.001

0.60

(0.52–0.69)

< 0.001

0.60

(0.52–0.69)

< 0.001

 1.2. Understand how to think about issues

0.60

(0.47–0.72)

< 0.001

0.59

(0.48–0.70)

< 0.001

0.59

(0.48–0.70)

< 0.001

 1.3. Decide about content or direction of a policy or programme

0.69

(0.56–0.82)

< 0.001

0.71

(0.59–0.82)

< 0.001

0.70

(0.59–0.82)

< 0.001

 1.4. Persuade others to a point of view or course of action

0.52

(0.40–0.65)

< 0.001

0.55

(0.42–0.67)

< 0.001

0.55

(0.43–0.68)

< 0.001

 1.5. Design the implementation or evaluation strategy for a policy or program

0.75

(0.59–0.90)

< 0.001

0.72

(0.55–0.90)

< 0.001

0.72

(0.55–0.90)

< 0.001

 1.6. Monitor implementation or evaluate the impact of a policy or program

0.66

(0.50–0.82)

< 0.001

0.63

(0.47–0.80)

< 0.001

0.64

(0.47–0.80)

< 0.001

 1.7. Meet organisational requirements to use research

0.41

(0.17–0.66)

0.001

0.43

(0.18–0.67)

0.001

0.43

(0.18–0.67)

0.001

2. Confidence in using research

 2.1. Find research to inform policy or programme development

0.83

(0.75–0.91)

< 0.001

0.82

(0.74–0.91)

< 0.001

0.76

(0.65–0.88)

< 0.001

 2.2. Evaluate the quality of research

0.88

(0.84–0.93)

< 0.001

0.87

(0.81–0.92)

< 0.001

0.79

(0.69–0.89)

< 0.001

 2.3. Interpret the results of research

0.83

(0.73–0.92)

< 0.001

0.81

(0.70–0.92)

< 0.001

   

 2.4. Apply research to policy or programme development

0.81

(0.67–0.94)

< 0.001

0.81

(0.68–0.95)

< 0.001

0.82

(0.70–0.94)

< 0.001

 2.5. Design evaluations of policies or programmes

0.81

(0.70–0.91)

< 0.001

0.81

(0.71–0.92)

< 0.001

0.85

(0.79–0.90)

< 0.001

 2.6. Commission research to support policy or programme development

0.67

(0.51–0.84)

< 0.001

0.69

(0.52–0.86)

< 0.001

0.76

(0.64–0.88)

< 0.001

 2.7. Partner with researchers to generate research

0.71

(0.55–0.86)

< 0.001

0.72

(0.56–0.88)

< 0.001

0.79

(0.69–0.89)

< 0.001

3. Value organisation places on using research

 3.1. Leaders believe it is important to use research in policy or programme development

0.87

(0.81–0.94)

< 0.001

0.85

(0.75–0.95)

< 0.001

0.85

(0.76–0.95)

< 0.001

 3.2. It is expected that research will be used in policy or programme development

0.90

(0.84–0.96)

< 0.001

0.88

(0.77–0.99)

< 0.001

0.88

(0.77–0.99)

< 0.001

 3.3. Generation of new research to inform policy or programme development is encouraged

0.62

(0.42–0.82)

< 0.001

0.65

(0.46–0.83)

< 0.001

0.65

(0.46–0.83)

< 0.001

 3.4. It is expected that policies/programmes will be evaluated

0.54

(0.28–0.80)

< 0.001

0.56

(0.33–0.78)

< 0.001

0.56

(0.33–0.78)

< 0.001

 3.5. Interaction or collaboration with researchers or research organisations is encouraged

0.67

(0.53–0.80)

< 0.001

0.71

(0.56–0.86)

< 0.001

0.71

(0.56–0.85)

< 0.001

4. Tools and systems

 4.1. Has processes for policy or programme development that provide guidance on how research should be used

0.61

(0.50–0.71)

< 0.001

0.59

(0.48–0.70)

< 0.001

0.59

(0.48–0.70)

< 0.001

 4.2. Has systems that encourage leaders to support use of research

0.67

(0.57–0.78)

< 0.001

0.67

(0.57–0.76)

< 0.001

0.67

(0.58–0.76)

< 0.001

 4.3. Provides access to training in using research in policy or programme development

0.52

(0.29–0.75)

< 0.001

0.54

(0.33–0.75)

< 0.001

0.54

(0.33–0.74)

< 0.001

 4.4. Has the resources needed to access research

0.53

(0.31–0.76)

< 0.001

0.55

(0.34–0.76)

< 0.001

0.54

(0.33–0.75)

< 0.001

 4.5. Has established methods for commissioning reviews of research

0.65

(0.47–0.84)

< 0.001

0.64

(0.46–0.82)

< 0.001

0.64

(0.46–0.82)

< 0.001

 4.6. Has documented processes for how policies or programmes should be evaluated

0.60

(0.42–0.77)

< 0.001

0.60

(0.43–0.76)

< 0.001

0.60

(0.45–0.76)

< 0.001

 4.7. Has existing relationships, or established methods for engaging, with research organisations

0.65

(0.50–0.80)

< 0.001

0.64

(0.47–0.81)

< 0.001

0.64

(0.48–0.80)

< 0.001

  1. ab standardised loading