Skip to main content

Advertisement

Table 2 Initial version of Evidence Utilisation in Policymaking Measurement Tool

From: Validity and reliability of the Evidence Utilisation in Policymaking Measurement Tool (EUPMT)

# Question Construct Validity & reliabilitya
1 Recall the last policy brief to which you contributed and assess it on the basis of the following respects: No search of papers and reports – comprehensive search of papers and reports Behaviour 1
2 No attention to quality of papers – assessment quality by the critical appraisal tools Behaviour 1
3 No use of opinions and experiences – use of all stakeholders’ opinions and experiences Behaviour 1
4 No use of standard frameworks – use of the standard frameworks (1-3-25, policy brief) Behaviour 3
5 I intend to develop the policy briefs on the basis of evidence Intention 1
6 Development of policy briefs on the basis of evidence makes prevention of resources wastage Attitude to behaviour 1
7 Prevention of the resource wastage is … to me
8 The process of developing an evidence-based policy brief is time-consuming Perceived behavioural control 5
9 The time-consuming nature of the process makes me give up developing the evidence-based policy brief
10 Using the evidence helps in different steps of the policymaking cycle (prioritising the issues, identifying the most effective policies, implementing and evaluating) Attitude to behaviour 2
11 Contributing to the different stages of the policymaking is … for me
12 The policy briefs that develop on the basis of evidence do not adapt to the conditions in my country Attitude to behaviour 4
13 The adaptation of policy briefs with the conditions of my country is … to me
14 The development of evidence-based policy briefs disrupts the timely problem solving Attitude to behaviour 1
15 Solving the problems on time is … to me
16 Development of policy briefs on the basis of evidence improves the quality of our decisions Attitude to behaviour 1
17 The improvement of the quality of our decisions is … to me
18 Development of policy briefs on the basis of evidence will update my professional knowledge and will increase my creativity Attitude to behaviour 1
19 The updating of professional knowledge and the increased creativity is … to me
20 My superior expects me to develop the policy briefs on the basis of evidence Subjective norm 1
21 The expectations of my superior are … to me
22 The policymaking authorities (the health policy council, the board of deputies, and the board of directors) support the development of evidence-based policy briefs Subjective norm 1
23 The support of policymaking authorities for the development of evidence-based policy briefs is … to me
24 Deputy Minister of Health in my work area supports me in developing the evidence-based policy briefs Subjective norm 4
25 The opinion of Deputy Minister of Health in my work area is … for me
26 The administrators of policies (the medical science universities and the service providers) show interest in the evidence-based policy briefs Subjective norm 1
27 The interest of the administrators of plans and policies is … to me
28 The development of evidence-based policy briefs paves the way for the participation of other stakeholders (NGOs and other public organisations) Subjective norm 1
29 The participation of other stakeholders in the policies is … to me
30 Decisions regarding the scope of my work are made in critical condition Perceived behavioural control 4
31 The critical conditions of decisions in the scope of my work make it … for me to develop the evidence-based policy briefs
32 My colleagues develop the policy briefs on the basis of evidence Subjective norm 5
33 Doing what my colleagues do is … to me
34 I expect to develop the policy briefs on the basis of evidence Intention 1
35 Programs/policies in my working field depend on the specific conditions such that the use of global evidence would be impossible Perceived behavioural control 4
36 Using the global evidence in developing the policy briefs is … for me in the particular circumstances of our country
37 For the development of evidence-based policy briefs, I have enough access to research evidence Perceived behavioural control 4
38 My access to the required research evidence makes it … for me to develop evidence-based policy briefs
39 My accessibility to the required routine data (organisational information and statistics) for the development of evidence-based policy briefs is limited Perceived behavioural control 1
40 My accessibility to the routine data makes it … for me to develop the evidence-based policy briefs
41 My relevant general director expected me to provide evidence-based policy briefs Perceived behavioural control 1
42 Expectations of the general director are … for me
43 My accessibility to the cost data (the cost of goods and services) for the development of evidence-based policy briefs is limited Perceived behavioural control 5
44 My accessibility to the cost data makes it … for me to develop the evidence-based policy briefs
45 For the development of evidence-based policy briefs, I do not have the possibility to use the opinions and experiences of different stakeholders (faculty members, service providers and receivers, and other organisations) Perceived behavioural control 1
46 Inability to use the opinions and experiences of different stakeholders makes it … for me to develop the evidence-based policy briefs
47 Most managers of the Headquarter of the Health Ministry are selected among the faculty members Perceived behavioural control 5
48 The selection of the managers of the Headquarter of the Health Ministry among the faculty members … me to develop the policy briefs on the basis of evidence
49 In addition to the evidence-based policy briefs, other factors (such as the pressure groups, the interests of the ruling coalition, lobbying, etc.) can influence the policies Perceived behavioural control 1
50 Effects of other factors on policies … me from developing the evidence-based policy briefs
51 The Headquarters of the Health Ministry suffers from management instability Perceived behavioural control 1
52 Management instability makes it … for me to develop evidence-based policy briefs
53 Experts of the Headquarters of the Health Ministry are not selected on the basis of their competencies in developing the evidence-based policy briefs Perceived behavioural control 5
54 The selection of the experts of the Headquarters of the Health Ministry not on the basis of their competencies leads to the development of policy briefs not on the basis of evidence
55 My spiritual copyright to develop the evidence-based policy briefs is not observed Perceived behavioural control 4
56 Infringement of my spiritual copyright … me from developing the evidence-based policy briefs
57 I want to develop the policy briefs on the basis of evidence Intention 1
58 Even if policy briefs are not based on evidence, they will be discussed at the policymaking meetings, and they will have the chance of being adopted Perceived behavioural control 1
59 The adoption of policy briefs which are not based on evidence … me from developing the evidence-based policy briefs
60 My workload is heavy Perceived behavioural control 5
61 My workload makes it … for me to develop evidence-based policy briefs
62 My workplace is crowded and noisy Perceived behavioural control 5
63 My crowded and noisy workplace makes it … for me to develop the evidence-based policy briefs
64 The development of evidence-based policy briefs is not a standard for the measurement of my performance Perceived behavioural control 1
65 Lack of assessment of my performance on this standard … me from developing the evidence-based policy briefs
66 My salary payment is not based on the development of evidence-based policy briefs Perceived behavioural control 1
67 This basis of payment … me from developing the evidence-based policy briefs
68 Development of the evidence-based policy briefs is not a criterion for job promotion (in the organisational hierarchy) in the Health Ministry Headquarters Perceived behavioural control 1
69 This promotion basis discourages me from developing the evidence-based policy briefs
70 The Minister of Health supports me in developing the evidence-based policy briefs Subjective norm 4
71 The opinion of the Minister of Health is … for me
  1. aStatus of validity and reliability:
  2. 1. Approval of the validity and reliability
  3. 2. Disapproval of the content validity
  4. 3. Disapproval of the internal consistency
  5. 4. Disapproval of the test-retest reliability
  6. 5. Disapproval of the construct validity