Table 2 Initial version of Evidence Utilisation in Policymaking Measurement Tool
From: Validity and reliability of the Evidence Utilisation in Policymaking Measurement Tool (EUPMT)
# | Question | Construct | Validity & reliabilitya |
|---|---|---|---|
1 | Recall the last policy brief to which you contributed and assess it on the basis of the following respects: No search of papers and reports – comprehensive search of papers and reports | Behaviour | 1 |
2 | No attention to quality of papers – assessment quality by the critical appraisal tools | Behaviour | 1 |
3 | No use of opinions and experiences – use of all stakeholders’ opinions and experiences | Behaviour | 1 |
4 | No use of standard frameworks – use of the standard frameworks (1-3-25, policy brief) | Behaviour | 3 |
5 | I intend to develop the policy briefs on the basis of evidence | Intention | 1 |
6 | Development of policy briefs on the basis of evidence makes prevention of resources wastage | Attitude to behaviour | 1 |
7 | Prevention of the resource wastage is … to me | ||
8 | The process of developing an evidence-based policy brief is time-consuming | Perceived behavioural control | 5 |
9 | The time-consuming nature of the process makes me give up developing the evidence-based policy brief | ||
10 | Using the evidence helps in different steps of the policymaking cycle (prioritising the issues, identifying the most effective policies, implementing and evaluating) | Attitude to behaviour | 2 |
11 | Contributing to the different stages of the policymaking is … for me | ||
12 | The policy briefs that develop on the basis of evidence do not adapt to the conditions in my country | Attitude to behaviour | 4 |
13 | The adaptation of policy briefs with the conditions of my country is … to me | ||
14 | The development of evidence-based policy briefs disrupts the timely problem solving | Attitude to behaviour | 1 |
15 | Solving the problems on time is … to me | ||
16 | Development of policy briefs on the basis of evidence improves the quality of our decisions | Attitude to behaviour | 1 |
17 | The improvement of the quality of our decisions is … to me | ||
18 | Development of policy briefs on the basis of evidence will update my professional knowledge and will increase my creativity | Attitude to behaviour | 1 |
19 | The updating of professional knowledge and the increased creativity is … to me | ||
20 | My superior expects me to develop the policy briefs on the basis of evidence | Subjective norm | 1 |
21 | The expectations of my superior are … to me | ||
22 | The policymaking authorities (the health policy council, the board of deputies, and the board of directors) support the development of evidence-based policy briefs | Subjective norm | 1 |
23 | The support of policymaking authorities for the development of evidence-based policy briefs is … to me | ||
24 | Deputy Minister of Health in my work area supports me in developing the evidence-based policy briefs | Subjective norm | 4 |
25 | The opinion of Deputy Minister of Health in my work area is … for me | ||
26 | The administrators of policies (the medical science universities and the service providers) show interest in the evidence-based policy briefs | Subjective norm | 1 |
27 | The interest of the administrators of plans and policies is … to me | ||
28 | The development of evidence-based policy briefs paves the way for the participation of other stakeholders (NGOs and other public organisations) | Subjective norm | 1 |
29 | The participation of other stakeholders in the policies is … to me | ||
30 | Decisions regarding the scope of my work are made in critical condition | Perceived behavioural control | 4 |
31 | The critical conditions of decisions in the scope of my work make it … for me to develop the evidence-based policy briefs | ||
32 | My colleagues develop the policy briefs on the basis of evidence | Subjective norm | 5 |
33 | Doing what my colleagues do is … to me | ||
34 | I expect to develop the policy briefs on the basis of evidence | Intention | 1 |
35 | Programs/policies in my working field depend on the specific conditions such that the use of global evidence would be impossible | Perceived behavioural control | 4 |
36 | Using the global evidence in developing the policy briefs is … for me in the particular circumstances of our country | ||
37 | For the development of evidence-based policy briefs, I have enough access to research evidence | Perceived behavioural control | 4 |
38 | My access to the required research evidence makes it … for me to develop evidence-based policy briefs | ||
39 | My accessibility to the required routine data (organisational information and statistics) for the development of evidence-based policy briefs is limited | Perceived behavioural control | 1 |
40 | My accessibility to the routine data makes it … for me to develop the evidence-based policy briefs | ||
41 | My relevant general director expected me to provide evidence-based policy briefs | Perceived behavioural control | 1 |
42 | Expectations of the general director are … for me | ||
43 | My accessibility to the cost data (the cost of goods and services) for the development of evidence-based policy briefs is limited | Perceived behavioural control | 5 |
44 | My accessibility to the cost data makes it … for me to develop the evidence-based policy briefs | ||
45 | For the development of evidence-based policy briefs, I do not have the possibility to use the opinions and experiences of different stakeholders (faculty members, service providers and receivers, and other organisations) | Perceived behavioural control | 1 |
46 | Inability to use the opinions and experiences of different stakeholders makes it … for me to develop the evidence-based policy briefs | ||
47 | Most managers of the Headquarter of the Health Ministry are selected among the faculty members | Perceived behavioural control | 5 |
48 | The selection of the managers of the Headquarter of the Health Ministry among the faculty members … me to develop the policy briefs on the basis of evidence | ||
49 | In addition to the evidence-based policy briefs, other factors (such as the pressure groups, the interests of the ruling coalition, lobbying, etc.) can influence the policies | Perceived behavioural control | 1 |
50 | Effects of other factors on policies … me from developing the evidence-based policy briefs | ||
51 | The Headquarters of the Health Ministry suffers from management instability | Perceived behavioural control | 1 |
52 | Management instability makes it … for me to develop evidence-based policy briefs | ||
53 | Experts of the Headquarters of the Health Ministry are not selected on the basis of their competencies in developing the evidence-based policy briefs | Perceived behavioural control | 5 |
54 | The selection of the experts of the Headquarters of the Health Ministry not on the basis of their competencies leads to the development of policy briefs not on the basis of evidence | ||
55 | My spiritual copyright to develop the evidence-based policy briefs is not observed | Perceived behavioural control | 4 |
56 | Infringement of my spiritual copyright … me from developing the evidence-based policy briefs | ||
57 | I want to develop the policy briefs on the basis of evidence | Intention | 1 |
58 | Even if policy briefs are not based on evidence, they will be discussed at the policymaking meetings, and they will have the chance of being adopted | Perceived behavioural control | 1 |
59 | The adoption of policy briefs which are not based on evidence … me from developing the evidence-based policy briefs | ||
60 | My workload is heavy | Perceived behavioural control | 5 |
61 | My workload makes it … for me to develop evidence-based policy briefs | ||
62 | My workplace is crowded and noisy | Perceived behavioural control | 5 |
63 | My crowded and noisy workplace makes it … for me to develop the evidence-based policy briefs | ||
64 | The development of evidence-based policy briefs is not a standard for the measurement of my performance | Perceived behavioural control | 1 |
65 | Lack of assessment of my performance on this standard … me from developing the evidence-based policy briefs | ||
66 | My salary payment is not based on the development of evidence-based policy briefs | Perceived behavioural control | 1 |
67 | This basis of payment … me from developing the evidence-based policy briefs | ||
68 | Development of the evidence-based policy briefs is not a criterion for job promotion (in the organisational hierarchy) in the Health Ministry Headquarters | Perceived behavioural control | 1 |
69 | This promotion basis discourages me from developing the evidence-based policy briefs | ||
70 | The Minister of Health supports me in developing the evidence-based policy briefs | Subjective norm | 4 |
71 | The opinion of the Minister of Health is … for me |