Skip to main content
Download PDF
Download ePub

Psychometric properties of the Norwegian version of the Evidence-Based Practice Attitude Scale (EBPAS): to measure implementation readiness

Health Research Policy and Systems volume 14, Article number: 47 (2016) Cite this article

Abstract

Background

Attitudes can be a precursor to the decision of whether or not to try a new practice. In order to tailor the implementation of evidence-based practices (EBPs) in mental health settings, we must first consider practitioner attitudes towards EBP adoption. To assess these attitudes, the Evidence-Based Practice Attitude Scale (EBPAS) was developed. The purpose of this study was to investigate the psychometric properties of the Norwegian version of the EBPAS, and to examine differences in attitudes towards implementing EBPs among mental health practitioners.

Methods

The EBPAS was translated into Norwegian and administered to 294 practitioners from seven primary and 22 specialized mental care units within a defined geographical area of Norway.

Results

The EBPAS showed good psychometric properties. The less clinical experience the practitioner had, the more positive their attitude toward EBPs. Primary care practitioners reported more positive attitudes towards implementing EBPs that were required of them than specialized care practitioners.

Conclusions

The Norwegian version of the EBPAS is a promising tool for measuring implementation readiness in mental health services, and can be used in clinical practice to tailor implementation efforts.

Trial registration

The study was approved by the regional committees for medical and health research ethics [REK 2013/2035] on 25th of May, 2014.

Peer Review reports

Background

Despite the increased focus on implementing evidence-based practices (EBPs) in mental health, it is still considered a struggle to bring such practices to the service users who would benefit from them [1]. EBP is the integration of the best available research with clinical expertise in the context of client characteristics, culture and preferences [2]. Multiple factors influence the implementation of EBP in real-world settings, including practitioners’ attitudes. Some studies have shown that practitioners’ general attitudes toward EBP can hinder or facilitate their decision of whether or not to try a new intervention [3, 4]. This is in accordance with Ajzen’s [5] theory of planned behaviour, which indicates that attitudes (a person’s positive or negative evaluation of performing the behaviour) along with subjective norms (a person’s perception of the social pressures put on them to perform or not perform the behaviour) and perceived behavioural control (a person’s confidence in their ability to perform a behaviour, often referred to as self-efficacy) influence one another, and together shape a person’s intentions and behaviour. Ajzen proposed that, as a general rule, the more favourable the attitudes, subjective norms, and perceived behavioural control, the stronger an individual’s intention to engage in the behaviour in question. However, this will be expressed only if the person decides at will to perform it or not. Even then, it may not be performed because of non-motivational factors such as the perceived availability of requisite opportunities and resources [6].

Assessing attitudes toward EBPs prior to implementation may give useful information about practitioners’ readiness to adopt a new intervention. Aarons [7] developed the Evidence-Based Practice Attitude Scale (EBPAS) to assess mental health practitioners’ attitudes towards adopting EBP in mental health settings. The EBPAS assesses four dimensions: the intuitive appeal of EBPs, the likelihood of adopting an EBP given the requirements to do so, openness to new practices, and perceived divergence between research-based interventions and current practice [8]. The higher the score, the more positive the attitude toward EBPs, except for the divergence scale, which is scored in reverse. Previous studies have suggested adequate internal consistency for the EBPAS total score (α = 0.79–0.77) and good internal consistency for the subscale scores (α = 0.93–0.74), except for the divergence scale ranging somewhat lower across studies (α = 0.66–0.56) [7, 9–12]. The studies also supported or partly supported the construct validity by finding acceptable model–data fit for confirmatory factor analysis (CFA) models, including acceptable fit indices for both a first-order structure and a higher order global structure. The content validity of the scale has been supported [12]. The criterion validity has shown mixed findings; some have found it to predict adoption or use of EBP [13–16], and others have not found a relation between EBPAS scores and EBP behaviours [17, 18]. Studies that have examined sensitivity to change have reported little variation of EBPAS scores over time [19, 20].

In search of better strategies to implement EBP in health services, researchers have used the EBPAS to examine factors that appear to affect practitioners’ attitudes towards EBPs. In terms of professional experience, practitioners with longer experience have scored lower on appeal, openness, requirements and the total EBPAS [10, 12, 21]. Mental health practitioners’ experiences were associated with higher scores on divergence in one study [22], and lower in another [12]. Practitioners with higher education scored lower on requirements, and higher on appeal and the EBPAS total [12, 22–24]. Results concerning differences by sex and age have been inconsistent; some studies found no differences by sex [7, 10], but others found women to score higher on appeal, requirements and the EBPAS total [12, 23]. Concerning age, some studies found younger practitioners to score higher on the EBPAS total [10, 17]. Others have found older practitioners to score higher on requirements and openness scores [12, 25], but that they also scored higher on divergence [25]. Attitudes have also been associated with organizational characteristics. For example, practitioners in less bureaucratic programs [7], more proficient organizational cultures and less stressful climates [21] have been shown to favour EBPs.

Except for one study among 966 Norwegian physicians that showed limited knowledge and experience of evidence-based medicine, but a positive attitude toward the concept [26], little is known about health practitioners’ attitudes in Norway. The Norwegian mental healthcare system is semi-decentralized [27]. Primary care is organized by the municipalities. Their political mandate is to deliver mental health services to users with all types of mental illnesses and close to where they live. Practitioners have a primary background in a mental health discipline or primary training in nursing, social education or social work, for example, with supplemental training in a mental health discipline. They offer individual outpatient psychotherapy, psychotropic medication management, and home visits. In most municipalities, there are few or no psychologists or psychiatrists. Because of large differences in size and organization among the municipalities, primary care practitioners are, to a large extent, at liberty to decide the content and organization of their services [27], which makes them more flexible and subject to fewer governmental restrictions than specialized care practitioners.

The government is responsible for specialized care, which is administered by four regional health authorities, each responsible for several health authorities that include mental health divisions consisting of both inpatient and outpatient services. To a great extent, specialized care consists of specialists in psychiatric nursing, psychiatry and psychology. Their main task is to diagnose and give specialized psychotherapeutic and medical treatment to service users with severe mental illnesses. Specialized care is subject to more formalized guidelines that are developed by the Norwegian Directorate of Health [28, 29].

To our knowledge, no other study to date has examined Norwegian mental health practitioners’ attitudes using the EBPAS. The purpose of this study was to investigate the psychometric properties of the Norwegian version of the EBPAS, and to examine differences in attitudes towards EBP among mental health practitioners. Understanding practitioners’ attitudes can give insights about their readiness to implement EBPs in their services, and contribute to the tailoring of better implementation strategies that strengthen EBP uptake. Specifically, we investigated the following research questions:

  1. 1)

    Does the Norwegian version of the EBPAS show satisfactory reliability and supported factor structure compared to the original version?

  2. 2)

    Does the Norwegian sample differ from a nationwide sample in the United States on attitudes among mental health service practitioners?

  3. 3)

    What role does practitioners’ experience play as a predictor for attitudes towards EBP in the Norwegian sample?

  4. 4)

    Are there differences in attitudes between practitioners in primary and specialized mental healthcare in the Norwegian sample?

Methods

Participants and procedure

The present cross-sectional study took place in the southern part of Norway, which represents the largest catchment area of a health authority. The regional committees for medical and health research ethics approved the study [REK 2013/2035]. Data were collected from October 2013 to May 2014. Seven primary care units in one geographical area were asked to participate, and they all accepted. Additionally, 30 of 36 eligible specialized care units were asked to participate in the survey. When 22 of the units had responded positively, it was considered a sufficient sample because these units represented all types of clinics in all departments in adult psychiatric care within the hospital trust. In 20 of the units, the first author made an appointment with the whole team of practitioners. The pen and paper survey was distributed and collected at these meetings (87.5% response rate). In nine of the units, the pen and paper survey was distributed to an employee who administered the survey to the other practitioners in the unit. The employee collected the survey in an envelope and sent it to the first author (78.4% response rate). Of 375 employees asked to participate, 315 (84%) accepted the invitation. Because of missing data on the EBPAS total scale, 21 surveys were excluded, leaving 294 respondents.

Of the participants (N = 294), 71.4% (n = 210) were from specialized inpatient and outpatient care units, and the remaining 28.6% (n = 84) were from primary care units. As shown in Table 1, practitioners in primary and specialized care differed significantly in level of education (χ2 test, P < 0.001) and discipline (χ2 test, P < 0.001). This makes sense, as primary care participants mostly held bachelor’s degrees in nursing/social education or social work, whereas specialized care participants mostly held master’s degrees in psychology, nursing/social education, or medicine.

Table 1 Participant demographic information
Full size table

Measures

The present study focuses on the EBPAS [7], which is a well-established 15-item measure that generates four scales: 1) Intuitive appeal (four items), refers to whether practitioners will use an innovation if it is attractive, gives meaning, can be used correctly, or is being used by colleagues who are pleased with it; 2) Requirements (three items), refers to whether practitioners will use the innovation if it is requested by the service, supervisor or by agency mandates; 3) Openness to change (four items) is the degree to which practitioners are willing to try new interventions; 4) Divergence (four items) refers to whether practitioners experience research-based interventions as not clinically useful and less important than clinical experience (reverse scored on the EBPAS total score). The total scale measures practitioners’ attitudes towards implementing EBP [12]. A five-point Likert scale is used to assess degree of agreement with a given statement (0 = not at all to 4 = to a very great extent). Higher mean scores indicate more favourable attitudes. Permission from the author was obtained to use the EBPAS questionnaire. The scale was translated into Norwegian by the first author. Conceptual equivalence was emphasized. The last author back-translated the scale and compared this with the original version together with the first author. It was concluded that no significant differences appeared during the translation process.

Practitioners’ demographics were assessed through self-reported age, sex, years of experience in current profession, education length, and profession.

Data analysis

To examine the psychometric properties of the EBPAS, Cronbach’s alpha and the within-clinic intraclass correlation coefficients (ICC) were calculated. An exploratory factor analysis was done using maximum likelihood and oblimin rotation using the psych R-package [30]. Four factors were extracted to see if the factors corresponded to the four subscales. Factor loadings below 0.32 were not shown [31]. A CFA was conducted using the psych R-package [30] to examine whether the four proposed factors and the higher-order factor in the EBPAS structure remained valid in this sample. A grouped CFA, or measurement invariance analysis, was also conducted to investigate whether the factor structure differed between specialized and community mental health services.

To examine the differences in attitudes among practitioners, the analyses were run using SPSS (Version 21). A one-sample t-test was used to compare the mean of the EBPAS total and the four factors in the Norwegian sample with an earlier study of mental health practitioners in the United States [12]. Correlational matrix and multivariate regression models were used to evaluate the association between practitioner demographic characteristics and the EBPAS. To handle three missing values in the practitioners’ experience variable, we used the pairwise deletion option in SPSS; t-tests were used to test differences in EBPAS scores between community and specialized care. Levene’s tests were used to decide whether the t-tests should be performed under the assumption of equal variances.

Results

Psychometric properties

Table 2 shows overall means and standard deviations, alpha values, ICC values, and item loadings for each of the scales. Reliability coefficients for the factors ranged between 0.64 and 0.88. Contrary to earlier research, item 14 loaded on the requirements factor (b = 0.43) instead of the appeal factor. The alpha value of the appeal factor showed only a small improvement if the item was deleted (α = 0.75 compared to α = 0.74). Based on earlier research supporting the original factor structure [10, 12], and due to the fact that the noise from the item was assumed to be limited, the item was retained in the appeal factor for further analyses. Regarding ICC, item 13 (“it was required by your state”) had an ICC value of 0.155. It may be that the translation of the item was weak, as it refers to municipalities rather than to authorities. The alpha value showed no improvements in the requirements factor if item 13 was deleted, so it was kept in the analyses. The remaining ICC values ranged between 0.00 and 0.05, indicating a relatively small degree of dependency among practitioners within the same clinic.

Table 2 EBPAS subscale and item means, standard deviations, Cronbach’s alpha, factor loadings from exploratory factor analysis, and intraclass correlation coefficient
Full size table

According to an acceptable range for model fit for CFA [32], the four factor model did not meet the criteria (χ2 (84, N = 294) = 285.705, P < 0.001; RMSEA = 0.081; 90% CI, 0.079–0.102; CFI = 0.874; TLI = 0.843; SRMR = 0.081). Model modification indices showed that model fit would improve if the residuals for item 9 (“it was intuitively appealing”) and 10 (“it made sense to you”) were allowed to correlate, which is similar to earlier factor analysis of the EBPAS [12, 33]. The revised model fit the data adequately (χ2 (83, N = 294) = 205.615, P < 0.001; RMSEA = 0.071; 90% CI, 0.059–0.083; CFI = 0.924; TLI = 0.903; SRMR = 0.065). Factor loadings ranged from 0.41 to 0.87 and factor intercorrelations ranged from 0.23 to 0.61. All factor loadings were statistically significant (Fig. 1). Similar to the four factor model, the higher-order factor did not meet the criteria (χ2 (86, N = 294) = 291.384, P < 0.001; RMSEA = 0.090; 90% CI, 0.079–0.102; CFI = 0.872; TLI = 0.844; SRMR = 0.085), but improved adequately when items 9 and 10 were correlated (χ2 (85, N = 294) = 212.653, P < 0.001; RMSEA = 0.071; 90% CI, 0.060–0.084; CFI = 0.921; TLI = 0.902; SRMR = 0.068). Factor loadings ranged from 0.35 to 1.04. All factor loadings were statistically significant (Fig. 2).

Fig. 1
figure 1

Confirmatory factor analysis model of the EBPAS. n = 294, χ2 (83) = 205.615, P < 0.001; RMSEA = 0.071; 90% CI, 0.059–0.083; CFI = 0.924; TLI = 0.903; SRMR = 0.065. All factor loadings are significant at P < 0.01

Full size image
Fig. 2
figure 2

Higher-order confirmatory factor analysis model of the EBPAS. n = 294, χ2 (85) = 212.653, P < 0.001; RMSEA = 0.071; 90% CI, 0.060–0.084; CFI = 0.921; TLI = 0.902; SRMR = 0.068. All factor loadings are significant at P < 0.01

Full size image

Due to the ICC value of item 13, measurement invariances were examined between specialized and community mental health services. The four factor model with a correlation of items 9 and 10 was used. When all parameters were constrained to be equal in the two groups, the model was adequate (χ2 = 420.126, P < 0.001; CFI = 0.869; TLI = 0.859; SRMR = 0.095). When item 13 was allowed to load differently in the two groups, the model showed a small improvement (χ2 = 413.894, P < 0.001; CFI = 0.872; TLI = 0.861; SRMR = 0.097). Item 13 loaded higher on requirements among practitioners in community services than in specialized services (P = 0.013).

Differences in attitudes

When comparing the Norwegian and United States [12] samples of mental health practitioners’ attitudes towards EBP, results suggest there were significant differences on appeal (M = 3.03 vs. M = 2.91), t (293) = 3.469, P = 0.001), openness (M = 2.65 vs. M = 2.76), t (293) = −2.580, P = 0.01), and divergence (M = 1.09 vs. M = 1.25), t (293) = −4.416, P = 0.000). There were no significant differences on the EBPAS total (M = 2.77 vs. M = 2.73), t (293) = 1.524, P = 0.13) or requirements (M = 2.50 vs. M = 2.41), t (293) = 1.668, P = 0.09).

In terms of individual factors that predict attitudes towards EBPs, years of experience and age were associated with all of the subscales and the EBPAS total in the correlational matrix, indicating that more experience and older age were associated with more negative attitudes towards EBP (Table 3). In addition, being female was associated with greater positive attitude in general, greater willingness to adopt given the appeal of the intervention, and more openness towards EBPs. Higher educational attainment was associated with lower scores on the requirement scale, indicating that the higher the educational level, the less likely to adopt an EBP if it was required. Because there were high correlations between practitioners’ age and clinical experience (r = 0.79, P < 0.01), and health service and educational level (r = 0.60, P < 0.01), age and educational level were dropped in the subsequent regression analyses to avoid multicollinearity. When controlling for sex and health service, multiple regression analyses confirmed the presence of strong associations between practitioners’ years of experience and all of the EBPAS scales (Table 4). Furthermore, when controlling for experience and health service, multiple regression analyses confirmed the presence of strong associations between sex and EBPAS total and appeal, in addition to a weak association between sex and openness (Table 4).

Table 3 Descriptive statistics and correlation matrix of the demographic characteristics and the EBPAS
Full size table
Table 4 Regression of EBPAS scale scores on years of experience controlling for sex and health service
Full size table

When comparing attitudes between practitioners in specialized (M = 2.37, SD = 0.90) and primary care (M = 2.83, SD = 0.80), there was a significant difference on the requirement scale, (t (292) = 4.102, P < 0.001; Cohen’s d = 0.54). There was also a small significant difference between specialized (M = 2.73, SD = 0.46) and primary care (M = 2.88, SD = 0.47) on the EBPAS total (t (292) = 2.539, P = 0.012; Cohen’s d = 0.32). There were no differences on the appeal, openness and divergence scales. Equal variances were accordingly assumed for all the scales. In addition, when controlling for experience and sex, multiple regression analyses confirmed the presence of strong associations between health service and EBPAS total and requirements.

Discussion

The current study provided evidence about the potential usefulness of the Norwegian version of the EBPAS in mental health services by investigating the psychometric properties of EBPAS scores in a sample of 294 mental health practitioners from both primary and specialized care. The study also confirmed associations between practitioners’ attitudes towards implementing EBPs and several demographic characteristics. This can be useful in the search for better strategies to implement new interventions in service settings.

Specifically, the study results supported the structure of four specific factors and a higher-order factor of the EBPAS, consistent with prior research [7, 12]. However, item 14 loaded on the requirement subscale instead of the appeal subscale. Two other psychometric studies of the EBPAS have also reported low factor loadings for item 14. Aarons [7] reported a factor loading of 0.48, and Melas et al. [10] reported a factor loading of 0.43. This may help explain why the CFA did not show perfect fit. This item distinguishes itself from the other items on the appeal factor in that it assesses how other people influence the individual’s attitudes towards EBPs (similar to the items on the requirements factor), rather than the individual’s own experiences. This might have influenced how the responders answered the question. Future research should address the issue of weak factor loadings in the EBPAS.

The sample of Norwegian practitioners showed no differences in attitudes towards EBP on EBPAS total compared to a nationwide sample drawn from the United States [12]. Accordingly, it may be assumed that Norwegian and United States mental health practitioners share many of the similar attitudes towards implementing EBP. However, differences on the appeal, openness and divergence subscales may imply cultural differences between the two nations, in addition to differences in the organization of health services and education of mental health practitioners. In terms of individual factors that have been examined as predictors of attitudes towards EBPs, years of experience seems to be congruent with most of the earlier studies [10, 21]. The more experienced the practitioner, the more negative towards EBPs. This indicates strong findings and may imply that practitioners gain more confidence on their own skills and become less curious towards new methods as they gain experience. Regarding other individual factors, earlier findings on age were initially mixed, but this study supported the findings of others that found younger practitioners to be more likely to score higher on the EBPAS total [10, 17] and lower on divergence [25]. Results on sex supported the majority of findings, namely that females score higher on appeal and the EBPAS total [12, 23]. In addition, the findings were also expanded to account for openness. It seems that female practitioners in general are more open to EBPs if these are appealing. Findings on education level did not support the many prior studies that showed associations with higher scores on appeal and the EBPAS total [22, 24]. It may be that there are cultural differences involved, and that Norwegian practitioners with higher education are more autonomous and sceptical towards EBPs than their colleagues elsewhere. The fact that higher education was associated with lower scores on requirement was confirmed. Due to differences in sample sizes and sample characteristics of the studies mentioned, it may be challenging to compare results. This also concerns findings based on regression analyses containing multiple variables [7, 12]. Due to the risk of multicollinearity, it is difficult to decide the unique contribution of every variable.

In terms of differences between primary and specialized care, the results showed that primary care employees were significantly more willing than practitioners in specialized care to use an EBP innovation if it was required by the organization. This indicates primary care practitioners are more strongly affected by organizational requirements than their colleagues in specialized care. According to Ajzen’s [5] theory, they accept the social pressure put on them (subjective norms). This may be explained by the fact that primary care practitioners have fewer formal guidelines imposed on them [27], and that they are perceived as being less bureaucratic [7] and under less stress [21]. Therefore, they can decide whether or not they will perform the behaviour. Conversely, practitioners in specialized care are subject to more formalized guidelines [27]. According to Ajzen’s [5] theory, feelings of pressure and decreased flexibility can lead to a decreased sense that practitioners are capable of implementing innovations. Because this study did not examine practitioners’ feelings of stress and inflexibility, which would have strengthened these assumptions, further research should study these associations.

The measurement invariance analysis showed an inaccuracy on item 13 between practitioners in primary and specialized health services. Thus, it is undeterminable whether there is an actual difference in requirements or if the factor measures different concepts. Of note, in addition to differences in the requirement scale scores, primary and specialized care also differed significantly on education level and discipline (Table 1). Differences in requirements may therefore be a result of differences in education level as well as of organizational factors. This may indicate a stronger sense of autonomy and integrity on the part of the specialized practitioners. Being less willing to use an innovation when required by the organization may indicate that the doctors and psychologists in specialized care rely more on autonomous decision-making than the nurses, social educators and practitioners in other primary care disciplines. Ultimately, this alleged professional structure and culture may present different challenges for those seeking to encourage practitioners to implement an EBP.

The current study had some strengths and limitations. To our knowledge, no other study has examined attitudes towards implementing EBPs by using the EBPAS in a Norwegian context. The recruitment strategy covered mental health practitioners in both primary and specialized care in the largest catchment area of a health authority in Norway. Although the response rate was adequate, the sample represents practitioners within the same geographical area and may not be generalizable to practitioners in other areas. Because information about the non-respondents were not available, it was not possible to compare them to the respondents to examine a potential non-response bias. Furthermore, independent variables in the regression analyses only explained between 3% and 10% of the variance of the different factors. This indicates that other practitioner and organizational factors not measured in this study likely play an important role in practitioners’ attitudes towards implementation of EBP. Lastly, we did not identify practitioners’ earlier experience with EBP. The EBPAS measures general attitudes, and therefore we do not know what practice respondents had in mind when they filled in the questionnaire.

This study has added to the knowledge about the EBPAS in general and for Norway in particular. Additional research is needed to further establish the factor structure of the Norwegian version of the EBPAS. Future studies should also more thoroughly examine differences by level of experience and profession, as well as other individual and organizational characteristics that may influence attitudes. More research is also needed on the attitude–behaviour relationship, and whether or not attitudes predict the adoption, implementation and sustainment of EBPs.

Conclusions

The EBPAS is likely to be a useful tool in future research as well as in clinical practice. Screening for attitudes towards EBP prior to implementation may indicate which attitudes are central among the participants. This may help organizations consider specific steps to influence practitioner attitudes as necessary, thereby enabling improved tailoring of implementation efforts.

Abbreviations

EBPs, evidence-based practices; EBPAS, Evidence-Based Practice Attitude Scale; ICC, intraclass correlation coefficients; CFA, confirmatory factor analysis; RMSEA, root mean square error of approximation; CI, confidence interval; CFI, comparative fit index; TLI, Tucker–Lewis index; SRMR, standardized root mean square residual

References

  1. Von Ranson KM, Wallace LM, Stevenson A. Psychotherapies provided for eating disorders by community clinicians: Infrequent use of evidence-based treatment. Psychother Res. 2013;23(3):333–43.

    Article  Google Scholar 

  2. American Psychological Association. Report of the 2005 Presidential Task Force on evidence-based practice. Washington: APA; 2005.

    Google Scholar 

  3. Nelson TD, Steele RG. Predictors of practitioner self-reported use of evidence-based practices: practitioner training, clinical setting, and attitudes toward research. Adm Policy Ment Health. 2007;34(4):319–30.

    Article  PubMed  Google Scholar 

  4. Damanpour F. Organizational innovation: a meta-analysis of effects of determinants and moderators. Acad Manage J. 1991;34(3):555–90.

    Article  Google Scholar 

  5. Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process. 1991;50:179–211.

    Article  Google Scholar 

  6. Ajzen I. From intentions to actions: a theory of planned behavior. In: Kuhl J, Beckmann J, editors. Action Control From Cognition to Behavior. München: Max-Planck-Institut für psychologische Forschung; 1985. p. 11–39.

    Google Scholar 

  7. Aarons G. Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS). Ment Health Serv Res. 2004;6(2):61–74.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Aarons G, Green AE, Miller E. Researching readiness for implementation of evidence-based practice. A comprehensive review of the Evidence-Based Practice Attitude Scale (EBPAS). Kelly B, Perkins DF, editors. Cambridge: Cambridge University Press; 2012

  9. Aarons GA, McDonald EJ, Sheehan AK, Walrath-Greene CM. Confirmatory factor analysis of the Evidence-Based Practice Attitude Scale in a geographically diverse sample of community mental health providers. Adm Policy Ment Health. 2007;34(5):465–9.

    Article  PubMed  Google Scholar 

  10. Melas CD, Zampetakis LA, Dimopoulou A, Moustakis V. Evaluating the properties of the Evidence-Based Practice Attitude Scale (EBPAS) in health care. Psychol Assess. 2012;24(4):867–76.

    Article  PubMed  Google Scholar 

  11. van Sonsbeek MA, Hutschemaekers GJ, Veerman JW, Kleinjan M, Aarons GA, Tiemens BG. Psychometric properties of the Dutch version of the Evidence-Based Practice Attitude Scale (EBPAS). Health Res Policy Syst. 2015;13:69.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Aarons G, Glisson C, Hoagwood K, Kelleher K, Landsverk J, Cafri G. Psychometric properties and U.S. National norms of the Evidence-Based Practice Attitude Scale (EBPAS). Psychol Assess. 2010;22(2):356–65.

    Article  PubMed  Google Scholar 

  13. Henggeler SW, Chapman JE, Rowland MD, Halliday-Boykins CA, Randall J, Shackelford J, et al. Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. J Consult Clin Psychol. 2008;76(4):556–67.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Shapiro CJ, Prinz RJ, Sanders MR. Facilitators and barriers to implementation of an evidence-based parenting intervention to prevent child maltreatment: the Triple P-Positive Parenting Program. Child Maltreat. 2011;17(1):86–95.

    Article  PubMed  Google Scholar 

  15. Smith BD, Manfredo IT. Frontline counselors in organizational contexts: a study of treatment practices in community settings. J Subst Abuse Treat. 2011;41(2):124–36.

    Article  PubMed  Google Scholar 

  16. Beidas RS, Marcus S, Aarons G, Hoagwood KE, Schoenwald S, Evans AC, et al. Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA. 2015;169(4):374–82.

    Google Scholar 

  17. Gray MJ, Elhai JD, Schmidt LO. Trauma professionals’ attitudes toward and utilization of evidence-based practices. Behav Modif. 2007;31(6):732–48.

    Article  PubMed  Google Scholar 

  18. Higa-McMillan C, Nakamura B, Morris A, Jackson D, Slavin L. Predictors of use of evidence-based practices for children and adolescents in usual care. Adm Policy Ment Health. 2015;42(4):373–83.

    Article  PubMed  Google Scholar 

  19. Gioia D. Using an organizational change model to qualitatively understand practitioner adoption of evidence-based practice in community mental health. Best Pract Ment Health. 2007;1:1–15.

    Google Scholar 

  20. Lopez MA, Osterberg LD, Jensen-Doss A, Rae WA. Effects of workshop training for providers under mandated use of an evidence-based practice. Adm Policy Ment Health. 2011;38(4):301–12.

    Article  PubMed  Google Scholar 

  21. Aarons GA, Glisson C, Green PD, Hoagwood K, Kelleher KJ, Landsverk JA. The organizational social context of mental health services and clinician attitudes toward evidence-based practice: a United States national study. Implement Sci. 2012;7(1):56.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Stahmer AC, Aarons G. Attitudes toward adoption of evidence-based practices: a comparison of autism early intervention providers and children’s mental health providers. Psychol Serv. 2009;6(3):223–34.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Aarons GA. Transformational and transactional leadership: association with attitudes toward evidence-based practice. Psychiatr Serv. 2006;57(8):1162–9.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Nakamura BJ, Higa-McMillan CK, Okamura KH, Shimabukuro S. Knowledge of and attitudes towards evidence-based practices in community child mental health practitioners. Adm Policy Ment Health. 2011;38(4):287–300.

    Article  PubMed  Google Scholar 

  25. Aarons GA, Sawitzky AC. Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychol Serv. 2006;3(1):61–72.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Ulvenes LV, Aasland O, Nylenna M, Kristiansen IS. Norwegian physicians’ knowledge of and opinions about evidence-based medicine: cross-sectional study. PLoS One. 2009;4(11):e7828.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Ringard AÅ, Sagan A, Sperre Saunes I, Lindahl AK. In: Sagan A, editor. Norway: Health system review. Oslo: Norwegian Knowledge Center for the Health Services; 2013. p. 1–162

  28. Helsedirektoratet. Nasjonal faglig retningslinje for utredning, behandling og oppfølging av personer med samtidig ruslidelse og psykisk lidelse – ROP-lidelser. Sammensatte tjenester – samtidig behandling. Oslo: Helsedirektoratet; 2011.

    Google Scholar 

  29. Helsedirektoratet. Nasjonal faglig retningslinje for utredning, behandling og oppfølging av personer med psykoselidelser. Oslo: Helsedirektoratet; 2013.

    Google Scholar 

  30. Revelle W. Psych: procedures for personality and psychological research. Evanston: Northwestern University; 2015.

    Google Scholar 

  31. Tabachnick BG, Fidell LS. Using multivariate statistics. 5th ed. Boston: Pearson; 2007.

    Google Scholar 

  32. Hooper D, Coughlan J, Mullen M. Structural equation modelling: guidelines for determining model fit. Electron J Business Res Meth. 2008;6(1):53–60.

    Google Scholar 

  33. Ashcraft RGP, Foster SL, Lowery AE, Henggeler SW, Chapman JE, Rowland MD. Measuring practitioner attitudes toward evidence-based treatments: a validation study. J Child Adolesc Subst. 2011;20(2):166–83.

    Article  Google Scholar 

Download references

ᅟ

ᅟ

Availability of data and materials

Data is stored at Akershus University Hospital. Data will not be shared, as informed consent for publication of the dataset was not obtained at the point of recruitment due to the sensitive information that was given.

Authors’ contributions

KME, TR, TO and KSH conceptualized the specific research questions and analytic approach for this manuscript. KME and KSH were responsible for the translation of the EBPAS into Norwegian. Analyses were conducted by KME and JCL. KME wrote the first draft of the manuscript; all authors edited and revised the manuscript, and approved the final manuscript. The Norwegian version of the EBPAS is available from the first author.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics and consent to participate

The study was approved by the regional committees for medical and health research ethics [REK 2013/2035] on 25th of May, 2014. The participants received written and oral information about the study, and consented to participate by filling out the questionnaire.

Author information

Authors and Affiliations

  1. Akershus University Hospital, Division of Mental Health Services, Sykehusveien 25, 1478, Lørenskog, Norway

    Karina M. Egeland, Torleif Ruud & Kristin Sverdvik Heiervang

  2. Institute of Clinical Medicine, University of Oslo, Oslo, Norway

    Torleif Ruud

  3. Norwegian Center for Child Behavioral Development, Essendropsgate 3, 0368, Oslo, Norway

    Terje Ogden

  4. Institute of Psychology, University of Oslo, Essendropsgate 3, 0368, Oslo, Norway

    Terje Ogden

  5. Helse Sør-Øst Health Services Research Centre, Akershus University Hospital, Sykehusveien 25, 1478, Lørenskog, Norway

    Jonas Christoffer Lindstrøm

Authors
  1. Karina M. Egeland
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Torleif Ruud
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Terje Ogden
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jonas Christoffer Lindstrøm
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kristin Sverdvik Heiervang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Karina M. Egeland.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Egeland, K.M., Ruud, T., Ogden, T. et al. Psychometric properties of the Norwegian version of the Evidence-Based Practice Attitude Scale (EBPAS): to measure implementation readiness. Health Res Policy Sys 14, 47 (2016). https://doi.org/10.1186/s12961-016-0114-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12961-016-0114-3

Keywords

Health Research Policy and Systems

ISSN: 1478-4505

Contact us