This article has Open Peer Review reports available.
Psychometric properties of the Norwegian version of the Evidence-Based Practice Attitude Scale (EBPAS): to measure implementation readiness
© The Author(s). 2016
Received: 3 February 2016
Accepted: 31 May 2016
Published: 17 June 2016
Attitudes can be a precursor to the decision of whether or not to try a new practice. In order to tailor the implementation of evidence-based practices (EBPs) in mental health settings, we must first consider practitioner attitudes towards EBP adoption. To assess these attitudes, the Evidence-Based Practice Attitude Scale (EBPAS) was developed. The purpose of this study was to investigate the psychometric properties of the Norwegian version of the EBPAS, and to examine differences in attitudes towards implementing EBPs among mental health practitioners.
The EBPAS was translated into Norwegian and administered to 294 practitioners from seven primary and 22 specialized mental care units within a defined geographical area of Norway.
The EBPAS showed good psychometric properties. The less clinical experience the practitioner had, the more positive their attitude toward EBPs. Primary care practitioners reported more positive attitudes towards implementing EBPs that were required of them than specialized care practitioners.
The Norwegian version of the EBPAS is a promising tool for measuring implementation readiness in mental health services, and can be used in clinical practice to tailor implementation efforts.
The study was approved by the regional committees for medical and health research ethics [REK 2013/2035] on 25th of May, 2014.
Despite the increased focus on implementing evidence-based practices (EBPs) in mental health, it is still considered a struggle to bring such practices to the service users who would benefit from them . EBP is the integration of the best available research with clinical expertise in the context of client characteristics, culture and preferences . Multiple factors influence the implementation of EBP in real-world settings, including practitioners’ attitudes. Some studies have shown that practitioners’ general attitudes toward EBP can hinder or facilitate their decision of whether or not to try a new intervention [3, 4]. This is in accordance with Ajzen’s  theory of planned behaviour, which indicates that attitudes (a person’s positive or negative evaluation of performing the behaviour) along with subjective norms (a person’s perception of the social pressures put on them to perform or not perform the behaviour) and perceived behavioural control (a person’s confidence in their ability to perform a behaviour, often referred to as self-efficacy) influence one another, and together shape a person’s intentions and behaviour. Ajzen proposed that, as a general rule, the more favourable the attitudes, subjective norms, and perceived behavioural control, the stronger an individual’s intention to engage in the behaviour in question. However, this will be expressed only if the person decides at will to perform it or not. Even then, it may not be performed because of non-motivational factors such as the perceived availability of requisite opportunities and resources .
Assessing attitudes toward EBPs prior to implementation may give useful information about practitioners’ readiness to adopt a new intervention. Aarons  developed the Evidence-Based Practice Attitude Scale (EBPAS) to assess mental health practitioners’ attitudes towards adopting EBP in mental health settings. The EBPAS assesses four dimensions: the intuitive appeal of EBPs, the likelihood of adopting an EBP given the requirements to do so, openness to new practices, and perceived divergence between research-based interventions and current practice . The higher the score, the more positive the attitude toward EBPs, except for the divergence scale, which is scored in reverse. Previous studies have suggested adequate internal consistency for the EBPAS total score (α = 0.79–0.77) and good internal consistency for the subscale scores (α = 0.93–0.74), except for the divergence scale ranging somewhat lower across studies (α = 0.66–0.56) [7, 9–12]. The studies also supported or partly supported the construct validity by finding acceptable model–data fit for confirmatory factor analysis (CFA) models, including acceptable fit indices for both a first-order structure and a higher order global structure. The content validity of the scale has been supported . The criterion validity has shown mixed findings; some have found it to predict adoption or use of EBP [13–16], and others have not found a relation between EBPAS scores and EBP behaviours [17, 18]. Studies that have examined sensitivity to change have reported little variation of EBPAS scores over time [19, 20].
In search of better strategies to implement EBP in health services, researchers have used the EBPAS to examine factors that appear to affect practitioners’ attitudes towards EBPs. In terms of professional experience, practitioners with longer experience have scored lower on appeal, openness, requirements and the total EBPAS [10, 12, 21]. Mental health practitioners’ experiences were associated with higher scores on divergence in one study , and lower in another . Practitioners with higher education scored lower on requirements, and higher on appeal and the EBPAS total [12, 22–24]. Results concerning differences by sex and age have been inconsistent; some studies found no differences by sex [7, 10], but others found women to score higher on appeal, requirements and the EBPAS total [12, 23]. Concerning age, some studies found younger practitioners to score higher on the EBPAS total [10, 17]. Others have found older practitioners to score higher on requirements and openness scores [12, 25], but that they also scored higher on divergence . Attitudes have also been associated with organizational characteristics. For example, practitioners in less bureaucratic programs , more proficient organizational cultures and less stressful climates  have been shown to favour EBPs.
Except for one study among 966 Norwegian physicians that showed limited knowledge and experience of evidence-based medicine, but a positive attitude toward the concept , little is known about health practitioners’ attitudes in Norway. The Norwegian mental healthcare system is semi-decentralized . Primary care is organized by the municipalities. Their political mandate is to deliver mental health services to users with all types of mental illnesses and close to where they live. Practitioners have a primary background in a mental health discipline or primary training in nursing, social education or social work, for example, with supplemental training in a mental health discipline. They offer individual outpatient psychotherapy, psychotropic medication management, and home visits. In most municipalities, there are few or no psychologists or psychiatrists. Because of large differences in size and organization among the municipalities, primary care practitioners are, to a large extent, at liberty to decide the content and organization of their services , which makes them more flexible and subject to fewer governmental restrictions than specialized care practitioners.
The government is responsible for specialized care, which is administered by four regional health authorities, each responsible for several health authorities that include mental health divisions consisting of both inpatient and outpatient services. To a great extent, specialized care consists of specialists in psychiatric nursing, psychiatry and psychology. Their main task is to diagnose and give specialized psychotherapeutic and medical treatment to service users with severe mental illnesses. Specialized care is subject to more formalized guidelines that are developed by the Norwegian Directorate of Health [28, 29].
Does the Norwegian version of the EBPAS show satisfactory reliability and supported factor structure compared to the original version?
Does the Norwegian sample differ from a nationwide sample in the United States on attitudes among mental health service practitioners?
What role does practitioners’ experience play as a predictor for attitudes towards EBP in the Norwegian sample?
Are there differences in attitudes between practitioners in primary and specialized mental healthcare in the Norwegian sample?
Participants and procedure
The present cross-sectional study took place in the southern part of Norway, which represents the largest catchment area of a health authority. The regional committees for medical and health research ethics approved the study [REK 2013/2035]. Data were collected from October 2013 to May 2014. Seven primary care units in one geographical area were asked to participate, and they all accepted. Additionally, 30 of 36 eligible specialized care units were asked to participate in the survey. When 22 of the units had responded positively, it was considered a sufficient sample because these units represented all types of clinics in all departments in adult psychiatric care within the hospital trust. In 20 of the units, the first author made an appointment with the whole team of practitioners. The pen and paper survey was distributed and collected at these meetings (87.5% response rate). In nine of the units, the pen and paper survey was distributed to an employee who administered the survey to the other practitioners in the unit. The employee collected the survey in an envelope and sent it to the first author (78.4% response rate). Of 375 employees asked to participate, 315 (84%) accepted the invitation. Because of missing data on the EBPAS total scale, 21 surveys were excluded, leaving 294 respondents.
Participant demographic information
Primary care (n = 84)
Specialized care (n = 210)
Total (N = 294)
Years of experience
The present study focuses on the EBPAS , which is a well-established 15-item measure that generates four scales: 1) Intuitive appeal (four items), refers to whether practitioners will use an innovation if it is attractive, gives meaning, can be used correctly, or is being used by colleagues who are pleased with it; 2) Requirements (three items), refers to whether practitioners will use the innovation if it is requested by the service, supervisor or by agency mandates; 3) Openness to change (four items) is the degree to which practitioners are willing to try new interventions; 4) Divergence (four items) refers to whether practitioners experience research-based interventions as not clinically useful and less important than clinical experience (reverse scored on the EBPAS total score). The total scale measures practitioners’ attitudes towards implementing EBP . A five-point Likert scale is used to assess degree of agreement with a given statement (0 = not at all to 4 = to a very great extent). Higher mean scores indicate more favourable attitudes. Permission from the author was obtained to use the EBPAS questionnaire. The scale was translated into Norwegian by the first author. Conceptual equivalence was emphasized. The last author back-translated the scale and compared this with the original version together with the first author. It was concluded that no significant differences appeared during the translation process.
Practitioners’ demographics were assessed through self-reported age, sex, years of experience in current profession, education length, and profession.
To examine the psychometric properties of the EBPAS, Cronbach’s alpha and the within-clinic intraclass correlation coefficients (ICC) were calculated. An exploratory factor analysis was done using maximum likelihood and oblimin rotation using the psych R-package . Four factors were extracted to see if the factors corresponded to the four subscales. Factor loadings below 0.32 were not shown . A CFA was conducted using the psych R-package  to examine whether the four proposed factors and the higher-order factor in the EBPAS structure remained valid in this sample. A grouped CFA, or measurement invariance analysis, was also conducted to investigate whether the factor structure differed between specialized and community mental health services.
To examine the differences in attitudes among practitioners, the analyses were run using SPSS (Version 21). A one-sample t-test was used to compare the mean of the EBPAS total and the four factors in the Norwegian sample with an earlier study of mental health practitioners in the United States . Correlational matrix and multivariate regression models were used to evaluate the association between practitioner demographic characteristics and the EBPAS. To handle three missing values in the practitioners’ experience variable, we used the pairwise deletion option in SPSS; t-tests were used to test differences in EBPAS scores between community and specialized care. Levene’s tests were used to decide whether the t-tests should be performed under the assumption of equal variances.
EBPAS subscale and item means, standard deviations, Cronbach’s alpha, factor loadings from exploratory factor analysis, and intraclass correlation coefficient
EBPAS subscales and total
12 Agency required
11 Supervisor required
13 State required
10 Makes sense
9 Intuitively appealing
14 Colleagues happy with intervention
15 Enough training
2 Will follow a treatment manual
4 Therapy developed by researchers
1 Like new therapy types
8 Therapy different than usual
5 Research based treatment not useful
7 Will not use manualized therapy
6 Clinical experience more important
3 Know better than researchers
Due to the ICC value of item 13, measurement invariances were examined between specialized and community mental health services. The four factor model with a correlation of items 9 and 10 was used. When all parameters were constrained to be equal in the two groups, the model was adequate (χ2 = 420.126, P < 0.001; CFI = 0.869; TLI = 0.859; SRMR = 0.095). When item 13 was allowed to load differently in the two groups, the model showed a small improvement (χ2 = 413.894, P < 0.001; CFI = 0.872; TLI = 0.861; SRMR = 0.097). Item 13 loaded higher on requirements among practitioners in community services than in specialized services (P = 0.013).
Differences in attitudes
When comparing the Norwegian and United States  samples of mental health practitioners’ attitudes towards EBP, results suggest there were significant differences on appeal (M = 3.03 vs. M = 2.91), t (293) = 3.469, P = 0.001), openness (M = 2.65 vs. M = 2.76), t (293) = −2.580, P = 0.01), and divergence (M = 1.09 vs. M = 1.25), t (293) = −4.416, P = 0.000). There were no significant differences on the EBPAS total (M = 2.77 vs. M = 2.73), t (293) = 1.524, P = 0.13) or requirements (M = 2.50 vs. M = 2.41), t (293) = 1.668, P = 0.09).
Descriptive statistics and correlation matrix of the demographic characteristics and the EBPAS
2. Years of experience
4. Education level
5. Health service
10. EBPAS total
Regression of EBPAS scale scores on years of experience controlling for sex and health service
EBPAS total (R 2 = 0.12)
Appeal (R 2 = 0.08)
Requirements (R 2 = 0.09)
Openness (R 2 = 0.05)
Divergence (R 2 = 0.04)
Years of experience
When comparing attitudes between practitioners in specialized (M = 2.37, SD = 0.90) and primary care (M = 2.83, SD = 0.80), there was a significant difference on the requirement scale, (t (292) = 4.102, P < 0.001; Cohen’s d = 0.54). There was also a small significant difference between specialized (M = 2.73, SD = 0.46) and primary care (M = 2.88, SD = 0.47) on the EBPAS total (t (292) = 2.539, P = 0.012; Cohen’s d = 0.32). There were no differences on the appeal, openness and divergence scales. Equal variances were accordingly assumed for all the scales. In addition, when controlling for experience and sex, multiple regression analyses confirmed the presence of strong associations between health service and EBPAS total and requirements.
The current study provided evidence about the potential usefulness of the Norwegian version of the EBPAS in mental health services by investigating the psychometric properties of EBPAS scores in a sample of 294 mental health practitioners from both primary and specialized care. The study also confirmed associations between practitioners’ attitudes towards implementing EBPs and several demographic characteristics. This can be useful in the search for better strategies to implement new interventions in service settings.
Specifically, the study results supported the structure of four specific factors and a higher-order factor of the EBPAS, consistent with prior research [7, 12]. However, item 14 loaded on the requirement subscale instead of the appeal subscale. Two other psychometric studies of the EBPAS have also reported low factor loadings for item 14. Aarons  reported a factor loading of 0.48, and Melas et al.  reported a factor loading of 0.43. This may help explain why the CFA did not show perfect fit. This item distinguishes itself from the other items on the appeal factor in that it assesses how other people influence the individual’s attitudes towards EBPs (similar to the items on the requirements factor), rather than the individual’s own experiences. This might have influenced how the responders answered the question. Future research should address the issue of weak factor loadings in the EBPAS.
The sample of Norwegian practitioners showed no differences in attitudes towards EBP on EBPAS total compared to a nationwide sample drawn from the United States . Accordingly, it may be assumed that Norwegian and United States mental health practitioners share many of the similar attitudes towards implementing EBP. However, differences on the appeal, openness and divergence subscales may imply cultural differences between the two nations, in addition to differences in the organization of health services and education of mental health practitioners. In terms of individual factors that have been examined as predictors of attitudes towards EBPs, years of experience seems to be congruent with most of the earlier studies [10, 21]. The more experienced the practitioner, the more negative towards EBPs. This indicates strong findings and may imply that practitioners gain more confidence on their own skills and become less curious towards new methods as they gain experience. Regarding other individual factors, earlier findings on age were initially mixed, but this study supported the findings of others that found younger practitioners to be more likely to score higher on the EBPAS total [10, 17] and lower on divergence . Results on sex supported the majority of findings, namely that females score higher on appeal and the EBPAS total [12, 23]. In addition, the findings were also expanded to account for openness. It seems that female practitioners in general are more open to EBPs if these are appealing. Findings on education level did not support the many prior studies that showed associations with higher scores on appeal and the EBPAS total [22, 24]. It may be that there are cultural differences involved, and that Norwegian practitioners with higher education are more autonomous and sceptical towards EBPs than their colleagues elsewhere. The fact that higher education was associated with lower scores on requirement was confirmed. Due to differences in sample sizes and sample characteristics of the studies mentioned, it may be challenging to compare results. This also concerns findings based on regression analyses containing multiple variables [7, 12]. Due to the risk of multicollinearity, it is difficult to decide the unique contribution of every variable.
In terms of differences between primary and specialized care, the results showed that primary care employees were significantly more willing than practitioners in specialized care to use an EBP innovation if it was required by the organization. This indicates primary care practitioners are more strongly affected by organizational requirements than their colleagues in specialized care. According to Ajzen’s  theory, they accept the social pressure put on them (subjective norms). This may be explained by the fact that primary care practitioners have fewer formal guidelines imposed on them , and that they are perceived as being less bureaucratic  and under less stress . Therefore, they can decide whether or not they will perform the behaviour. Conversely, practitioners in specialized care are subject to more formalized guidelines . According to Ajzen’s  theory, feelings of pressure and decreased flexibility can lead to a decreased sense that practitioners are capable of implementing innovations. Because this study did not examine practitioners’ feelings of stress and inflexibility, which would have strengthened these assumptions, further research should study these associations.
The measurement invariance analysis showed an inaccuracy on item 13 between practitioners in primary and specialized health services. Thus, it is undeterminable whether there is an actual difference in requirements or if the factor measures different concepts. Of note, in addition to differences in the requirement scale scores, primary and specialized care also differed significantly on education level and discipline (Table 1). Differences in requirements may therefore be a result of differences in education level as well as of organizational factors. This may indicate a stronger sense of autonomy and integrity on the part of the specialized practitioners. Being less willing to use an innovation when required by the organization may indicate that the doctors and psychologists in specialized care rely more on autonomous decision-making than the nurses, social educators and practitioners in other primary care disciplines. Ultimately, this alleged professional structure and culture may present different challenges for those seeking to encourage practitioners to implement an EBP.
The current study had some strengths and limitations. To our knowledge, no other study has examined attitudes towards implementing EBPs by using the EBPAS in a Norwegian context. The recruitment strategy covered mental health practitioners in both primary and specialized care in the largest catchment area of a health authority in Norway. Although the response rate was adequate, the sample represents practitioners within the same geographical area and may not be generalizable to practitioners in other areas. Because information about the non-respondents were not available, it was not possible to compare them to the respondents to examine a potential non-response bias. Furthermore, independent variables in the regression analyses only explained between 3% and 10% of the variance of the different factors. This indicates that other practitioner and organizational factors not measured in this study likely play an important role in practitioners’ attitudes towards implementation of EBP. Lastly, we did not identify practitioners’ earlier experience with EBP. The EBPAS measures general attitudes, and therefore we do not know what practice respondents had in mind when they filled in the questionnaire.
This study has added to the knowledge about the EBPAS in general and for Norway in particular. Additional research is needed to further establish the factor structure of the Norwegian version of the EBPAS. Future studies should also more thoroughly examine differences by level of experience and profession, as well as other individual and organizational characteristics that may influence attitudes. More research is also needed on the attitude–behaviour relationship, and whether or not attitudes predict the adoption, implementation and sustainment of EBPs.
The EBPAS is likely to be a useful tool in future research as well as in clinical practice. Screening for attitudes towards EBP prior to implementation may indicate which attitudes are central among the participants. This may help organizations consider specific steps to influence practitioner attitudes as necessary, thereby enabling improved tailoring of implementation efforts.
EBPs, evidence-based practices; EBPAS, Evidence-Based Practice Attitude Scale; ICC, intraclass correlation coefficients; CFA, confirmatory factor analysis; RMSEA, root mean square error of approximation; CI, confidence interval; CFI, comparative fit index; TLI, Tucker–Lewis index; SRMR, standardized root mean square residual
Availability of data and materials
Data is stored at Akershus University Hospital. Data will not be shared, as informed consent for publication of the dataset was not obtained at the point of recruitment due to the sensitive information that was given.
KME, TR, TO and KSH conceptualized the specific research questions and analytic approach for this manuscript. KME and KSH were responsible for the translation of the EBPAS into Norwegian. Analyses were conducted by KME and JCL. KME wrote the first draft of the manuscript; all authors edited and revised the manuscript, and approved the final manuscript. The Norwegian version of the EBPAS is available from the first author.
The authors declare that they have no competing interests.
Consent for publication
Ethics and consent to participate
The study was approved by the regional committees for medical and health research ethics [REK 2013/2035] on 25th of May, 2014. The participants received written and oral information about the study, and consented to participate by filling out the questionnaire.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Von Ranson KM, Wallace LM, Stevenson A. Psychotherapies provided for eating disorders by community clinicians: Infrequent use of evidence-based treatment. Psychother Res. 2013;23(3):333–43.View ArticleGoogle Scholar
- American Psychological Association. Report of the 2005 Presidential Task Force on evidence-based practice. Washington: APA; 2005.Google Scholar
- Nelson TD, Steele RG. Predictors of practitioner self-reported use of evidence-based practices: practitioner training, clinical setting, and attitudes toward research. Adm Policy Ment Health. 2007;34(4):319–30.View ArticlePubMedGoogle Scholar
- Damanpour F. Organizational innovation: a meta-analysis of effects of determinants and moderators. Acad Manage J. 1991;34(3):555–90.View ArticleGoogle Scholar
- Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process. 1991;50:179–211.View ArticleGoogle Scholar
- Ajzen I. From intentions to actions: a theory of planned behavior. In: Kuhl J, Beckmann J, editors. Action Control From Cognition to Behavior. München: Max-Planck-Institut für psychologische Forschung; 1985. p. 11–39.Google Scholar
- Aarons G. Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS). Ment Health Serv Res. 2004;6(2):61–74.View ArticlePubMedPubMed CentralGoogle Scholar
- Aarons G, Green AE, Miller E. Researching readiness for implementation of evidence-based practice. A comprehensive review of the Evidence-Based Practice Attitude Scale (EBPAS). Kelly B, Perkins DF, editors. Cambridge: Cambridge University Press; 2012Google Scholar
- Aarons GA, McDonald EJ, Sheehan AK, Walrath-Greene CM. Confirmatory factor analysis of the Evidence-Based Practice Attitude Scale in a geographically diverse sample of community mental health providers. Adm Policy Ment Health. 2007;34(5):465–9.View ArticlePubMedGoogle Scholar
- Melas CD, Zampetakis LA, Dimopoulou A, Moustakis V. Evaluating the properties of the Evidence-Based Practice Attitude Scale (EBPAS) in health care. Psychol Assess. 2012;24(4):867–76.View ArticlePubMedGoogle Scholar
- van Sonsbeek MA, Hutschemaekers GJ, Veerman JW, Kleinjan M, Aarons GA, Tiemens BG. Psychometric properties of the Dutch version of the Evidence-Based Practice Attitude Scale (EBPAS). Health Res Policy Syst. 2015;13:69.View ArticlePubMedPubMed CentralGoogle Scholar
- Aarons G, Glisson C, Hoagwood K, Kelleher K, Landsverk J, Cafri G. Psychometric properties and U.S. National norms of the Evidence-Based Practice Attitude Scale (EBPAS). Psychol Assess. 2010;22(2):356–65.View ArticlePubMedGoogle Scholar
- Henggeler SW, Chapman JE, Rowland MD, Halliday-Boykins CA, Randall J, Shackelford J, et al. Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. J Consult Clin Psychol. 2008;76(4):556–67.View ArticlePubMedPubMed CentralGoogle Scholar
- Shapiro CJ, Prinz RJ, Sanders MR. Facilitators and barriers to implementation of an evidence-based parenting intervention to prevent child maltreatment: the Triple P-Positive Parenting Program. Child Maltreat. 2011;17(1):86–95.View ArticlePubMedGoogle Scholar
- Smith BD, Manfredo IT. Frontline counselors in organizational contexts: a study of treatment practices in community settings. J Subst Abuse Treat. 2011;41(2):124–36.View ArticlePubMedGoogle Scholar
- Beidas RS, Marcus S, Aarons G, Hoagwood KE, Schoenwald S, Evans AC, et al. Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA. 2015;169(4):374–82.Google Scholar
- Gray MJ, Elhai JD, Schmidt LO. Trauma professionals’ attitudes toward and utilization of evidence-based practices. Behav Modif. 2007;31(6):732–48.View ArticlePubMedGoogle Scholar
- Higa-McMillan C, Nakamura B, Morris A, Jackson D, Slavin L. Predictors of use of evidence-based practices for children and adolescents in usual care. Adm Policy Ment Health. 2015;42(4):373–83.View ArticlePubMedGoogle Scholar
- Gioia D. Using an organizational change model to qualitatively understand practitioner adoption of evidence-based practice in community mental health. Best Pract Ment Health. 2007;1:1–15.Google Scholar
- Lopez MA, Osterberg LD, Jensen-Doss A, Rae WA. Effects of workshop training for providers under mandated use of an evidence-based practice. Adm Policy Ment Health. 2011;38(4):301–12.View ArticlePubMedGoogle Scholar
- Aarons GA, Glisson C, Green PD, Hoagwood K, Kelleher KJ, Landsverk JA. The organizational social context of mental health services and clinician attitudes toward evidence-based practice: a United States national study. Implement Sci. 2012;7(1):56.View ArticlePubMedPubMed CentralGoogle Scholar
- Stahmer AC, Aarons G. Attitudes toward adoption of evidence-based practices: a comparison of autism early intervention providers and children’s mental health providers. Psychol Serv. 2009;6(3):223–34.View ArticlePubMedPubMed CentralGoogle Scholar
- Aarons GA. Transformational and transactional leadership: association with attitudes toward evidence-based practice. Psychiatr Serv. 2006;57(8):1162–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Nakamura BJ, Higa-McMillan CK, Okamura KH, Shimabukuro S. Knowledge of and attitudes towards evidence-based practices in community child mental health practitioners. Adm Policy Ment Health. 2011;38(4):287–300.View ArticlePubMedGoogle Scholar
- Aarons GA, Sawitzky AC. Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychol Serv. 2006;3(1):61–72.View ArticlePubMedPubMed CentralGoogle Scholar
- Ulvenes LV, Aasland O, Nylenna M, Kristiansen IS. Norwegian physicians’ knowledge of and opinions about evidence-based medicine: cross-sectional study. PLoS One. 2009;4(11):e7828.View ArticlePubMedPubMed CentralGoogle Scholar
- Ringard AÅ, Sagan A, Sperre Saunes I, Lindahl AK. In: Sagan A, editor. Norway: Health system review. Oslo: Norwegian Knowledge Center for the Health Services; 2013. p. 1–162Google Scholar
- Helsedirektoratet. Nasjonal faglig retningslinje for utredning, behandling og oppfølging av personer med samtidig ruslidelse og psykisk lidelse – ROP-lidelser. Sammensatte tjenester – samtidig behandling. Oslo: Helsedirektoratet; 2011.Google Scholar
- Helsedirektoratet. Nasjonal faglig retningslinje for utredning, behandling og oppfølging av personer med psykoselidelser. Oslo: Helsedirektoratet; 2013.Google Scholar
- Revelle W. Psych: procedures for personality and psychological research. Evanston: Northwestern University; 2015.Google Scholar
- Tabachnick BG, Fidell LS. Using multivariate statistics. 5th ed. Boston: Pearson; 2007.Google Scholar
- Hooper D, Coughlan J, Mullen M. Structural equation modelling: guidelines for determining model fit. Electron J Business Res Meth. 2008;6(1):53–60.Google Scholar
- Ashcraft RGP, Foster SL, Lowery AE, Henggeler SW, Chapman JE, Rowland MD. Measuring practitioner attitudes toward evidence-based treatments: a validation study. J Child Adolesc Subst. 2011;20(2):166–83.View ArticleGoogle Scholar