Skip to main content
Download PDF
Download ePub

Use of qualitative research in World Health Organisation guidelines: a document analysis

Health Research Policy and Systems volume 22, Article number: 44 (2024) Cite this article

Abstract

Background

Guidelines depend on effect estimates, usually derived from randomised controlled trials, to inform their decisions. Qualitative research evidence may improve decisions made but where in the process and the methods to do this have not been so clearly established. We sought to describe and appraise how qualitative research has been used to inform World Heath Organization guidance since 2020.

Methods

We conducted a document analysis of WHO guidelines from 2020 to 2022. We purposely sampled guidelines on the topics of maternal and newborn health (MANH) and infectious diseases, as most of the qualitative synthesis to date has been conducted on these topics, likely representing the ‘best case’ scenario. We searched the in-built repository feature of the WHO website and used standardised search terms to identify qualitative reporting. Using deductive frameworks, we described how qualitative evidence was used to inform guidelines and appraised the standards of this use.

Results

Of the 29 guidelines, over half used qualitative research to help guide decisions (18/29). A total of 8 of these used qualitative research to inform the guideline scope, all 18 to inform recommendations, and 1 to inform implementation considerations. All guidelines drew on qualitative evidence syntheses (QES), and five further supplemented this with primary qualitative research. Qualitative findings reported in guidelines were typically descriptive, identifying people’s perception of the benefits and harms of interventions or logistical barriers and facilitators to programme success. No guideline provided transparent reporting of how qualitative research was interpreted and weighed used alongside other evidence when informing decisions, and only one guideline reported the inclusion of qualitative methods experts on the panel. Only a few guidelines contextualised their recommendations by indicating which populations and settings qualitative findings could be applied.

Conclusions

Qualitative research frequently informed WHO guideline decisions particularly in the field of MANH. However, the process often lacked transparency. We identified unmet potential in informing implementation considerations and contextualisation of the recommendations. Use in these areas needs further methods development.

Peer Review reports

Background

Evidence-informed guidance usually includes a critical summary of one or more systematic reviews of reliable research findings to inform the decisions. For simple clinical questions which assess the efficacy of a new drug, systematic reviews of randomised control trials may provide the most appropriate information [1]. Making recommendations about drugs, vaccines and public health interventions all require reflection on the acceptability or appropriateness of an intervention, and this requires different forms of evidence and types of research [2]. The value of qualitative methods lies in their ability to pursue systematically ‘what’, ‘why’ or ‘how’ questions that are not easily answerable by experimental methods [3].

There is an increasing recognition of the importance of the social determinants of health in policy making, given the complex nature of most public health issues [4]. Qualitative research methods are particularly adept to explore these findings from the individual, community or broader system level [4, 5]. Qualitative research may also range from descriptive to explanatory in nature [6]. Descriptive findings address people’s views or experiences, such as the perception of personal benefits and harms of interventions, and the trade-offs between these. Descriptive findings may also identify and describe unintended consequences of the proposed intervention. Finally, they may identify logistical barriers and facilitators to programme success [7, 8]. These aspects are particularly valuable, as they bring forth the patient and health worker voice in decision making [9].

Explanatory findings, on the other hand, link descriptive perspectives or experiences to aspects of psychological, historical, cultural, economic, social, environmental and political context [6]. In doing so, they help generate a theoretical understanding of ‘why’ perceptions and experiences occur and may have broader applications to related contexts [6]. Here qualitative findings may be used to explain how personal attributes and lifestyle impact individuals, how local context impacts group choice to access treatment or diagnosis or how broad structural and health systems can impede their ability to access, benefit or trust health interventions [7, 8].

Guideline developers such as the World Health Organisation (WHO) are beginning to draw on qualitative research to inform their decisions [2], aided by the methodological developments of systematic reviews of qualitative research, known as qualitative evidence syntheses (QES) and their appraisal [10]. Previous research has documented examples on how qualitative research has so far informed guideline processes, including identifying relevant outcomes, evaluating evidence to produce recommendations and developing implementation considerations [11,12,13]. However, it remains unclear how often qualitative research is actually used for these purposes. Further, it is thought that qualitative research does not always fit well within the ‘summary-based and compartmentalised structure’ of the guideline framework [12], given the wide range of aims of qualitative research, from describing people’s views to explaining the impact of structural barriers to treatment access. Documenting which of these the WHO has drawn on so far will help to further refine guidance for the uptake of qualitative research by Identifying areas of unmet potential.

Furthermore, as with any guideline development, those preparing the reviews and the panels using them need to provide transparent reporting and rigorous appraisal akin to those historically practised with quantitative research in decision-making [12, 14]. However, so far, no methodological guidance exists on how best to systematically draw on and evaluate qualitative findings during guideline processes [9], and it is unclear how often these standards are achieved [11,12,13].

Our aim is to describe how qualitative evidence has been used in existing WHO guideline development procedures and appraise the standards of this inclusion.

Methods

We used a study design of document analysis to systematically describe and appraise WHO guidelines. Document analysis is a qualitative method commonly used in health policy analysis [15], which aims to synthesise and appraise textual data to elicit meaning, gain understanding and develop empirical knowledge [16]. This necessitates a systematic approach; however, standardised methodologies are lacking [15]. To ensure rigour, we drew on Kayesa and Shung-King [15], who identified the key steps reported in document analyses: adopting clear inclusion criteria for documents and clear procedures for identifying documents, coding them and extracting data; applying a clear analytical framework to analyse the role of qualitative research cited in policy documents; and presenting the findings of each stage of the process from searching for documents to answering the research question.

Guideline retrieval

A scoping search of the Cochrane Library [17] identified that QES were most frequently conducted on MANH (6/23 QES) and infectious disease topics (7/23 QES). For this reason, we chose to focus our analysis on these topic areas, as whilst not exhaustive, they may represent the ‘best case scenario’.

We used the in-built document repository feature on WHO’s website [18] to identify guideline documents. Therefore, only documents published on this web page were eligible for inclusion. Grey literature was not included. The web page allowed for filtering by publication type and year, which was restricted to ‘guideline’ in 2020 and 2021. A 2-year period was chosen to reflect the most current practices of qualitative research at the time of the search. The lead author (M.T.) then screened the guideline titles in the search results for topics relating to Maternal and Newborn Health (MANH) and infectious disease. MANH was defined as any topic covering the health of women during pregnancy, childbirth and the post-partum period and babies’ first month of life. Infectious disease was defined as any topic covering the prevention, diagnosis and treatment of all diseases acquired through human–human or animal–human transmission, including vector-borne diseases. A table detailing the excluded guidelines and justification for this exclusion can be found in Additional file 1: Excluded studies. The final list of included and excluded guidelines was approved by the entire author team.

The unit of analysis used in this study was the section of text describing a qualitative finding within a guideline document. As a result, we performed a second search within the included guideline documents to identify any qualitative reporting. We defined a qualitative study as one that collected data using qualitative methods such as ethnographic observations, in‐depth interviews, focus group discussions and open‐ended survey questions. Appropriate analysis methods included, for example, thematic analysis, narrative analysis, framework analysis, and grounded theory. While we acknowledge that mixed methods studies may contribute qualitative findings, for the purpose of this study they were excluded, as it was not possible to identify which findings had been derived from quantitative or qualitative methods. Initial reading of a sample of three guidelines in-depth identified terms that accompanied qualitative reporting. We then performed a key-word search for the following terms in all guidelines to identify qualitative reporting: ‘qualitative’, ‘accept*’, ‘value’, ‘equit*’, ‘feasib’, ‘interview’ or ‘focus-group discussion’. Sections of text containing the keywords were checked against their corresponding citation to ensure the findings were derived from qualitative studies.

Data extraction and analysis

Data analysis occurred in three phases. First, given the broad range of potential qualitative findings, we sought to understand what ‘type’ guidelines typically drew on. To achieve this, we developed a deductive framework informed by the literature. We crossed (1) the nested individual, community and broader system ecosystems within social determinants of health theory against (2) descriptive to explanatory qualitative research methodology. Within this, we populated the matrix with qualitative research aims derived from literature and discussed in the background of this paper. This provided us with a theoretical overview of the potential contribution of qualitative research (Fig. 1). We then coded each qualitative finding contained within guidelines with one of these aims. The framework was validated on a selection of guidelines, which led to the inclusion of one inductive aim of qualitative research: to understand information needs.

Fig. 1
figure 1

Matrix of how qualitative research can contribute to guideline development

Full size image

We next sought to describe how qualitative research was identified by the guideline and how it was used to inform the scope of the guideline, the intervention recommendation and implementation considerations. Finally, we sought to appraise how qualitative research had been used using analogous standards expected and practised for quantitative methods in decision-making processes. Table 1 guided this process. Extraction domains and questions were initially identified a priori, and any new questions that arose during analysis were shared and discussed within the team to ensure they were appropriate. If new questions were added to the data extraction tool (Table 1), all guidelines were re-analysed to ensure a complete dataset.

Table 1 Domains used to guide data extraction
Full size table

Results

Search results

Between 2020 and 2022, the WHO published 29 guidelines on the topics MANH and infectious diseases. Seven guidelines were excluded as they did not cover the chosen topics areas. Of the 29 included guidelines, 18 (62%) incorporated qualitative research to inform either the scope, recommendation or implementation considerations. Of the 18 guidelines that used qualitative research, 15/18 guidelines were on topics of MANH, in contrast to 3/18 on infectious diseases. An overview of the search results is shown in Fig. 2 below, and a summary of all included guidelines is detailed in Table 2.

Fig. 2
figure 2

Overview of guideline search process

Full size image
Table 2 A summary of all guidelines identified in the search and their use of qualitative evidence
Full size table

Below follows a narrative summary of where the 18 guidelines used qualitative evidence in informing their scope, decisions and implementation considerations. This is followed by an appraisal of this use according to the pre-specified domains of transparency, specificity, certainty and reflexivity.

How qualitative research was used

Overall, qualitative research summarised in guidelines typically provided descriptive understanding of logistical barriers and facilitators to programme success (133 quotations across 18 guidelines) or patient perception of benefits and harms (126 quotations across 18 guidelines). Less frequently, qualitative findings explained the influence of local context of health-seeking behaviours and the influence of local context (51 quotations across 18 guidelines); described information needs (42 quotations across 10 guidelines); explained the influence of personal attributes on health seeking behaviour (42 quotations across 10 guidelines); described unintended consequences (12 quotations across 5 guidelines); or explained how systems function and their impact on individuals (5 quotations across 1 guidelines). Figure 3 provides an overview of these findings with selected example quotations derived from the guidelines presented in this study. A cross comparison of how these roles fed into each stage of the decision-making process is presented below:

Fig. 3
figure 3

Illustration of how WHO guidelines used qualitative research according to their role

Full size image

Retrieving qualitative research

Guideline documents either specifically commission research to inform their process or identify existing literature. Seven guidelines commissioned QES specifically for their guideline [22, 25, 28,29,30,31,32], while four guidelines performed a systematic search of published literature [19, 20, 33, 34]. However, seven guidelines did not include any methods for how they obtained qualitative research.

Overall, the guidelines in our analysis drew on a total of 38 primary studies and 25 systematic reviews of qualitative research (QES) to inform their recommendations. Guidelines most often drew on 2 qualitative research studies and a maximum of 33 qualitative research studies [27].

All guidelines that used qualitative research drew on systematic reviews of qualitative evidence, known as QES to inform their process. No guidelines drew exclusively on primary qualitative studies, but five did include them alongside qualitative evidence synthesis data [22, 24, 25, 27, 31].

Informing guideline scope

Seven guidelines [19,20,21,22,23,24,25] on the topic of MANH drew on the same QES [26] to inform the addition of a quantitative ‘positive postnatal experience outcome’, defined as ‘in which women, partners, parents, caregivers and families receive information and reassurance in a consistent manner from motivated health workers. Both the women’s and babies’ health, social and developmental needs are recognized, within a resourced and flexible health system that respects their cultural context’ [25]. The inclusion of this outcome allowed for prioritising women’s psychosocial and emotional well-being alongside physical health outcomes, such as mortality or morbidity, when evaluating an intervention. One infectious disease guideline [27] drew on qualitative research to inform the background of 6/99 recommendations. Findings here were often coded as ‘to understand why programmes succeed or fail’, suggesting that qualitative research can be used in this context to detail challenges with current approaches and provide a rationale for the consideration of new interventions and service designs.

Informing the decision to recommend an intervention

All 18 guidelines drew on qualitative research to inform the decision. The frequency of use for this purpose likely reflects the standardisation of the research-to-decision-making framework (EtD) and pre-specified domains of ‘acceptability’, ‘values and preferences’, ‘feasibility’ or ‘equity’ of a proposed intervention. Table 2 provides an overview of which of these domains included qualitative research. Regarding the feasibility of the proposed intervention, 12 guidelines drew on qualitative research. Regarding the acceptability of the proposed intervention, 13 guidelines drew on qualitative research. Regarding the values and preferences relating to the proposed intervention, 17 guidelines drew on qualitative research. Finally, regarding the equity implications of the proposed intervention, five guidelines drew on qualitative research.

Findings that described people’s perception of benefits and harms were typically used in the ‘values and preferences’ domain, which helped to understand the importance patients place on guideline outcomes. They were also used to inform acceptability and feasibility, and it was noted that typically these findings often justified that interventions were acceptable or feasible. In contrast, unacceptable or unfeasible aspects of interventions drew on findings concerned with explaining the influence of local context on health seeking behaviour, understanding how programmes succeed or fail or identifying information needs. Qualitative research was rarely used to identify unintended consequences or to understand how systems function and its impact. These two roles may have important contributions to considerations of equity, yet few guidelines drew on qualitative research to inform this domain.

Depending on the information provided, all but one [27] of the guidelines then determined a judgement of ‘probably yes’, ‘variable’ or ‘probably no’ to each domain. Judgements of the former two were frequent, and we observed only one occasion in which the acceptability was judged to be ‘probably no’ [25]. However, ‘varied’ acceptability judgements did not appear to correspond to context specific recommendations or feed into implementation considerations. We found only one example where qualitative research had influenced the overall recommendation and was directly reported in the accompanying justification [25].

Informing the implementation considerations of an intervention

We found only one guideline where qualitative research had been clearly cited in the designated implementation considerations section for 1/99 recommendations [27]. This makes it difficult to assess the extent to which qualitative research is used for this component or to delineate considerations that are derived from panel opinion or other forms of research. The qualitative research finding used here stated ‘other challenges include lack of nutrition support’ in reference to adherence support required for children and infants. The reductive nature of the quotation makes it difficult to assess the intended purpose of the use of qualitative research.

Standards of qualitative research use

Certainty

All MANH guidelines reported judgements about the certainty of evidence by applying the CERQual tool to their QES findings but did not conduct any formal quality assessment on stand-alone primary studies. None of the infectious disease guidelines reported judgements about the certainty of evidence or conducted quality assessments on primary studies.

Transparency

Readers should be able to understand the justification for each recommendation from the research presented [12]. However, we found that this information was often lacking. A rationale for why the guideline panel judged there to be ‘probably yes’, ‘varied’ or ‘probably no’ acceptability, feasibility, and equity was not provided in any guideline. For some recommendations, the judgement could be easily intuited. For example, a summary of qualitative research that only describes positive viewpoints under acceptability could be reasonably judged to be ‘probably yes’. Yet, when varied viewpoints were presented, it was unclear why acceptability had been labelled ‘probably yes’ as opposed to ‘varied’. Was this due to the relative proportions of conflicting viewpoints or the relative importance of viewpoints?

Some guidelines drew on a mixture of both qualitative and quantitative studies to inform their values, acceptability, feasibility and equity domains. When this occurred, it was not clear how this research was weighed and evaluated in the decision. For example, in one guideline [27], women were less accepting of the intervention in qualitative interviews in contrast to the surveys which reported high rates of acceptability. Yet the guideline summarised acceptability as ‘high’ and cited quantitative studies to support this. As no quality assessments were performed in any guideline, it is likely that weighting was not dependant on this.

Specificity

Qualitative research can allow for more tailored recommendations that moves beyond what intervention may work in a controlled setting, to which intervention may work in real-life settings and contexts. This is often referred to as the efficacy to effectiveness gap [35]. However, for this to happen contextualising of recommendations are necessary. This requires narrative summaries of qualitative research to retain sufficient information on the context of findings [12]. A total of 11 guidelines contextualised a finding at least once. However, overall contextualisation was infrequent and reductive as considerations were labelled as: LMIC settings (54 findings), low-resource settings (2 findings), rural settings (7 findings), HIC settings (3 findings), children (1 finding) and unequal gender relations (2 findings). We acknowledge there is likely to be some crossover between these considerations but have listed them as referred to in the guideline documents. Moreover, contextualised findings did not appear to lead to more nuanced recommendations, e.g. for which populations is this intervention acceptable, or implementation considerations, e.g. how should the implementation be adapted for specific populations.

Reflexivity

Three guidelines in the field of MANH health, but no guidelines in infectious diseases, included someone experienced in qualitative research on the panel. Meanwhile, we sought to understand whether summaries of qualitative research had been produced by the guideline author team, by the guideline panel or in close collaboration, yet no guidelines reported this.

Discussion

Qualitative research was frequently used in WHO guidelines between 2020 and 2022, although had a larger role in informing MANH than infectious diseases. Within healthcare, qualitative research has its roots in nursing, due to the relative importance of social interventions [6], and it is likely that the frequent use of qualitative research in MANH is linked to its longer history here, given the similarities in the two fields. This may also explain why some of the MANH guidelines included qualitative expertise, compared with none of the infectious disease guidelines.

We found that qualitative research rarely informed the scope of the guideline or the implementation considerations. Instead, qualitative research most often informed the decision. A similar study reported that 86% of WHO and UK, US and Canadian national guidelines used qualitative research to inform decisions but only 20% to identify clinical questions and 19% to inform implementation considerations [36]. This may be due to lack of clear citing, which made it difficult to assess accurately the extent of use. However, qualitative research presented in guidelines were often found to touch on issues regarding implementation, and yet this information did not appear to track to the appropriate section. Given that qualitative methods are considered an integral component in wider implementation science, it is surprising to see the lack of qualitative research here [37, 38].

Across the different theoretical aims of qualitative research, the most frequently used was ‘describing perception of benefits and harms’ and ‘describing barriers and facilitators to programme success’. In contrast, explanatory findings were less frequently used. Similarly, In National Institute of Health and Care Excellence (NICE) guidelines between 2015 and 2019, over half of qualitative research addressed one of two types of question: “What are the barriers and/or facilitators?” and “What are the information (and support) needs?”, and they were all descriptive in nature [39]. This may indicate a limited understanding of the potential of qualitative research particularly for more explanatory findings or simply reflect that they infrequently capture these findings to begin with. However, engaging with explanatory findings may allow guideline panels to indicate to national government which findings are likely to be transferable to their context and population groups.

We found that summaries of qualitative research and the process of transforming these into ‘yes’, ‘no’ or ‘varied’ judgments were often reductive, at the expense of the original case complexity and nuance [8, 40]. There are several ways recommendations can be contextualised from the perspectives of: geographical, epidemiological, sociocultural, socioeconomic, ethical, legal and political [41]. Qualitative research may help in understanding how proposed interventions interact with these aspects of context, but this is currently poorly conducted. One driver of this may be in how domains such as ‘acceptability’ are framed and defined. Guideline developers drew on the following definition of acceptability: ‘the extent to which that intervention is considered to be reasonable among those receiving, delivering or affected by the intervention’ [13]. However, acceptability can include affective attitude, burden, ethicality, intervention coherence, opportunity costs, perceived effectiveness and self-efficacy [42].

We found that guidelines failed to address or consider quality when interpreting primary qualitative research. Similarly, national UK guidelines by the National Institute of Health and Care Excellence (NICE) between 2003 and 2019 rarely conducted quality appraisal [39, 43]. High quality, rigorous evidence is central to the principles of evidence-based practice [1], and it is important that appropriate standards are applied to qualitative research, not only to ensure the usability of the findings but also to institutionalise the credibility of the methodology as a whole. The use of qualitative research also lacked transparency as it was often unclear how the information had been interpreted and evaluated. Aside from a transparency issue, it is possible that qualitative research was just not a key influencer in most decisions and mainly relegated to supportive roles in guideline processes [44].

Study limitations

This study has some limitations. First, we collected guideline documents from a relatively short time frame. The trends documented in this review may be an artefact of 2020–2022, specifically, and do not describe general trends in qualitative research use. Second, lack of clear and transparent reporting on the use of qualitative research does not necessarily mean that, for example, it did not directly feed into overall judgements, or implementation considerations. Document analysis is limited by the availability of public documents, and it may be that further information is contained within meeting notes, email exchanges and other private reports that we cannot access. Finally, we chose to focus on the topics of MANH and infectious disease as they account for a large portion of qualitative research, but the use of qualitative research may be different for other topic areas.

Conclusions

Qualitative research frequently informed WHO guideline decisions particularly in the field of MANH and was rarely used to inform guidelines relating to infectious diseases. However, the process of how qualitative evidence was used and evaluated often lacked transparency. We identified unmet potential in informing implementation considerations and contextualisation of the recommendations. Use in these areas needs further methods development.

Availability of data and materials

The coded guideline documents and data extraction tables are available from the authors upon request.

Abbreviations

MANH:

Maternal and newborn health

WHO:

World Health Organisation

NICE:

National Institute of Health and Care Excellence

QES:

Qualitative evidence synthesis

LMIC:

Low-and middle-income country

HIC:

High income country

EtD:

Evidence to decision

References

  1. Sackett DL, Rosenberg WMC, Gray JAM, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn’t. BMJ. 1996;312(7023):71–2.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Lewin S, Glenton C. Are we entering a new era for qualitative research? Using qualitative evidence to support guidance and guideline development by the World Health Organization. Int J Equity Health. 2018;17(1):126.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Isaacs A. An overview of qualitative research methodology for public health researchers. Int J Med Public Health. 2014;4(4):318.

    Article  Google Scholar 

  4. Gopinathan U, Buse K. How can WHO transform its approach to social determinants of health? BMJ. 2022;8:376.

    Google Scholar 

  5. Dahlgren GWM. Policies and strategies to promote social equity in health. Sweden: Stockholm; 1991.

    Google Scholar 

  6. Kearney MH. Focus on research methods: Levels and applications of qualitative research evidence. Res Nurs Health. 2001;24(2):145–53.

    Article  CAS  PubMed  Google Scholar 

  7. Patton MQ. Qualitative research and evaluation methods: theory and practice. 4th ed. Thousand Oaks: SAGE Publications Inc; 2015. p. 832.

    Google Scholar 

  8. Tolley EE, Ulin PR, Mack N, Elizabeth TR, Succop SM. Qualitative methods in public health: a field guide for applied research. 2nd ed. Hoboken: John Wiley & Sons; 2016. p. 480.

    Google Scholar 

  9. Carmona C, Baxter S, Carroll C. Systematic review of the methodological literature for integrating qualitative evidence syntheses into health guideline development. Res Synth Methods. 2021;12(4):491–505.

    Article  PubMed  Google Scholar 

  10. Lewin S, Booth A, Glenton C, Munthe-Kaas H, Rashidian A, Wainwright M, et al. Applying GRADE-CERQual to qualitative evidence synthesis findings: Introduction to the series. Implement Sci. 2018;13(1):1–10. https://doi.org/10.1186/s13012-017-0688-3.

    Article  Google Scholar 

  11. Downe S, Finlayson KW, Lawrie TA, Lewin SA, Glenton C, Rosenbaum S, et al. Qualitative Evidence Synthesis (QES) for Guidelines: Paper 1-using qualitative evidence synthesis to inform guideline scope and develop qualitative findings statements. Health Res Policy Syst. 2019;17(1):1–12. https://doi.org/10.1186/s12961-019-0467-5.

    Article  Google Scholar 

  12. Lewin S, Glenton C, Lawrie TA, Downe S, Finlayson KW, Rosenbaum S, et al. Qualitative Evidence Synthesis (QES) for Guidelines: paper 2-using qualitative evidence synthesis findings to inform evidence-to-decision frameworks and recommendations. Health Res Policy Syst. 2019;17(1):1–8.

    Article  Google Scholar 

  13. Glenton C, Lewin S, Lawrie TA, Barreix M, Downe S, Finlayson KW, et al. Qualitative Evidence Synthesis (QES) for Guidelines: paper 3-using qualitative evidence syntheses to develop implementation considerations and inform implementation processes. Health Res Policy Syst. 2019;17(1):1–4.

    Article  Google Scholar 

  14. Ford N, Thomas R, Grove J. Transparency: a central principle underpinning trustworthy guidelines. J Clin Epidemiol. 2022;142:246.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Kayesa NK, Shung-King M. The role of document analysis in health policy analysis studies in low and middle-income countries: lessons for HPA researchers from a qualitative systematic review. Health Policy OPEN. 2020. https://doi.org/10.1016/j.hpopen.2020.100024.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Bowen GA. Document analysis as a qualitative research method. Qual Res J. 2009;9(2):27–40.

    Article  Google Scholar 

  17. Cochrane library. 2023. https://www.cochranelibrary.com/. Accessed 25 Mar 2024.

  18. WHO Publications. 2023. https://www.who.int/publications/i?publishingoffices=c09761c0-ab8e-4cfa-9744-99509c4d306b. Accessed 25 Mar 2024.

  19. World Health Organisation. WHO antenatal care recommendations for a positive pregnancy experience Nutritional interventions update: Multiple micronutrient supplements during pregnancy.

  20. World Health Organisation. WHO recommendations on antiplatelet agents for the prevention of pre-eclampsia.

  21. World Health Organisation. WHO antenatal care recommendations for a positive pregnancy experience Nutritional interventions update: zinc supplements during pregnancy.

  22. World Health Organisation. WHO recommendations on drug treatment for non-severe hypertension in pregnancy.

  23. World Health Organisation. WHO antenatal care recommendations for a positive pregnancy experience Nutritional interventions update: Vitamin D supplements during pregnancy.

  24. World Health Organisation. Calcium supplementation before pregnancy for the prevention of pre-eclampsia and its complications.

  25. World Health Organization, Special Programme of Research D. WHO recommendations on maternal and newborn care for a positive postnatal experience. p. 224.

  26. Downe S, Finlayson K, Tunçalp Ö, Gülmezoglu AM. Provision and uptake of routine antenatal services: a qualitative evidence synthesis. Cochrane Database Syst Rev. 2019. https://doi.org/10.1002/14651858.CD012392.pub2/full.

    Article  PubMed  PubMed Central  Google Scholar 

  27. World Health Organization. Consolidated guidelines on HIV prevention, testing, treatment, service delivery and monitoring : recommendations for a public health approach. p. 548.

  28. World Health Organisation. WHO guideline for screening and treatment of cervical pre-cancer lesions for cervical cancer prevention use of mRNA tests for human papillomavirus (HPV). p. 51.

  29. World Health Organisation. WHO recommendation on Umbilical vein injection of oxytocin for the treatment of retained placenta.

  30. World Health Organisation. Vaginal preparation with antiseptic agents for women undergoing caesarean section. Geneva: World Health Organization; 2021.

    Google Scholar 

  31. World Health Organization. Guideline: infant feeding in areas of Zika virus transmission. Geneva: World Health Organization; 2021.

    Google Scholar 

  32. World Health Organisation. WHO recommendation on uterine balloon tamponade for the treatment of postpartum haemorrhage. Geneva: World Health Organization; 2021.

    Google Scholar 

  33. World Health Organisation. WHO recommendation on Advance misoprostol distribution to pregnant women for prevention of postpartum haemorrhage.

  34. World Health Organisation. WHO recommendation on Routes of oxytocin administration for the prevention of postpartum haemorrhage after vaginal birth.

  35. Nordon C, Karcher H, Groenwold RHH, Ankarfeldt MZ, Pichler F, Chevrou-Severac H, et al. The ‘efficacy-effectiveness gap’: Historical background and current conceptualization. Val Health. 2016;19(1):75–81.

    Article  Google Scholar 

  36. Wang YY, Wang YY, Wang YY, Liang DD, Liang DD, Liang DD, et al. An exploration of how developers use qualitative evidence: content analysis and critical appraisal of guidelines. BMC Med Res Methodol. 2020;20(1):1–28. https://doi.org/10.1186/s12874-020-01041-8.

    Article  Google Scholar 

  37. Hamilton AB, Finley EP. Qualitative methods in implementation research: an introduction. Psychiatr Res. 2019;280:112516.

    Article  Google Scholar 

  38. Ramanadhan S, Revette AC, Lee RM, Aveling EL. Pragmatic approaches to analyzing qualitative data for implementation science: an introduction. Implement Sci Commun. 2021;2(1):1–10. https://doi.org/10.1186/s43058-021-00174-1.

    Article  Google Scholar 

  39. Carmona C, Baxter S, Carroll C. The conduct and reporting of qualitative evidence syntheses in health and social care guidelines: a content analysis. BMC Med Res Methodol. 2022;22(1):267.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Horton L. Making qualitative data more visible in policy: a critical appraisal of meta-synthesis. Qual Res. 2020;20(5):534–48.

    Article  Google Scholar 

  41. Booth A, Moore G, Flemming K, Garside R, Rollins N, Tunçalp Ö, et al. Taking account of context in systematic reviews and guidelines considering a complexity perspective analysis. BMJ Glob Health. 2019;4:840. https://doi.org/10.1136/bmjgh-2018-000840.

    Article  Google Scholar 

  42. Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017. https://doi.org/10.1186/s12913-017-2031-8.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Tan TPYSTSE. Use of qualitative research as evidence in the clinical guideline program of the National Institute for Health and Clinical Excellence. Int J Evid Based Healthc. 2009;7(3):169–72.

    Article  PubMed  Google Scholar 

  44. Stern E, Stame N, Mayne J, Forss K, Davies R, Befani B. Broadening the range of designs and methods for impact evaluations sharing the benefits of trade DFID’S Aid for Trade Portfolio Monitoring & Evaluation Framework. 2012.

  45. World Health Organisation. Guidelines for the management of symptomatic sexually transmitted infections guidelines. 2021.

  46. World Health Organization. Guideline for Preventive Chemotherapy for the Control of Taenia solium Taeniasis. Guideline for Preventive Chemotherapy for the Control of Taenia solium Taeniasis. Pan American Health Organization; 2021. https://iris.paho.org/handle/10665.2/54800. Accessed 7 Aug 2023.

  47. World Health Organization. Recommendations and guidance on hepatitis C virus self-testing. p 20.

  48. World Health Organisation. WHO guidelines for plague management: revised recommendations for the use of rapid diagnostic tests, fluoroquinolones for case management and personal protective equipment for prevention of post-mortem transmission. Geneva: World Health Organization; 2021.

    Google Scholar 

  49. World Health Organisation. Who guideline on mass drug administration of azithromycin to children under five years of age to promote child survival.

  50. World Health Organisation. WHO guidelines for the prevention of sexual transmission of Zika virus.

  51. World Health Organisation. Driving impact through programme monitoring and management guidelines HIV strategic information for impact. Geneva: World Health Organization; 2020.

    Google Scholar 

  52. World Health Organisation. Guidelines for the management of pregnant and breastfeeding women in the context of Ebola virus disease Clinic.

  53. World Health Organization. Diagnosing and managing disseminated histoplasmosis among people living with HIV. 2020. https://www.who.int/publications/i/item/9789240006430. Accessed 7 Aug 2023.

  54. World Health Organisation. WHO recommendations on Choice of antiseptic agent and method of application for preoperative skin preparation for caesarean section. Geneva: World Health Organization; 2021.

    Google Scholar 

  55. World Health Organisation. WHO recommendation on Routine antibiotic prophylaxis for women undergoing operative vaginal birth. Geneva: World Health Organization; 2021.

    Google Scholar 

  56. World Health Organisation. Prophylactic antibiotics for women undergoing caesarean section. Geneva: World Health Organization; 2021.

    Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Melissa Taylor and Sandy Oliver are supported by the Research, Evidence and Development Initiative (READ‐It) project. READ‐It (project number 300342‐104) is funded by UK aid from the UK Government; however, the views expressed do not necessarily reflect the UK Government's official policies.

Author information

Authors and Affiliations

  1. Department of Clinical Sciences, Liverpool School of Tropical Medicine, Liverpool, UK

    Melissa Taylor & Paul Garner

  2. EPPI-Centre, Social Science Research Unit, UCL Institute of Education, University College London, London, UK

    Sandy Oliver

  3. Africa Centre for Evidence, Faculty of Humanities, University of Johannesburg, Johannesburg, South Africa

    Sandy Oliver

  4. Department of International Public Health, Liverpool School of Tropical Medicine, Liverpool, UK

    Nicola Desmond

Authors
  1. Melissa Taylor
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Paul Garner
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sandy Oliver
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nicola Desmond
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

M.T. conducted data collection, analysis and interpretation in consultation with P.G., S.O. and N.D. M.T. wrote the first and subsequent drafts of the manuscript, with comments and revision from P.G., S.O. and N.D. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Melissa Taylor.

Ethics declarations

Ethics approval and consent to participate.

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Taylor, M., Garner, P., Oliver, S. et al. Use of qualitative research in World Health Organisation guidelines: a document analysis. Health Res Policy Sys 22, 44 (2024). https://doi.org/10.1186/s12961-024-01120-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12961-024-01120-y

Keywords

Health Research Policy and Systems

ISSN: 1478-4505

Contact us