Skip to main content
Download PDF
Download ePub

Development of rapid guidelines: 1. Systematic survey of current practices and methods

Health Research Policy and Systems volume 16, Article number: 61 (2018) Cite this article

Abstract

Background

Guidelines in the healthcare field generally should contain evidence-based recommendations to inform healthcare decisions. Guidelines often require 2 years or more to develop, but certain circumstances necessitate the development of rapid guidelines (RGs) in a short period of time. Upholding methodological rigor while meeting the reduced development timeframe presents a challenge for developing RGs. Our objective was to review current practices and standards for the development of RGs. This is the first of a series of three articles addressing methodological issues around RGs.

Methods

We conducted a systematic survey of methods manuals and published RGs to identify reasons for the development of RGs. Data sources included existing guideline manuals, published RGs, Trip Medical Database, MEDLINE, EMBASE and communication with guideline developers until February 2018.

Results

We identified 46 guidelines that used a shortened timeframe for their development. Nomenclature describing RGs varied across organisations, wherein the United States Centers for Disease Control and Prevention produced ‘Interim Guidelines’, the National Institute for Health and Care Excellence in the United Kingdom developed ‘Short Clinical Guidelines’, and WHO provided ‘Rapid Advice’. The rationale for RGs included response to emergencies, rapid increases in cases of a condition or disease severity, or new evidence regarding treatment. In general, the methods to assess the quality of evidence, the consensus process and the management of the conflict of interest were not always clear. While we identified another 11 RGs from other institutions, there was no reference to timeframe and reasons for conducting a RG. The three organisations mentioned above provide guidance for the development of RGs.

Conclusions

There is a lack of standardised nomenclature and definitions regarding RGs and there is inconsistency in the methods described in manuals and in RG. It is therefore important that all RGs provide a detailed and transparent description of their methods in order for readers and end-users to be able to assess their quality and validate their findings.

Peer Review reports

Background

Guidelines contain recommendations to inform users (e.g. healthcare providers, general population or patients) about the benefits and harms of a specific intervention or situation to achieve the best health outcome. Guidelines differ depending on their purpose, scope and timeframe for development. Typically, guidelines take 2 years to develop due to the several steps required, including identification of important outcomes, identification of evidence, synthesis and presentation of evidence, peer review, and dissemination and implementation, among others [1]. However, certain situations require the development, dissemination and implementation of guidelines within a condensed timeframe such as in response to a public health emergency or urgent humanitarian crisis [2].

Rapid guidelines (RGs) refer to guidelines that report the use of a shortened timeframe for their development. A challenge with developing RGs is maintaining methodological rigor while meeting a reduced development timeframe. Our objective was to review current practices and standards for the development of RGs. This systematic survey is the first in a series of three articles to inform the process and guiding principles for the development of rapid and evidence-based recommendations [3, 4]. The second article in the series reports on results from interviews with RGs developers, and the third presents recommendations for the expansion of the Guideline Development Checklist and tool for RGs [5].

Methods

To understand the current practices and standards for the development of RGs, we examined the methods and approaches presented in manuals produced by several guideline development organisations and in published RGs. We developed the protocol in April 2013 (Additional file 1: Appendix 1) and then conducted a systematic survey of published RGs and purposively sampled methods manuals from several organisations to describe current practices and standards for the development of RGs. We focused on identifying the rationale for development, methods and approaches used, as well as the overall quality of the guidelines.

Systematic survey of RGs

Search strategy

We utilised several search strategies to identify organisations that developed guidelines using a shortened timeframe. We conducted searches, from database inception through February 2018, in MEDLINE, EMBASE, and Trip Medical Database, which searches the National Guideline Clearinghouse. We used a combination of the following terms for each database: “rapid”, “fast”, “short”, “interim” (Additional file 1: Appendix 2). In addition, we contacted guideline developers and methodologists from key organisations for their input. Finally, we searched the 35 manuals identified by guideline developers, methodologists and references to develop the GIN-McMaster Guideline Development Checklist (Additional file 1: Appendix 3) [5]. Discrepancies in electronic and manual search strategies were resolved by discussion and consensus.

Eligibility criteria

The inclusion criteria for data sources considered in this study were (1) methods manuals and publications focusing on the development of guidelines using a shortened timeframe; (2) guidelines described as ‘rapid’ and/or using a shortened timeframe for their development; and (3) guidelines and manuals published in English. We excluded guideline updates, rapid systematic reviews, rapid health technology assessments, rapid review reports and position statements that did not make recommendations.

Selection of studies and data abstraction

To identify current practices used for RG development, we selected up to three of the most recent guidelines identifying a shortened timeframe from organisations that did not publish RGs regularly (i.e. less than five published guidelines between 2011 and 2014). From organisations that published more than five guidelines in that period (considered as regularly publishing RGs), all RGs were selected and assessed. Six investigators (RLM, MF, IDF, II, YZ, WW) independently screened titles and abstracts, and the full text of potentially relevant articles was obtained to determine eligibility. We developed and pilot tested a data abstraction form to extract information about the topics of interest. The abstraction form collected information on (1) condition evaluated; (2) guideline group member composition, (3) number of research questions requiring recommendations; (4) number of recommendations; (5) guideline’s timeframe (including time spent in each step and time to completion); (6) evidence review process; (7) quality of evidence assessment procedures; (8) factors considered when formulating recommendations; (9) considerations about costs and stakeholder involvement; and (10) reasons for developing a RG instead of a standard guideline. An additional file shows the information collected in more detail (Additional file 1). For the pilot phase, four investigators (MF, II, YZ, FS) abstracted data from two RGs, namely ‘Osteoporosis: assessing the risk of fragility fracture’ and ‘Rapid advice: Diagnosis, prevention and management of cryptococcal disease in HIV-infected adults, adolescents and children’ [6, 7]. Subsequently, eight investigators (RLM, MF, IDF, II, YZ, FS, SK, LI) independently and in duplicate reviewed eligible studies and abstracted data.

To assess the overall quality of the guideline, five investigators (MF, II, YZ, SK, WW) applied the Appraisal of Guidelines for Research & Evaluation Instrument (AGREE II) in pairs to all RGs identified and agreement between reviewers was calculated [8]. The AGREE II instrument consists of 23 key items organised within six domains followed by two global rating items. Raters assess the credibility of a guideline using a 7-point scale (1 – strongly disagree, 7 – strongly agree) and calculate separate scores ranging from 0 to 100% for each of the six domains. Higher percentages suggest higher credibility.

Purposive sampling of methods manuals

The search strategy and eligibility criteria used for identifying methods manuals for guideline development have been described previously [5]. The systematic search identified ‘guidelines for guidelines’, guideline method reports and guideline manuals available from guideline development organisations (e.g. international and national agencies, professional societies, etc.), as well as clinical and public health guidelines describing their development process [5]. In addition, we contacted key stakeholders and topic-specific experts to identify relevant manuals. The topic-specific experts have worked in the guidelines for more than 10 years, served on key committees, and attended meetings in the field. Websites of organisations that develop RGs were reviewed to identify methods manuals.

Data analysis

We present data narratively with descriptive statistics.

Results

Rapid guidelines

Search results

We identified 46 guidelines from 11 different organisations using a shortened timeframe [6, 7, 9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51] (Fig. 1). Of the 11 organisations, only three published more than five RGs during that time period – WHO (n = 8), National Institute for Health and Care Excellence (NICE; n = 9), and the United States Centers for Disease Control and Prevention (CDC; n = 17). The nomenclature related to RGs was not uniform across organisations (Table 1).

Fig. 1
figure 1

PRISMA flow diagram

Full size image
Table 1 Nomenclature used for rapid guidelines according to institutions
Full size table

Characteristics of included guidelines

Table 2 depicts the key characteristics of the RGs evaluated. WHO guidelines (n = 8) were related to chronic infectious diseases including HIV and emerging infections [7, 11, 15, 22, 25, 31, 39, 47]. The reasons provided for RG were the sudden increase in incidence along with high case-fatality rates of the disease (e.g. human cases of avian influenza), the emergence of new treatment modalities, new evidence on existing treatments or new diagnostic tests. For two guidelines, HIV and infant feeding and tuberculosis in children, the rationale was not described [10, 11]. The development timeframe varied from 5 to 12 months.

Table 2 Characteristics of the rapid guidelines according to organisations (n = 36)
Full size table

NICE Short Clinical Guidelines (n = 9) focused primarily on the diagnosis or treatment of chronic diseases [6, 26, 33, 34, 36,37,38, 49, 52]. The reasons for conducting an RG were not always clear; however, some RGs reported rationale as uncertainty in disease management or in clinical practice. The timeframe from the decision to develop a guideline to publication varied from 15 to 26 months.

CDC produced the greatest volume of RGs during the duration of this study (n = 17). CDC refers to them as ‘Interim Guidance’ documents. These RGs were mostly related to emerging infection and virus control and management [20, 21, 23, 24, 27,28,29,30,31, 40, 41, 43, 45, 46, 50,51,52]. The rationale for developing RGs on influenza, Zika, anthrax, and Ebola control and management was based on the uncertainty about the disease evolution and transmission, the lack of an effective vaccine, and high mortality and morbidity. The scope of the CDC RG was broad and varied from case definitions, surveillance for different settings (e.g. schools) and treatment with antivirals. The CDC also produced RGs related to other infections (e.g. osteoarticular infections, polio vaccination, HIV prevention and prophylaxis) [20, 21, 23, 24, 29]. The reasons to develop these RGs, in general, were to present new evidence and provide recommendations to reduce the risk of disease transmission and infection. References for the tools used to assess the quality of evidence were found in RGs of WHO and NICE, but not in the CDC.

The remaining 12 RGs were produced by other institutions (Table 2) [9, 12,13,14,15,16,17,18,19, 42, 44, 48]. The RG topics were very broad, related to infectious diseases, cancer or lipid control. The Public Health Agency of Canada published two RGs on avian influenza and SARS [18, 19]. The reasons to develop the guidelines were not explicit in the text or supplement materials; however, we suspected the impetus for formulating guidance was to benefit healthcare organisations and workers in the management of people with suspected avian influenza. Generally, these institutions did not assess the quality of evidence, except for the ‘Interim UK guidelines for management of close community contacts of invasive group A streptococcal disease’, which used the Scottish Intercollegiate Guideline Network approach [9, 53]. The WHO Global Malaria Programme published three RGs related to malaria, varying from larva control, drugs management and pregnancy [15,16,17]. There was no description of the WHO Global Malaria Programme RG timeframe, the number of questions was not clear and the reason to conduct a RG was not reported. The timeframe was 7–8 months, similar to other WHO RGs.

Methodological quality of included guidelines

On the AGREE II instrument, the credibility of WHO, NICE and CDC guidelines varied across domains (Table 3). Participation of stakeholders was usually described in NICE and WHO guidelines while, among guidelines from CDC and other institutions, the scores in that domain were low, varying from 6% to 69%. Similarly, regarding group composition, patient participation was identified in all NICE guidelines, in 30% of WHO guidelines, in only one CDC guideline, and was not reported in the guidelines from other institutions. NICE guidelines described public consultation. Experts in guideline methods participated in all NICE guidelines and in 30% of WHO guidelines, but other institutions did not mention their participation. The use of tables summarising the characteristics and effects across studies or frameworks occurred in most of the NICE guidelines and approximately half of the guidelines from WHO; however, there was no description of these in the guidelines from other institutions. WHO reported the methods used to achieve consensus among members of the guideline development group in the majority of their guidelines; no other organisations mentioned their decision-making processes. Within the domain ‘rigor of development’, both WHO and NICE guidelines scored higher than the CDC and others. WHO guidelines had lower scores in the applicability domain. Only WHO and NICE consistently described the external review process for their guidelines. Regarding editorial independence, WHO guidelines achieved the highest scores compared with NICE, CDC and others. In addition, AGREE II scores for clarity of presentation were high for both WHO and NICE guidelines. The median (minimum and maximum) AGREE II overall assessment score was 6.0 (5.0–6.5) for NICE, 6.0 (4.5–6.5) for WHO and 4.5 (3.5–5.0) for CDC. The overall assessment score for other institutions was 5.0 (2.5–5.0).

Table 3 Evaluation of the process of rapid guidelines’ development and the quality of reporting applying the AGREE II according to organisationsa
Full size table

Methods manuals

Search results

Of the 35 methods manuals previously identified on guideline development, only WHO, NICE and CDC provided guidance on RG development (Table 4) [1, 54, 55].

Table 4 Comparison of rapid guidelines methods used by WHO, NICE and CDC
Full size table

WHO

WHO defines a rapid advice guideline as an evidence-informed guideline produced within 1–3 months providing global leadership and timely guidance in response to emergencies or to an urgent need [1]. The timeframe in which guidelines are required differentiates the planning for the development of standard or rapid advice guidelines. The methods for guideline development should follow the same basic steps as for a standard guideline with modifications as required to meet the timeline dictated by the emergency. The WHO approval and quality control processes may be accelerated for this type of guideline. For example, rapid advice guidelines may be described as evidence based, but are not necessarily supported by a standard systematic review of evidence, whereas standard guidelines are expected to be supported by standard systematic evidence reviews. Additionally, the peer-review process for rapid advice guidelines may be limited to a review of the completed draft only, immediately before final clearance. Peer review may occur just before clearance and reviewers may be limited in number to between three and six experts rather than more, and precluded in some situations based on time constraints. Standard guidelines require a more complete peer-review process. In comparison, more comprehensive peer review is required for standard guidelines, including a review of the questions, a review of the evidence tables and draft recommendations, and a record of responses to the peer review and changes made to the document. Rapid advice guidelines require a defined date and plan for updating or conversion to a standard guideline.

The WHO Handbook specifies two types of guidelines in response to an emergency or urgent need, namely ‘rapid advice guidelines’ as discussed above and ‘emergency (rapid response) guidelines’ [1]. WHO develops emergency guidelines when a public health emergency necessitates a response within hours to days; the recommendations may be based on previous guidelines or even expert opinion [1]. However, if the public health emergency continues for an extended period, emergency guidelines must be reviewed, taking into account both the evidence emerging from the current emergency and a systematic review of the relevant evidence.

NICE

NICE produces RGs called ‘Short Clinical Guidelines’, which address only part of a care pathway and are intended to allow for the rapid development of guidance on aspects of care for which the National Health Service requires urgent advice [56]. The Short Clinical Guidelines steps and their timeframes are presented in the NICE Guidelines Manual [56].

The development of Short Clinical Guidelines are similar to those of standard clinical guidelines; however, the timeframe is shorter and the scope much narrower [56]. The development phase takes 4–6 months, during which the Guideline Development Group meets approximately every 4–6 weeks. Only 3–6 review questions are usually considered, compared with 15–20 in the standard clinical guideline process, resulting in 5–20 recommendations. Additionally, in contrast to standard guidelines, the Short Clinical Guideline process does not involve updating searches near the end of the development process and the consultation period is only 4 weeks. However, NICE generally does incorporate an economic assessment in Short Clinical Guidelines.

CDC

CDC produces a large number of recommendations covering a broad range of disciplines (e.g. physical activity, treatment of influenza, motor vehicle safety, etc.). CDC guidelines address surveillance, programme implementation and policy interventions, among others. To provide development and reporting standards to improve the transparency, validity and reliability of CDC guidelines and recommendations, CDC published the ‘Guidelines and Recommendations: a CDC primer’ [54]. Taking into account the variety of audiences, topics and communications formats, this document describes the critical elements and standards relevant to CDC guidelines. CDC develops ‘Interim Guidance’ using a shortened process in response to emergencies or to a rapid increase in prevalence or incidence of a disease or condition. This Interim Guidance refers to recommendations made between a few weeks and a couple of months and we therefore included them as RGs in our reviews. Interim Guidance may also be based on tentative or emerging data (e.g. the use of face masks and respirators during an influenza pandemic) and often updated when new evidence is available. Morbidity and Mortality Weekly Report or other peer-reviewed journals usually publish these RGs.

Discussion

There is a need for guidelines in public health emergencies and humanitarian crises; however, the typical time required to produce a standard guideline (2 years or more) is not appropriate in these situations. The development of RGs is an alternative to meet the needs of policy-makers, programme managers and healthcare workers. However, there is limited information about how RGs are developed and implemented and their impact on health outcomes. This study presents current practices for RG development and the quality of RGs produced by diverse organisations.

Differences between the RG organisations identified in this study include the rationale for the development of RGs to justify the shortened timeframe. WHO RG defined the rationale for developing RGs more clearly than NICE or CDC. Often, the reason was implicit, such as the threats of new emerging diseases (e.g. severe acute respiratory syndrome) and avian influenza A (H5N1) infection, as well as pandemics of chronic diseases requiring international action and recommendations [55]. Only a few of the identified guidelines reported the duration of development (ranging from 5 to 26 months) [10, 55, 57]. Additionally, few RGs reported the involvement of guideline methodologists or end-users (e.g. patients, consumers, programme managers, etc.) during development.

We found that CDC documents included fewer recommendations when compared with WHO and NICE RGs, while failing to report the use of systematic reviews and the timeframe to develop the guidance. Standard systematic reviews often take from 6 months to 1 year to complete [58]. To address requests for literature reviews in shorter time periods and to facilitate informed decision-making and understand the credibility of rapid reviews, their methods should be explicit and transparent [59]. Butler [60], studying rapid assessments, identified that selection bias, publication bias and language of publication bias may be introduced when using literature that is readily accessible to a researcher. Ganann et al. [58] noted that rapid reviews with shorter timeframes (1–3 months) were often less systematic in their search for evidence than those with longer timeframes (3–6 months). Another study by Watt et al. [61] showed that full reviews were more likely than rapid reviews to report clinical outcomes, economic factors and social issues, and to provide greater depth of information and detail in recommendations. The authors suggested that using rapid reviews might lead to uncertainty around the conclusions drawn and inability to answer certain types of questions (e.g. economic analyses). However, they found that, although the scope of rapid reviews is limited, they can provide adequate advice for clinical and policy decisions. For RG developers, considering the amount of resources required to maintain quality in a short timeframe remains a challenge but can be overcome by working in larger and qualified teams [59, 60]. In fact, remaining systematic in the identification and use of evidence is equally important for RGs as it is for standard guidelines and RGs should not rely on expert opinion without stating the evidence from which this opinion is formed.

We found that timeframes were inconsistent with the organisations’ methods manuals. While WHO recommends RGs be developed in a timeframe between 1 and 3 months, the median time required based on our systematic survey was 8.5 months. For the NICE guidelines, the results showed a median time of 21 months while the manual suggests a timeframe of between 11 and 13 months. We identify some reasons why the proposed timeframe is not followed by the RG developers.

One point would be that RG developers were using the standard guidelines methods in a shortened period. If so, even a streamline process is not enough to fit their timeframe. Another option would be that they were using shortened methods for RG development. Again, it seems that the approach does not match the definition of RGs according to their methods manuals. Therefore, it seems imperative to define the minimal parameters to define RGs and propose their developmental methods accordingly. Otherwise, the lack of standardised RG development may lead to widely varying recommendations.

The organisations stated in their manuals that the rigorous adherence to the systematic use of evidence is the basis for all policies and that the methods applied for standard guidelines should be followed by the RGs even when under time pressure constraints [1, 54, 56]. Woolf et al. [62] advocated that the analytic framework of a guideline is a key element in its development. It is in this critical stage that a group defines which questions must be answered to arrive at a recommendation. However, in the majority of the RGs assessed in this systematic survey, many details were not identified, including how the evidence was assessed, the timeframe needed to conduct the process, the number of key questions for the RGs, and the procedures for editorial independence and external review. The WHO and NICE RGs described the use of systematic reviews and the assessment of the quality of evidence; however, there was no information regarding the process of consensus [1, 7]. Declaration of interest and conflict of interest management were also not described in the majority of the RGs in the present study, in line with other findings in the literature [63]. One possibility is that the steps were conducted but not reported.

Although RGs may be designed to reduce the work and time necessary to complete a guideline, they should provide the same information as a standard guideline, explicitly indicating the methods used and recognition of the potential bias introduced by the abbreviated methods [58, 64]. This information should be clearly and transparently described enabling end-users to balance the certainty placed in recommendations and the evidence underlying them [55]. For example, describing that systematic reviews were not used in the process because there was none available in the period that the guideline was developed is informative, instead of simply omitting the information.

In the present review, no institution reported using a pilot study or other mechanism for guideline implementation. Gagliardi and Brouwers [65] observed that there was a lack of details regarding guideline implementation in the literature and that new approaches for guideline development and implementation may need to be developed to enhance the use of guidelines. Shekelle et al. [66] suggest that identification of potential barriers to the implementation of recommendations and strategies for guideline dissemination should be addressed in the guidelines. WHO emphasised that the RGs should be developed only for situations where dissemination and implementation would be feasible when considering the health systems, acceptability of the intervention, training and resources available [1]. While RGs may be developed in a transparent manner and with methodological rigor, the implementation should also be evaluated to assess the impact of RGs.

Our review of the credibility of RGs identified variation between documents and across organisations. While documents from WHO rated highest when evaluated with AGREE II, our results suggest that organisations should plan their guidelines according to tools such as the GIN-McMaster Checklist to achieve high ratings on the AGREE II instrument [5]. The third article in this series provides guidance for applying the checklist to RGs [4]. Two domains of importance include transparency in the involvement of external stakeholders, including patient participation and the process for public consultation.

The strengths of this study include the extensive and systematic literature review, aggregating electronic, experts’ opinions and hand searching (Additional file 1: Appendix 4). Further, the application of piloted and standardised methods to extract data conducted in pairs contributed to the robustness of the analysis. The weaknesses of this study include the exclusion of methods manuals and guidelines not published in English, as well as reports or documents that used other nomenclature that may have been developed following a shortened timeframe for their development. There are a wide variety of terms and definitions used among the organisations for RGs, which made it difficult to identify them and assess their methodology and characteristics. Finally, we do not know how the AGREE II scores of RGs compare to guidelines developed without time constraints but suggest that this could be further explored.

We did identify one example of guidelines developed within a shortened timeframe whilst maintaining high quality methods [55]. In response to the avian influenza pandemic (H5N1), WHO developed a RG within 4 months using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach. When assessed using AGREE II, this guideline was determined to be of high quality. Although one of the authors of the current article was an author of that guideline, the assessment of the guideline using AGREE II was conducted by authors not involved in developing that guideline. Preceding uptake of rapid guideline development in the WHO handbook, the authors of the guidelines explicitly reported the methods used. The authors attributed the transparency and the short amount of time used to prepare the guideline (4 months) to utilising the GRADE approach and methods developed for the WHO shortly before the guideline work began [55]. They suggested that the time can be reduced by identifying collaborating centres capable of elaborating evidence profiles and also by building up in-house capacity to reduce the time needed to organise a review team. The use of tools such as the GRADEpro Guideline Development tool (www.gradepro.org) that keep records of evidence, decisions and judgments, facilitates the development of updated RGs, as recently demonstrated in WHO delamanide and bedaquiline guidelines for multi-drug resistant tuberculosis [67].

Conclusions

There is a lack of standardised nomenclature, definitions and processes regarding RG development. Only three institutions (WHO, NICE and CDC) were identified as routinely developing RGs. However, the reasons for developing RGs were not always clear and varied widely. We identified inconsistencies in the proposed methods and non-adherence to self-imposed timeframes. The methods used to assess the quality of evidence, the consensus process and the management of the conflicts of interests were not always transparent. However, we also identified a RG that achieved its goal of maintaining credibility if there is a concentration of skilled resources [55]. Organisations developing RGs can provide important service by using a robust and transparent process that simplifies adaptation of RGs to specific settings.

Abbreviations

AGREE II:

Appraisal of Guidelines for Research & Evaluation Instrument

CDC:

United States Centers for Disease Control and Prevention

GRADE:

Grading of Recommendations Assessment, Development and Evaluation

NICE:

National Institute for Health and Care Excellence

RG:

rapid guideline

References

  1. World Health Organization. WHO Handbook for Guideline Development. Geneva: World Health Organization; 2014.

    Google Scholar 

  2. Thayer KA, Schünemann HJ. Using GRADE to respond to health questions with different levels of urgency. Environ Int. 2016;92:585–9.

    Article  PubMed  Google Scholar 

  3. Florez ID, Morgan RL, Falavigna M, Kowalski SC, Zhang Y, Etxeandia-Itzeandia I, Santesso N, Wiercioch W, Schünemann HJ. Development of rapid guidelines: 2. A qualitative study with WHO guideline developers. Health Res Policy Syst. Accepted for publication. https://doi.org/10.1186/s12961-018-0329-6.

  4. Morgan R, Florez I, Falavigna M, Kowalski S, Alk E, Thayer K, Rooney A, Schünemann HJ. Development of rapid guidelines: 3. GIN-McMaster Guideline Development Checklist extension for rapid recommendations. Health Res Policy Syst. Accepted for publication. https://doi.org/10.1186/s12961-018-0330-0.

  5. Schünemann HJ, Wiercioch W, Etxeandia I, Falavigna M, Santesso N, Mustafa R, Ventresca M, Brignardello-Petersen R, Laisaar K-T, Kowalski S. Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise. Can Med Assoc J. 2014;186(3):E123–42.

    Article  Google Scholar 

  6. National Institute for Health and Clinical Excellence. Osteoporosis: Fragility Fracture Risk: Osteoporosis: Assessing the Risk of Fragility Fracture. London: Royal College of Physicians; 2012.

  7. World Health Organization. Rapid Advice: Diagnosis, Prevention and Management of Cryptococcal Disease in HIV-Infected Adults, Adolescents and Children. Geneva: World Health Organization; 2011.

    Google Scholar 

  8. Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, Fervers B, Graham ID, Grimshaw J, Hanna SE. AGREE II: advancing guideline development, reporting and evaluation in health care. Can Med Assoc J. 2010;182(18):E839–42.

    Article  Google Scholar 

  9. Health Protection Agency Group A Streptococcus Working Group. Interim UK guidelines for management of close community contacts of invasive group a streptococcal disease. Commun Dis Public Health/PHLS. 2004;7(4):354.

    Google Scholar 

  10. World Health Organization. Guidelines on HIV and Infant Feeding 2010: Principles and Recommendations for Infant Feeding in the Context of HIV and a Summary of Evidence Geneva: WHO; 2010.

  11. World Health Organization. Rapid Advice: Treatment of Tuberculosis in Children. Geneva: WHO; 2010.

    Google Scholar 

  12. Glimelius B, Tiret E, Cervantes A, Arnold D, Group EGW. Rectal cancer: ESMO clinical practice guidelines for diagnosis, treatment and follow-up. Ann Oncol. 2013;24(suppl 6):vi81–8.

    Article  PubMed  Google Scholar 

  13. American College of Medical Toxicology. ACMT position statement: interim guidance for the use of lipid resuscitation therapy. J Med Toxicol. 2011;7(1):81–2.

    Article  PubMed Central  Google Scholar 

  14. The Royal College of Ophthalmologists. Interim Guidelines for Management of Retinal Vein Occlusion. 2010. See https://www.nice.org.uk/guidance/ta229/documents/macular-oedema-retinal-vein-occlusion-dexamethasone-submission-from-royal-college-of-ophthalmologists-interim-guidelines-for-management-of-retinal-vein-occlusion2. Accessed 8 June 2018.

  15. World Health Organization. WHO Interim Position Statement – The Role of Larviciding for Malaria Control in Sub-Saharan Africa: WHO; 2012. http://www.who.int/malaria/publications/atoz/larviciding_position_statement/en/.

  16. World Health Organization. The Safety and Effectiveness of Single Dose Primaquine as a P. Falciparum Gametocytocide. WHO Evidence Review Group. Geneva: WHO; 2012.

    Google Scholar 

  17. World Health Organization. Updated WHO Policy Recommendation: Intermittent Preventive Treatment of Malaria in Pregnancy using Sulfadoxine-Pyrimethamine (IPTp-SP). World Health Organization; 2012.

  18. Public Health Agency of Canada. Interim Guidance - Avian Influenza A(H7N9) Virus. 2013. http://www.phac-aspc.gc.ca/eri-ire/h7n9/guidance-directives/h7n9-ig-dp-eng.php. Accessed 8 June 2018.

  19. Public Health Agency of Canada. Management of Severe Acute Respiratory Syndrome (SARS) in Adults: Interim Guidance for Health Care Providers. 2003. See http://web.archive.org/web/20101014152115/http:/www.phac-aspc.gc.ca/sars-sras/pdf/phmanagementofcases12-17_e.pdf. Accessed 8 June 2018.

  20. Centers for Disease Control and Prevention. Update to Interim Guidance for Preexposure Prophylaxis (PrEP) for the Prevention of HIV Infection: PrEP for Injecting Drug Users. MMWR Morb Mortal Wkly Rep. 2013;62(23):463.

    Google Scholar 

  21. Centers for Disease Control and Prevention. Interim Treatment Guidance for Osteoarticular Infections Associated with Injection of Contaminated Steroid Products. 2012. See https://www.cmtjustice.com/blog/2012/11/interim-treatment-guidance-for-osteoarticular-infections-associated-with-injection-of-contaminated-s.shtml. Accessed 8 June 2018.

  22. World Health Organization. Rapid Advice: Antiretroviral Therapy for HIV Infection in Adults and Adolescents. Geneva: WHO; 2009.

    Google Scholar 

  23. Smith D, Grant R, Weidle P, Lansky A, Mermin J, Fenton K. Interim guidance: preexposure prophylaxis for the prevention of HIV infection in men who have sex with men. MMWR Morb Mortal Wkly Rep. 2011;60(3):65–8.

    Google Scholar 

  24. Smith DK, Thigpen MC, Nesheim SR, Lampe M, Paxton L, Samandari T. Interim guidance for clinicians considering the use of preexposure prophylaxis for the prevention of HIV infection in heterosexually active adults. MMWR Morb Mortal Wkly Rep. 2012;61(31):586–9.

    Google Scholar 

  25. Schünemann HJ, Hill SR, Kakad M, Bellamy R, Uyeki TM, Hayden FG, Yazdanpanah Y, Beigel J, Chotpitayasunondh T, Del Mar C, et al. WHO rapid advice guidelines for pharmacological management of sporadic human infection with avian influenza a (H5N1) virus. Lancet Infect Dis. 2007;7(1):21–31.

    Article  PubMed  Google Scholar 

  26. Rabar S, Lau R, O'Flynn N, Li L, Barry P, Guideline Development Group. Risk assessment of fragility fractures: summary of NICE guidance. BMJ. 2012;345:e3698.

    Article  PubMed  Google Scholar 

  27. Centers for Disease Control and Prevention. Interim Guidance for Infection Control within Healthcare Settings when Caring for Patients with Confirmed, Probable, or Cases under Investigation of Avian Influenza A (H7N9) Virus Infection. 2013. See https://www.cdc.gov/flu/avianflu/novel-flu-infection-control.htm. Accessed 8 June 2018.

  28. Centers for Disease Control and Prevention. Interim Treatment Guidance for Central Nervous System and Parameningeal Infections Associated with Injection of Contaminated Steroid Products. 2012. See http://idrsinfo.org/pdfs/alerts/meningitis_treatGuidance_121006.pdf. Accessed 8 June 2018.

  29. Wallace GS, Seward JF, Pallansch MA, Centers for Disease C, Prevention. Interim CDC guidance for polio vaccination for travel to and from countries affected by wild poliovirus. MMWR Morb Mortal Wkly Rep. 2014;63(27):591–4.

    PubMed  PubMed Central  Google Scholar 

  30. Centers for Disease Control and Prevention. Interim Guidance on Case Definitions for Investigations of Human Infection with Avian Influenza A (H7N9) Virus in the United States. 2013. https://www.cdc.gov/flu/avianflu/h7n9/case-definitions.htm. Accessed 11 June 2018.

  31. Centers for Disease Control and Prevention. Supplemental Interim Guidance for School Administrators Associated with Possible Outbreaks of H3N2 Variant Influenza Virus (“H3N2v”). 2012. See https://www.cdc.gov/flu/swineflu/h3n2v-schools.htm. Accessed 7 June 2018.

  32. World Health Organization. Interim Guidance on the Use of Bedaquiline to Treat MDR-TB. 2014. See http://wwww.hoint/tb/challenges/mdr/bedaquiline/en/Read. Accessed 7 June 2018.

  33. National Institute for Health and Clinical Excellence. Colonoscopic Surveillance for Prevention of Colorectal Cancer in People with Ulcerative Colitis, Crohn's Disease or Adenomas. London: National Institute for Health and Clinical Excellence; 2011.

  34. Tan T, Shaw EJ, Siddiqui F, Kandaswamy P, Barry PW, Baker M, Guideline Development Group. Inpatient management of diabetic foot problems: summary of NICE guidance. BMJ. 2011;342:d1280.

    Article  PubMed  CAS  Google Scholar 

  35. Bennett MI, Graham J, Schmidt-Hansen M, Prettyjohns M, Arnold S, Guideline Development Group. Prescribing strong opioids for pain in adult palliative care: summary of NICE guidance. BMJ. 2012;344:e2806.

    Article  PubMed  Google Scholar 

  36. Walsh J, O'Flynn N. Diagnosis and assessment of food allergy in children and young people in primary care and community settings: NICE clinical guideline. Br J Gen Pract. 2011;61(588):473–5.

    Article  PubMed  PubMed Central  Google Scholar 

  37. National Institute for Health and Clinical Excellence. Organ Donation for Transplantation: Improving Donor Identification and Consent Rates for Deceased Organ Donation. London: National Institute for Health and Clinical Excellence; 2011. www.nice.org.uk/guidance/CG135. Accessed 7 June 2018.

  38. National Institute for Health and Clinical Excellence. Kidney Disease: Peritoneal Dialysis in the Treatment of Stage 5 Chronic Kidney Disease. London: National Institute for Health and Clinical Excellence; 2011. www.nice.org.uk/guidance/CG125. Accessed 7 June 2018.

  39. World Health Organization. Rapid Advice: Use of Antiretroviral Drugs for Treating Pregnant Women and Preventing HIV Infection in Infants. Version 2. Geneva: WHO; 2009.

  40. Centers for Disease Control and Prevention. Announcement: interim U.S. guidance for monitoring and movement of persons with potential Ebola virus exposure. MMWR Morb Mortal Wkly Rep. 2014;63(43):984.

    Google Scholar 

  41. Centers for Disease Control and Prevention. Interim guidance for Zika virus testing of urine - United States, 2016. MMWR Morb Mortal Wkly Rep. 2016;65(18):474.

    Article  Google Scholar 

  42. Fleischer DM, Sicherer S, Greenhawt M, Campbell D, Chan E, Muraro A, Halken S, Katz Y, Ebisawa M, Eichenfield L, et al. Consensus communication on early peanut introduction and prevention of peanut allergy in high-risk infants. Pediatr Dermatol. 2016;33(1):103–6.

    Article  PubMed  Google Scholar 

  43. Oster AM, Brooks JT, Stryker JE, Kachur RE, Mead P, Pesik NT, Petersen LR. Interim guidelines for prevention of sexual transmission of Zika virus - United States, 2016. MMWR Morb Mortal Wkly Rep. 2016;65(5):120–1.

    Article  PubMed  Google Scholar 

  44. Papageorghiou AT, Thilaganathan B, Bilardo CM, Ngu A, Malinger G, Herrera M, Salomon LJ, Riley LE, Copel JA. ISUOG interim guidance on ultrasound for Zika virus infection in pregnancy: information for healthcare professionals. Ultrasound Obstet Gynecol. 2016;47(4):530–2.

    Article  PubMed  CAS  Google Scholar 

  45. Rabe IB, Staples JE, Villanueva J, Hummel KB, Johnson JA, Rose L, Mts, Hills S, Wasley A, Fischer M et al. Interim guidance for interpretation of Zika virus antibody test results. MMWR Morb Mortal Wkly Rep 2016, 65(21):543–546.

  46. Staples JE, Dziuban EJ, Fischer M, Cragan JD, Rasmussen SA, Cannon MJ, Frey MT, Renquist CM, Lanciotti RS, Munoz JL, et al. Interim guidelines for the evaluation and testing of infants with possible congenital Zika virus infection - United States, 2016. MMWR Morb Mortal Wkly Rep. 2016;65(3):63–7.

    Article  PubMed  Google Scholar 

  47. World Health Organization. Interim Guidance on Breastfeeding in the Context of Zika Virus. Geneva: WHO; 2016.

    Google Scholar 

  48. Public Health Agency of Canada. Interim Syphilis Treatment Guidelines during the Benzathine Penicillin G (Bicillin L-A) Shortage 2016. 2016. www.phac-aspc.gc.ca/std-mts/sti-its/cgsti-ldcits/assets/pdf/syphilis-eng.pdf. Accessed 7 June 2018.

  49. National Institute for Health and Clinical Excellence. Tuberculosis: Clinical Diagnosis and Management of Tuberculosis, and Measures for its Prevention and Control 2011. London: National Institute for Health and Clinical Excellence; 2011.

  50. Bond S. Centers for Disease Control and Prevention issues interim guidelines for pregnant women and infants exposed to Zika virus and prevention of sexually transmitted Zika infection. J Midw Women’s Health. 2016;61(3):392–4.

    Article  Google Scholar 

  51. Centers for Disease Control and Prevention. Interim guidelines for investigation of and response to bacillus anthracis exposures. MMWR Morb Mortal Wkly Rep. 2001;50(44):987.

    Google Scholar 

  52. Centers for Disease Control and Prevention. Interim guidelines for the evaluation of infants born to mothers infected with West Nile virus during pregnancy. MMWR Morb Mortal Wkly Rep. 2004;53(7):154–7.

    Google Scholar 

  53. Scottish Intercollegiate Guidelines Network, Robin T. Harbour, and Lesley Forsyth. SIGN 50: A Guideline Developer's Handbook. Scottish Intercollegiate Guidelines Network. 2008. at http://www.sign.ac.uk/sign-50.html. Accessed 7 June 2018.

  54. Centers for Disease Control and Prevention. Guidelines and Recommendations: A CDC Primer. Atlanta: Office of the Associate Director for Science Centers for Disease Control and Prevention; 2012.

    Google Scholar 

  55. Schünemann HJ, Hill SR, Kakad M, Vist GE, Bellamy R, Stockman L, Wisloff TF, Del Mar C, Hayden F, Uyeki TM, et al. Transparent development of the WHO rapid advice guidelines. PLoS Med. 2007;4(5):e119.

    Article  PubMed  PubMed Central  Google Scholar 

  56. National Institute for Health and Clinical Excellence. The Guidelines Manual. London: NICE; 2012.

    Google Scholar 

  57. National Collaborating Centre for Cancer. Opioids in Palliative Care: Safe and Effective Prescribing of Strong Opioids for Pain in Palliative Care of Adults. 2012.

    Google Scholar 

  58. Ganann R, Ciliska D, Thomas H. Expediting systematic reviews: methods and implications of rapid reviews. Implement Sci. 2010;5(1):56.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Schünemann HJ, Moja L. Reviews: rapid! Rapid! Rapid! ...And systematic. Syst Rev. 2015;4(1):4.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Butler G, Deaton S, Hodgkinson J, Holmes E, Marshall S. Quick but not dirty: rapid evidence assessments as a decision support tool in social policy. London: Government Social Research Unit; 2005.

    Google Scholar 

  61. Watt A, Cameron A, Sturm L, Lathlean T, Babidge W, Blamey S, Facey K, Hailey D, Norderhaug I, Maddern G. Rapid reviews versus full systematic reviews: an inventory of current methods and practice in health technology assessment. Int J Technol Assess Health Care. 2008;24(2):133–9.

    Article  PubMed  Google Scholar 

  62. Woolf S, Schunemann HJ, Eccles MP, Grimshaw JM, Shekelle P. Developing clinical practice guidelines: types of evidence and outcomes; values and economics, synthesis, grading, and presentation and deriving recommendations. Implement Sci. 2012;7:61.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Papanikolaou GN, Baltogianni MS, Contopoulos-Ioannidis DG, Haidich AB, Giannakakis IA, Ioannidis JP. Reporting of conflicts of interest in guidelines of preventive and therapeutic interventions. BMC Med Res Methodol. 2001;1(1):3.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  64. Schünemann HJ, Fretheim A, Oxman AD. Improving the use of research evidence in guideline development: 1. Guidelines for guidelines. Health Res Policy Syst. 2006;4:1.

    Article  Google Scholar 

  65. Gagliardi AR, Brouwers MC. Integrating guideline development and implementation: analysis of guideline development manual instructions for generating implementation advice. Implement Sci. 2012;7:67.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Shekelle P, Woolf S, Grimshaw JM, Schunemann HJ, Eccles MP. Developing clinical practice guidelines: reviewing, reporting, and publishing guidelines; updating guidelines; and the emerging issues of enhancing guideline implementability and accounting for comorbid conditions in guideline development. Implement Sci. 2012;7:62.

    Article  PubMed  PubMed Central  Google Scholar 

  67. World Health Organization. WHO Best-Practice Statement on the Off-Label Use of Bedaquiline and Delamanid for the Treatment of Multidrug-Resistant Tuberculosis. Geneva: WHO; 2017.

    Google Scholar 

Download references

Acknowledgements

Dr Susan L. Norris, World Health Organization, Geneva, Switzerland, contributed to the design of this study and to its implementation.

Funding

This research was supported by McMaster University internal research funds.

Availability of data and materials

The datasets during and/or analysed during the current study available from the corresponding author on reasonable request.

Author information

Author notes

  1. Sergio C. Kowalski and Rebecca L. Morgan contributed equally to this work.

Authors and Affiliations

  1. Department of Health Research Methods, Evidence and Impact and Mac GRADE Center, McMaster University Health Sciences Centre, Room 2C16, 1280 Main Street West, Hamilton, ON, L8N 4K1, Canada

    Sergio C. Kowalski, Rebecca L. Morgan, Iván D. Florez, Itziar Etxeandia-Ikobaltzeta, Wojtek Wiercioch, Yuan Zhang, Liudmila Ivanova, Nancy Santesso & Holger J. Schünemann

  2. Department of Internal Medicine, Division of Rheumatology- Universidade Federal do Paraná, R. Gen. Carneiro, 181, Curitiba, PR, Brazil

    Sergio C. Kowalski

  3. Hospital Moinhos de Vento, Porto Alegre, Brazil

    Maicon Falavigna

  4. National Institute of Science and Technology for Health Technology Assessment, Federal University of Rio Grande do Sul, Porto Alegre, Brazil

    Maicon Falavigna

  5. Department of Pediatrics, University of Antioquia, Cra. 51D #62-29, Medellin, 050001, Colombia

    Iván D. Florez

  6. Public Health & Preventive Medicine Residency Program (including Family Medicine), McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4L8, Canada

    Faria Sakhia

  7. Cochrane Canada Center, McMaster University, Health Sciences Centre, Room 2C14, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada

    Nancy Santesso & Holger J. Schünemann

  8. Department of Medicine, McMaster University, Health Sciences Centre, Room 2C14, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada

    Holger J. Schünemann

Authors
  1. Sergio C. Kowalski
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rebecca L. Morgan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Maicon Falavigna
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Iván D. Florez
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Itziar Etxeandia-Ikobaltzeta
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Wojtek Wiercioch
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Yuan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Faria Sakhia
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Liudmila Ivanova
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Nancy Santesso
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Holger J. Schünemann
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

MF and HS designed and conceived the study. NS, MF, II and HS developed search strategies and provided workflow suggestions. MF, II, YZ, FS, SK, WW, LI and IF conducted the systematic survey. MF and SK analysed the data. SK, RM, MF and HS wrote and revised the manuscript. HS provided key institutional support and funding. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Holger J. Schünemann.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Appendix 1. Protocol. Appendix 2. Search strategies. Appendix 3. List of predefined societies for manual search. Appendix 4. PRISMA Checklist. (DOCX 627 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kowalski, S.C., Morgan, R.L., Falavigna, M. et al. Development of rapid guidelines: 1. Systematic survey of current practices and methods. Health Res Policy Sys 16, 61 (2018). https://doi.org/10.1186/s12961-018-0327-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12961-018-0327-8

Keywords

Health Research Policy and Systems

ISSN: 1478-4505

Contact us