Skip to main content

Development of rapid guidelines: 3. GIN-McMaster Guideline Development Checklist extension for rapid recommendations

Abstract

Background

Practice guidelines require a substantial investment of resources and time, often taking between 1 and 3 years from conceptualisation to publication. However, urgent situations require the development of recommendations in a shorter timeframe. In this third and final article in the series exploring challenges and solutions in developing rapid guidelines (RGs), we propose guiding principles for the development of RGs.

Methods

We utilised the Guideline International Network-McMaster Guideline Development Checklist (GDC) as a starting point for elements to consider during RG development. We built on those elements using the findings from a systematic review of guideline manuals, a survey of international organisations conducting RGs, and interviews of guideline developers within WHO. We reviewed initial findings and developed an intermediate list of elements, as well as narrative guidance. We then invited experts to validate the intermediate list, reviewing for placement, brevity and redundancy. We used this iterative process and group consensus to determine the final elements for RG development guidance.

Results

Our work identified 21 principles within the topics of the Guideline International Network-McMaster GDC to guide the planning and development of RGs. Principles fell within 15 of the 18 checklist topics, highlighting strategies to streamline and expedite the guideline development process.

Conclusions

We defined principles to guide the development of RGs, while maintaining a standardised, rigorous and transparent process. These principles will serve as guidance for guideline developers responding to urgent situations such as public health urgencies. Integration of these principles within currently disseminated guideline development standards will facilitate the use of those tools in situations necessitating RG recommendations.

Peer Review reports

Background

Healthcare guidelines are statements that include recommendations intended to optimise healthcare, whether at the clinical, public health or health policy levels. They should be informed by a systematic review of evidence and an assessment of the desirable and undesirable consequences of alternative care options [1]. Practice guideline (PG) development can be a resource intensive and a time consuming process. The development timeframe of PGs vary across organisations, often ranging from 1 to 3 years [2,3,4]. These timeframes are not realistic for situations requiring immediate decisions and urgent recommendations, including situations of emerging infectious diseases, disasters and new evidence with a potentially vast health impact.

Organisations have adopted rapid guideline (RG) processes to shorten development timeframes. RGs can provide useful guidance and be conducted in an evidence-based and transparent manner [5]. One approach to expedite the guideline development process is to increase the resources (human or financial) and perform the standard amount of work in a shorter timeframe; unfortunately, however, increasing resources is not an option in most cases. A simple approach is to reduce the amount of work by narrowing the guideline scope to one or few recommendations, yet not many topics lend themselves to inform users sufficiently with single recommendations [6]. A further approach is to use shortcuts in the development process. The challenge is in identifying the shortcuts that have minimal impact on validity or credibility of the guideline produced rapidly. For example, using unsystematically identified evidence is likely to impact the validity and credibility of the guideline.

Guideline developers using shortcuts would need to maintain some ‘essential elements’ of the process to ensure highly credible recommendations. To date, there is no systematically developed guidance of which elements of the process are essential when developing RGs. In 2014, we developed the Guideline International Network (GIN)-McMaster Guideline Development Checklist (GDC) (http://heigrade.mcmaster.ca/home) [7], which is organised into 146 elements across 18 topics addressing all stages of the guideline enterprise from planning, to implementation and evaluation [7].

The objective of this article was to develop an extension of the GDC for RG development. This is the third and final article in the series on exploring challenges in developing RGs. In the prior two articles of this series, we systematically surveyed the current practices on RG development [8] and the perception of guideline developers at WHO about RG development processes [9].

Methods

We adopted the WHO definition of RGs, as guidelines completed within a 1- to 3-month timeframe to provide guidance in response to an emergency, urgent need or new evidence [4, 10]. Interim guidelines refer to guidelines provided when new interventions, exposures or diseases arise, or new evidence becomes available or data are likely to be incomplete. Full guidelines provide complete coverage (e.g. surveillance, diagnosis, public health, and clinical interventions) of a health topic or disease. We use the classification included in that definition of the RG process throughout this series on RG development [8, 9].

We followed a four-step process to generate a list of guiding elements for RG development, involving (1) systematic survey of manuals and published RGs from international guideline development organisations [8]; (2) interviews to examine the perceptions and experiences of guideline developers at WHO [9]; (3) qualitative analysis of the results of the systematic survey and interviews; and (4) validation and alignment of the guiding elements with the GDC topics. Based on these previous studies [8, 9], the final qualitative analysis, and the GIN-McMaster GDC, we provide practical guidance for how to overcome challenges in RG development.

Qualitative analysis of the results of the systematic review and interviews

We utilised the GDC as a starting point for elements to specifically consider in RG development [7]. One reviewer (RM) extracted an initial list of elements based on the results of the systematic survey and interviews into an Excel database. A second reviewer (IF) reread the documents and extracted additional elements. Reviewers included elements that identified gaps in published RGs or methods to improve, streamline, or standardise the RG development process. During this initial review, we focused on creating a comprehensive and inclusive list of RG-related elements. Reviewers organised these elements into exhaustive lists under the most relevant topics provided by the GDC [8, 9]. The reviewers discussed placement of elements within GDC topics to reach consensus.

Identification of guiding elements

A small team (IF, RM, HS) then appraised the initial list of elements for order, brevity and redundancy, and prepared an intermediate table (Table 1). Elements included in the intermediate table reflected elements identified in the systematic survey as distinct to rapid guidelines, all distinct elements from qualitative interviews, and additional elements identified during the validation process.

Table 1 Intermediate table of elements identified from the systematic survey, interviews and validation process

We changed the placement of some elements to different topics within the GDC. For example, we initially placed ‘Consider the resources (both time and financial) needed and available for conducting the systematic review’ within Topic 1: Organisation, Budget, Planning and Training; however, since this item refers specifically to the development of the systematic review used to inform the RG, we reordered it to Topic 10: Deciding what evidence to include and searching for evidence. Modifications to improve brevity and reduce redundancy among the list included grouping ‘Consider involving a health economist’ and ‘Involve representative from the clearance process to expedite review of final document’ within guidance for the composition of a guideline oversight committee. Similarly, if two or more elements represented the same theme, we combined them into one. For example, the interviews identified seven distinct rationales that might provide the impetus for developing RGs, namely (1) new evidence about efficacy; (2) new evidence about cost-effectiveness; (3) new evidence about safety; (4) pressure from country members of WHO; (5) the need to provide advice; (6) the need to respond to public opinion; and (7) emergent or dangerous situations (e.g. epidemic of an infectious disease, the management or control of biological, chemical or radioactive hazards). We recognised the overarching theme as clearly defining the motivation for developing an RG, which includes the situations listed previously. When we did not identify elements for any of the topics, we noted it in the table. For each element, we narratively listed the most closely relatable overarching topic from the GDC, and provided clarification and guidance to facilitate understanding and implementation in practice.

Validation of elements

Using an iterative approach, we shared these elements and narrative descriptions with other authors (EA, KT, AR) to validate the assessments made. They assessed placement of the elements within the GDC topics, improving brevity and reducing redundancy, and suggested additional elements for inclusion in GDC topics. Additionally, they reviewed narrative guidance about RG elements and provided suggestions to increase clarity and utility when implemented into practice. We then described the overarching principles of RGs according to the GDC topics.

Results

Of the 32 elements identified from the qualitative analysis of the results of the systematic review and interviews, we selected 21 discrete guiding principles for planning or developing RGs. We linked these principles in the topics identified in the GIN-McMaster GDC [7]. Table 2 lists the final principles for RG development identified from the systematic survey, interviews and validation process organised by the topics from the GDC.

Table 2 Final principles for the extension of the Guideline Development Checklist (GDC) for rapid guidelines (RGs)

Guiding principles

Principle 1 (Topic 1: Organisation, budget, planning and training)

Define the amount of time available for development of the RG and the elements from the GDC that should be followed.

The quality of the RG is influenced by several considerations about the organisation, budget and planning. If enough financial and human resources are available or could be mobilised, then the guideline developer should consider conducting the work expected for a full systematic review or guideline within an expedited timeframe. If financial or human resource constraints exist, guideline developers should be pragmatic and consider using abbreviated methods to meet the timeframe in which the RG is needed. A detailed protocol of the guideline (item 11 on the GDC) may be omitted when the organisation has established guideline methods in place. In the extreme case of an emergent or dangerous situation requiring an immediate response, the time constraints may define the type of RG possible.

Principle 2 (Topic 1: Organisation, budget, planning and training)

Develop RG-related standard operating procedures, develop templates for RGs, identify peer reviewers early on and plan panel meetings as early as possible.

Plan ahead to facilitate the RG-development process. Some aspects of the process that can be developed internally to prepare for situations that necessitate RGs include the development of standard operating procedures and templates for use. Peer reviewers of the final document can be identified early in the RG development process, as can the dates of the panel meetings. Both of these strategies allow for the coordination of schedules and may lead to greater availability of peer reviewers and panel member participation.

Principle 3 (Topic 2: Priority-setting)

Define the rationale motivating the RG (e.g. new and recommendation-changing evidence about efficacy/cost-effectiveness/safety, emergent/dangerous situations, etc.)

The developers should clearly state the rationale for why an RG is needed instead of a routine guideline. Suggested categories, based on findings from the systematic review and survey and interviews with WHO personnel [8, 9] for the rationale include (1) emergent and dangerous situations (e.g. epidemic of an infectious disease, the management or control of biological, chemical or radioactive hazards); (2) new and recommendation-changing evidence about safety; (3) new and recommendation-changing evidence about efficacy that could change current knowledge or practice; and (4) new and recommendation-changing evidence about cost-effectiveness. The latter reasons may require less need for RGs. However, pressure from communities or jurisdictions for rapid guidance may stem from any of the rationales listed above, or lead to the need for advice or response to public opinion. The involvement of all relevant stakeholders (Topic 3 on the GDC) will often not be feasible and requires abbreviated processes. In the case of an early response to an emergent issue (e.g. a spill), RGs are likely to be more conservative or health protective because of the overwhelming value of protecting public health in the short term (e.g. can justify removing people from their homes for a few days or weeks, but difficult to keep them out for months or years from a spill).

Principle 4 (Topic 2: Priority-setting)

Address whether there is a need for temporary and/or emergency guidance.

Decide whether interim guidance is needed before a RG becomes available. If yes, include the development of temporary guidance or rapid guidance in the planning documents. In emergency situations, an iterative process of following emergency or urgent guidance with a RG or full guideline may be required.

Principle 5 (Topic 3: Guideline group membership)

Involve relevant individuals in the guideline oversight committee.

Including a member of the institution’s clearance process in the guideline oversight committee to make sure that institutional requirements are met. If expertise is restricted to those involved in dealing with the emergency (e.g. human infection with the avian influenza virus), involve those experts early on and throughout.

Principle 6 (Topic 3: Guideline group membership)

Develop a database of topic-specific experts by area of expertise to consult when establishing the guideline oversight committee.

A database of external experts organised by area of expertise may expedite the identification of panel members and peer reviewers for the RG development process. Care should be taken to vary participation of identified external experts by RGs and continue to add to the database in preparation for future RGs.

Principle 7 (Topic 4: Establishing guideline group processes)

When the timelines are short, greater emphasis should be placed on using virtual meetings (alone or along with face-to-face meetings).

Virtual meetings may shorten the time needed for organisational planning. In addition, if cost is an issue, e.g. due to the urgency of the situation or existing organisational budgets, virtual meetings may provide an economical alternative. Virtual meetings may allow panels to meet more often and for a shorter time. However, virtual meetings may compromise the participation of some guideline panel members. Face-to-face meetings require logistics that can be handled rapidly, e.g. by established organisations.

Principle 8 (Topic 5: Identifying target audience and topic selection)

Alert the target audience to the RG before release.

During the RG development process, alerting the target audience to the upcoming RG may increase stakeholder involvement in the development, review, dissemination and uptake of the RG.

Principle 9 (Topic 7: Conflicts of interest (COI) considerations)

RG guideline development panels may need a rapid process for implementing COI policies.

Organisations with time consuming approaches to COI declaration and management might need to restrict panel membership to those not reporting direct financial COIs. However, when making RGs for urgent situations or on new interventions, participation from individuals with the most topic-specific expertise who have a financial or academic conflict may be unavoidable. The organisation would need to declare any modifications to their COI policies dictated by the need to conduct the RG.

Principle 10 (Topic 8: PICO question generation)

RGs should address a limited number of questions.

The development of PICO questions should reflect the resource limitations outlined in the planning process, including improving the precision of the PICOs and/or limiting the number of PICOs. A guideline with a limited number of questions would require fewer resources, by expediting the evidence review. Similarly, the scope of the guideline can be reduced by narrowing the target audience. It is important to establish an adequate process for question prioritisation in order to make sure the most appropriate questions are covered by the guideline. Distinguishing a single rapid recommendation from a guideline containing several recommendations to provide adequate coverage of a topic may be important. The former is suitable for very few situations, e.g. a new intervention for a narrow problem [6], while the latter often provides more practical, yet focused coverage of a topic, e.g. an emerging problem that may be addressed by multiple interventions [11, 12]. Guideline developers should document the processes of topic and question selection for the guideline to ensure transparency. In emergent or dangerous situations, information is needed to determine the extent of the research question to acutely focus the RG.

Principle 11 (Topic 9: Considering importance of outcomes and interventions, values, preferences and utilities)

Outcome prioritisation process for each PICO should be brief.

In addition to limiting the scope and number of PICOs, outcomes assessed to inform decision-making should be limited to include only those deemed critical, especially in situations where outcomes are informed by distinct systematic reviews. If outcomes assessed are reduced, make sure that they still address both benefits and harms. An iterative process is effective at developing the list of critical outcomes. First, panel members decide what information is needed to respond to the emergency, considering both the exposure and health effects. Based on the available information, determine the estimated time to collect missing information to inform the critical outcomes. In some emergent or dangerous situations, such as a chemical spill, some outcomes may be prescriptive given the information needed to inform decisions concerning the public.

Principle 12 (Topic 9: Considering importance of outcomes and interventions, values, preferences and utilities)

Information on patients’ values and preferences can be informed by multiple methods, such as qualitative literature or patient advocacy groups.

Patients’ values and preferences are crucial for the development of recommendations. Their point of view may be assessed through different strategies such as including patient member representatives in the discussion or performing systematic reviews of utilities. In emergency situations of chemical spills or outbreaks, the impacted population may be represented on the panel by a community member or spokesperson. Assessing patients’ values and preferences indirectly through published literature or guideline members’ opinion may be a time- and resource-saving strategy. In situations of RG, qualitative literature and the panel members’ surrogate values and preferences may be used if they are directly related to the relative importance of the outcomes that are considered critical for decision-making.

Flexibility of methods for ascertaining patients’ values and preferences may allow resources to be allocated for other steps of guideline development. Ensure that panel members have suitable clinical and field experience in order to adequately provide patients’ point of the view.

Principle 13 (Topic 10: Deciding what evidence to include and searching for evidence)

Consider the resources (both time and financial) needed and available when defining the process for conducting the systematic review. Scoping or rapid reviews may inform eligibility criteria and prioritisation.

Similar to the process of resource consideration when determining the comprehensiveness of the RG, available time and labour will influence the quality of the systematic review. If time and budget constraints exist, consider abbreviated methods for updating existing systematic reviews, such as utilising previously published systematic reviews, rapid reviews or tailored search criteria to define smaller searches [13]. Performing scoping or rapid reviews on the RG topic may inform realistic objectives and eligibility criteria for the RG. In addition, these reviews may inform the prioritisation of topics for an RG or topics that could be considered later in the process.

RGs should be based on systematic reviews; however, the focus may be placed on identifying relevant existing, highly credible, and up-to-date systematic reviews with targeted updates as necessary. Similarly, previously published guidelines can be assessed for quality and either updated, if new evidence is available, or ‘adoloped’ (adopted or adapted) to the target environment [14]. ‘Adolopment’ describes an effective model to avoid redundancies in the guideline development process. Developers consider the potential of certain strategies in the following order: (1) verbatim adoption of the current guideline for the target setting; (2) adaptation of the guidelines for the target setting; or (3) de novo development of guidelines for situations in which guidelines either do not exist or are too indirect for application in the target setting [14]. For emergent or dangerous situations, if an existing systematic review is not available, ensure that the methods used to identify and appraise the evidence are transparently described [5]. Additionally, when the RG is iterative, clearly describe how further review of information impacts initial RG outcome or guidance.

In situations without relevant existing systematic reviews, developers should conduct rapid systematic reviews. When deciding what evidence to include and the process of searching for evidence, steps to reduce the amount of results, such as focused database searches, may be appropriate. For example, limiting the language of the article search to English may reduce the volume of articles to review, and time and resources to conduct translations. Similarly, developers can limit the search to only peer-reviewed articles instead of also including grey or unpublished literature.

Principle 14 (Topic 11: Summarising evidence and considering additional information)

Relevant primary studies and evidence solicited from experts may be used to inform ‘additional information’ in the evidence-to-decision table.

Principle 15 (Topic 13: Developing recommendations and determining their strength)

Use pre-meeting voting and virtual meetings to expedite the decision-making process.

Pre-voting on domain judgments within the evidence-to-decision table by panel members and synthesis of responses by the methodologist or subject-matter chair can identify consensus among panel members without any further need of discussion or dissonance requiring additional discussion. The strength and direction of recommendations can be decided using virtual panel meetings (e.g. with GRADE’s software GRADEpro, https://gradepro.org/).

Principle 16 (Topic 14: Wording of recommendations and of considerations about implementation, feasibility and equity)

Finalise the wording of the final recommendations during the panel meeting(s).

Finalising the wording of the recommendations during the panel meeting when the evidence is assessed and recommendations developed may streamline drafting the final document. Standardised wording to represent the strength and direction of the recommendations exists to facilitate this process [15]. Preparing draft recommendations by the organiser will reduce the time needed but requires buy-in by guideline panel members into the approach used.

Principle 17 (Topic 15: Reporting and peer review)

Define and transparently record the process used when evidence is determined to be limited.

To maintain transparency in the final document and inform subsequent iterations of RGs and development of the PG, developers should present details of the systematic review and evidence-assessment process.

Principle 18 (Topic 15: Reporting and peer review)

Expedited options for internal and external review of the RG should be explored, and if deemed possible, the process should be outlined in the RG.

Peer review of RGs is critical to the process; however, steps may be taken to expedite the process. For instance, by making arrangements and setting up deadlines with reviewers early on in the process of RG development. Transparency of the methods used for peer review should be maintained by documenting the process in the final document.

Principle 19 (Topic 16: Dissemination and implementation)

RG implementation strategy should reflect the scope of the PICO.

Similar to the precise definition of the target audience, the implementation strategy should reflect considerations of feasibility, focusing efforts on the target audience identified by the guideline scope.

Principle 20 (Topic 16: Dissemination and implementation)

RGs should outline and address any potential obstacles to implementation.

When describing dissemination and implementation in RGs, potential obstacles should be identified and addressed. These obstacles may require different strategies based on the objectives and rationale for the development of the RG. Examples of potential obstacles include the lack of availability of interventions, such as drugs or temperature-controlled supply chains required to maintain the efficacy of vaccines or treatment, in some countries.

Principle 21 (Topic 18: Updating)

When developing an interim guideline, the date for when the RG or full PG will be conducted should be defined. If developing an RG, the date for when the full PG will be conducted should be defined.

As part of outlining a strategy for how and when an update or a guideline revision will be needed, for interim guidance or RGs, a clearly defined timeline and date for when the full PG will be conducted should be provided in the document. This recognises that interim guidance and RGs are conducted under an expedited or consolidated process and additional evidence and thorough review may increase the certainty of the recommendation. In an emergent or dangerous situation, RG updates may be disseminated as ‘staged releases’ in the following order: (1) the first action/release is to protect public health, and respond to the crisis or spill that is heavily weighted to protect against worst-case scenario; and (2) the second release, based on new and additional information will address planned updates and change in values.

Discussion

In this article, we summarise principles for the expansion of the GIN-McMaster GDC to the development of RGs. The principles are based on the GIN-McMaster GDC and informed by a systematic review of developed RGs and qualitative research [8, 9]. Guidance for development of systematic reviews in an abbreviated time without compromising rigor can be found in previously published literature [13]. Additionally, we recently described solutions to retain transparency and rigor in assessing the certainty of evidence when providing emergency, rapid or urgent guidance [5].

Apart from the information and the recommendations provided by the National Institute for Clinical Excellence [3], WHO [4] and the United States Centers for Disease Control and Prevention [16] handbooks, to date, there is no specific guidance of how to develop a RG nor a minimum set of elements that should be considered when doing so. In the prior articles of this series, we summarise the recommendations by these organisations and gained understanding of the perceptions about the development process and barriers from WHO developers [8, 9]. Therefore, we are confident that these results reflect the reality of the process and these elements will be useful and applicable in future processes.

The addition of the GIN principles for disclosing and managing COI make for a more comprehensive package of guideline development procedures and considerations [17]. These elements provide guidance for when urgent situations necessitate the development of guidelines in a shortened timeframe. These elements serve as the minimum set of standards (i.e. irreducible minimum of work) required and are intended for use by guideline developers to plan and track the process of RG development as a complementary tool or a manual for guideline development of the original Guideline 2.0 checklist, now called the GIN-McMaster GDC [7].

While full guidelines remain the gold standard in guideline development, RGs are often necessary to provide important evidence-based guidance in times of urgency and emergency. In emergent or dangerous situations, RGs may have unique considerations such as staged roll-out plans or involvement of different stakeholders. By building on the guiding principles for both the development of guidelines and disclosure of interests and management of conflicts in guidelines, these elements for the development of RGs will help in maintaining a systematic, rigorous and transparent process. Adoption and implementation of these elements encourages consistency and standardisation among researchers and organisations tasked with the development of RGs.

One key factor in the process of RG development is the conduct or use of a systematic review. This step is the core of any guideline development, and frequently one of the most time-consuming steps. In our analysis of the perceptions of RG developers in WHO [9], it was identified as the ‘Achilles heel’, because its quality could be negatively affected by the need to reduce time. Efforts to make the systematic review process more efficient while maintaining its quality should be part of any RG enterprise. Although recommendations exist about how and when to develop rapid reviews [13, 18, 19], this is still an area of further research, and improvements in this field will directly impact the RG process.

When developing recommendations in response to emergencies, it is challenging to reduce the time for development while maintaining methodological rigor, transparency, participative process and implementability of recommendations. Our principles may be useful for individuals and organisations with varying levels of experience in RGs interested in developing or implementing a systematic processes to develop recommendations in short time periods to respond to specific urgent scenarios. Having an available roadmap can make the decision-making process easier at the global, national, regional or local levels. In addition to its usefulness for the developer, this guidance provides an opportunity help policy-makers assess the completeness of a RG document that they intend to use.

While this paper focuses on the development of RGs, organisations could also consider using published guidelines, which would involve assessing those guidelines for their currency, quality, and relevance to the question(s) of interest. Based on this assessment, the organisation might decide to adapt as is, adolop or redevelop the guidelines [14]. Additionally, we do not yet address the development of emergency guidance, where timelines are too short to allow for conduct of systematic reviews of the literature. Such process could still benefit from some the principles described above such as using a systematic and transparent approach and involving experts on an emergency basis [5].

Similar to the principles of the GIN-McMaster GDC, the publication and dissemination of this extension for RGs will allow to solicit feedback from users to inform its revisions, updates and adaptations [14]. These reviews and revisions contribute to the continued validation of the checklist by confirming or refuting checklist elements. This represents an efficient way to gain insights about the properties of the GDC, as we did not identify other reference against which to validate.

Strengths and limitations

The development of these principles is based on the results from a comprehensive systematic survey of guidelines and methods by the most influential organisations that produce RGs globally [8]. In addition, we conducted in-depth interviews with key RG developers at the WHO that allowed us to have a better understanding of their perceptions about RGs in the context of public health emergencies and special scenarios commonly faced by this organisation [9]. These two studies provided empirical evidence validating the development of these RG elements. In addition, evaluation of the preliminary checklist confirmed the inclusion and placement of items for the final RG development checklist.

Among the possible limitations, we should mention that we do not propose differential weight to the elements. Hence, we cannot indicate which elements are more important than others, and developers and readers should make those choices based on the context and their specific scenario.

Conclusions

Our guiding principles represent a comprehensive list of considerations during the development of RGs and an expansion to the GDC. Although these principles aim to address all stages in the RG guideline process, there are several areas for which further guidance is needed. Additionally, this paper can be used as a set of principles by which to evaluate RGs relative to the standard process. Future work will focus on validating these elements, obtaining additional feedback from RG developers and keeping this checklist up to date.

Abbreviations

COI:

Conflicts of interest

GDC:

Guideline Development Checklist

GIN:

Guideline International Network

PG:

practice guideline

RG:

rapid guideline

References

  1. Steinberg E, Greenfield S, Mancher M, Wolman DM, Graham R. Clinical Practice Guidelines We Can Trust. Washington: National Academies Press; 2011.

  2. Scottish Intercollegiate Guidelines Network. SIGN 50: A Guideline Developers' Handbook. Edinburgh: Scottish Intercollegiate Guidelines Network; 2008.

  3. National Institute for Health and Clinical Excellence. The Guidelines Manual. London: NICE; 2012.

    Google Scholar 

  4. World Health Organization. WHO Handbook for Guideline Development. Geneva: WHO; 2014.

    Google Scholar 

  5. Thayer KA, Schünemann HJ. Using GRADE to respond to health questions with different levels of urgency. Environ Int. 2016;92-93:585–9.

    Article  PubMed  Google Scholar 

  6. Report of the Guideline Development Group Meeting on the use of bedaquiline in the treatment of multidrug-resistant tuberculosis, A review of available evidence. Geneva: World Health Organization; 2017. Licence: CC BY-NC-SA 3.0 IGO; 2016.

  7. Schünemann HJ, Wiercioch W, Etxeandia I, Falavigna M, Santesso N, Mustafa R, Ventresca M, Brignardello-Petersen R, Laisaar KT, Kowalski S, et al. Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise. CMAJ. 2014;186(3):E123–42.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Kowalski SC, Morgan RL, Falavigna M, Etxeandia-Ikobaltzeta I, Wiercioch W, Zhang Y, Sakhia F, Ivanova L, Santesso N, Florez ID, et al. Development of rapid guidelines: 1. Systematic survey of current practices and methods. Health Res Policy Syst. https://doi.org/10.1186/s12961-018-0327-8.

  9. Florez ID, Morgan RL, Falavigna M, Kowalski SC, Zhang Y, Etxeandia-Itzeandia I, Santesso N, Wiercioch W, Schünemann HJ. Development of rapid guidelines: 2. Interviews with World Health Organization (WHO) guideline developers. Health Res Policy Syst. https://doi.org/10.1186/s12961-018-0329-6.

  10. Garritty CM, Norris SL, Moher D. Developing WHO rapid advice guidelines in the setting of a public health emergency. J Clin Epidemiol. 2017;82:47–60.

    Article  PubMed  Google Scholar 

  11. Schunemann HJ, Hill SR, Kakad M, Bellamy R, Uyeki TM, Hayden FG, Yazdanpanah Y, Beigel J, Chotpitayasunondh T, Del Mar C, et al. WHO rapid advice guidelines for pharmacological management of sporadic human infection with avian influenza a (H5N1) virus. Lancet Infect Dis. 2007;7(1):21–31.

    Article  PubMed  CAS  Google Scholar 

  12. Schunemann HJ, Hill SR, Kakad M, Vist GE, Bellamy R, Stockman L, Wisloff TF, Del Mar C, Hayden F, Uyeki TM, et al. Transparent development of the WHO rapid advice guidelines. PLoS Med. 2007;4(5):e119.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Schünemann HJ, Moja L. Reviews: rapid! Rapid! Rapid! ...And systematic. Syst Rev. 2015;4(1):4.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Schünemann HJ, Wiercioch W, Brozek J, Etxeandia-Ikobaltzeta I, Mustafa RA, Manja V, Brignardello-Petersen R, Neumann I, Falavigna M, Alhazzani W, et al. GRADE evidence to decision (EtD) frameworks for adoption, adaptation, and de novo development of trustworthy recommendations: GRADE-ADOLOPMENT. J Clin Epidemiol. 2017;81:101–10.

    Article  PubMed  Google Scholar 

  15. Akl EA, Guyatt GH, Irani J, Feldstein D, Wasi P, Shaw E, Shaneyfelt T, Levine M, Schünemann HJ. “Might” or “suggest”? No wording approach was clearly superior in conveying the strength of recommendation. J Clin Epidemiol. 2012;65(3):268–75.

    Article  PubMed  Google Scholar 

  16. Centers for Disease Control and Guidelines and Recommendations. A CDC Primer. Atlanta: Office of the Associate Director for science centers for disease control and Prevention; 2012.

    Google Scholar 

  17. Schünemann HJ, Al-Ansary LA, Forland F, Kersten S, Komulainen J, Kopp IB, Macbeth F, Phillips SM, Robbins C, van der Wees P. Guidelines international network: principles for disclosure of interests and management of conflicts in guidelines. Ann Intern Med. 2015;163(7):548–53.

    Article  PubMed  Google Scholar 

  18. Khangura S, Konnyu K, Cushman R, Grimshaw J, Moher D. Evidence summaries: the evolution of a rapid review approach. Syst Rev. 2012;1(1):10.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Hartling L, Guise J, Hempel S, Featherstone R, Mitchell M, Motu'apuaka M, Robinson K, Schoelles K, Totten A, Whitlock E. EPC Methods: AHRQ End-User Perspectives of Rapid Reviews. Research White Paper. Rockville (MD): Agency for Healthcare Research and Quality; 2016.

    Google Scholar 

Download references

Funding

This research was supported by McMaster University internal research funds.

Availability of data and materials

The datasets produced and/or analysed during the current study are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

Authors

Contributions

RM, IF, MF, SK and HS designed and conceived the study. RM and IF conducted the analysis. EA, KT, AR and HS validated the data. RM, IF and HS wrote and revised the manuscript. HS provided key institutional support. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Holger J. Schünemann.

Ethics declarations

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Morgan, R.L., Florez, I., Falavigna, M. et al. Development of rapid guidelines: 3. GIN-McMaster Guideline Development Checklist extension for rapid recommendations. Health Res Policy Sys 16, 63 (2018). https://doi.org/10.1186/s12961-018-0330-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12961-018-0330-0

Keywords