Skip to main content

Public health research priorities for WHO on COVID-19 in the South-East Asia Region: results of a prioritization survey

Abstract

Background

Effectively addressing the coronavirus disease 2019 (COVID-19) pandemic caused by the new pathogen requires continuous generation of evidence to inform decision-making. Despite an unprecedented amount of research occurring globally, the need to identify gaps in knowledge and prioritize a research agenda that is linked to public health action is indisputable. The WHO South-East Asia Region (SEAR) is likely to have region-specific research needs.

Methods

We aimed to identify a priority research agenda for guiding the regional and national response to the COVID-19 pandemic in SEAR countries. An online, anonymous research prioritization exercise using recent WHO guidance was conducted among the technical staff of WHO’s country and regional offices engaged with the national COVID-19 response during October 2020. They were each asked to contribute up to five priority research ideas across seven thematic areas. These research ideas were reviewed, consolidated and scored by a core group on six parameters: regional specificity, relevance to the COVID-19 response, feasibility within regional research capacity, time to availability for decision-making, likely impact on practice, and promoting equity and gender responsiveness. The total scores for individual suggestions were organized in descending order, and ideas in the upper tertile were considered to be of high priority.

Results

A total of 203 priority research ideas were received from 48 respondents, who were primarily research and emergency response focal points in country and regional offices. These were consolidated into 78 research ideas and scored. The final priority research agenda of 27 items covered all thematic areas—health system (n=10), public health interventions (n=6), disease epidemiology (n=5), socioeconomic and equity (n=3), basic sciences (n=1), clinical sciences (n=1) and pandemic preparedness (n=1).

Conclusions

This exercise, a part of WHO’s mandate to “shape the research agenda”, can help build a research roadmap ensuring efficient use of limited resources. This prioritized research agenda can act as a catalyst for Member States to accelerate research that could impact the COVID-19 response in SEAR.

Peer Review reports

Background

The coronavirus disease 2019 (COVID-19) pandemic caused by a novel pathogen presents an unprecedented challenge to existing scientific knowledge and national responses. The pandemic has elicited a fundamentally multifaceted and evolving policy response from national governments addressing health, legal, social and economic issues in the immediate, short and long term [1, 2]. Updated scientific evidence can assist decision-making during public health emergencies to improve outcomes and reduce morbidity and mortality and the cost of relief efforts [3].

Knowledge generation is essential for ensuring evidence-informed programmes and policies. An enormous amount of research has been carried out and new knowledge gained on this new disease [4]. An initial assessment of studies on COVID showed that many of them were of low quality [5]. Poor quality of evidence usually, though not always, translates into lower strength of recommendations, which may have serious public health implications [6]. This creates problems for decision-makers, as they are unable to weigh the evidence or identify research that is relevant to them [7]. In this context, research should be undertaken such that the findings have local relevance and can be conducted within the available research capacity. While multiple types of evidence may be needed during a public health emergency, the urgency and the limited resource availability necessitate prioritization to enable targeted responses that will deliver the maximum impact.

Understanding this need, several COVID-19-related research prioritization exercises have been carried out [8,9,10,11,12,13]. Most of these were done in the early phase of the pandemic and were mainly by and for academicians and focused on clinical and epidemiological aspects in order to understand the disease process and its transmission. Later, as the pandemic spread and its impact became wider, researcher focus shifted to specific programme areas, such as maternal and child health, environment, mental health and ageing, to name but a few [14,15,16,17]. Also, the list of unanswered questions indicated a shift towards health system and public health interventions [18].

While global stakeholders address issues of global importance (which may also have regional relevance), regional resources are best spent on addressing issues which have higher regional relevance, though they may also be useful globally. Regional specificity may be needed where the results of global research are not applicable to the region or the methodology requires regional adaptation. For example, given the differences in the household structure and social dynamics, the results of household transmission studies from other parts of the world may not be applicable to countries of South-East Asia. It is also possible that some regional issues may not be addressed otherwise; for example, the role of traditional medicine in COVID-19 prevention and treatment. Finally, regional research priorities must consider the regional resources and capacity to undertake prioritized research.

One of WHO’s six core functions is to “shape the research agenda and stimulate the generation, translation and dissemination of valuable knowledge”. This core function is reflected in The WHO strategy on research for health and the WHO Regional Office for South-East Asia (SEARO) Regional strategy on research for health 2018–2022 [19, 20]. Both documents identify research prioritization as an important area of the WHO mandate. In keeping with this mandate, SEARO carried out an exercise to identify the current research priorities that would be useful to guide regional and national responses to the current COVID-19 pandemic in the South-East Asia Region (SEAR).

Methods

This exercise was designed, coordinated and managed by a core team in WHO/SEARO, guided by SEARO senior management. The core team was selected to represent different departments within WHO to gain a wider perspective. The core team had members from research, gender and equity, health emergencies, programme management and infectious hazard management backgrounds.

The exercise followed the recently released WHO guidance document for undertaking a research priority-setting exercise [21]. In addition, we followed the Child Health and Nutrition Research Initiative (CHNRI)-recommended principle of “wisdom of crowds” by independent scoring of research ideas by experts and the formation of a core coordination team to determine the scope and context of exercise and the criteria for prioritization [22]. The exercise was designed to put country priorities first, work for equity in development and link research to action, which are principles defining the essential national health research (ENHR) paradigm [23].

The core team brainstormed the scope and approach of the exercise. The exercise comprised four steps—preparatory work, generation of a preliminary list of research ideas, review and consolidation of these ideas, and the prioritization step.

Preparatory work

As the objective of the exercise was the identification of regional priorities for the WHO SEARO and WHO country offices (WCOs) in Bangladesh, Bhutan, Democratic People’s Republic of Korea, India, Indonesia, Maldives, Myanmar, Nepal, Sri Lanka, Thailand and Timor-Leste, the intended participants in the prioritization exercise were all technical staff in these offices actively engaged with the national and regional COVID-19 response. It was understood that their input would be informed by and reflect the respective national COVID-19 research gaps and response priorities. Based on the initial review of earlier prioritization exercises referred to above, seven broad thematic areas were identified (Table 1).

Table 1 Thematic areas of research on COVID-19 for prioritization

Survey to generate research ideas

A webinar was held with WCO research and emergency focal points and SEARO programme managers to orient them to the process and their role. They were all invited to complete an anonymous online survey, which provided the background information on the exercise and its purpose, provided links to earlier prioritization exercises, and described the seven themes mentioned in Table 1. The survey, which was conducted between 25 September and 14 October 2020, was voluntary and asked participants to contribute up to five research questions in their area of expertise. Participants were also allowed to forward the survey invitation to anyone in their office who was involved in the national COVID-19 response.

Consolidation of research ideas

The research ideas generated by this process were independently reviewed by the core team, with each member being identified as a key discussant for a specific thematic area. Multiple online discussions were held between the members wherein each question was considered for the following possible decisions: retain without change, reformulate and retain, merge with similar idea, split into multiple ideas, or discard. All differences of opinion between members were resolved by discussion to achieve consensus. A proactive effort was made to include gender, equity and human rights considerations when reformulating the ideas.

Prioritization

The scoring system for prioritization was conducted as a two-step process: identifying the parameters for scoring, followed by finalizing a scoring system. CHNRI lists 15 and ENHR 23 possible parameters for scoring [22, 23]. These were reviewed and six parameters finalized as shown in Table 2. Given the objective of the exercise, regional specificity and urgency (time for results to be available for decision-making) were included in addition to four other parameters of relevance in shaping the pandemic response, feasibility given the regional research capacity, effectiveness or likely impact on clinical or public health practice, and social consideration of gender, equity and human rights. Each parameter was provided with a clarifying statement.

Table 2 Scoring system for prioritization of research ideas

All scores were given equal weight. The scoring system followed that recommended by the ENHR approach and began with one point for the first choice, with each following choice scoring one point more than the preceding choice to a maximum of four, giving a maximum total score of 24 for each idea (Table 2). All members first scored independently and then had an open discussion on differing viewpoints, and members were free to change their scoring after that. However, no attempt was made at consensus generation. These individual scores were totalled to get the final score for each idea. These were listed in descending order of the total score, and it was decided that the final prioritized research agenda should not have more than 30 items.

Results

Invitations for the survey were sent to 56 participants among the attendees of the webinar, and a total of 48 responded to the survey. Seventeen (35%) of the respondents were from SEARO and 31 (65%) from WCOs. Their median period of service within WHO was 5.5 years. The participants were mainly from communicable diseases (n=16), WHO health emergencies (n=15) and health systems and life course (n=11) departments. All countries except the Democratic People’s Republic of Korea responded, with maximum response from Myanmar (n=11).

A total of 203 research ideas were received through the survey. Seventy-three (73, 36%) of these ideas came from SEARO respondents and the rest (130, 64%) from WCOs. Most ideas were related to the health system (n=56), epidemiology (n=44) and public health (n=43) themes, predominantly driven by responses from SEARO and Myanmar (Table 3).

Table 3 List of research ideas by thematic areas and sources of suggestion

During the process of consolidation, it was noted that the interaction of COVID-19 with other diseases formed the bulk of the ideas in three of the thematic areas. Under the clinical theme, most questions were related to the bidirectional impact of COVID-19 and other diseases (impact of COVID-19 on other diseases like diabetes and tuberculosis outcomes, and of these diseases on COVID-19 outcomes). Under the epidemiological theme, the bidirectional impact of COVID-19 and other diseases on epidemiology, transmission and burden including mortality of either was most frequent. Under the health systems theme, most ideas were related to the surge capacity of different health system dimensions to respond effectively to COVID-19 or health system capacity to keep key COVID-19 and non-COVID-19-related health services going—extent of disruption of various types of health services and measures taken to ensure the continuity of these services.

After discussion among the core group members, the research ideas were retained with or without rephrasing (n = 43), merged with another related or similar idea (n = 156), or dropped as not considered a research question (n = 4). This process resulted in a final list of 78 research ideas. In this list, health system (n=23) and epidemiology (n=17) continued to have the highest number of research ideas.

After arranging the sum of the scores given by the core group members in descending order, it was decided to consider the upper tertile as of “higher priority”. This was to keep the maximum number of priority research ideas below 30. The final 27-item priority research agenda covered all the thematic areas—health system (n=10), public health and social measures (n=6), epidemiology (n=5), socioeconomic and equity (n=3), basic sciences (n=1), clinical sciences (n=1) and pandemic preparedness (n=1) (Table 4).

Table 4 Priority research agenda for COVID-19 in SEAR

The key research priorities identified on the health system theme were “measuring the effect of COVID-19 on essential health services”, “ability to manage dual (COVID-19 and non-COVID-19) load of patients”, “supply chain and vaccine delivery aspects”, “healthcare worker safety”, and “health system capacity” and “governance”. The public health and safety measures (PHSM)-related research priorities included “evaluation of effectiveness of different interventions for prevention of transmission”, “contact tracing strategies and their effectiveness” and barriers to roll out of preventive strategies such as vaccination and behavioural interventions. Under the epidemiology theme, ideas related to burden including serology, disease transmission, thresholds for early warning and disaggregated analysis of data were identified. The worsening of inequities due to COVID-19 and the equity focus of national COVID-19 responses were identified as key research areas in the socioeconomic and equity thematic area.

Discussion

Each research priority-setting exercise is unique and is tailored to its context in terms of method of generation and prioritization of research ideas. This exercise was conducted with a clear focus on the public health aspects that shape national COVID-19 responses. It has resulted in identifying key research ideas relevant to the region. This exercise followed standard guidance and used open and transparent procedures, including independent scoring rather than consensus. Key limitations were largely driven by the short time frame of 3 months from conception to execution, which precluded a fuller consultative process of involvement of national-level stakeholders. However, given the urgency of the exercise, this is not unexpected. The respondents for the survey were WHO staff, selected based on their involvement with the national pandemic response and likely familiarity with country evidence priorities and gaps. The prioritization was done by a small group, with the possibility of bias by their own research interests, which was partly compensated by independent scoring and the diverse backgrounds of the core group. It is acknowledged that this list was not intended to cover all the research that needs to be undertaken, such as environmental issues, mental health or digital health interventions and many more.

There are various ways to identify research priorities, each with its advantages and disadvantages. The key issues in any such exercise are the process of generating research ideas, criteria for scoring and the prioritization process. Research idea generation could be by a review of literature or a survey of experts and sometimes through large stakeholder consultation. The timeline for such processes also varies from several months to a few weeks. The size, composition and process for selecting experts determines the validity of this step. In previous COVID-19 research prioritization exercises, the size of the group has varied from above 1500 to 5, as compared with 48 in this exercise [8, 13]. All have adopted online surveys, reflecting the COVID-19 realities. Scoring methods to identify priorities have varied from experts conducting a simple scoring on a scale of 1–10 for each topic or experts each choosing their top three research ideas, to a detailed scoring on pre-identified parameters, as was done in this exercise [8]. Finally, the composition of the group of people who do the scoring for prioritization impacts the prioritization process and reflects their bias. Most prioritization exercises have involved researchers and academicians as experts rather than users of the research as in this case.

This process identified health system and public health issues as major research priorities in the current period, as these are downstream issues inherently linked to national responses. While earlier such exercises had an epidemiological and clinical focus, in this exercise the role of health system and equity in national COVID-19 responses gained importance [24,25,26]. This may reflect evolving priorities over time in the current pandemic as well as the agency conducting the prioritization exercise. In a priority listing of research in the health policy and systems research (HPSR) space, Gilson et al. identified the following areas: differential impact of COVID-19 on disadvantaged groups, impact on local health system by COVID-19, and governance and decision-making [26]. Other researchers have made recommendations related to the need to protect essential services during the pandemic [27]. Similarly, recommendations have been made for an equity-driven response, applying a social determinants and health equity lens on monitoring, evaluation and clinical trials; and the need to dedicate resources to prioritize high-risk communities for clinical management and prevention as well as policies that address the social and economic barriers that these populations face during a pandemic [28]. Our exercise reinforces these recommendations.

While prioritization is an important step, the more critical step is the implementation of the prioritized research agenda. WHO has a role in convening stakeholders to set research priorities, but is usually not engaged in implementation of research. This exercise would help in building a COVID-19 research roadmap for WHO SEARO and its Member States which will ensure efficient use of limited resources available for COVID-19 research. WHO (headquarters/SEARO/country office) technical staff and senior management can use the priorities thus generated in policy dialogue and advocacy with Member States and in the development of their work plans and resource allocation decisions. The prioritized list may also act as a catalyst for Member States and other stakeholders including development partners to support research which could help shape the COVID-19 response in SEAR. When taking up these ideas for implementation, researchers may need to formulate their questions more specifically with reference to their own country or programme area. It is also recommended that they reflect gender, equity and human rights concerns in formulating their specific questions. This priority agenda should also stimulate an assessment of the research capacity of Member States to address these concerns and measures to strengthen the response, including greater investment in health research (from basic sciences to translational) and the promotion of national and international research collaborations.

In conclusion, this exercise has been a timely effort to identify current public health research priorities that are needed for countries to respond more effectively to the COVID-19 pandemic. It should also be noted that the dynamic nature of the pandemic means that the priorities will change over time, and this process may need to be repeated in due course.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Cheng C, Barceló J, Hartnett AS, Kubinec R, Messerschmidt L. COVID-19 government response event dataset (CoronaNet v.1.0). Nat Hum Behav. 2020;4(7):756–68.

    Article  Google Scholar 

  2. Hale T, Angrist N, Kira B, Petherick A, Phillips T, Webster S. “Variation in Government Responses to COVID-19” Version 6.0. Blavatnik School of Government Working Paper. May 25, 2020. www.bsg.ox.ac.uk/covidtracker.

  3. European Centre for Disease Prevention and Control. The use of evidence in decision-making during public health emergencies. Stockholm: ECDC; 2019

  4. Chams N, Chams S, Badran R, Shams A, Araji A, Raad M, Mukhopadhyay S, Stroberg E, Duval EJ, Barton LM, Hajj HI. COVID-19: a multidisciplinary review. Front Public Health. 2020;29(8):383.

    Article  Google Scholar 

  5. Pundi K, Perino AC, Harrington RA, Krumholz HM, Turakhia MP. Characteristics and strength of evidence of COVID-19 studies registered on ClinicalTrials.gov. JAMA Intern Med. 2020;180(10):1398–400.

    Article  CAS  Google Scholar 

  6. Miles KE, Rodriguez R, Gross AE, Kalil AC. Strength of recommendation and quality of evidence for recommendations in Current Infectious Diseases Society of America Guidelines. Open Forum Infect Dis. 2021;8(2): ofab033.

    Article  Google Scholar 

  7. Diseases TLI. The COVID-19 infodemic. Lancet Infect Dis. 2020;20(8):875.

    Article  Google Scholar 

  8. World Health Organization. A coordinated global research roadmap: 2019 novel coronavirus. March 2020. https://www.who.int/emergencies/diseases/novel-coronavirus-2019/global-research-on-novel-coronavirus-2019-ncov.

  9. AAS/UKCDR/TGHN. COVID-19 research priorities identified by the Global Research Community. July 2020. https://www.who.int/publications/m/item/a-coordinated-global-research-roadmap. Accessed 18 Jan 2021.

  10. The African Academy of Sciences Priority Setting Exercise Research and Development goals for COVID-19 in Africa. https://media.tghn.org/medialibrary/2020/07/COVID-19_Research_Priorities_REPORT_15-7-2020_Final_Version.pdf. Accessed 18 Jan 2021.

  11. Harris C, Carson G, Baillie JK, Horby P, Nair H. An evidence-based framework for priority clinical research questions for COVID-19. J Glob Health. 2020;10(1): 011001.

    Article  Google Scholar 

  12. Infectious Disease Society of America. COVID-19 Key Research Questions and Recommendations. https://www.idsociety.org/globalassets/idsa/public-health/covid-19/idsa-covid-19-key-research-qs.pdf. Accessed 18 Jan 2021.

  13. COVID-19 Clinical Research Coalition. Global coalition to accelerate COVID-19 clinical research in resource-limited settings’. Lancet. 2020;395:1322–5.

    Article  Google Scholar 

  14. Ikedionwu CA, Dongarwar D, Yusuf KK, Maiyegun SO, Ibrahimi S, Salihu HM. Using nominal group technique to elucidate a COVID-19 Research Agenda for Maternal and Child Health (MCH) Populations. Int J MCH AIDS. 2020;9(3):394–6.

    Article  Google Scholar 

  15. Barouki R, Kogevinas M, Audouze K, Belesova K, Bergman A, Birnbaum L, Boekhold S, et al. HERA-COVID-19 working group. The COVID-19 pandemic and global environmental change: Emerging research needs. Environ Int. 2020; 146:106272. https://www.heraresearcheu.eu/.

  16. O’Connor DB, Aggleton JP, Chakrabarti B, Cooper CL, Creswell C, Dunsmuir S, Fiske ST, et al. Research priorities for the COVID-19 pandemic and beyond: a call to action for psychological science. Br J Psychol. 2020;111(4):603–29.

    Article  Google Scholar 

  17. Rylett RJ, Alary F, Goldberg J, Rogers S, Versteegh P. COVID-19 and priorities for research in aging. Can J Aging. 2020;39(4):500–5.

    Article  CAS  Google Scholar 

  18. Norton A, De La Horra Gozalo A, Feune de Colombi N, Alobo M, MutheuAsego J, Al-Rawni Z, Antonio E, Parker J, et al. The remaining unknowns: a mixed methods study of the current and global health research priorities for COVID-19. BMJ Glob Health. 2020;5(7): e003306.

    Article  Google Scholar 

  19. World Health Organization. The WHO strategy on research for health. 2012.

  20. World Health Organization/SEARO. Regional Strategy on research for Health. 2018

  21. WHO/HQ. A systematic approach for undertaking a research priority-setting exercise. Guidance for WHO staff. Geneva: World Health Organization; 2020.

  22. Rudan I, Gibson JL, Ameratunga S, et al. Setting priorities in global child health research investments: guidelines for implementation of CHNRI method. Croat Med J. 2008;49(6):720–33.

    Article  Google Scholar 

  23. David Okello Pisonthi Chongtrakul and The COHRED Working Group on Priority setting. A Manual for Research Priority Setting using the ENHR Strategy. March 2000 COHRED.

  24. English M, Moshabela M, Nzinga J, Barasa E, Tsofa B, Marchal B, Kruk ME. Systems and implementation science should be part of the COVID-19 response in low resource settings. BMC Med. 2020;18(1):219.

    Article  CAS  Google Scholar 

  25. Shadmi E, Chen Y, Dourado I, Faran-Perach I, Furler J, Hangoma P, Hanvoravongchai P, et al. Health equity and COVID-19: global perspectives. Int J Equity Health. 2020;19(1):104.

    Article  Google Scholar 

  26. Gilson L, Marchal B, Ayepong I, Barasa E, Dossou JP, George A, Guinaran R, et al. What role can health policy and systems research play in supporting responses to COVID-19 that strengthen socially just health systems? Health Policy Plan. 2020;6:112.

    Google Scholar 

  27. Blanchet K, Alwan A, Antoine C, Cros MJ, Feroz F, Amsalu Guracha T, Haaland O, et al. Protecting essential health services in low-income and middle-income countries and humanitarian settings while responding to the COVID-19 pandemic. BMJ Glob Health. 2020;5(10): e003675.

    Article  Google Scholar 

  28. Wang ML, Behrman P, Dulin A, Baskin ML, Buscemi J, Alcaraz KI, Goldstein CM, et al. Addressing inequities in COVID-19 morbidity and mortality: research and policy recommendations. Transl Behav Med. 2020;10(3):516–9.

    Article  Google Scholar 

Download references

Funding

The survey was conducted using WHO internal funds.

Author information

Authors and Affiliations

Authors

Contributions

TA and KA conceived and coordinated the study. RS, VDR, AB, PRW reviewed the methods at all steps and were part of the core group which implemented the survey and scored during the prioritization process. RO and SC provided policy guidance and direction. AK wrote the first draft of the paper; all authors reviewed and provided comments on it. All the authors have read and approved the final manuscript.

Corresponding author

Correspondence to Tasnim Azim.

Ethics declarations

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Azim, T., Bhushan, A., Del Rio Vilas, V.J. et al. Public health research priorities for WHO on COVID-19 in the South-East Asia Region: results of a prioritization survey. Health Res Policy Sys 20, 96 (2022). https://doi.org/10.1186/s12961-022-00862-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12961-022-00862-x

Keywords