Maternal and perinatal guideline development in hospitals in South East Asia: results from the SEA-ORCHID project
© Thinkhamrop et al; licensee BioMed Central Ltd. 2009
Received: 23 January 2009
Accepted: 08 May 2009
Published: 08 May 2009
Recognising the potential of clinical practice guidelines (CPGs) to improve practice, one of the strategies of the SEA-ORCHID project was to facilitate the development of evidence-based CPGs, and to support clinical staff in each of the four countries to build their skills in development of CPGs in the nine participating hospitals in Thailand, Malaysia, Philippines and Indonesia. This study was undertaken to investigate the impact of the SEA-ORCHID project on development of evidence-based CPGs.
Data on the CPGs available to support maternal and perinatal healthcare were collected by SEA-ORCHID team members at each hospital before and after the intervention period of the project.
There were only a few evidence-based CPGs available in the SEA-ORCHID hospitals before the intervention period. After the intervention period, in the SEA-ORCHID hospitals in Malaysia and Indonesia there was no change in evidence-based CPG development activity in maternal and perinatal care. In Thailand and The Philippines there was a small increase in evidence-based CPG development activity in maternal and perinatal care.
Despite the wide range of interventions to support evidence-based CPG development implemented in the hospitals participating in the SEA-ORCHID, very little change was seen in the development of evidence-based CPGs.
Each year more than half a million women die in and as a result of childbirth worldwide. Ninety-eight percent of these deaths occur in the developing world. For women in Asia the lifetime risk of maternal death is one in 65, a rate that is more than 25 times higher than it is for women in developed countries.  Rates of perinatal and infant death are also high in developing countries. Each year there are almost eight million stillbirths and early neonatal deaths, along with increased rates of morbidity such as low birth weight, birth asphyxia and infection.  These striking figures are a clear indication that work is needed to improve health care for mothers and infants in developing countries
The South East Asia Optimising Reproductive and Child Health in Developing Countries (SEA-ORCHID, http://www.seaorchid.org) project is a five-year collaborative project (2004–08) between four countries in South East Asia (Thailand, Malaysia, Philippines and Indonesia) and Australia funded by the Wellcome Trust and the Australian National Health and Medical Research Council.
By establishing a network of researchers and teachers of evidence-based health care across Thailand, Malaysia, Philippines and Indonesia, supported from Australia, SEA ORCHID aims to examine whether the health of mothers and babies in the four South East Asian countries can be improved by increasing the capacity for research synthesis and improving the implementation of effective clinical practices. 
The evaluation of the SEA-ORCHID project includes quantitative evaluation of change in clinical practice, health outcomes, research activity and guideline development or adaptation; combined with qualitative investigation of the barriers to and enablers of these changes.
One of the key ways in which effective practice can be implemented is through the use of evidence-based clinical practice guidelines (CPGs). By identifying, appraising and synthesising the research evidence relevant to a particular area of clinical practice, rigorously developed CPGs can be an important part of the process by which research evidence is translated into improved practice. [4, 5] Evidence-based CPGs have been demonstrated to improve both the process and the outcomes of health care delivery. However, while the number of published CPGs is increasing [5, 7] there is evidence from a range of settings that the quality of CPGs is often low and the link between research and recommendations is an area of particular weakness. [8–10]
Recognising the potential of CPGs to improve practice, one of the strategies of the SEA-ORCHID project was to facilitate the development (or adaptation) and implementation of evidence-based CPGs, and to support clinical staff in each of the four countries to build their skills in development of CPGs.
Aim of this study
This study was undertaken to investigate the impact of the SEA-ORCHID project on development and adaptation of evidence-based CPGs in the nine participating hospitals in Thailand, Malaysia, Philippines and Indonesia.
Pre-intervention data collection
In 2005, prior to the implementation of the project intervention, the SEA-ORCHID team members in each of the South East Asian hospitals were asked to collect information on the nationally and locally developed guidelines relating to maternal and perinatal clinical practice which were in use in their hospitals. Standard data collection forms were used by the SEA-ORCHID team members to collect information on the nature and development methods for each of the guidelines currently used in practice. SEA-ORCHID team members were doctors and nurses working in the maternal and perinatal units of the participating hospitals. Details of the team members for each of the hospitals can be found at http://www.seaorchid.org.
During the 18-month intervention phase of the project, a variety of strategies were implemented by SEA-ORCHID team members working at each of the hospitals in South East Asia, supported by the team from Australia. These strategies aimed to improve the implementation of evidence-based perinatal practice in ways that were tailored to the context and needs of each hospital.
Some of the intervention strategies of the SEA-ORCHID project were focused on improving skills in development (or adaptation) of evidence-based CPG development and implementation, and on supporting evidence-based CPG development, adaptation and implementation within the hospital quality improvement processes.
SEA-ORCHID teams ran local, national and international workshops and seminars on evidence-based CPG development and implementation, and several health practitioners from South East Asia undertook fellowships in Australia in order to have protected time to develop skills and gain practical experience in evidence-based CPG development.
Examples of activities undertaken to support CPG development & implementation within SEA-ORCHID: (Details of the strategies implemented at each of the hospitals can be found at .) http://www.seaorchid.org
International workshop on CPG development held in Indonesia
National symposia on CPG development held in The Philippines
Fellowships on CPG development in Australia for obstetricians and neonatologists from SEA-ORCHID hospitals
Workshops and training sessions on CPG development, adaptation, appraisal and implementation at each SEA-ORCHID hospital run by SEA-ORCHID Investigators, Educators and Fellows
Departmental meetings within SEA-ORCHID hospitals to follow-up progress on CPG development
Membership on national working groups for CPG development by SEA-ORCHID Investigators, Educators and Fellows
Post-intervention data collection
In 2008, after the project intervention period, SEA-ORCHID team members in each of the hospitals were asked to use standard data collection forms to update the list of the nationally and locally developed guidelines related to clinical practice in pregnancy and childbirth, noting any new guidelines or updates of existing guidelines.
Team members were also asked to identify whether these guidelines were developed on the basis of a systematic review of the available research evidence, and whether the guideline development team was multidisciplinary.
We initially planned to evaluate the rigour of development of the identified guidelines using AGREE criteria , however after reviewing several of the guidelines it was decided that this was not feasible since the methods of guideline development were rarely reported. From discussions with SEA-ORCHID investigators and educators it was clear that at baseline, few guidelines had been developed using rigorous evidence-based approaches.
We have not provided numbers of guidelines at each of the sites as these are very difficult to interpret; for example some hospitals had one broad protocol that covered a large number of clinical areas, whereas in other hospitals each clinical area was addressed by individual, smaller guidelines.
Pre-intervention data collection
Prior to the intervention phase, the level of evidence-based CPG development in the SEA-ORCHID hospitals was relatively low.
In Malaysia, a few CPGs based on systematic searches for evidence and multidisciplinary involvement had been developed at a national level, and were locally implemented. The hospitals also had several of their own, non-evidence-based local protocols.
In the Indonesian hospitals practice was largely guided by the hospitals own, largely non-evidence-based local protocols. There were two nationally developed CPGs, however no CPGs were available that had been developed on the basis of systematic searches for evidence and multidisciplinary involvement.
In the Philippines, three national CPGs were available, all of which had been developed on the basis of systematic searches for evidence and two of which had included multidisciplinary involvement. A non-evidence-based book of procedures was also available to guide practice. The hospitals also had their own, non-evidence-based local protocols.
In Thailand there were several local CPGs for specific areas of practice in use at the hospitals and one regional guideline. The majority of the guidelines had been developed on the basis of systematic searches for evidence and multidisciplinary involvement. The hospitals also had their own non-evidence-based local protocols.
The topic areas addressed by national and local guidelines and protocols at baseline are provided in Additional File 1.
Post-intervention data collection
There was relatively little evidence-based guideline development or adaptation undertaken at most of the SEA-ORCHID hospitals during the intervention period.
In the Indonesian and Malaysian hospitals no additional CPGs were in use in the clinical areas associated with SEA-ORCHID.
In The Philippines, two additional CPGs were developed at a national level, one national CPG was updated, and one CPG was developed at Philippines General Hospital. In each case these were developed in on the basis of systematic searches for evidence and multidisciplinary involvement, however these were largely driven by activities outside of the SEA-ORCHID project.
In Thailand, two new CPGs were developed on the basis of systematic searches for evidence and multidisciplinary involvement at one of the hospitals, five new CPGs were developed on the basis of systematic searches for evidence and multidisciplinary involvement at another hospital and four new CPGs developed by a multidisciplinary team, but not on the basis of systematic searches, were written at the third hospital.
The limited CPG development undertaken at the SEA-ORCHID hospitals during the project highlights the real, practical difficulty of developing evidence-based CPGs in hospital settings in resource-poor countries. In spite of good intentions, the availability of high quality evidence and training in evidence-based guideline development, the staff at the hospitals participating in SEA-ORCHID struggled to develop evidence-based guidelines.
Interviews with clinicians working in the SEA-ORCHID hospitals suggested that while CPGs were valued, a number of reasons why CPGs were not developed or adapted more frequently in their hospitals as is reported in detail in our exploration of the barriers to CPG development.  For example, the clinicians in these hospitals agreed that, as has been reported elsewhere, the accepted evidence-based CPG development process "is slow, laborious, and expensive". The substantial requirements in terms of knowledge, resources, skills and time to carry out the systematic reviews of research literature required for rigorous evidence-based CPG development [5, 14] are often barriers in hospital environments and this was also true in the SEA-ORCHID hospitals. Adaptation of existing evidence-based guidelines may help overcome these barriers, however adaptation was not widely undertaken in the SEA-ORCHID hospitals during the project, and the reasons for this are discussed in the companion paper to this article. 
While guides to the process of developing evidence-based CPGs are widely available, these have largely been produced to guide CPG development at a national level, and not in hospital settings. CPG development in a hospital setting may well require a different approach. For CPGs to be developed (or adapted) and implemented in hospital environments, like those in the SEA-ORCHID project, new strategies will need to be developed to overcome the barriers identified, and make the process more feasible.
It has recently been argued that given the wide variations in health systems, resource availability and disease epidemiology, low-income countries will increasingly need to develop guidelines locally, rather than being able to use guidelines that are developed centrally, by organisations such as WHO.  If this is the case, then it would further support the need for new, pragmatic but reliable evidence-based guideline development methods which make the guideline development process more feasible in environments with limited resources.
The SEA-ORCHID project was a large, complex project, in which development of CPGs was just one of several secondary outcomes. The results of this study suggest that the SEA-ORCHID teams in most hospitals chose to focus their efforts and apply the project resources on achieving changes in other project outcomes, such as clinical practice change and systematic review development, where perhaps change was perceived as easier to achieve. The results of the SEA-ORCHID project on these other outcomes will be reported elsewhere.
One of the key limitations of this research was the definition of CPG as compared to protocol or procedure. To gather the baseline and post-intervention data, we relied on self-report by SEA-ORCHID team members in each of the hospitals and it was clear that definitions of CPG, protocol and procedure, as well as what it meant to systematically search for evidence and involve a multidisciplinary team, varied between the hospitals. We do not believe that these differences would fundamentally alter the conclusions of the research, however they do make interpreting the differences between hospitals difficult. The extensive time commitment required to rigorously develop CPGs may mean that there are some CPGs for which development has begun but which are not yet completed, and therefore have not been included in the results, however we are aware of only a small number of CPGs in this situation.
While there is a growing awareness of the importance of evidence-based CPGs in maternal and perinatal care in SEA-ORCHID hospitals in Thailand, Malaysia, Philippines and Indonesia, few of the currently available CPGs have been developed in a rigorously evidence-based way, and the SEA-ORCHID project did not result in a substantial increase in guideline production at most hospitals.
If development of evidence-based CPGs in hospital settings is to be increased, new strategies will need to be developed to overcome the substantial barriers and make the process more feasible.
SEA-ORCHID is jointly funded by an International Collaborative Research Grant from the National Health and Medical Research Council of Australia (No. 307703) and Wellcome Trust, United Kingdom (071672/Z/03/Z). Detty Nurdiati, Sivasangari Subramaniam, Japaraj R Peter, Hans Van Rostenberghe, Jadsada Thinkhamrop, Ussanee Swadpanich, Bunpode Suwannachat, Mario Festin and Valerie Tiempo-Guinto were responsible for data collection at each of the participating hospitals.
The SEA-ORCHID Study Group consists of Project Investigators: David Henderson-Smart (University of Sydney, Australia), Pisake Lumbiganon (Khon Kaen University, Thailand), Caroline Crowther (University of Adelaide, Australia), Mario Festin (University of the Philippines Manila), Sally Green (Monash University, Australia), Jackie Ho (Penang Medical College, Malaysia) and Hakimi Mohammed (Gadjah Mada University, Indonesia); Project Coordinators: Steve McDonald (Monash University, Australia) and Malinee Laopaiboon (Khon Kaen University, Thailand); Project Administrators: Melissa Murano (University of Sydney, Australia), Natthaleeya Narash and Rabieb Poombankor (Khon Kaen University, Thailand); Statisticians: Malinee Laopaiboon and Porjai Pattanittum (Khon Kaen University, Thailand); Educators and Fellows AUSTRALIA: Jacki Short (University of Sydney), Tari Turner (Monash University), Ruth Martis (University of Adelaide); THAILAND: Pranom Buppasiri, Patcharee Komvilaisak, Jadsada Thinkhamrop (Khon Kaen University Hospital) Songsri Deesrikaew, Porjai Pattanittum, Butsakorn Ussahgij (Khon Kaen University), Bussarin Khianman, Bunpode Suwannachat (Kalasin Regional Hospital), Thitiporn Siriwachirachai, Ussanee Swadpanich (Khon Kaen Hospital); PHILIPPINES: Resti Bautista, Geraldine Castillo Torralba, Valerie Guinto, Cristina Crisologo (Philippine General Hospital), Maria Lu Andal, Cynthia Anzures (Jose Fabella Hospital), Gina Canceran (University of the Philippines Manila); MALAYSIA: Alvin Chang, Chun Wearn Koh, Japaraj Peter, Zabidah Mat Sidi, Sivasangari Subramaniam (Ipoh Hospital), Che Anuar, Tan Beng Geok, Noraida Hassan, Hans Van Rostenberghe (Universiti Sains Malaysia); INDONESIA: Diah Rumekti Hadiati, Tunjung Wibowo, Setya Wandita (Dr Sardjto Hospital), Fauziah Basuki (Sleman District Hospital) and Nawang Purwanti (Gajdah Mada University).
- Global Health Council: Making Childbirth Safer Through Promoting Evidence-Based Care [Technical Report]. 2002, Washington: Global Health CouncilGoogle Scholar
- Save the Children: State of the world's newborns report. 2006, Washington: Save the ChildrenGoogle Scholar
- Henderson-Smart DJ, Lumbiganon P, Festin MR, Ho JJ, Mohammad H, McDonald SJ, Green S, Crowther CA: Optimising reproductive and child health outcomes by building evidence-based research and practice in South East Asia (SEA-ORCHID): study protocol. BMC Med Res Methodol. 2007, 7: 43-10.1186/1471-2288-7-43.View ArticlePubMedGoogle Scholar
- Haines A, Jones R: Implementing findings of research. British Medical Journal. 1994, 308: 1488-1492.View ArticlePubMedGoogle Scholar
- Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J: Clinical guidelines: potential benefits, limitations, and harms of clinical guidelines. British Medical Journal. 1999, 318: 527-530.View ArticlePubMedGoogle Scholar
- Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: iii-iv.View ArticlePubMedGoogle Scholar
- Grilli R, Magrini N, Penna A, Mura G, Liberati A: Practice guidelines developed by specialty societies: the need for a critical appraisal. The Lancet. 2000, 355: 103-106. 10.1016/S0140-6736(99)02171-6.View ArticleGoogle Scholar
- Cates JR, Young DN, Bowerman DS, Porter RC: An independent AGREE evaluation of the Occupational Medicine Practice Guidelines. Spine J. 2006, 6: 72-77. 10.1016/j.spinee.2005.06.012.View ArticlePubMedGoogle Scholar
- Harpole LH, Kelley MJ, Schreiber G, Toloza EM, Kolimaga J, McCrory DC: Assessment of the scope and quality of clinical practice guidelines in lung cancer. Chest. 2003, 123: 7S-20S. 10.1378/chest.123.1_suppl.7S.View ArticlePubMedGoogle Scholar
- Oxman A, Lavis J, Fretheim A: Use of evidence in WHO recommendations. The Lancet. 2007, 369: 1883-1889. 10.1016/S0140-6736(07)60675-8.View ArticleGoogle Scholar
- Laopaiboon M, Lumbiganon P, McDonald SJ, Henderson-Smart DJ, Green S, Crowther CA: Use of evidence-based practices in pregnancy and childbirth: South East Asia Optimising Reproductive and Child Health in Developing Countries project. PLoS ONE. 2008, 3: e2646-10.1371/journal.pone.0002646.View ArticlePubMedGoogle Scholar
- Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care. 2003, 12: 18-23. 10.1136/qhc.12.1.18.
- Turner T, Short J: Maternal and perinatal guideline development in hospitals in South East Asia: the experience of the SEA-ORCHID project. Health Research Policy and Systems. 2009,Google Scholar
- Rowe AK, de Savigny D, Lanata CF, Victora CG: How can we achieve and maintain high-quality performance of health workers in low-resource settings?. The Lancet. 2005, 366: 1026-1035. 10.1016/S0140-6736(05)67028-6.View ArticleGoogle Scholar
- English M, Scott J: What Is the Future for Global Case Management Guidelines for Common Childhood Diseases?. PLoS Medicine. 2008, 5: e241-10.1371/journal.pmed.0050241.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.