- Research article
- Open Access
- Open Peer Review
Developing evidence-based maternity care in Iran: a quality improvement study
BMC Pregnancy and Childbirthvolume 8, Article number: 20 (2008)
Current Iranian perinatal statistics indicate that maternity care continues to need improvement. In response, we implemented a multi-faceted intervention to improve the quality of maternity care at an Iranian Social Security Hospital. Using a before-and-after design our aim was to improve the uptake of selected evidence based practices and more closely attend to identified women's needs and preferences.
The major steps of the study were to (1) identify women's needs, values and preferences via interviews, (2) select through a process of professional consensus the top evidence-based clinical recommendations requiring local implementation (3) redesign care based on the selected evidence-based recommendations and women's views, and (4) implement the new care model. We measured the impact of the new care model on maternal satisfaction and caesarean birth rates utilising maternal surveys and medical record audit before and after implementation of the new care model.
Twenty women's needs and requirements as well as ten evidence-based clinical recommendations were selected as a basis for improving care. Following the introduction of the new model of care, women's satisfaction levels improved significantly on 16 of 20 items (p < 0.0001) compared with baseline. Seventy-eight percent of studied women experienced care consistent with the new model and fewer women had a caesarean birth (30% compared with 42% previously).
The introduction of a quality improvement care model improved compliance with evidence-based guidelines and was associated with an improvement in women's satisfaction levels and a reduction in rates of caesarean birth.
Around one million women give birth annually in Iran, with 90% receiving maternity care in hospital. Maternal mortality is still high compared with rates in developed countries (37.5 per 100000 live births), as is neonatal mortality (16.9 per 1000 live births), and the caesarean birth rate is close to 40% . Of the 295 registered maternal deaths in 2005, 87.6% occurred in hospitals and 60% were found to be related to medical errors . Despite many advances in the Iranian health care system over recent decades, these statistics alone show that there is still much room for improvement in the quality of maternity care .
Worldwide, several methods have been used for improving the quality of maternity care in hospitals, such as clinical practice guidelines (CPGs), clinical pathways, and clinical audit [4–11]. Almost all of these methods have their origin in evidence-based practice (EBP) to apply the best evidence in clinical care . EBP is simply the integration of the best available research-based evidence, clinical expertise, and patient needs, values and preferences to develop a system of quality care . Quality improvements thus require professional consensus about implementation of research-based clinical evidence, and attention to patient needs, values and preferences .
Although EB practice has been recognised as necessary for quality care in developed countries, it has often been conceptualised in terms of research-based clinical evidence and less attention has been paid to patient needs and preferences . Yet service quality has been defined as meeting or exceeding service users' needs [16, 17]. Patient satisfaction has indeed been recognised as an important outcome measure for the quality of health care since the late 1980s . Furthermore identifying patient needs and requirements has been judged essential for both measuring and improving quality of care .
In order to improve the quality of maternity care at an Iranian Social Security Hospital serving a poor population (Fayazbakhsh Hospital), we measured the impact on women's satisfaction and caesarean birth rates of a multifaceted intervention to improve uptake of selected EB practices, utilising a before-and-after study design.
Ethics approval to conduct the study was granted from the Ethics Committee of Tehran University of Medical Sciences and Urmia University of Medical Sciences (dated 20 September 2005) after submitting the information that would be given to the participants. All participants gave their written consent prior to the interviews and before-and-after surveys.
A four-step process was utilised to develop, implement and evaluate more evidence based maternity care at the study hospital .
Step 1: Selecting evidence-based practices
In October 2005, a small team of health care providers (including an obstetrician, a neonatologist, an anaesthetist, and four midwives) was formed at the maternity ward to oversee the improvement. This team identified the most important EB practices from the following sources:
Women's needs, values and preferences
Between 31 January and 4 February 2006, the midwives of the team conducted in-depth structured interviews with women following birth (n = 18) to identify their needs and requirements using 11 open-ended questions (Table 1). The conduct of the interview had been standardised with the use of a detailed flowchart to be confident about consistency and reliability [see Additional file 1].
Through these interviews, fifty-four needs and requirements were identified and numbered. Subsequently, the team members helped a subgroup of the interviewees to rank identified needs and requirements using analytical hierarchy process (AHP) . Pairwise comparison of identified needs and requirements using a 1–9 scale was the basis of AHP, with the 20 highest-ranked needs and requirements (comprising 70% cumulative weight) finally selected for further attention (Table 2).
Research-based clinical evidence
The team reviewed the most well-known EB clinical practice guidelines: NGC (National Guideline Clearinghouse) and NICE (National Institute for Clinical Excellence) [22, 23]. The AGREE (Appraisal of Guidelines Research & Evaluation) Instrument was then used to assess the quality (internal and external validity) of the guidelines. AGREE consists of six domains with each domain intended to capture a separate dimension of guideline quality such as scope, clarity, and applicability . Twenty-eight high-quality clinical recommendations were selected, nine of which were already implemented routinely, but 19 of which had not been followed at the study hospital (Table 3).
Using a Delphi technique, the physicians of the team tailored the 19 selected EB clinical recommendations to the conditions of the maternity ward according to four criteria (availability of resources, the physical environment of the maternity ward, clinical experience and culture, and correspondence with women's needs and requirements) . To this end, the 19 recommendations were separately ranked for each criterion using a 1–5 scale by the physicians. Each ranking was continually modified until all the physicians achieved a consensus about the order of the recommendations. Finally, 10 of the 19 EB recommendations not already routinely implemented were chosen as the basis for improving maternity care (Table 3).
Step 2: Assessing current care
We assessed women's satisfaction, clinical adherence to EBP, and the rate of caesarean birth at the hospital prior to implementation of the new care model.
The team conducted a baseline survey with a representative sample of women, who had given birth at the study hospital within the previous year, to appraise their level of satisfaction with given services. To this end, a self-completed questionnaire, using a Likert scale (1 for 'poor' to 5 for 'excellent'), was designed based on the previously identified 20 needs and requirements . The questionnaire was piloted with 15 women. From piloting, the variance related to women's preferences was estimated (= 1.92) and the required sample size was calculated (n = 82 with α = 0.05, S2 = 1.92, and d = 0.3). After modifying three questions, the final questionnaire provided scale scores ranging from 0–21 and was found to be reliable, with a Cronbach's α of 0.90 indicating very high internal consistency .
A random sample of 100 women was drawn up from the list of all women who had given birth in the previous 12 months (= 2213) using a table of random numbers. Given low levels of education and other cultural factors, the team decided to visit women in their homes in order to explain the study and support women to complete the questionnaires. A detailed flowchart of the process for visiting women was used to increase the reliability of the survey [see Additional file 2].
Between 23 July and 19 September 2006, the questionnaires were voluntarily completed by participants (= 89) at home (response rate = 89%). Two women had moved, one woman declined to take part and eight women were unable to complete the questionnaire due to literacy problems. Analysis of the survey was undertaken calculating the mean and variance of the responses to each question.
The team members also assessed clinical adherence to EBP in current care by reviewing the inpatient records of surveyed women and identifying practices that were inconsistent with the 10 selected EB recommendations. Mode of birth among participants was also noted in order to identify the proportion who had experienced a caesarean birth.
Step 3: Designing the new care
As only five women's identified needs and requirements were supported by EB clinical recommendations (well-being of woman and baby, vaginal birth, companionship, and low-pain labour), the team radically redesigned maternity care also based on the remaining 15 identified needs and requirements along with the 10 EB clinical recommendations by developing a process flowchart of maternity care. An illustration of just one aspect of the flowchart for the new care model is shown in Figure 1. This demonstrates how the admission process was redesigned based on the selected EB recommendations as well as women's needs and requirements.
Physicians – 20 obstetricians, 6 anaesthetists and 4 neonatologists (90% of total physicians) – then reviewed the ideal process step-by-step and planned for realistic contingencies . Over a one-month period, the physicians and midwives then participated in training courses and workshops which included EBP and quality improvement methods .
Step 4: Implementing and evaluating the new care
Between 20 February and 16 March 2007, satisfaction data were again collected from a random sample of 100 women following the implementation of the new care model. For a period of 25 days, four women were randomly selected from all women who had given birth each day using random numbers generated by a relevant website, and they completed the same questionnaire with the same protocol previously used at baseline. Six initially selected participants who were unable to complete the questionnaire due to literacy problems were each replaced by further random selection form the day's births. One hundred fully completed questionnaires were thus obtained. Differences in women's satisfaction before and after the intervention were assessed using the Mann-Whitney non-parametric test in SPSS 13.0 .
The team members again reviewed the inpatient records of participants to identify the level of clinician adherence with the new maternity care model as well as their clinical outcomes (vaginal or caesarean birth). We calculated the relative risk (RR) and 95% confidence interval for caesarean birth in those women for whom the new maternity care model was not followed.
Prior to implementation of the new care model, women's satisfaction with care indicated low to moderate levels of satisfaction (mean < 3.6), on 15 of the 20 items. Statistical comparison of women's satisfaction levels before and after the intervention showed a significant increase in satisfaction for sixteen of the twenty needs and requirements. Just four items showed no significant improvement in women's rating – painless vaginal examination, low-pain labour, short labour and clean maternity ward – all of which had exhibited high levels of satisfaction even before introduction of the new model (Table 4).
Clinician adherence to evidence-based care
None of the selected EB practices had been routinely followed before the intervention. After the new care model was introduced, clinicians complied with the new EB guidelines in the care of 78 participants (78%). The EB practice that had most often been missed was the new protocol for admission in labour (68%). In 67% of these instances of non-compliance, women experienced a caesarean birth.
Prior to implementation of the new model of care, 42% of participants had a caesarean birth. Following its implementation 30% of women had a caesarean birth. In the 22 women for whom the new care model was not followed, the relative risk of caesarean birth was significantly higher (RR = 3.55, 95% CI: 2.07–6.07) (Table 5).
Implementation of the new maternity care model improved clinician compliance with evidence-based guidelines and was associated with an improvement in women's satisfaction levels and a reduction in rates of caesarean birth. Whilst promising, these findings need to be interpreted cautiously primarily because of limitations for attributing causality in the before-and-after design used here . Thus, although our findings are consistent with those of other recently published studies [15, 30, 31], the impact of the intervention would be more appropriately studied in a well-designed randomised trial. Whether the method and findings of the study have value in other settings and with other clinical processes will only be seen in future studies.
Most of the quality improvement literature emphasises the involvement of people who know the process best (the process owners) as essential for eliciting the best information and for increasing the participation and commitment of quality improvement team members . However there are some limitations. A dual role as caregiver and quality improvement team member can be a source of bias. In Step 1, the purpose of our interviews with women was to develop understanding of patient needs and requirements (not to assess their satisfaction with care). At this stage caregiver involvement was unlikely to introduce bias. However, the involvement of the midwives during the collection of satisfaction data (in Steps 2 and 4) may have been a source of bias in the study. We tried to increase the internal validity of the study through midwife training, assurances to women about the purpose of the study, standardisation of the survey process and supervision of the survey and data analysis by the authors who were external to the quality improvement processes .
The identified women's needs and requirements had a major role in design of the new care model. Available EB guidelines alone do not guarantee patient satisfaction or high quality of care. In this study women identified that they did not want support during labour and birth from their partner or a family member, but rather from their professional caregivers. Despite research evidence that supports the role for companionship during birth , women's stated preference was for non-professional support from their partners or family members, immediately after the birth. Thus the new model adopted a modified evidence-based guideline appropriate to the expressed wishes of the women attending the study hospital. In addition, professional consensus about areas of practice on which to focus improvement efforts largely ensured adherence to and smooth implementation of the new model of care. Our experience suggests that care designers should always consider all the relevant sources of evidence, including patient needs and requirements and professional consensus, in any EB initiative .
It appears that participation and raised awareness among clinicians played an important role in successful implementation of the new care guidelines. However, in around one in five cases compliance with the new model was not achieved. Changing care practices is always a time-consuming and ongoing process requiring much organisational support . Lack of time and experience, conflicts between professional groups and/or generations, cultural and psychosocial characteristics of the community, the physical and technical environment, rights and rules, and fear of poor outcomes may all be barriers to the adoption of EB practices .
In our study it was of interest that caesarean birth was more likely to be associated with non-compliance with admission guidelines, that is, women being admitted who were not in active labour, did not have effective contractions and did not respond well to stimulation – a set of circumstances that may predispose to a decision to perform a caesarean. Alternatively, for women who attended hospital late in labour there may simply have been less opportunity for medical intervention.
This multi-faceted intervention to translate appropriate evidence into practice appears to have had an important and positive impact on maternity care provision in the study hospital. Our study has demonstrated both that women are well aware of their needs and that identifying patient needs and requirements can play a major role in designing and measuring quality improvements. Equally, attention to professional consensus about priorities for EB practices appears to improve implementation of new care models and reduce clinician resistance to change. This study may also provide food for thought for health care policy-makers and care providers who are looking for better strategies to bring about evidence-based and patient-centred care.
Ministry of Health and Medical Education (MHME) of Iran: The Report of the Health Indicators in 2003. 2004, [http://www.mohme.gov.ir/HNDC/Indicators/DHS_Eng/MAIN.SWF]
Motlagh MI: Iran on the Mirror of Statistics. 2006, [http://www.rahekargar.net/amar/Iran_Dar_Aaineye_Amar-09-2006.htm]
Tita ATN, Stringer JSA, Goldenberg RL, Rouse DJ: Two decades of the safe motherhood initiative: Time for another Wooden Spoon award?. Obstet Gynecol. 2007, 110: 972-976.
King JF: A short history of evidence-based obstetric care. Best Pract Res Clin Obstet Gynaecol. 2005, 19 (1): 3-14.
Smith H, Brown H, Hofmeyr GJ, Garner P: Evidence-based obstetric care in South Africa: influencing practice through the 'Better Births Initiative'. S Afr Med J. 2004, 94: 117-120.
Ransom SB, McNeeley SG, Yono A, Ettlie J, Dombrowski MP: The development and implementation of normal vaginal delivery clinical pathways in a large multihospital health system. Am J Manag Care. 1998, 4 (5): 723-727.
Ransom SB, Studdert DM, Dombrowski MP, Mello MM, Brennan TA: Reduced medicolegal risk by compliance with obstetric clinical pathways: A case-control study. Obstet Gynecol. 2003, 101 (4): 751-755.
Fox S: All-Wales clinical pathway for normal labour: a way to reducing unnecessary intervention. RCM Midwives. 2004, 7: 216-219.
Graham W, Wagaarachchi P, Penney G, McCaw-Binns A, Antwi KY, Hall MH: Criteria for clinical audit of the quality of hospital-based obstetric care in developing countries. Bull World Health Organ. 2000, 78 (5): 614-620.
Mercer SW, Sevar K, Sadutshan TD: Using clinical audit to improve the quality of obstetric care at the Tibetan Delek hospital in North India: a longitudinal study. Reprod Health. 2006, 3: 4-
Ronsmans C: What is the evidence for the role of audits to improve the quality of obstetric care?. Stud HSO P. 2001, 17: 207-228.
Stevens KR: An introduction to evidence-based practice. Newborn Infant Nurs Rev. 2001, 1: 6-10.
Porter-O'Grady T: A new age for practice: creating the framework for evidence. Introduction to Evidence-based Practice in Nursing and Health Care. Edited by: Malloch K, Porter-O'Grady T. 2005, Sudbury: Jones and Bartlett Publishers, 1-30.
Sanares DC, Heliker D: A framework for nursing clinical inquiry: pathway toward evidence-based nursing practice. Introduction to Evidence-based Practice in Nursing and Health Care. Edited by: Malloch K, Porter-O'Grady T. 2005, Sudbury: Jones and Bartlett Publishers, 31-64.
Chaillet N, Dumont A: Evidence-based strategies for reducing cesarean section rates: a meta-analysis. Birth. 2007, 34 (1): 53-64.
Iacobucci D, Ostrom A, Grayson K: Distinguishing service quality and customer satisfaction. J Cons Psychol. 1995, 4: 277-303.
Morand P: Partnering with customers by capturing their voice. J Electron Manuf. 1995, 5: 121-128.
Williams B: Patient satisfaction: a valid concept?. Soc Sci Med. 1994, 38 (4): 509-516.
Aharony L, Strasser S: Patient satisfaction: what we know about and what we still need to explore. Med Care Rev. 1993, 50: 49-79.
Sakala C, Corry MP: What is evidence-based health care?. J Midwifery Women Health. 2001, 46: 127-128.
Chaplin E, Terninko J: Customer driven healthcare: QFD for process improvement and cost reduction. 2000, Milwaukee: ASQ Quality Press
Institute for Clinical Systems Improvement: Management of Labor. 2005, Bloomington: ICSI
National Collaborating Centre for Women's and Children's Health: Caesarean Section. 2004, London: NICE
The AGREE Collaboration: Appraisal of Guidelines for Research & Evaluation (AGREE) Instrument. 2001, [http://www.agreetrust.org/instrument.htm]
Devellis RF: Scale Development: Theory and Applications. 2003, Newbury Park: Sage Publications, 2
Plsek PE: Quality improvement methods in clinical medicine. Pediatrics. 1999, 103 (1 Suppl E): 203-214.
Smith WR: Evidence for the effectiveness of techniques to change physician behavior. Chest. 2000, 8-17. Suppl 2
Hayes BE: Measuring Customer Satisfaction: Development and Use of Questionnaires. 1997, Milwaukee: ASQ Quality Press, 2
Juni P, Altman DG, Egger M: Assessing the quality of randomised controlled trials. Systematic Reviews in Health Care: Meta-analysis in Context. Edited by: Egger M, Smith GD, Altman, DG. 2001, London: BMJ Publishing Group, 87-108.
Studnicki J, Remmel R, Campbell R, Werner DC: The impact of legislatively imposed practice guidelines on cesarean section rates: the Florida experience. Am J Med Qual. 1997, 12 (1): 62-68.
Lagrew DC, Morgan MA: Decreasing the cesarean section rate in a private hospital: success without mandated clinical changes. Am J Obstet Gynecol. 1996, 174 (1 Pt 1): 184-191.
Batalden P: Organizationwide quality improvement in health care. The Textbook of Total Quality in Healthcare. Edited by: Al-Assaf AF, Schmele JA. 1997, Boca Raton: St Lucie Press, 60-75.
Hofmeyr GJ: Evidence-based intrapartum care. Best Pract Res Clin Obstet Gynaecol. 2005, 19: 103-115.
Allison L: Evidence-based practice as a tool for case management. Case Manager. 2004, 15: 62-65.
Rhydderch M, Elwyn G, Marshall M, Grol R: Organisational change theory and the use of indicators in general practice. Qual Saf Health Care. 2004, 13 (3): 213-217.
Turan JM, Bulut A, Nalbant H, Ortayli N, Erbaydar T: Challenges for the adoption of evidence-based maternity care in Turkey. Soc Sci Med. 2006, 62: 2196-2204.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2393/8/20/prepub
Our thanks are due to Tehran University of Medical Sciences (TUMS) for financial support of this research (No. 132/9656- 30 January 2006). The authors are most grateful to Soheila Mohammadi, Faeze Bahrami, Tahmineh Farkhani, Parisa Ghafari, Zahra Pourkalhor, Hila H. Vaziri, and Shahnaz T. Zahrani for their invaluable contributions as members of the study team. We would also like to thank Social Security Organization (SSO), Fayazbakhsh hospital and La Trobe University for their sincere collaboration in development of this research.
The authors declare that they have no competing interests.
SA developed study design, administered the study team at the study hospital, performed data management and interpretation, and drafted the manuscript for publication. FA, AL, KM, RS and MA provided scientific advice on the design and implementation of the study, analysis and interpretation of the data as well as in drafting the manuscript. All authors read and approved the manuscript.