- Study protocol
- Open Access
- Open Peer Review
Diabetes in pregnancy among indigenous women in Australia, Canada, New Zealand, and the United States: a method for systematic review of studies with different designs
BMC Pregnancy and Childbirthvolume 11, Article number: 104 (2011)
Diabetes in pregnancy, which includes gestational diabetes mellitus (GDM) and type 2 diabetes mellitus (T2DM), is associated with poor outcomes for both mother and infant during pregnancy, at birth and in the longer term. Recent international guidelines recommend changes to the current GDM screening criteria. While some controversy remains, there appears to be consensus that women at high risk of T2DM, including indigenous women, should be offered screening for GDM early in pregnancy, rather than waiting until 24-28 weeks as is current practice. A range of criteria should be considered before changing screening practice in a population sub-group, including: prevalence, current practice, acceptability and whether adequate treatment pathways and follow-up systems are available. There are also specific issues related to screening in pregnancy and indigenous populations. The evidence that these criteria are met for indigenous populations is yet to be reported. A range of study designs can be considered to generate relevant evidence for these issues, including epidemiological, observational, qualitative, and intervention studies, which are not usually included within a single systematic review. The aim of this paper is to describe the methods we used to systematically review studies of different designs and present the evidence in a pragmatic format for policy discussion.
The inclusion criteria will be broad to ensure inclusion of the critical perspectives of indigenous women. Abstracts of the search results will be reviewed by two persons; the full texts of all potentially eligible papers will be reviewed by one person, and 10% will be checked by a second person for validation. Data extraction will be standardised, using existing tools to identify risks for bias in intervention, measurement, qualitative studies and reviews; and adapting criteria for appraising risk for bias in descriptive studies. External validity (generalisability) will also be appraised. The main findings will be synthesised according to the criteria for population-based screening and summarised in an adapted "GRADE" tool.
This will be the first systematic review of all the published literature on diabetes in pregnancy among indigenous women. The method provides a pragmatic approach for synthesizing relevant evidence from a range of study designs to inform the current policy discussion.
Gestational diabetes mellitus (GDM) is defined as "any degree of glucose intolerance with onset or first recognition during pregnancy" . GDM can be a temporary glucose intolerance, as a result of hormonal changes in pregnancy, or type 2 diabetes mellitus (T2DM) that has not previously been diagnosed. Diabetes in pregnancy (DIP) includes both GDM and T2DM, which may or may not have been previously diagnosed, and type 1 diabetes mellitus.
DIP is associated with increased risks at birth for the mother (caesarean section) and the infant (macrosomia, hypoglycaemia) . Women with GDM are at high risk for T2DM after pregnancy [3, 4], and GDM is often identified as an early step in the "natural history" of the progression to T2DM. Children born to women with DIP have higher risks for obesity and for T2DM in later life [5, 6]. These observations have led to the proposal that DIP is a major contributor to the high observed prevalence of T2DM in indigenous populations and to the increasing prevalence of obesity and diabetes among their children . Indigenous women in Australia, Canada, New Zealand and the United States have experienced rapid changes from a traditional diet and lifestyle, to one rich in processed, carbohydrate-dense foods and reduced energy expenditure, which are associated with increased rates of obesity, GDM and T2DM .
T2DM is a serious metabolic disorder, in which blood sugar is no longer controlled, and can lead to heart disease, stroke, renal disease, kidney failure, amputations and blindness . The prevalence of T2DM is increasing in line with increasing rates of obesity across the globe. Indigenous populations generally have significantly higher rates than non-indigenous people within the same country, suggesting that indigenous populations have progressed past the pre-diabetes stage in this metabolic disorder .
The current recommendations for screening and diagnosis of GDM were written over 40 years ago by adapting methods for screening non-pregnant women in order to identify those at high risk for T2DM after pregnancy . Recently demonstrated clear associations between any degree of hyperglycaemia and adverse pregnancy outcomes  has, however, led to a review of these long-established criteria . There is ongoing controversy about use of universal or selective screening, the timing and the type of tests [13–15] and the choice of interventions for prevention management and follow-up, particularly for indigenous communities . However, there appears to be consensus that women in populations with a high prevalence of T2DM should be offered screening for GDM early in pregnancy, before an oral glucose tolerance test at 24-28 weeks gestation (as is current practice), particularly if metabolic testing in this age group is not commonly conducted [17, 18].
The aim of population-based screening is to reduce the burden of disease in the community by earlier detection of disease, thus providing an opportunity for intervention and improvement of health-related outcomes . Early detection of GDM provides an opportunity to offer support and treatment to reduce or manage hyperglycaemia and the associated risks in both pregnancy and the long term. Pregnancy is an opportune time to offer support to women, as they have frequent scheduled contacts with health-care providers and are often highly motivated to adapt their behaviour to improve the health of their infant. In addition, any effective interventions could affect the health of the whole family, including the unborn child [20, 21].
A number of factors should be considered, however, before introducing population-based interventions, including; the prevalence and natural history of the condition, current screening practice and rates, acceptability (preferences and values), efficacy and cost and the availability of adequate treatment pathways and follow-up . In addition to these routine criteria, there are specific considerations related to screening in pregnancy and in indigenous populations. Increased diagnosis in pregnancy of a medical condition in a generally healthy population can be associated with unnecessary stress , and ineffective therapy might be given that initiates a "cascade of interventions"  which interfere with the normal process of pregnancy and birth. Indigenous communities in particular face a range of exacerbated health challenges, with complex cultural and social issues, which should be considered in any medical intervention . The current consensus makes it likely that indigenous women will experience changes in screening practice earlier than low-risk population groups. However, the evidence that the criteria for population-based screening are met for this population group has not been reviewed, nor have the specific issues unique for this population group.
The evidence for these factors will be generated by studies with a number of different designs, including epidemiological studies, qualitative studies, measurement studies, intervention studies and even opinion pieces. Systematic review offers a rigorous process for appraising the quality of evidence; however, such reviews are often restricted, as they include only a limited number of study designs in order to focus on the internal validity of the design and not to consider the external validity or generalizability of the results for the intended purpose . Thus, researchers and journal editors face challenges in making research relevant for decision-making . These challenges are familiar to clinicians developing evidence-based practice guidelines, and a number of tools have been developed to "GRADE" and present evidence that may be useful for adaptation in the public health setting .
Our aim in this paper is to describe a method for systematically reviewing all published studies relevant to informing future discussions about screening for DIP among indigenous women in Australia, Canada, New Zealand and the United States.
The inclusion criterion will be broadly defined as "any publication that includes analysis or discussion of diabetes in pregnancy among indigenous women in Australia, New Zealand, Canada or the United States".
This broad definition was used so that all studies would be included and information to address the relevant screening criteria  could be extracted. This includes information regarding perspectives and acceptability, which affect the overall sensitivity of screening interventions when applied at a population level. The body of literature therefore comprises all original intervention, measurement and descriptive studies, as well as reviews, program descriptions and opinion pieces. Indigenous women in Australia, Canada, New Zealand and the United States were grouped, as they are considered to have similar (but not identical) social and health experiences of colonisation and rapid transition from a traditional diet and lifestyle to one of relative poverty in a high-income country [25, 28, 29]. In most published studies, indigenous women have been compared with non-indigenous women in the same countries, or evidence for non-indigenous women was applied to indigenous women, with arguable external validity.
We will search the Cochrane Database of Systematic Reviews (1995-July 2010), Medline (1950-July 2010), Embase (1949-July 2010), CINAHL (1937-July 2010), and PsychINFO (1905-July 2010). The following key words in the titles and abstracts and subsequent MeSH headings will be searched:
pregnan* or antenatal or prenatal, or neonatal or newborn or infan* or fetal or fetus or foetal or foetus
AND diabet* or hyperglyc?mi* or glucose intoleran* or obes* (or gestational diabet*)
AND aborigin* or indigen* or native* or first nation*
See table 1 for a full search tree in Medline. We will not apply any language or other restrictions.
Citations identified by the search of the five databases will be downloaded into Endnote © for removal of duplications, and all abstracts will be reviewed by two people to determine whether the publications potentially meet the criterion for inclusion in this review.
The full text of all publications that potentially meet the inclusion criterion will be reviewed by one assessor, and 10% will be independently reviewed by a second assessor for validation. When there is disagreement, a third person will make the final decision. The proportions of agreement between the first and second reviewer and between the first and final reviewer will be reported to provide an estimate of the degree of possible variation in interpretation.
Kappa scores will not be calculated, as there is a high rate of expected agreement that would require a larger sample size of co-reviewed papers than is feasible within the resource constraints of this review. All publications that do not meet the inclusion criterion, with reasons specified, will be available from the contact author on request.
A spreadsheet will be prepared in Microsoft Excel © to extract standardised data items from the included publications. One person will extract data from all the included publications, and 10% will be extracted independently by a second reviewer and checked for agreement. When there is disagreement, a third person will make the final decision. The proportions of agreement between the first and second reviewer and the first and final reviewer will be reported in order to provide an estimate of potential variation in interpretation. Again, kappa scores will not be calculated because of the high level of expected agreement.
Publications will be coded according to their focus on indigenous people in the following countries:
Australia (Aboriginal and/or Torres Strait Islander);
Canada (Cree, Saskatchewan Indian, Saskatoon Indian, Inuit, First Nation);
New Zealand (Maori);
United States (Navajo Indian, Papago, Athabaskan, Chamorro, Chippewa, Pima Indian, Tohono Indian, Zuni Indian, Hawaiin, Yup'ik Eskimo, Native Indian); and
"Other" (when more than one group or general reference is made).
The following outcome data will be extracted: rationale, aims, number of people included, journal title, outcomes reported, main findings and conclusions, funding source, data source, GDM incidence, diagnostic criteria used and years of measurement.
The publication topics will be grouped according to the "key criteria" of the population-based screening framework  as: epidemiology and natural history of DIP, screening practice and rates, acceptability, efficacy and cost (measurement), adequate treatment pathways, systems for follow-up and "other" (including preventive interventions).
Appraisal of external validity (generalisability)
The external validity will be appraised by coding the studies according to:
whether the population is rural, urban, remote or mixed; and
whether the data were collected from clinics, individual communities or broader populations.
Appraisal of internal validity (risk for bias)
The risk for bias will be critically appraised with specific tools for different study designs. Intervention and measurement studies, reviews and qualitative descriptive studies will be appraised with the following tools:
Intervention studies will be appraised with the Centre for Evidence-Based Medicine (CEBM) Critical Appraisal Skills Programme (CASP) tool for intervention studies .
Measurement studies will be appraised with the CEBM CASP tool for studies of diagnostic accuracy .
Reviews will be appraised with the CEBM CASP tool for systematic reviews .
As no tool exists for appraising descriptive studies, we adapted an instrument from Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) , a recent systematic review of descriptive studies  and a tool used by clinicians for rapid evidence appraisal . Our tool was developed specifically for this review and pilot-tested with a sample of over 20 studies; it was subsequently modified, as some items could not be appraised (e.g. reporting bias) (see Table 3).
Data will be analysed with Microsoft Excel ©. The outcomes reported will include: the rates of publications per country and over time, the type of research that has been published, the internal validity and risks for bias identified in the research, the published findings relevant to population-based screening criteria and the generalisability of the findings.
A detailed "characteristics of included studies table" will be available on request, in which the included studies will be summarised in alphabetical order with: description of the population, study details, main findings and a summary of the risks for bias.
The conclusions about the strength of the evidence within each of the criteria will be clearly communicated to the reader by presenting a summary table adapted from the "GRADE" criteria, which is used to assess guideline evidence [27, 40] (see Table 4).
The summary of findings table will include columns for each of the screening criteria, an evidence statement for the main findings under each criterion (referenced), a strength of evidence symbol and a comment about the generalisability of each statement (i.e. remote, rural, urban or mixed communities and country).
This paper outlines a process for systematic review and appraisal of both the internal and external validity of the published literature and for presenting it in a framework to inform decisions about population-based screening for GDM among indigenous women in Australia, Canada, New Zealand and the United States.
The heterogeneity of the study designs and the heterogeneity between studies of the same design (e.g. different diagnostic criteria for GDM and different criteria for identification of indigenous status both between countries and between studies in descriptive prevalence studies) will preclude a meta-analysis of the studies. Nevertheless, the authors consider it valuable to present a narrative synthesis of the relevant research that has been published under each of the population-based screening criteria.
Calculating kappa scores was not feasible, as the high rate of expected agreement for some criteria would have required co-review by a second person of approximately half of the 123 included publications. Resources permitting, it would be desirable to have all the data extracted by two people.
The inclusion criterion for this review does not include potentially relevant evidence on other population groups or topics such as cancer screening. We do not propose that the evidence from the published academic literature on a specific topic for population groups with some similarities would, in itself, provide sufficient information to enable informed decision-making. However, this review should be a useful resource to contribute to the evidence base for developing interventions in this area.
The vast majority of the studies are observational, descriptive and quantitative, for which there are no commonly used or widely accepted critical appraisal tools. The STROBE guidelines provide a useful reference point; however, they are designed for reporting rather than for the methods of research. The tool presented here for appraising quantitative descriptive studies was adapted for the studies in this review. Specific consideration was paid to the potential for selection bias, which can be from a non-representative source, and the criteria used for identifying indigenous status (e.g. blood quantum specifications). As we were unable to develop clear objective criteria for assessing analytical bias, we adapted a tool that was already available . As there was insufficient information to assess reporting bias, this aspect was removed after pilot-testing
One of the common criticisms of academic literature is that the criteria for internal validity are too restrictive and relevant evidence is not presented in a way that is useful for policy-makers . A strength of this review is that a relevant framework is described, with criteria  that define the range of study designs that should be included. While consideration of a broad range of study designs presents methodological challenges for systematic reviews of the literature, the method described here presents a means for rigorous appraisal of the internal and external validity of the included studies.
The method for our review was adapted to allow inclusion of the perspectives and experiences of indigenous women and communities, which are clearly relevant to policy-makers. At the time of writing, we were unable to find any structured research about DIP that was explicitly reported from an indigenous perspective, thus highlighting a critical gap, or "perspective bias", in the research. This gap may be due to a number of factors, such as an under-representation of indigenous people in academic institutions, lack of trust between indigenous communities and academic institutions and the notion that "objectivity" is desirable in public health research, thus negating the validity of perspectives.
Indigenous women in Australia, Canada, New Zealand and the United States have one of the highest prevalence rates of T2DM in the world; therefore, there is consensus that they should be offered changes to current screening practice in the near future. However, there are unique social and health considerations for this vulnerable population group which requires active collaboration and careful reflection on the existing evidence base. Policy-makers need information presented in a format that is useable and that includes all the relevant data for which both the internal and external validity have been rigorously appraised and the evidence gaps clearly identified, to ensure that decisions made on the basis of limited evidence are carefully evaluated.
This paper has described a process of adapting rigorous systematic review methods to include different study designs, in order to produce relevant evidence for a contemporary discussion about screening policies for DIP among pregnant indigenous women.
This paper was written by Catherine Chamberlain as part of a PhD program investigating gestational diabetes among Aboriginal and Torres Strait Islander women in Australia.
diabetes in pregnancy
gestational diabetes mellitus
type 2 diabetes mellitus.
American Diabetes Association: Diagnosis and classification of diabetes mellitus (position statement). Diabetes Care. 2009, 32 (Suppl 1): S62-S67.
Couston DR, Lowe LP, Metzger BE, Dyer AR: The Hyperglycaemia and Adverse Pregnancy Outcome (HAPO) study: paving the way for new diagnostic criteria for gestational diabetes mellitus. American Journal of Obstetrics & Gynecology. 2010, 202: 654.e651-
Mohamed N, Dooley J: Gestational diabetes and subsequent development of NIDDM in aboriginal women of northwestern Ontario. International Journal of Circumpolar Health. 1998, 57 (Suppl 1): 355-358.
Steinhart JR, Sugarman JR, Connell FA: Gestational diabetes is a herald of NIDDM in Navajo women. High rate of abnormal glucose tolerance after GDM. Diabetes Care. 1997, 20 (6): 943-947. 10.2337/diacare.20.6.943.
Pettitt DJ, Baird HR, Aleck KA, Bennett PH, Knowler WC: Excessive obesity in offspring of Pima Indian women with diabetes during pregnancy. New England Journal of Medicine. 1983, 308 (5): 242-245. 10.1056/NEJM198302033080502.
Pettitt DJ, Nelson RG, Saad MF, Bennett PH, Knowler WC: Diabetes and obesity in the offspring of Pima Indian women with diabetes during pregnancy. Diabetes Care. 1993, 16 (1): 310-314. 10.2337/diacare.16.1.310.
Alberti G, Zimmet P, Shaw J, Bloomgarden Z, Kaufman F, Silink M: Type 2 diabetes in the Young: The Evolving Epidemic. The International Diabetes Federation Consensus Workshop. Diabetes Care. 2004, 27 (7): 1798-1811. 10.2337/diacare.27.7.1798.
Bhattarai MD: Three patterns of rising type 2 diabetes prevalence in the world: Need to widen the concept of prevention in individuals into control in the community. Journal of the Nepal Medical Association. 2009, 48 (174): 173-179.
Australian Institute of Health and Welfare: Australia's Health 2010. 2010, Canberra: AIHW
Yu CHY, Zinman B: Type 2 diabetes and impaired glucose tolerance in aboriginal populations: a global perpsective. Diabetes Research & Clinical Practice. 2007, 78: 159-170. 10.1016/j.diabres.2007.03.022.
HAPO Study Cooperative Research Group: Hyperglycaemia and Adverse Pregnancy Outcomes. The New England Journal of Medicine. 2008, 358 (19):
International Association of Diabetes and Pregnancy Study Groups: International Association of Diabetes and Pregnancy Study Groups Recommendations on the Diagnosis and Classification of Hyperglycaemia in Pregnancy. Diabetes Care. 2010, 33 (3): 676-682.
Holt RI, Jacklin PB, Round JA, Mugglestone MA, Hughes RG: Gestational Diabetes Mellitus: NICE for the US? A comparison of the American Diabetes Association and the College of Obstetricians and Gynecologists Guidelines with the UK National Institute for health and Clinical Excellence Guidelines. Diabetes Care. 2010, 33 (3): e46-47. 10.2337/dc09-2234.
Simmons D, McElduff A, McIntyre HD, Elrish M: Gestational Diabetes Mellitus: NICE for the US? A comparison of the American Diabetes Association and the American College of Obstetricians and Gynecologists Guidelines with the UK National Institute for Health and Clinical Excellence Guidelines. Diabetes Care. 2010, 33 (3): e48-10.2337/dc09-2335.
Brill D: New gestational diabetes plan divides expert opinion. Diabetes Care. 2010, 33: 690-691. 10.2337/dc09-2306.
O'Dea K, Rowley K, Brown A: Diabetes in Indigenous Australians: Possible ways forward. Medical Journal of Australia. 2007, 186 (10): 494-495.
Waugh N, Pearson D, Royle P: Screening for hyperglycaemia in pregnancy: Consensus and controversy. Best Practice & Research Clinical Endocrinology & Metabolism. 2010, 24: 553-571. 10.1016/j.beem.2010.06.004.
Leary J, Pettitt DJ, Jovanovic L: Gestational Diabetes guidelines in a HAPO world. Best Practice & Research Clinical Endocrinology & Metabolism. 2010, 24: 673-685. 10.1016/j.beem.2010.05.009.
Wilson J, Jungner G: Principles and Practice of screening for disease. Public Health Paper Number 34. 1968, Geneva: WHO
McBride CM, Emmons KM, Lipkus IM: Understanding the potential of teachable moments: the case of smoking cessation. Health Educ Res. 2003, 18 (2): 156-170. 10.1093/her/18.2.156.
Orleans CT, Barker DC, Kaufman NJ, Marx JF: Helping pregnant smokers quit: meeting the challenge in the next decade. Tob Control. 2000, 9 (suppl 3): iii6-iii11.
Australian Health Ministers' Advisory Council: Population Based Screening Framework. Edited by: Committee APHDP. 2008, Barton: Commonwealth of Australia
Sable MJ, Wilkinson DS: Impact of Perceived Stress, Major Life Events And Pregnancy Attitudes on Low Birth Weight. Fam Plann Perspect. 2000, 32 (6): 288-294. 10.2307/2648197.
Roberts C, Tracy S, Peat B: Rates for obstetric intervention among private and public patients in Australia: population based descriptive study. BMJ. 2000, 321: 137-141. 10.1136/bmj.321.7254.137.
Anderson I, Whyte J: Populations at special health risk: Indigenous Populations. ?. 2008
Green LW, Glasgow RR, Atkins D, Stange K: Making Evidence from Research More Relevant, Useful, and Actionable in Policy, Program Planning and Practice. American Journal of Preventive Medicine. 2009, 37 (6S1): S187-191.
Balshem H, Helfand M, Schunemann H, Oxman A, Kunz R, Brozek J, Vist G, Falck-Ytter Y, Meerpohl J, Norris S, et al: GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol. 2011, 64: 401-406. 10.1016/j.jclinepi.2010.07.015.
McNamara BJ, Sanson-Fisher R, D'Este C, Eades S: Type 2 diabetes in Indigenous populations: Quality of intervention research over 20 years. Preventive Medicine. 2011, 52: 3-9. 10.1016/j.ypmed.2010.11.002.
Sanson-Fisher R: Indigenous health research: a critical review of outputs over time. Medical Journal of Australia. 2006, 184 (10): 502-505.
Sayers SM: Indigenous Newborn Care. Pediatric Clinics of North America. 2009, 56 (6): 1243-1261. 10.1016/j.pcl.2009.09.009.
Study Designs. [http://www.cebm.net/index.aspx?o=1039]
Critical appraisal for treatment. [http://www.cebm.net/index.aspx?o=1157]
Diagnostic Critical Appraisal Sheet. [http://www.cebm.net/index.aspx?o=1157]
Critical Appraisal Sheet for Systematic Reviews. [http://www.cebm.net/index.aspx?o=1157]
Critical Appraisal Checklist for an article on Qualitative Research. [http://www.gla.ac.uk/media/media_64038_en.pdf]
Treloar C, Champness S, Simpson P, Higginbotham N: Critical Appraisal Checklist for Qualitative Research Studies. Indian J Pediatr. 2000, 67 (5): 347-351. 10.1007/BF02820685.
von Elm E, Altman D, Egger M, Pocock S, Gotzsche P, Vandenbrouke J: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. J Clin Epidemiol. 2008, 61: 344-349. 10.1016/j.jclinepi.2007.11.008.
Shah P: Paternal factors and low birth weight, preterm, and small for gestational age births: a systematic review. American College of Obstetrics and Gynecology. 2010, 103-120.
Centre for Clinical Effectiveness: Evidence-Based Answers to Clinical Questions for Busy Clinicians. Workbook. 2009
The GRADE Approach to Rating the Quality of Evidence. [http://www.igh.org/Cochrane/grade-intro.ppt]
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2393/11/104/prepub
Acknowledgements and funding
We would like to thank Tari Turner and colleagues at the AustralAsian Cochrane Centre for advice on tools for appraising risk for bias and the participants in a workshop on scientific writing held under the auspices of an [Australian] National Health and Medical Research Council Indigenous Research Capacity Building Grant (457379).
Catherine Chamberlain is supported by a National Health and Medical Research Council PhD scholarship (607247) and Indigenous Capacity Building Grant (457379).
The authors declare that they have no competing interests.
CC prepared the protocol, developed and piloted the appraisal tools in collaboration with local experts, and drafted the manuscript. DY developed and pilot-tested the appraisal tools, reviewed 10% of the full texts to confirm inclusion and exclusion of studies and to check data extraction quality, and provided feedback on drafts. HL developed and pilot-tested the appraisal tools, acted as the third reviewer when there was a discrepancy in appraisals, and provided feedback on drafts. EW co-reviewed abstracts of all search results for included studies and provided feedback on drafts. BM assisted in development of appraisal tool and provided feedback on drafts. BO had input into the review protocol and provided feedback on drafts. JO had input into the review protocol and provided feedback on drafts. SE had input into review protocol, advised on relevant indigenous comparisons, and provided feedback on drafts. All authors read and approved the final manuscript.