- Research article
- Open Access
- Open Peer Review
Seeking order amidst chaos: a systematic review of classification systems for causes of stillbirth and neonatal death, 2009–2014
BMC Pregnancy and Childbirthvolume 16, Article number: 295 (2016)
Each year, about 5.3 million babies die in the perinatal period. Understanding of causes of death is critical for prevention, yet there is no globally acceptable classification system. Instead, many disparate systems have been developed and used. We aimed to identify all systems used or created between 2009 and 2014, with their key features, including extent of alignment with the International Classification of Diseases (ICD) and variation in features by region, to inform the World Health Organization’s development of a new global approach to classifying perinatal deaths.
A systematic literature review (CINAHL, EMBASE, Medline, Global Health, and PubMed) identified published and unpublished studies and national reports describing new classification systems or modifications of existing systems for causes of perinatal death, or that used or tested such systems, between 2009 and 2014. Studies reporting ICD use only were excluded. Data were independently double-extracted (except from non-English publications). Subgroup analyses explored variation by extent and region.
Eighty-one systems were identified as new, modifications of existing systems, or having been used between 2009 and 2014, with an average of ten systems created/modified each year. Systems had widely varying characteristics: (i) comprehensiveness (40 systems classified both stillbirths and neonatal deaths); (ii) extent of use (systems were created in 28 countries and used in 40; 17 were created for national use; 27 were widely used); (iii) accessibility (three systems available in e-format); (iv) underlying cause of death (64 systems required a single cause of death); (v) reliability (10 systems tested for reliability, with overall Kappa scores ranging from .35–.93); and (vi) ICD alignment (17 systems used ICD codes). Regional databases were not searched, so system numbers may be underestimated. Some non-differential misclassification of systems was possible.
The plethora of systems in use, and continuing system development, hamper international efforts to improve understanding of causes of death. Recognition of the features of currently used systems, combined with a better understanding of the drivers of continued system creation, may help the development of a truly effective global system.
Each year, approximately 2.6 million babies are stillborn in their third trimester, about half of these during labour (intrapartum stillbirths). Another 2.7 million are born alive only to die within their first month [1, 2]. With 5.3 million deaths a year, perinatal death is a tragedy on a par with under-5 deaths (5.9 million ), and has far-reaching effects for bereaved families, caregivers, and ultimately society at large . Understanding the causes of stillbirths and neonatal deaths is critical for prevention. Systems that classify causes are thus indispensable tools for researchers, policy makers and caregivers working to reduce the numbers of these deaths.
Classification systems for causes of stillbirth and neonatal death are roughly a century old. The first systems originated in Scotland to classify causes based on clinically observable factors . In 1941, Baird developed what has become one of the most widely used classification systems, referred to as the “Aberdeen,” which aimed to reduce the percentage of unexplained deaths . Early modifications to the Aberdeen added categories, provided definitions to increase consistency of interpretation, and incorporated World Health Organization (WHO) definitions for low birthweight. A new family of systems with more focus on autopsy results was established in 1956 by Bound . This system was modified for use by the British Perinatal Mortality Survey, with several other subsequent modifications . In 1980, Wigglesworth launched a third family using categories that were simple to apply, clinically actionable, and did not require autopsy . The Wigglesworth system has been used and adapted widely . Numerous other types of systems have been developed to classify causes of both stillbirth and neonatal deaths, for instance systems based on placental pathology , distinguishing between immediate and underlying causes [10, 11], combining autopsy results with clinical data , incorporating deaths both before birth and through infancy , and exploring preventability rather than causality .
There is a recognized need to rationalize approaches to cause-of-death classification. The Lancet’s 2011 stillbirth series called for the creation of a “universal classification system” for causes of stillbirth [15, 16], and the United Nations-endorsed Every Newborn Action Plan (2014) identified cause of death as a key gap in the available data, proposing registration of all stillbirths and neonatal deaths together with identification of cause of death as one of the plan’s global indicators .
While it is improving, under-reporting of perinatal deaths (particularly stillbirths) in some of the highest-burden regions is still problematic . In recognition of the need to increase accurate data capture and reporting, the WHO is currently developing a new approach to perinatal death classification for global use, the “WHO Application of the ICD-10 to perinatal deaths” (ICD-Perinatal Mortality or ICD-PM) . Having a separate ICD module for perinatal deaths which incorporates both maternal and fetal/neonatal conditions, in recognition of the mother-baby dyad, is intended to increase reporting of perinatal deaths globally, as well as improving data accuracy.
Several reviews of classification systems for causes of stillbirth and neonatal death have been undertaken, yet all have been limited by one or more factors, including type of death (most were stillbirth-only) and scope (time period, languages included, etc.) [8, 19–21]. The aim of this systematic review was to gain an understanding of classification systems that have been developed or used recently in order to inform the ICD-PM and plans for its implementation. Specific objectives were to:
identify classification systems for causes of stillbirth and neonatal death which have been developed as new systems, modified from existing systems, or used between 2009 and 2014;
describe the characteristics of these systems, including any reliability testing performed;
describe the alignment of these systems with the ICD; and
examine variation in Objectives 1–3 according to country economic region as defined by the World Bank .
This paper presents findings from the first of a two-part study. The second part presents an assessment of alignment of the systems identified and reported on in the present paper with expert-identified characteristics for a globally acceptable system, and is also reported in the BMC Ending Preventable Stillbirths series .
A systematic literature review was undertaken using principles of the Cochrane Collaboration , including a comprehensive search, and study selection and data extraction independently undertaken by two authors. The senior author resolved differences; otherwise, system developers who are co-authors were excluded from selection of studies, data extraction and analysis. See Additional file 1 for the PRISMA checklist.
We included published and unpublished studies reporting classification systems for stillbirths (SB) and/or neonatal deaths (NND) that were created, modified, and/or used between 2009 and 2014. The inclusion criteria were:
All publications between 2009 and 2014 that:
described at least one new and/or modified classification system for causes of SB and/or NND or
reported data on causes of SB and/or NND using any classification system, regardless of when that system was created or modified.
For any systems that were found to be used between 2009 and 2014, as in (1-b) above, we also included the publication that was provided as the reference for that system, regardless of whether it was published in 2009–2014 or earlier.
All publications between 2009 and 2014 that reported on reliability testing of any systems included via (1) and (2) above.
The most recent publication between 2009 and 2014 in English that described a national system.
The original search period was the ten years from 2004–2013; this was halved (to 2009–2013) due to resource limitations, and because data extraction extended into 2014, a sixth year was added to the search period. Systems classifying SB were included regardless of the gestation at which SB was defined in included publications. Systems classifying both early (0–7 days) and late (8–28 days) NND were included, as well as systems classifying perinatal deaths without separation into SB and NND.
The rationale for including modifications of original systems was twofold. First, even slight modification of a system may render its data less compatible with other systems, and second, modification may reflect users’ perceptions of the inadequacy of available systems.
See Fig. 1 for definitions of terms used.
Systems developed for specific populations (e.g., unexplained SB at term, low birthweight babies) were excluded. Systems for which data on SB, NND, and/or perinatal deaths could not be separated from data on deaths before or after the perinatal period (e.g., miscarriages, late infant deaths) were excluded. Because our ultimate aim was to inform development and optimize successful uptake of a new global system, we needed to gain an understanding of the context of systems development beyond the ICD. This meant our focus was on understanding the features of systems developed by users, and thus which reflected their needs. Hence, papers describing use of only the ICD were also excluded.
Search strategy and study selection
Five electronic databases (CINAHL, EMBASE, Global Health, MEDLINE, and PubMed) were searched for the period January 1, 2009, to December 31, 2014, with no language limits (see Fig. 2 for search string). In addition, an English-language search was carried out to identify all national systems in use. Searches were supplemented by contacting expert informants.
Every English-language paper was independently screened for inclusion by two authors in two stages—abstract review and full text review—with final decisions made by the senior author in the event of disagreement (see Additional file 2 for decision tree on inclusion/exclusion). Screening of non-English papers at the abstract stage was performed in the same way, but full-text review was done by one of three researchers (depending on language) with guidance by the first author.
A data collection tool was purpose-built and pilot tested for data extraction of 48 variables (see Additional file 3), including:
21 variables to describe basic system features such as year of publication, whether systems were new or modified, whether authors intended to create or modify systems or merely to use existing systems, and authors’ descriptions of reasons for system creation;
26 variables to enable assessment of alignment with expert-identified characteristics for a globally acceptable system (see ), including variables for:
Comprehensiveness (e.g. whether both SB and NND were included, and whether associated factors were recorded);
Extent of use (e.g. regions of origin and use, number of deaths classified, and whether national or not);
Accessibility and relevance (e.g. whether available in e-format and multiple languages and whether guidance for accessing data was provided; also, although verbal autopsy is a data collection tool, we recorded whether systems had been used with verbal autopsy as one proxy for a system’s relevance in low-resource settings);
Identification of underlying causes (e.g. maximum % “other” recorded by any use of the systems in included papers, number of causes in top “level”, number of levels, and whether fully, partially, or not hierarchical; see Fig. 1 for definitions of terms);
Reliability (including whether rules for assigning cause of death and definitions of causes were provided);
One variable to record whether ICD codes were used. This variable was included in data extraction as it was known to be important for development of the ICD-PM.
Data for variables relating to basic system features were taken both from publications that introduced new or modified systems between 2009 and 2014, and from older publications if they had been cited as the source of a system used within 2009–2014, regardless of year of publication. Data relating to the use of the systems (included in #2 above), for instance number of deaths classified, countries in which used, and percent of deaths classified as “other”, were taken from publications within 2009–2014 that described use of these systems. Therefore, a system described in a publication from 1970 would be included only if it had been used at least once in a publication between 2009 and 2014; all data relating to use of this system would be taken only from the latter publication, while all data relating to the system’s basic features would be taken from the former publication.
Data from English publications were independently double-extracted; any disagreements were resolved by the senior author. Data from non-English publications were extracted by the same researchers who had performed full-text review of these publications, with the guidance of the first author. Where multiple systems were included in a single publication, each was extracted separately.
Data management and analysis
Data were entered into Microsoft Excel 2013. Coding was independently checked by a second researcher, and then imported to Stata/IC 12.1 for analysis of frequency distributions. Subgroup analyses were performed to explore differences in frequencies according to extent of use (whether widely used, region in which used, and use in highest-burden countries). A sensitivity analysis was carried out to explore the implications of cut-offs for identification of widely used systems (see Additional file 4 for method).
For a copy of the study protocol, please contact the author.
In total, 4,948 publications were screened for eligibility, 764 were assessed for eligibility, and 146 were included (Fig. 3). Some included publications met more than one inclusion criterion (e.g., included both a description of a new system and use of an existing system) (see Additional file 5 for all included publications with reasons for inclusion). Of included publications, 11 presented systems that were newly created, 40 presented systems that were modified, 81 presented system use (including 17 systems that had been created prior to 2009), and 15 presented the results of reliability testing for one or more included systems. 120 non-English publications in 16 languages were screened via English abstracts, with publications in eight non-English languages identified for full-text review. Eight publications in Persian were excluded due to the inability to identify a translator. See Fig. 3 for a summary of reasons for exclusion.
System creation and use
Number and year of creation of systems
A total of 81 systems were created, modified, and/or used between 2009 and 2014.Footnote 1 The oldest system in use was Wigglesworth 1980, while two systems created in 2014 had no published record of use (McClure 2014-Global Network and Gardosi 2014-MAIN). An average of 10 systems were created or modified annually between 2009 and 2014 (see Additional file 6).
New and modified systems compared to author intent
The majority of systems (n = 59, 73 %) were modifications of existing systems. Of the 14 systems that we defined as new, 10 were also intended by their authors as new systems. Of the remaining four, two were intended as new approaches rather than new systems, one was intended as a use of an existing system, and one was not intended as a use or creation of any system. Just 22 of the 59 systems defined by us as modifications were intended by their authors as such. A further 27 were intended as uses of existing systems, with the modifications that we found going unmentioned by the authors; five were intended as new systems, and the remaining five had other intents. We were unable to determine whether eight systems were new or modified; of these, six were intended as uses of existing systems, while author intent for the remaining two could not be determined (see Table 1 and Additional file 5).
Reasons for system creation
Authors of 27 of the 73 systems which we were able to identify as either new or modified provided no rationale for the creation or modification of the systems. Reasons provided for the remainder focused on adding features  and missing categories [26, 27], accommodating new knowledge on causation and increasing accuracy , reaching new audiences (e.g. in low-and middle-income countries, LMIC) , addressing underlying causes [5, 8, 11, 30, 31], providing rules and/or definitions [7, 8, 26, 29, 32–35], or reducing the proportion of “unexplained” deaths [27, 32, 35–38]. Some found the inclusion of both SB and NND to be a shortcoming to be addressed (through creation of SB-only or NND-only systems) , while others felt that limiting systems to SB only or NND only was a shortcoming to be addressed (through creation of a system for both SB and NND) [8, 35]. There was a similar difference of opinion regarding whether hierarchy was a shortcoming to be addressed through creation of a non-hierarchical system , or a useful feature to incorporate into a new system .
Overview of system characteristics
Characteristics of the 81 included systems are presented in Table 1. The characteristics that were most common among the systems regardless of whether used in high-income countries (HIC) only or LMIC only were: (i) exclusion of fetal growth restriction (FGR), intrauterine growth restriction (IUGR) and small-for-gestational age (SGA) from the list of causes (75 % and 88 % of HIC-only and LMIC-only systems, respectively); (ii) requiring a single cause of death to be recorded (81 % and 72 %); (iii) ten or fewer causes at the top level (72 % and 88 %); (iv) not requiring recording of the type of data used to assign causes (81 % and 100 %); (v) not using ICD codes (92 % and 75 %); (vi) not having been tested for reliability (86 % and 88 %); (vi) use in just one country (83 % and 94 %); (vii) unavailable in e-format (94 % and 97 %); and (viii) unavailable in multiple languages (97 % and 100 %).
In addition to these, the characteristics that were most common among the 36 systems used only in HIC were: (i) non-hierarchical; and (ii) not having been used with verbal autopsy. Characteristics most common among the 32 systems used only in LMIC included: (i) lack of rules for assigning causes of death; (ii) lack of guidance on how to access data from systems; (iii) no inclusion of associated factors; and (iv) used to classify fewer than 500 deaths (among publications included in our search 2009–2014).
Comprehensiveness of systems
Types of deaths included
Systems classifying both SB and NND were most common, with just under half the systems classifying both types of death. Next most common were systems classifying just NND (around one-third of systems) (see Table 1). There was a difference in type of death classified according to region of use. Of the 36 systems used in HIC only, over half classified both types of death, and one quarter classified SB only. SB-only systems were less common among the 32 systems used in LMIC only: 14 systems classified both SB and NND death and 14 classified NND only, while just four classified SB only.
Of the 55 systems that included SB, a minority (n = 16, 29 %) required distinguishing between antepartum (AP) and intrapartum (IP) SB, with similar results across HIC and LMIC settings. For the 40 systems including both SB and NND, more than half (n = 22) provided no guidelines or rules for distinguishing between SB and NND, and 11 had no categories that were clearly either SB or NND (see Table 1).
Twenty-three systems (28 %) allowed associated factors to be recorded (see Table 1). This feature was more common among HIC-only systems (13 of the 36 systems) than LMIC-only systems (six of the 32 systems). Less than half (n = 11) of systems allowing associated factors clearly distinguished them from causes of death.
Extent of use of all systems
Regions of origin and use
Systems were created or modified in 28 countries on six continents, the majority (65 %) in HIC, and were used in a total of 40 countries (see Fig. 4). Of the 53 systems created in HIC, most (68 %) were used only in HIC. Of the 28 systems created in LMIC, the majority (86 %) were used only in LMIC. Half of the 81 systems were used only in the publications which presented them. Most systems (74 %) were used in just one country, and five systems were described but not used. Four systems were used to report global data; other than these, the largest number of countries in which any system was used was seven (by Wigglesworth 1980 and Gardosi 2005-ReCoDe) (see Additional file 7). About one-fifth of the 81 systems (n = 17) were national, including 12 systems used in eight HIC and five systems used in five countries in Asia, Africa, and South America (see Additional file 8).
Systems used in highest-burden settings
Included systems were used in only about half of the highest-burden countries (six of the top 11 highest-NND burden countries and six of the top 10 highest-SB burden countries) (see Additional file 9). This included just one national system, used in Bangladesh. Specifically, no systems were found to be used in the two highest-burden countries, China and India (though the ICD has been used to classify perinatal deaths in China ). Other than systems used to estimate global causes, only two systems were used in more than one highest-burden country: Engmann 2012  (in Pakistan and the Democratic Republic of the Congo, DRC) and Wigglesworth 1980  (in Pakistan and Bangladesh).
Number of deaths classified
According to published reports of system use, 49 of 81 systems (60 %) had been used to classify fewer than 500 deaths, including 17 of the 36 systems used only in HIC (47 %) and 26 of the 32 systems used only in LMIC (81 %; see Table 1). Just under one third of systems (28 %) were used to classify 1000 or more deaths: 12 of the 36 systems used only in HIC (33 %) and just four of the 32 systems used only in LMIC (13 %) (see Table 1).
Other than global systems and systems that were not used, systems classified between 14 and 47,238 deaths. The total deaths classified by systems (excluding global systems) between 2009 and 2014 was just under 234,000, representing less than 1 % of all SB and NND globally in this period (assuming 2.6 million stillbirths and 2.7 million neonatal deaths annually [1, 2]) (see Table 2 for data on numbers of deaths classified by widely used systems; other data not shown).
Most widely used systems and their selected characteristics
Systems used in more than one country and/or to classify 1000 or more deaths were considered to be “widely used” (see Additional file 4 for the results of sensitivity analysis of these cut-offs). It is worth noting that national systems in countries with small numbers of perinatal deaths, such as Bhutan and Wales, were thus not considered to be widely used, though they may cover a high percentage of deaths within their context. By this definition, 27 systems (33 %) were widely used, including almost half of the 17 national systems (see Table 2). Thirteen of the 27 most widely used systems classified both SB and NND, 10 classified NND only and four classified SB only. Most (about 70 %) of the widely used systems were not hierarchical. Nearly one-third of the 17 widely used systems which included SB did not distinguish at all between AP and IP SB.
The majority of the widely used systems (78 %) required identifying a single cause of death. Ten allowed associated factors to be recorded, although this varied depending on which types of deaths were classified, with two of the four widely used SB-only systems and two of the 10 widely used NND-only systems allowing associated factors. Most of the 27 widely used systems (70 %) provided definitions for at least some causes of death, though only eight systems provided definitions for all causes. About half gave some description of how cause of death should be assigned (see Table 2).
Widely used systems differed from less used systems in several respects. They were more likely to: (i) be used in both HIC and LMIC (eight of 27 systems, or 30 %, as opposed to none of the 54 less used systems); (ii) have been tested for reliability (22 % vs 7 % respectively); (iii) be available in e-format (11 % vs none); (iv) record the degree of certainty of the cause of death assigned (48 % vs 39 %); (v) record the type of data available for assigning cause of death (19 % vs 4 %); (vi) provide definitions for some or all causes of death (70 % vs 50 %); (vii) provide rules for assigning cause of death (52 % vs 35 %); and (viii) allow associated factors (37 % vs 24 %). Widely used systems that included both SB and NND were also more likely to clearly distinguish the two types of death (six of the 13 widely used systems including both SB and NND vs seven of the 27 less used systems including both types of deaths).
Widely used systems were less likely to: (i) be used in LMIC only (22 % of widely used systems versus 48 % of less used systems); and (ii) have recorded a maximum proportion of deaths classified as “unexplained” that was less than 20 % (22 % vs 35 %) (data not shown).
Accessibility and relevance
The majority of systems (n = 66, 82 %) provided no guidance on how potential users might access data from their systems. Three systems were available in e-format (as defined by availability of a form that could be filled in online). Just one system was available in more than one language (English and Lithuanian). Fourteen systems (17 %) had been used with verbal autopsy (see Table 1).
Identification of underlying causes
Number of causes and levels
Systems had from one to four levels (see Fig. 1 for definition of this term), with a mean of 1.8 levels. Just over half had more than one level. Nine of the 36 HIC-only systems (25 %) versus three of the 32 LMIC-only systems (10 %) had three or more levels. The range of number of causes at the top level was two to 40, with a median of 8.2 causes. Most systems (n = 67, 83 %) had 10 or fewer causes at the top level. Of the 14 systems with more than 10 causes at the top level, 10 were used only in HIC. Most systems (n = 64, 79 %) required that a single cause of death be recorded, with similar results for HIC-only and LMIC-only systems (see Table 1).
Most systems (n = 53, 65 %) were not hierarchical, while just under one-quarter were completely hierarchical. Hierarchy was more common among the 32 systems used only in LMIC (just under one-third of these were completely hierarchical) than among the 36 systems used only in HIC (14 % were completely hierarchical) (see Fig. 1 for definition of terms and Table 1 for data).
Percent “other” and “unexplained”
Around two-thirds of systems (n = 54) had at least one category for grouping causes not defined elsewhere in the system as “other” (see Table 1). For most of these systems (72 %), the maximum proportion of deaths classified as “other” was less than 20 %, a finding that was similar for both HIC-only and LMIC-only systems. The range of the maximum proportion of deaths classified as “other” was 0 %  to 68 % , with an average of 14 % and a median of 8 % (for systems with at least one “other” category and available data). The range of proportion of deaths classified as “other” was somewhat narrower for SB-only (1–48 %) and NND-only systems (0–54 %) than for systems including both types of deaths (1–68 %) (see Additional file 10).
The majority of systems (n = 70, 86 %) also had categories for “unexplained” deaths. Of these 70 systems, just 36 % had a maximum proportion of deaths classified as “unexplained” that was less than 20 %. Slightly more LMIC-only systems than HIC-only had this relatively low proportion of deaths classified as “unexplained" (46 % of LMIC-only versus 38 % for HIC-only systems, including only systems with at least one “unexplained” category). The range was 0 %  to 100 % (the FIGO system as used in ),Footnote 2 with an average of 29 % and a median of 23 %. (The mean and median were virtually unchanged when the outlier of 100 % was excluded.) The range of proportion of deaths classified as “unexplained” was narrowest for NND-only systems (0–30 %) and widest for systems including both types of deaths (6–100 %; excluding the slight outlier of 100 %, the range was 0–81 %). See Additional file 10 for details and a list of terms that were included in the assessment of the proportion of deaths classified as “other” and “unexplained”.
Only 10 systems (12 %) were tested for reliability between 2009 and 2014 (see Table 1), about half of these only internally (by the teams which had developed the systems). Eight of the 10 tested systems originated in HIC. Three groups tested systems other than their own, and four systems were tested more than once. The overall Kappa ranged from .35 (poor agreement) (for Cole 1986 ) to .93 (excellent agreement) (for Korteweg 2006-Tulip ); all but one of the Kappa values were over .50 (fair to excellent) (see Additional file 11). The range for external Kappas (Kappa values from testing by teams which had not developed the systems being tested) was .35–.93 and the range for internal Kappas (Kappa values from testing by teams which had developed the systems being tested) was .51–.89. The 59 modified systems were much less likely to have been tested for reliability than the 14 new systems (9 % v 36 %, respectively).
Availability of definitions and rules
Just 23 of the 81 systems (28 %) provided definitions for all causes of death, and 33 (41 %) provided some description of how to assign causes of death (see Table 1). Sixteen of the 32 systems used only in LMIC (50 %), and 14 of the 36 systems used only in HIC (39 %), provided no definitions for causes. The majority of LMIC-only systems (n = 23, 72 %) and HIC-only systems (n = 20, 56 %) provided no guidance on assigning cause of death. Only seven of 81 systems (9 %) allowed recording of the type of data used to assign cause of death, all of them HIC-only systems.
System alignment with the ICD
Seventeen of the included systems (21 %) used ICD codes; this was more common among LMIC-only systems (25 %) than HIC-only systems (8 %) (see Table 1).
We reviewed contemporary classification systems used for causes of stillbirths and neonatal deaths globally, to inform development of the new ICD-PM. We found a large number of systems in addition to the ICD, with widely varying characteristics and limited reach in terms of numbers of deaths classified, especially in highest-burden countries.
The most comprehensive review of classification systems prior to this one, by Gordijn et al., described 35 systems published in English developed between 1954 and 2006 . In 2009, Flenady et al. identified and tested six contemporary systems commonly used for stillbirth in HIC using independent teams across a number of countries ; a publication by Frøen et al. on challenges of data collection reviewed 11 systems . In 2014, a systematic review of studies reporting factors associated with stillbirth in LMIC found just seven systems used . We identified far more systems developed and used than these previous reviews. While our comprehensiveness (including no language restriction) may partially explain this difference, the inclusion of “modifications”, even if minor, is likely the major reason. We did this both because even slight modification may affect data comparability, and because modification may reflect users’ perceptions of the inadequacy of available systems. We also included systems for both stillbirth and neonatal death, whereas most previous reviews focused on stillbirth.
While the overarching aim of all perinatal death classification systems is to understand causes to enable prevention, systems had multiple specific purposes and rationales, including national tracking (e.g., MRC 2002-PPIP ), in-depth investigation (e.g., Flenady 2009-PSANZ-PDC ), research (e.g., Dudley 2010-INCODE ), or more generally to overcome shortcomings of existing systems and meet context-specific needs [4, 31, 33] (see Additional file 12). Numerous incompatible systems reduces the utility of the data of each , yet few papers describing new or modified systems mentioned other systems. Only one-third of systems were “widely used” by our definition (see Table 2), and systems collectively classified only a small proportion of perinatal deaths globally between 2009 and 2014 (other than those estimating global causes, e.g. CHERG for NND only); none were classified in six of the 12 highest-burden (LMIC) countries. National systems were used in only a few countries (see Additional file 8), and there were none in the two highest-burden HIC (the US and Russia). Low coverage may be due to lack of the required data or poor system accessibility, both of which may reflect systems’ unsuitability, especially for low-resource settings. The size of the burden itself, requiring allocation of scarce resources to healthcare, may place a high opportunity cost on the resources required for classification, even in high-resource settings. Coverage may also be hampered by a silo effect, with over half of systems only used by the teams that created or modified them, and most only used in the regions where they were created, possibly because many systems are context-specific. For instance, there are more NND-only systems in LMIC, a situation which may be driven by the relative lack of SB data and attention to SB in LMIC. With nearly twice as many systems created in HIC as in LMIC, this suggests potential LMIC users may also have less choice in terms of available, locally relevant systems. In particular, limited diagnostic capacity in low-resource settings may make some systems based on pathology findings impossible to use.
The multiple systems reflect many challenges for the uptake of a system aimed at global application. This review suggests ways to increase global uptake. Characteristics found to be common among all systems (e.g. requiring a single cause of death and lacking hierarchy), and among the most widely-used systems (e.g. availability of rules and definitions), could be considered proxies for what users expect in an effective system. The characteristics that were rarest (e.g. using ICD codes and having been tested for reliability) may reflect not only user preferences, but also the resources available to users. A globally acceptable system might also benefit from incorporating the most common characteristics of systems used only in LMIC (to increase uptake across settings), and from exploring in greater depth than was possible in this study the reasons why certain features (e.g. reliability testing) were quite uncommon. A global system must accommodate not only low levels of data in poorer settings but also more detailed data in HIC settings, or other regions with access to better diagnostics . Disseminating a system widely, removing language barriers, offering electronic as well as paper-based data collection, training users, assessing system reliability, and addressing users’ concerns with established systems would increase acceptance and uptake of any system intended for global use, including by governments. Systems’ broad albeit thin reach also presents opportunities; for instance, a new global system could be introduced through existing channels for classification.
The ICD is the global standard for assigning diagnoses. It is used for reporting deaths in 117 countries, sometimes including perinatal deaths, for example in three of the highest burden countries—China, Tanzania and Bangladesh [32, 40, 45]. However, perinatal deaths, in particular stillbirths, remain poorly captured and classified; this is a driving factor in the WHO’s work to create the ICD-PM. Many systems are incompatible with the ICD’s key principles, such as identification of a single cause of death, use of ICD codes, incorporation of associated factors, and distinguishing between IP and AP, and between SB and NND. This may be in part due to low awareness of its importance, but is more likely to be due to the ICD’s limited utility for classification of stillbirths. It is hoped that future revisions of the ICD will address this limitation. A particular concern is the low percentage of systems that require recording the timing of deaths (IP vs AP). This information is among the most basic and is obtainable even in low-resource settings, yet was only required by 16 of the 55 systems that include SB, reflecting the larger issue of insufficient data on IP stillbirths worldwide, despite the huge burden and preventability of most of these deaths .
This review had some limitations. The comprehensive search notwithstanding, some systems may not have been identified; no regional databases were searched. This would have led to an underestimate of the true number of systems, possibly weighted toward those in LMIC. The quality of included publications was not assessed, so data used to assign values for percent of deaths classified as “other” and “unexplained” and number of deaths classified was likely of varying quality. For national systems, since only the most recent publication within 2009–2014 was included, the number of deaths classified may be an underestimate. However, this would likely not have affected our findings significantly. Data for some variables were difficult to ascertain, for instance the number of languages in which a system was available, possibly leading to non-differential misclassification of systems for some variables. We were unable to review findings with system authors or double-extract data from non-English publications (6 % of included publications).
Stillbirth and neonatal death deprive millions of babies of their right to grow and develop, bereaving their parents and other family members and affecting millions of caregivers. Though this burden is decreasing, progress is slow. Greater effort must be made, through increased attention from policy-makers, bolder partnerships across the reproductive, maternal, and child health spectrum, country leadership, and innovative programs to scale up effective interventions. Classification of causes is critical to this effort. Whether directly or indirectly, the ultimate aim of classification is to provide data that can be useful in reducing stillbirth and neonatal death. A prime example of how classification systems can be useful is in the recording of stillbirth timing—whether antepartum or intrapartum. This data should be generally available even in low-resource settings and is actionable, even amidst the chaos of multiple systems.
This systematic review provides a comprehensive summary of the landscape of contemporary classification systems for stillbirths and neonatal deaths to inform the development of a globally acceptable approach for the accurate determination of causes of death. In part two of the study, we assess the alignment of the 81 identified systems with expert-identified characteristics for a globally acceptable classification system . We hope that this study will ultimately prove useful not only to researchers and practitioners, but also to bereaved families in all countries who want to know “what happened”.
There was not a one-to-one correspondence between included publications and included systems (many publications included more than one system; multiple publications used the same system); hence search results do not demonstrate the total number of systems found.
The system was National Services Scotland 2013-FIGO,  which only allocates stillbirths to one of two “causes”, SB weighing 1000 g + and normally formed SB weighing 500 g+, both of which were included as “unexplained” causes in the BMC Supplement companion paper that we used as our guide (Reinebrant H, Zheyi T, Wojcieszek AM, Coory M, Gardener G, Lourie R et al. Causes of stillbirth globally – burden in high- and low-resource settings: in preparation).
Child Health Epidemiology Reference Group
Centre for Maternal and Child Enquiries
Cause of death
Causes of death and associated conditions
Demographic and Health Surveys
Democratic Republic of the Congo
Fetal growth restriction
International Federation of Gynaecology and Obstetrics
International Classification of Diseases
International Classification of Diseases for Perinatal Mortality
International collaborative effort
Initial Causes of Fetal Death
Intrauterine growth restriction
Low- and middle-income countries
The Maternal, Antenatal, Intrapartum & Neonatal Classification System for Perinatal Deaths
Medical Research Council
Neonatal and Intrauterine Death Classification according to Etiology
National Institute of Population Research and Training
Perinatal and Maternal Mortality Review Committee
Perinatal Problem Identification Programme
Perinatal Society of Australia and New Zealand Neonatal Death Classification
Perinatal Society of Australia and New Zealand Perinatal Death Classification
Relevant condition at death
Small for gestational age
World Health Organization
Wisconsin Stillbirth Service Program
You D, Hug L, Ejdemyr S, Beise J, on behalf of the United Nations Inter-agency Group for Child Mortality Estimation (UN IGME). Levels and Trends in Child Mortality Report 2015. New York: United Nations Children’s Fund; 2015.
Lawn JE, Blencowe H, Waiswa P, Amouzou A, Mathers C, Hogan D, et al. Stillbirths: rates, risk factors, and acceleration towards 2030. Lancet. 2016;387(10018):587–603.
Heazell AE, Siassakos D, Blencowe H, Burden C, Bhutta ZA, Cacciatore J, et al. Stillbirths: economic and psychosocial consequences. Lancet. 2016;387(10018):604–16.
Chan A, King JF, Flenady V, Haslam RH, Tudehope DI. Classification of perinatal deaths: development of the Australian and New Zealand classifications. J Paediatr Child Health. 2004;40(7):340–7. doi:10.1111/j.1440-1754.2004.00398.x.
de Galan-Roosen AE, Kuijpers JC, van der Straaten PJ, Merkus JM. Fundamental classification of perinatal death. Validation of a new classification system of perinatal death. Eur J Obstet Gynecol Reprod Biol. 2002;103(1):30–6.
Bound JP, Butler NR, Spector WG. Classification and causes of perinatal mortality. Br Med J. 1956;2(5003):1191–6. contd.
Wigglesworth JS. Monitoring perinatal mortality. A pathophysiological approach. Lancet. 1980;2(8196):684–6.
Gordijn SJ, Korteweg FJ, Erwich JJHM, Holm JP, van Diem MT, Bergman KA, et al. A multilayered approach for the analysis of perinatal mortality using different classification systems. Eur J Obstet Gynecol Reprod Biol. 2009;144(2):99–104.
Naeye RL. Causes of perinatal mortality in the US Collaborative Perinatal Project. JAMA. 1977;238(3):228–9.
Autio-Harmainen H, Rapola J, Hoppu K, Osterlund K. Causes of neonatal deaths in a pediatric hospital neonatal unit. An autopsy study of a ten-year period. Acta Paediatr Scand. 1983;72(3):333–7.
Froen JF, Pinar H, Flenady V, Bahrin S, Charles A, Chauke L, et al. Causes of death and associated conditions (Codac) - a utilitarian approach to the classification of perinatal deaths. BMC Pregnancy Childbirth. 2009;9:22.
Hovatta O, Lipasti A, Rapola J, Karjalainen O. Causes of stillbirth: a clinicopathological study of 243 patients. Br J Obstet Gynaecol. 1983;90(8):691–6.
Whitfield CR, Smith NC, Cockburn F, Gibson AA. Perinatally related wastage--a proposed classification of primary obstetric factors. Br J Obstet Gynaecol. 1986;93(7):694–703.
Borch-Christensen H, Langhoff-Roos J, Larsen S, Lindberg B, Wennergren M. The Nordic/Baltic perinatal death classification. Acta Obstet Gynecol Scand Suppl. 1997;164:40–2.
Goldenberg RL, McClure EM, Bhutta ZA, Belizan JM, Reddy UM, Rubens CE, et al. Stillbirths: the vision for 2020. Lancet. 2011;377(9779):1798–805. doi:10.1016/S0140-6736(10)62235-0.
Flenady V, Middleton P, Smith GC, Duke W, Erwich JJ, Khong TY, et al. Stillbirths: the way forward in high-income countries. Lancet. 2011;377(9778):1703–17. doi:10.1016/S0140-6736(11)60064-0.
WHO, UNICEF. Every Newborn: an action plan to end preventable deaths. Geneva: World Health Organization; 2014.
Allanson ER, Tunçalp Ö, Gardosi J, Pattinson RC, Francis A, Vogel JP et al. The WHO Application of ICD-10 to perinatal deaths (ICD-PM): Results from pilot database testing in South Africa and United Kingdom. BJOG. 2016. doi:10.1111/1471-0528.14244.
Froen JF, Gordijn SJ, Abdel-Aleem H, Bergsjo P, Betran A, Duke CW, et al. Making stillbirths count, making numbers talk - issues in data collection for stillbirths. BMC Pregnancy Childbirth. 2009;9:58. doi:10.1186/1471-2393-9-58.
Flenady V, Froen JF, Pinar H, Torabi R, Saastad E, Guyon G, et al. An evaluation of classification systems for stillbirth. BMC Pregnancy Childbirth. 2009;9:24.
Aminu M, Unkels R, Mdegela M, Utz B, Adaji S, van den Broek N. Causes of and factors associated with stillbirth in low- and middle-income countries: a systematic literature review. BJOG. 2014;121(4):141–53. doi:10.1111/1471-0528.12995.
World Bank. 2015. http://data.worldbank.org/about/country-and-lending-groups#High_income. Accessed 23 Feb 2015.
Leisher SH, Teoh Z, Reinebrant H, Allanson E, Blencowe H, Erwich JJ, et al. Classification systems for causes of stillbirth and neonatal death, 2009-2014: an assessment of alignment with characteristics for an effective global system. BMC Pregnancy Childbirth. 2016;16:269. doi:10.1186/s12884-016-1040-7.
Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions. Version 5.1.0 ed.: The Cochrane Collaboration; 2011.
VanderWielen B, Zaleski C, Cold C, McPherson E. Wisconsin stillbirth services program: a multifocal approach to stillbirth analysis. Am J Med Genet A. 2011;155A(5):1073–80. doi:10.1002/ajmg.a.34016.
Cole SK, Hey EN, Thomson AM. Classifying perinatal death: an obstetric approach. Br J Obstet Gynaecol. 1986;93(12):1204–12.
National Services Scotland. Scottish Perinatal and Infant Mortality and Morbidity Report 2011. Edinburgh: Perinatal Society of Australia and New Zealand (PSANZ) Perinatal Mortality Group; 2013.
Flenady V, King J, Charles A, Gardener G, Ellwood D, Day K, et al. PSANZ Clinical Practice Guideline for Perinatal Mortality. Brisbane: Perinatal Society of Australia and New Zealand (PSANZ) Perinatal Mortality Group; 2009.
McClure EM, Bose CL, Garces A, Esamai F, Goudar SS, Patel A, et al. Global network for women's and children's health research: a system for low-resource areas to determine probable causes of stillbirth, neonatal, and maternal death. Maternal health, neonatology and perinatology. 2015;1:11. doi:10.1186/s40748-015-0012-7.
Kidron D, Bernheim J, Aviram R. Placental findings contributing to fetal death, a study of 120 stillbirths between 23 and 40 weeks gestation. Placenta. 2009;30(8):700–4.
Winbo IG, Serenius FH, Dahlquist GG, Kallen BA. NICE, a new cause of death classification for stillbirths and neonatal deaths. Neonatal and Intrauterine Death Classification according to Etiology. Int J Epidemiol. 1998;27(3):499–504.
National Institute of Population Research and Training (NIPORT), Mitra and Associates, ORC Macro. Bangladesh Demographic and Health Survey 2004. Dhaka, Bangladesh, and Calverton, Maryland, USA. National Institute of Population Research and Training, Mitra and Associates, and ORC Macro; 2005.
Varli IH, Petersson K, Bottinga R, Bremme K, Hofsjo A, Holm M, et al. The Stockholm classification of stillbirth. Acta Obstet Gynecol Scand. 2008;87(11):1202–12. doi:10.1080/00016340802460271.
Dudley DJ, Goldenberg R, Conway D, Silver RM, Saade GR, Varner MW, et al. A new system for determining the causes of stillbirth. Obstet Gynecol. 2010;116(2 PART 1):254–60.
Korteweg FJ, Gordijn SJ, Timmer A, Erwich JJ, Bergman KA, Bouman K, et al. The Tulip classification of perinatal mortality: introduction and multidisciplinary inter-rater agreement. BJOG. 2006;113(4):393–401. doi:10.1111/j.1471-0528.2006.00881.x.
Centre for Maternal and Child Enquiries (CMACE). Perinatal Mortality 2008: United Kingdom. London: CMACE; 2010.
Gardosi J, Kady SM, McGeown P, Francis A, Tonks A. Classification of stillbirth by relevant condition at death (ReCoDe): population based cohort study. BMJ. 2005;331(7525):1113–7. doi:10.1136/bmj.38629.587639.7C.
Manning E, Corcoran P, Meaney S, Greene RA, on behalf of the Perinatal Mortality Group. Perinatal Mortality in Ireland Annual Report 2011. Cork: National Perinatal Epidemiology Centre; 2013.
Engmann C, Garces A, Jehan I, Ditekemena J, Phiri M, Mazariegos M, et al. Causes of community stillbirths and early neonatal deaths in low-income countries using verbal autopsy: an International, Multicenter Study. J Perinatol. 2012;32(8):585–92.
Feng X, Guo S, Hipgrave D, Zhu J, Zhang L, Song L et al. China's facility-based birth strategy and neonatal mortality: a population-based epidemiological study. Lancet. 2011;378(9801):1493-500. doi:10.1016/S0140-6736(11)61096-9.
Simpson CD, Ye XY, Hellmann J, Tomlinson C. Trends in cause-specific mortality at a Canadian outborn NICU. Pediatrics. 2010;126(6):e1538–44.
Freitas BAC, Goncalves MR. Ribeiro RdCL. Infant mortality according to preventable causes and components - Vicosa-MG, 1998-2010. [Portuguese]. Pediatria Moderna. 2012;48(6):237–45.
Flenady V. Epidemiology of fetal and neonatal death. In: Khong TY, Malcomson RDG, editors. Keeling's Fetal and Neonatal Pathology 5ed.: Springer International Publishing; 2015. p. 141-64.
Flenady V, Wojcieszek AM, Middleton P, Ellwood D, Erwich JJ, Coory M, et al. Stillbirths: recall to action in high-income countries. Lancet. 2016;387(10019):691–702.
Setel PW, Whiting DR, Hemed Y, Chandramohan D, Wolfson LJ, Alberti KG, et al. Validity of verbal autopsy procedures for determining cause of death in Tanzania. Trop Med Int Health. 2006;11(5):681–96. doi:10.1111/j.1365-3156.2006.01603.x.
Centre for Maternal and Child Enquiries (CMACE). Perinatal Mortality 2009: United Kingdom. London: CMACE; 2011.
Manandhar SR, Ojha A, Manandhar DS, Shrestha B, Shrestha D, Saville N, et al. Causes of stillbirths and neonatal deaths in Dhanusha district, Nepal: a verbal autopsy study. Kathmandu University Medical Journal. 2010;8(1):62–72.
The MRC Unit for Maternal and Infant Health Care Strategies, PPIP Users, National Department of Health. Saving Babies 2002: Third Perinatal Care Survey of South Africa. 2002.
Wood AM, Pasupathy D, Pell JP, Fleming MS. Trends in socioeconomic inequalities in risk of sudden infant death syndrome, other causes of infant mortality, and stillbirth in Scotland: population based study. BMJ: British Medical J (Overseas & Retired Doctors Edition). 2012;344(7850):21. doi:10.1136/bmj.e1552.
Seaton SE, Field DJ, Draper ES, Manktelow BN, Smith GCS, Springett A et al. Socioeconomic inequalities in the rate of stillbirths by cause: A population-based study. BMJ Open. 2012;2(3).
Black RE, Cousens S, Johnson HL, Lawn JE, Rudan I, Bassani DG, et al. Global, regional, and national causes of child mortality in 2008: a systematic analysis. Lancet. 2010;375(9730):1969–87. doi:10.1016/S0140-6736(10)60549-1.
Cole S, Hartford RB, Bergsjo P, McCarthy B. International collaborative effort (ICE) on birth weight, plurality, perinatal, and infant mortality. III: A method of grouping underlying causes of infant death to aid international comparisons. Acta Obstet Gynecol Scand. 1989;68(2):113–7.
Lawn JE, Wilczynska-Ketende K, Cousens SN. Estimating the causes of 4 million neonatal deaths in the year 2000. Int J Epidemiol. 2006;35(3):706–18. doi:10.1093/ije/dyl043.
Lawn JE, Kinney MV, Black RE, Pitt C, Cousens S, Kerber K et al. Newborn survival: a multi-country analysis of a decade of change. (Special Issue: A decade of change for newborn survival, policy and programmes (2000-2010): A multi-country evaluation of progress towards scale.). Health Policy Plan. 2012;27(Suppl. 3). doi:10.1093/heapol/czs053.
Lawn JE, Kerber K, Enweronu-Laryea C, Cousens S. 3.6 Million neonatal deaths - what is progressing and what is not? (Special Issue: Global perinatal health.). Semin Perinatol. 2010;34(6):371–86. doi:10.1053/j.semperi.2010.09.011.
Rocha R, Oliveira C, Karina Ferreira D, Bonfim C. Neonatal mortality and avoidability: an epidemiological profile analysis [Portuguese]. Revista Enfermagem UERJ. 2011;19(1):114–20.
Smith LK, Manktelow BN, Draper ES, Springett A, Field DJ. Nature of socioeconomic inequalities in neonatal mortality: population based study. BMJ. 2010;341(c6654).
Winter R, Pullum T, Langston A, Mivumbi NV, Rutayisire PC, Muhoza DN, et al. Trends in Neonatal Mortality in Rwanda, 2000-2010. Calverton: ICF International; 2013.
This project was conceived as part of the Harmonized Reproductive Health Registries project through the Norwegian Institute of Public Health in partnership with the Mater Research Institute, Brisbane, Australia, and in collaboration with the Department of Reproductive Health and Research, WHO. Thanks to Kirsty Rickett for reviewing search strings and running searches of several databases; Viviana Rodriguez for administrative support; Dr Paul Gardiner for assistance during the initial phase of data extraction; Rafaela Augusto Neman Dos Santos (Spanish and Portuguese), Amanda Quach (French, Bosnian, German, Serbian and Turkish), and Yu Gao (Chinese) for assistance with screening and data extraction for non-English papers; and Liam Flenady, Drew Kilday, Amber Popattia, and Erica Woonji Jang for assistance with data extraction and other tasks.
Dedicated to Wilder D Leisher and Emily E Prasky.
The Mater Research Institute, University of Queensland, Australia, funded VF, and partially funded HR, AW, and SHL, and TZ as part of the University of Queensland undergraduate student scholarship, to undertake this study. There was no external source of funding for this study.
Availability of data and materials
VF and FF conceptualized the study. SHL and VF designed the study; SHL, ZT and HR carried out data extraction; VF acted as arbiter for disagreements on data extraction; SHL coordinated the study, conducted all data analysis and drafted the paper; VF, AW, FK, HB, JJE, GS, OT, MG, EA, RP, and EM reviewed early drafts of the manuscript. All authors (SHL, ZT, HR, EA, HB, JJE, JFF, JG, SG, AMG, AEPH, FK, JL, EMM, RP, GCSS, ӦT, AMW, VF) read and approved the final manuscript.
The lead author, SHL, has no competing interests. ZT, HR and AW have no competing interests. The remaining authors have been involved in the development or evaluation of existing perinatal death classification systems.
Consent for publication
Not applicable, as no individual person’s data has been reported in this paper.
Ethics approval and consent to participate
Not applicable, as no individual person’s data has been reported in this paper.
PRISMA checklist. (DOCX 51 kb)
Decision tree for inclusion/exclusion. (DOCX 45 kb)
List of variables extracted. (DOCX 46 kb)
Sensitivity of number of “widely used” systems to cut-offs for number of countries in which used and number of deaths classified. (DOCX 46 kb)
All included publications with reason for inclusion and author intent. (DOCX 223 kb)
Year of creation/modification of classification systems for causes of stillbirth and neonatal death developed or used between 2009 and 2014. (DOCX 48 kb)
Countries in which more than one system was used to classify causes of stillbirths and/or neonatal deaths, 2009-2014. (DOCX 45 kb)
National classification systems for causes of stillbirth and neonatal death in use 2009-2014. (DOCX 53 kb)
Classification systems for causes of stillbirth and neonatal death used in highest-burden countries, 2009-2014. (DOCX 83 kb)
Maximum percent of deaths classified as “other” and “unexplained” by classification systems according to type of death classified. (DOCX 62 kb)
Kappa scores from reliability testing of classification systems for causes of stillbirth and neonatal death in use 2009-2014. (DOCX 66 kb)
Selected shortcomings of existing systems and rationale for development of new systems/modification of existing systems. (DOCX 44 kb)