You are viewing the site in preview mode

Skip to main content


Combining adverse pregnancy and perinatal outcomes for women exposed to antiepileptic drugs during pregnancy, using a latent trait model



Application of latent variable models in medical research are becoming increasingly popular. A latent trait model is developed to combine rare birth defect outcomes in an index of infant morbidity.


This study employed four statewide, retrospective 10-year data sources (1999 to 2009). The study cohort consisted of all female Florida Medicaid enrollees who delivered a live singleton infant during study period. Drug exposure was defined as any exposure to Antiepileptic drugs (AEDs) during pregnancy. Mothers with no AED exposure served as the AED unexposed group for comparison. Four adverse outcomes, birth defect (BD), abnormal condition of new born (ACNB), low birth weight (LBW), and pregnancy and obstetrical complication (PCOC), were examined and combined using a latent trait model to generate an overall severity index. Unidimentionality, local independence, internal homogeneity, and construct validity were evaluated for the combined outcome.


The study cohort consisted of 3183 mother-infant pairs in total AED group, 226 in the valproate only subgroup, and 43,956 in the AED unexposed group. Compared to AED unexposed group, the rate of BD was higher in both the total AED group (12.8% vs. 10.5%, P < .0001), and the valproate only subgroup (19.6% vs. 10.5%, P < .0001). The combined outcome was significantly correlated with the length of hospital stay during delivery in both the total AED group (Rho = 0.24, P < .0001) and the valproate only subgroup (Rho = 0.16, P = .01). The mean score for the combined outcome in the total AED group was significantly higher (2.04 ± 0.02 vs. 1.88 ± 0.01, P < .0001) than AED unexposed group, whereas the valproate only subgroup was not.


Latent trait modeling can be an effective tool for combining adverse pregnancy and perinatal outcomes to assess prenatal exposure to AED, but evaluation of the selected components is essential to ensure the validity of the combined outcome.


  • AEDs have significant effects on all four component birth outcomes, and as well as the combined outcome.

  • Valproate has significant effects on two out of four component outcomes, and no association with the combined outcome.

  • Latent Trait Modeling is an effective tool to combine rare birth defect outcomes.

  • Evaluation of selected components is essential to ensure the validity of the combined outcome.


Birth defects (BDs), involving major congenital malformation (MCM) and minor anomaly (MA) are the leading causes of infant mortality, morbidity, and years of potential life lost. In the USA, the association of infant BDs and pregnancy and obstetrical complications (PCOCs) with maternal exposure to antiepileptic drugs (AEDs) has been investigated extensively [13]. However, the rare occurrence of BDs, abnormal condition of new born (ACNBs), and PCOCs limits the power of most published studies, and makes study results inconclusive [46]. A joint model for combining individual outcomes is proposed to improve the efficiency and power of BD studies [7].

Latent variable models have increasingly been applied in medical research, including measurement of quality of life, diagnostic testing, survival analysis, and joint modeling of longitudinal data [8]. Latent variables are unobserved variables that can only be assessed indirectly by observable manifest variables. A latent variable model is a statistical approach that uses a set of observable manifest variables to derive one or more unobsersable variables. In latent variable model with a latent trait setting, the manifest variables are discrete, including dichotomous, nominal, or ordinal variables, whereas, the latent variables are continuous variables and can be assumed as normally or log-normally distributed [9]. An important assumption for latent variable model is the “local independence”, defined as that the manifest variables are conditionally independent upon a given latent variable, and the relationship among the manifest variables is fully explained by the latent variable [10]. A latent variable model in a latent trait setting was developed for this study to combine individual BD outcomes and generate an infant morbidity index [11]. This model combines four infant morbidity outcomes and generates a continuous index representing the infant’s propensity for morbidity [11]. Application of this model to combine rare adverse pregnancy and perinatal outcomes in drug safety studies may increase statistical power and improve efficiency of studies investigating low prevalence sequelae.

A debate remains over the use of combined or individual outcomes in drug safety studies. A combined outcome may lead to incorrect results and threaten the validity of the study if the components are selected inappropriately [12, 13]. Therefore, the combined outcome must be evaluated in terms of conceptualization of the composite outcome [12], and appropriate properties of the latent variable, such as local independence, construct validity and reliability [14].

The objective of this study is to apply a latent trait model to generate a valid combined outcome (adverse perinatal and pregnancy outcome; APO) to assess the overall adverse pregnancy and perinatal risks for mothers and infants exposed to AEDs.


Data sources

This study used four statewide, retrospective 10-year databases: Florida Medicaid claims, Florida Birth Vital Statistics, Florida Birth Anomalies, and Florida Hospital Discharge Inpatient and Outpatient records (January 1, 1999–December 31, 2009).

Study population

This study includes all female Florida Medicaid enrollees who delivered a live singleton infant between April 1, 2000 and December 31, 2009. Exclusion criteria for maternal-infant pairs are: mothers with dual eligibility for Medicare, HMO, or private insurance; mothers having multiple births (twins or higher order); mothers with diabetes mellitus (ICD-9 codes: 249.x, 250.x, 790.29, or use of any anti-diabetics during baseline), hypertension (ICD-9 codes: 401.x, 416.x, 796.2, 997.91, 459.3, or antihypertensive drug use during baseline), or HIV pre-pregnancy (ICD-9 codes: 042, 079.53, V08, V01.79, 795.71, or use of any antiretroviral therapy); infants who were twins, triplets, quadruplets or more; infants with birth weight lower than 350 g or higher than 6000 g; mothers or infants with critical information missing (e.g., birth weight, demographics, or medical information).

Study design

The index date is the infant’s birth date. The drug exposure window was defined as the preceding 9-month pregnancy period after the first day of the last menstrual date. A six month baseline period before the first date of the last menstrual date was utilized to determine the baseline demographic and clinical characteristics. BD outcomes were detected 0–365 days after live birth.


Drug exposure was determined from Medicaid pharmacy claims using national drug codes. Two drug exposure groups, valproate and AEDs (including valproate), were employed to develop two scenarios with different patterns of association with the four component outcomes. Valproate use was defined as prescriptions dispensed for valproate, sodium valproate, or divalproex. AEDs included: carbamazepine, ethosuximide, felbamate, gabapentin, lamotrigine, levetiracetam, oxcarbazepine, phenobarbital, phenytoin, pregabalin, primidone, tiagabine, topiramate, valproate, and zonisamide.

The birth anomalies are related to exposure time during pregnancy: [15] MCM associates with teratogen exposure in the first trimester [16], and MA and LBW relate to the maternal drug exposure in the third trimester [15, 17]. Therefore, maternal drug exposure during the entire pregnancy can affect the combined outcome. The prenatal drug exposure window was established as the period of 14 days before the first day of the mother’s last menstrual period to the infant’s birth date. The drug exposure was defined as any one dose of the drugs listed above dispensed during the exposure window, including which drug was dispensed prior to the exposure window and its days of supply covers at least one day of the exposure window. Adding 14 days prior to the pregnancy takes into account the conception period and the residual effects of AEDs. Sensitivity analysis was conducted to examine the effects of different drug exposure windows on the combined outcome.

Component outcomes

We investigated four adverse pregnancy and infant outcomes: BD (involving MCM and MA), abnormal condition of new born (ACNB), LBW, and PCOC from multiple data sources. The operational definition for each component outcome was listed in Additional file 1: Table S1. MCMs and MAs were collected for 365 days following birth using the 9th edition of the International Classification of Diseases-Clinical Modification (ICD-9 CM) code (740–759.9) from Florida Hospital Discharge Inpatient and Outpatient data. It has been confirmed that Hospital Discharge data, along with other Children’s Medical Services diagnostic information, efficiently enhanced case ascertainment for BD cases from Florida Birth Vital Statistics data [1820]. ACNB and birth weight were obtained from Florida Birth Vital Statistics. The common conditions of ACNBs include anemia, birth injury, fetal alcohol syndrome, hyaline membrane disease, and assisted ventilation. Birth weight was categorized into four levels: Extremely Low Birth Weight (ELBW, 350–999 g), Very Low Birth Weight (VLBW, 1000–1499 g), Low Birth Weight (LBW, 1500–2499 g) and Normal Birth Weight (NBW, 2500–5999 g). PCOCs were identified either from Florida Birth Vital Statistics data or using ICD-9-CM and Current Procedural Terminology codes from Medicaid inpatient and outpatient claims data depending upon the extent of the validity and reliability of these data sources as reported in previous studies [2125]. Gestational hypertension, preeclampsia, and eclampsia were identified using ICD-9-CM codes from hospital discharge data [22, 23]. Preterm birth was operationally defined as gestational age less than 37 weeks [24]. Gestational age was computed from the infant birth date and mother’s last menstrual period. To identify obstetrical conditions, we defined cesarean delivery and forceps or vacuum extractor delivery from either birth certificates or ICD-9-CM codes in hospital discharge data, if it was missing in the birth certificates. Postpartum hemorrhage was identified solely using ICD-9-CM codes in hospital discharge data due to poor validity of birth certificate data on pregnancy complications and obstetric events [25].

Selected component outcomes were evaluated for similarity of importance, frequency rate, and treatment effect. The importance of the component outcome was assessed by computing Spearman correlations between individual outcomes and a clinically meaningful endpoint, defined as infant’s length of hospital stay following delivery [26].

Reference group and covariates

A reference group, defined as infants with no maternal exposure to any AEDs during pregnancy and termed “AED unexposed group”, was selected for the estimation of treatment effects of the combined and component outcomes. The potential confounding factors were controlled using propensity score matching techniques. Previous studies have documented that common risk factors for adverse maternal and infant outcomes include socioeconomic status, infant gender, maternal age, race, BMI, smoking, alcohol consumption, parity, and drug exposure during pregnancy [2730]. Significant teratogens such as alcohol and tobacco were controlled for during treatment effect assessment [3136]. Other medical indications documented as teratogens in previous studies were also controlled in this study [37, 38]. Demographic characteristics were identified from birth certificates, whereas co-morbidities or co-medications during pregnancy were identified using ICD-9-CM and National Drug Codes from Hospital Discharge data.

Combining outcomes using latent trait modeling

The statistical inference and mathematical algorithm for the model have been described elsewhere [39]. An important assumption of the model is “local independence”, defined as an independence of manifest outcomes conditioned on latent variables [11]. Estimated Generalized Nonlinear Least Squares estimation was employed to obtain the parameters involved in the latent trait model [11, 40]. The derivative process for the combined outcome is as follows:

  • Step 1. Calculate initial estimates of the model parameters. First, we selected initial estimates to make the iteration process converge. We obtained 32 independent levels by combining 3 dichotomous component outcomes: BD (Yes/No), ACNB (Yes/No), PCOC (Yes/No), and 1 polytomous component outcome: Birth Weight (BW): 2500 ~ 5999 g, 1500 ~ 2499 g, 1000 ~ 1499 g, 350 ~ 999 g. The frequencies and proportions for each level of the combination of four component outcomes were calculated and utilized to deduce the initial estimates of the model parameters.

  • Step 2. Derive the final estimates of the model parameters. Using the set of initial values and the modified Gauss-Newton algorithm, final estimates of the model parameters were obtained. The modified Gauss–Newton algorithm was run in SAS Proc IML, starting from the initialized value at iteration 0, until the difference of the last two estimates was less than 10−9. All final parameters were estimated from the iteration process.

  • Step 3: Calculate the conditional probabilities given the latent variable S for each component outcome. Substituting the final estimates into the latent trait model, we calculated expected probabilities and counts for each level of the combination of four component outcomes.

  • Step 4: Derive the combined outcome, the severity index of adverse perinatal and pregnancy outcome (APO). Substituting final estimates and conditional probabilities into the latent trait model, we further obtained the posterior distribution of latent variable S, and the mean of the posterior distribution (ŝ). The final estimate, APO, is a rescaled ŝ, to adapt for measurement of severity of health status.

Evaluation of combined outcome

Local independence of four component outcomes was assessed using Yen’s Q statistics [41]. Validity and reliability of the combined outcome were evaluated using factor analysis and Spearman correlation [42, 43].

Statistical analysis

Continuous variables were compared using a student t test, and categorical variables were examined using a chi-square test. Spearman correlation was calculated for discrete data, and Pearson correlation was calculated for continuous variables that are normally distributed. Multivariate logistic modeling was used to obtain propensity scores and assess the effects of drug use for each component outcome. Latent trait modeling was employed to combine four component outcomes into a severity index.

Statistical analysis was conducted using SAS 9.3 (Cary, NC). P < 0.05 was considered a statistically significant difference, except where P < 0.025 was deemed significant after Bonferroni correction for two comparisons.


After applying all inclusion and exclusion criteria, the final study cohort consisted of 3183 mother-infant pairs in the AED exposure group, 226 mother-infant pairs in the valproate exposure subgroup, and 43,956 mother-infant pairs in the AED unexposed group. A comparison of the demographic and clinical characteristics of the three groups is presented in Table 1, and the characteristics of all study populations, as well as missing data, were presented in Additional file 1: Table S2. The detailed data about AED exposure in pregnant women in Florida Medicaid has been published in elsewhere [44].

Table 1 Demographic and Clinical Characteristics of Study Participants. Obtained from Florida Birth Vital Statistics or Medicaid Claims Data

The combined outcome, APO scores were compared between AED, valproate only, and AED unexposed group (Fig. 1). The average APO score in the total AED group was significantly different for AED unexposed group (Mean ± SE: 2.04 ± 0.02 vs 1.88 ± 0.01, P < .0001), but not for the valproate subgroup (Mean ± SE: 2.00 ± 0.07 vs. 1.88 ± 0.01, P = 0.1003). The valproate subgroup (n = 226) was smaller than the total AED group (n = 3183), which could have affected the statistical results due to insufficient power.

Fig. 1

Comparison of Adverse Perinatal and Pregnancy Outcome (APO) Scores between Total AED Group, Valproate Subgroup, and AED unexposed group. Total AED group includes the patients using valproate

Figure 2 presents the incidence rates of PCOC, BD (MCM and MA), and ACNB in three study groups. Compared to AED unexposed group, the total AED exposed group had significant higher rates on PCOC (36% vs. 28%, P < .0001) and ACNB (12.1% vs. 7.8%, P < .0001). The rate of PCOC was not significantly higher in the valproate subgroup compared to the AED unexposed group (34% vs. 28%, P = 0.0509). The valproate subgroup had the highest rates of BD, significantly higher than the AED unexposed group (20% vs. 10.5%, P < .0001). ACNB in valproate subgroup was not different than the AED unexposed group (10.2% vs. 7.8%, P = 0.1525).

Fig. 2

PCOC, Birth Defects (Major and Minor Congenital Malformation), and ACNB in the Total AED Group and Valproate Subgroup, and AED unexposed group. Total AED group includes patients using valproate. BD: Birth defects. ACNB: Abnormal condition of new born. PCOC: Pregnancy and obstetrical complication. LBW: Low birth weight

Figure 3 delineates the distribution of four BW categories (Normal: 2500–5999 g, LBW: 1500 ~ 2500 g, VLBW: 1000 ~ 1500 g, and ELBW: <1000 g) in three study groups. The rate of LBW in the total AED exposed group was significantly higher than that of the AED unexposed group (88.1% vs. 91.6%, 10.6% vs. 6.7%, 0.9% vs. 0.7%, 0.5% vs. 0.99%, P < .0001). The valproate subgroup did not differ significantly in the distribution of BW categories from AED unexposed group (88.6% vs. 91.6%, 10.6% vs. 6.7%, 0.4% vs. 0.7%, 0.4% vs. 0.99%, P = 0.0752).

Fig. 3

Distribution of Four Birth Weight Categories in the Total AED Group, Valproate Subgroup, and AED Unexposed Group. The total AED group includes patients using valproate. ELBW: Extreme Low Birth Weight. VLBW: Very Low Birth Weight. LBW: Low Birth Weight

In Table 2, we further compared the propensity score adjusted drug effects and clinical importance (defined as Spearman correlation with the length of hospital stay during delivery) for each component or combined outcome in the total AED group or valproate subgroup. The adjusted drug effects and Spearman correlation with the length of hospital stay during delivery were significant for the total AED group on all four component outcomes, and for the valproate subgroup on BD and PCOC, but not for ACNB or LBW. The combined outcome APO was significantly associated with exposure to total AED (β ± SE: 0.24 ± 0.03, P < .0001) or valproate only (β ± SE: 0.32 ± 0.09, P = .0004).

Table 2 Propensity Score Adjusted Drug Effects, and Importance of Each Component or Combined Outcome in Pregnant Women Exposed to Total AED or Valproate Only

Expected and observed frequencies and percentages of each combination of the four observed outcomes were enumerated in Additional file 1: Table S3. Additional file 1: Table S3 also presents the estimated posterior mean ŝ and final estimate APO for 32 combinations of four component outcomes, each of which is associated with an unique score of APO, ranging from 1 to 8.

There was no correlation between the four component outcomes after controlling for the latent variable. Thus, local independence of the four component outcomes was established according to Yen’s Q3 Statistics. The internal homogeneity was confirmed in all four component outcomes. They all significantly correlate with each other and the combined outcome APO. APO was significantly correlated with the length of hospital stay during delivery (Rho = 0.27, P < .0001), and no correlation with infant breast fed status (Rho = −0.07, P < .0001) indicate that APO was associated with a well-established health status measure. The higher the APO score, the longer the hospital stay for the mothers and infants during delivery.

Sensitivity study

We re-defined the pregnancy period calculating gestational age +10 day, 20 days, and 30 days to examine the change in association between AED exposure during pregnancy and four component outcomes. There were no significant differences between these time windows.


The total AED group was significantly different from the AED unexposed group on all observed outcomes, whereas valproate subgroup differed statistically from AED unexposed group only on BD and PCOC. These two exposure groups had varied patterns of observed outcomes that were combined using the latent trait model. The psychometric properties of the combined outcome were evaluated and compared among the two exposed groups and one healthy comparison group. The four component outcomes were found to be not significantly different on the incidence rates. One exception was PCOC, which had the highest incidence out of the three component outcomes. However, neither the differences of AED effects on PCOC nor the correlation between PCOC and the length of the hospital stay during delivery was significantly different between the total AED group and AED unexposed group. Thus, these four component outcomes exhibited a high level of homogeneity and demonstrated the validity of component selection for the AED safety study.

Table 1 provides evidence for a pronounced difference between the mother-infant pairs exposed to AEDs versus AED unexposed group and raises a concern that studies of pregnancy outcome need to control for these differences. In our study, propensity score was used to adjust these covariates for drug effect assessment.

Figures 1, 2, and 3 raise concern for combining outcomes in valproate drug safety studies. Compared to the AED unexposed group, AED use in the total exposed group was associated with significant effects on all four component outcomes, whereas, valproate use was related to increased BD and PCOC, and had no significant effect on ACNB and BW. The lack of differences for valproate on APO, ACNB and BW may be in part due to the small sample size of the valproate subgroup. Previous studies using birth registry data has shown that fetal valproate exposure is associated with higher rates of BD than other AEDs. For example, the UK Birth Registry reported a 6.7% rate of major congenital malformations for valproate, and the North American AED Pregnancy Registry reported a rate of 10.7% [3, 45]. However, the incidence of minor abnormalities in our study, 9.1% in AED unexposed group and 10.7% in the total AED group, was lower than reported in the literature, 15% to 20% in the general population and 37% in AED exposed pregnant women [4650]. Considering the difficulties of identifying minor abnormalities, under-reporting or misdiagnosis of minor abnormalities in claims data might account for this discrepancy. Given that valproate exposure is not consistently associated with the four component outcomes and violates the criteria for component selection for a composite outcome, a concern is raised about the validity of combining these four outcomes in a valproate safety study.

To our knowledge, combining outcomes using a latent variable model has not been utilized in any pharmaco-epidemiological studies previously. This model was first described in 2008 for combining four birth defect outcomes to construct an infant morbidity index [11]. We employed the model to assess the comprehensive effects of AEDs on four adverse perinatal and pregnancy outcomes in both mothers and infants. Superior to other composite outcomes, the latent variable model generates a continuous measure that correlates to the component outcomes with different levels and takes into account the comprehensive effects of all component outcomes [11].

The final estimate of the latent variable S ^ ranged from 0.08 for normal infant-mother pairs to 0.61 for the mother-infant pairs with different patterns of BD, ACNB, PCOC, and ELBW. These estimates are similar in magnitude to those documented previously [11].

This article is based on a thesis published by one of the authors in 2013 (

Study limitations

Several limitations should be considered as a consequence of using linked claims data and the nature of the study. First, by combining MCM, MA, LBW, and PCOC, the latent variable APO is an overall adverse outcome for both mothers and infants. The association between drug exposure and each individual component outcome is unknown if latent variable APO is used as a dependent variable in the model. Second, the power to detect differences in the valproate only subgroup is a concern due to small sample size. The insignificant difference in APO between valproate only subgroup and health unexposed group might be due to the inadequate statistical power. Third, MAs might be underestimated in this study, which could cause underestimation of APO score. However, the misclassification of MAs is non-differential, so it should not affect the assessment of differences between drug use groups. Finally, this latent variable model combines manifest outcomes based upon the probability of occurrence in the study population. The severity of each outcome is not mathematical weighted in the combining process. Future studies are needed to develop more advanced statistical models to combine more specific outcomes based upon not only the probability of occurrence, but also the severity of each outcome.


This study used a latent trait model to assess adverse pregnancy and perinatal outcomes in women exposed to antiepileptic drugs during pregnancy. We recommend using this latent trait model in other drug studies examining similarly related component outcomes. If the study drug, is only weakly associated with any of the selected component outcomes, the study drug’s effects on the combined outcome may be diluted and be statistically non-significant compared to the reference group. Such an approach is detrimental to any drug safety study as the results move towards the null and the true teratogenic effects of the drug can be masked. Hence, evaluation of selected components is essential before a latent trait model can be used to assess a combined outcome.



Abnormal Condition of Newborn


Antiepileptic Drugs (also called Anticonvulsant Drugs)


Adverse Perinatal Outcome


Birth defect


Birth weight


Confidence Interval


Extremely Low Birth Weight


Low birth weight


Minor anomaly


Major congenital malformation


Normal Birth Weight


Pregnancy and Obstetric Complication


Standard Error


Very Low Birth Weight


  1. 1.

    The Centers for Disease Control and Prevention. Birth Defects. Accessed 14 Jan 2011.

  2. 2.

    Meador KJ, Baker GA, Finnell RH, et al. In utero antiepileptic drug exposure: fetal death and malformations. Neurology. 2006;67:407–12.

  3. 3.

    Wyszynski DF, Nambisan M, Surve T, Alsdorf RM, Smith CR, Holmes LB. Increased rate of major malformations in offspring exposed to valproate during pregnancy. Neurology. 2005;64:961–5.

  4. 4.

    Mølgaard-Nielsen D, Hviid A. Newer-generation antiepileptic drugs and the risk of major birth defects. JAMA. 2011;305(19):1996–2002.

  5. 5.

    Bakker MK, Kerstjens-Frederikse WS, Buys CH, de Walle HE, de Jong-van den Berg LT. First-trimester use of paroxetine and congenital heart defects: a population-based case-control study. Birth Defects Res A Clin Mol Teratol. 2010;88(2):94–100.

  6. 6.

    Davis RL, Rubanowice D, McPhillips H, Raebel MA, Andrade SE, Smith D, Platt R. HMO Research Network Center for Education, Research in Therapeutics. Risks of congenital malformations and perinatal events among infants exposed to antidepressant medications during pregnancy. Pharmacoepidemiol Drug Saf. 2007;16(10):1086–94.

  7. 7.

    McCulloch C. Joint modelling of mixed outcome types using latent variables. Stat Methods Med Res. 2008;17:53–73.

  8. 8.

    Rabe-Hesketh S, Skrondal A. Classical latent variable models for medical research. Stat Methods Med Res. 2008;17:5–32.

  9. 9.

    Rabe-Hesketh S, Skrondal A. Multilevel and Latent Variable Modeling with Composite Links and Exploded Likelihoods. Psychometrika. 2007;72(2):123–40.

  10. 10.

    Sobel ME. Measurement, Causation and local independence in latent variable models. In: Latent Variable Modeling and Applications to Causality, Lecture Notes in Statistics, Volume 120. 1997. p. 11–28.

  11. 11.

    Liu X, Roth J. Development and validation of an infant morbidity index using latent variable models. Stat Med. 2008;27(7):971–89.

  12. 12.

    Cordoba G, Schwartz L, Woloshin S, Bae H, Gotzsche C. Definition, reporting, and interpretation of composite outcomes in clinical trials: systematic review. BMJ. 2010;341:c3920.

  13. 13.

    Freemantle N, Calvert M, Wood J, Eastaugh J, Griffin C. Composite outcomes in randomized trials: greater precision but with greater uncertainty? JAMA. 2003;289(19):2554–9.

  14. 14.

    O’Leary-Kelly SW, Volurka RJ. The empirical assessment of construct validity. J Oper Manag. 1998;16:387–405.

  15. 15.

    Persaud TVN, Chudley AE, Skalko RG. Basic concepts in teratology. New York: Alan R. Liss, Inc.; 1985.

  16. 16.

    Cooper WO, Hernandez-Diaz S, Arbogast PG, Dudley JA, Dyer S, Gideon PS, Hall K, Ray WA. Major congenital malformations after first-trimester exposure to ACE inhibitors. N Engl J Med. 2006;354(23):2443–51.

  17. 17.

    Costei AM, Kozer E, Ho T, Ito S, Koren G. Perinatal outcome following third trimester exposure to paroxetine. Arch Pediatr Adolesc Med. 2002;156(11):1129–32.

  18. 18.

    Cooper WO, Hernandez-Diaz S, Gideon P, Dyer SM, Hall K, Dudley J, Cevasco M, Thompson AB, Ray WA. Positive predictive value of computerized records for major congenital malformations. Pharmacoepidemiol Drug Saf. 2008;17:455–60.

  19. 19.

    Salemi JL, Tanner JP, Block S, Bailey M, Correia JA, Watkins SM, Kirby RS. The relative contribution of data sources to a birth defects registry utilizing passive multisource ascertainment methods: does a smaller birth defects case ascertainment net lead to overall or disproportionate loss? J Registry Manag. 2011;38(1):30–8.

  20. 20.

    Wang Y, Sharpe-Stimac M, Cross PK, Druschel CM, Hwang SA. Improving case ascertainment of a population-based birth defects registry in New York State using hospital discharge data. Birth Defects Res A Clin Mol Teratol. 2005;73(10):663–8.

  21. 21.

    Reichman NE, Hade EM. Validation of birth certificate data. A study of women in New Jersey’s HealthStart program. Ann Epidemiol. 2001;11(3):186–93.

  22. 22.

    Roohan PJ, Josberger RE, Acar J, Dabir P, Feder HM, Gagliano PJ. Validation of birth certificate data in New York State. J Community Health. 2003;28(5):335–46.

  23. 23.

    Gore DC, Chez RA, Remmel RJ, Harahan M, Mock M, Yelverton R. Unreliable medical information on birth certificates. J Reprod Med. 2002;47(4):297–302.

  24. 24.

    DiGiuseppe DL, Aron DC, Ranbom L, Harper DL, Rosenthal GE. Reliability of birth certificate data: a multi-hospital comparison to medical records information. Matern Child Health J. 2002;6(3):169–79.

  25. 25.

    Northam S, Knapp TR. The reliability and validity of birth certificates. J Obstet Gynecol Neonatal Nurs. 2006;35(1):3–12.

  26. 26.

    Horn SD, Sharkey PD, Buckle JM, et al. The relationship between severity of illness and hospital length of stay and mortality. Med Care. 1991;29:305–17.

  27. 27.

    Hogan DP, Park JM. Family factors and social support in the developmental outcomes of very low-birth weight children. Clin Perinatol. 2000;27:433–59.

  28. 28.

    Duong HT, Hoyt AT, Carmichael SL, Gilboa SM, Canfield MA, Case A, McNeese ML, Waller DK, and the National Birth Defects Prevention Study. Is maternal parity an independent risk factor for birth defects? Birth Defects Res A Clin Mol Teratol. 2012;94(4):230–6.

  29. 29.

    Baardman ME, Kerstjens-Frederikse WS, Corpeleijn E, de Walle HE, Hofstra RM, Berger RM, Bakker MK. Combined adverse effects of maternal smoking and high body mass index on heart development in offspring: evidence for interaction? Heart. 2012;98(6):474–9. Epub 2012 Jan 30.

  30. 30.

    Siega-Riz AM, Herring AH, Olshan AF, Smith J. Moore C; National Birth Defects Prevention Study. The joint effects of maternal prepregnancy body mass index and age on the risk of gastroschisis. Paediatr Perinat Epidemiol. 2009;23(1):51–7.

  31. 31.

    Andrade SE, Raebel MA. Use of prescription medications with a potential for fetal harm among pregnant women. Pharmacoepidemiol Drug Saf. 2006;15(8);546–54.

  32. 32.

    Koren G, Pastuszak A, Ito S. Drugs in Pregnancy. N Engl J Med. 1998;338:1128–37.

  33. 33.

    Bracken MB, Holford TR. Exposure to prescribed drugs in pregnancy and association with congenital malformations. Obstet Gynecol. 1981;58(3):336–44.

  34. 34.

    Davis RL, Rubanowice D, McPhillips H. HMO Research Network Center for Education, Research in Therapeutics. Risk of congenital malformations and perinatal events among infants exposed to antidepressant medications during pregnancy. Pharmacoepidemiol Drug Saf. 2007;16:1086–94.

  35. 35.

    Niebyl JR, Simpson JL. Teratology and Drugs in Pregnancy, Gynecology and Obstetrics. Volume 2, Chapter 6. Accessed 26 Dec 2012.

  36. 36.

    Chung W. Teratogens and their effects. Accessed 26 Dec 2012.

  37. 37.

    The Effects of Workplace Hazards on Female Reproductive Health. DHHS (NIOSH) Publication No. 99.104. Feb 1999. Accessed 26 Dec 2012.

  38. 38.

    Maternal Disease and Complications–Summary Outline. Accessed 26 Dec 2012.

  39. 39.

    Bartholomew DJ, Knott M. Latent variable models and factor analysis. London: Arnold; 1999.

  40. 40.

    Hartley HO. The modified Gauss-Newton method for the fitting of non-linear regression functions by least squares. Techmetrics. 1961;3:269–80.

  41. 41.

    Yen WM. Scaling performance assessments: Strategies for managing local item dependence. J Educ Meas. 1993;30:187–213.

  42. 42.

    Kimberlin C, Winterstein AG. Validity and reliability of measurement instruments use in research. Am J Health-Syst Pharm. 2008;65:2276–84.

  43. 43.

    John OP, Benet-Martinez V. Measurement: Reliability, construct validation, and scale construction. In: Reis HT, Judd CM, editors. Handbook of research methods in social psychology. New York: Cambridge University Press; 2000. p. 339–69.

  44. 44.

    Wen X, Meador KJ, Hartzema A. Antiepileptic drug use by pregnant women enrolled in Florida Medicaid. Neurology. 2015;84(9):944–50. Epub 2015 Feb 4.

  45. 45.

    Campbell E, Kennedy F, Russell A, Smithson WH, Parsons L, Morrison PJ, Liggan B, Irwin B, Delanty N, Hunt SJ, Craig J, Morrow J. Malformation risks of antiepileptic drug monotherapies in pregnancy: updated results from the UK and Ireland Epilepsy and Pregnancy Registers. J Neurol Neurosurg Psychiatry. 2014;85(9):1029–34. doi:10.1136/jnnp-2013-306318.

  46. 46.

    Kaneko S, Kondo T. Antiepileptic agents and birth defects: incidence, mechanisms and prevention. CNS Drugs. 1995;3(1):41–55.

  47. 47.

    Women with epilepsy: drug risks and safety during pregnancy. American academy of neurology. 2009., Accessed 2 Jan 2011.

  48. 48.

    Samren EB, van Duijn CM, Christianens GC, et al. Antiepileptic drug regimens and major congenital abnormalities in the offspring. Ann Neurol. 1999;46:739–46.

  49. 49.

    Kaneko S, Battino D, Andermann E, et al. Congenital malformations due to antiepileptic drugs. Epilepsy Res. 1999;33:145–58.

  50. 50.

    Kaneko S, Otani K, Fukushima Y, et al. Teratogenicity of antiepileptic drugs: analysis of possible risk factors. Epilpesia. 1988;29:459–67.

Download references




No funding support for this study.

Availability of data and materials

All data in this study were provided by Florida Department of Health ( and the Agency for Health Care Administration (

Authors’ contributions

XW Initiated and designed the study; made substantial contributions to conception, and acquisition, analysis and interpretation of data; drafted and revised the manuscript; and gave final approval of the version to be published. AH Made substantial contributions to conception and design, and acquisition of data; involved in drafting the manuscript and revising it critically for important intellectual content; and gave final approval of the version to be published. JAD Made substantial contributions to conception and design, analysis and interpretation of data; involved in revising the manuscript critically for important intellectual content; gave final approval of the version to be published. BB Made substantial contributions to conception and design, analysis and interpretation of data; involved in revising the manuscript critically for important intellectual content; gave final approval of the version to be published. XL Made substantial contributions to conception and design, analysis and interpretation of data; involved in revising the manuscript critically for important intellectual content; gave final approval of the version to be published. RE Made substantial contributions to conception and design, and interpretation of data; involved in revising the manuscript critically for important intellectual content; gave final approval of the version to be published. JR Made substantial contributions to conception and design, and acquisition of data; involved in revising the manuscript critically for important intellectual content; gave final approval of the version to be published. RS Made substantial contributions to conception and design, and interpretation of data; involved in revising the manuscript critically for important intellectual content; gave final approval of the version to be published. KJM Made substantial contributions to conception and design, and analysis and interpretation of data; involved in drafting the manuscript and revising it critically for important intellectual content; gave final approval of the version to be published.

Competing interests

The authors declare that they have no competing interests, except Dr. Kimford Meador. The followings are Dr. Meador’s financial disclosure statements:

  • Research Grants

    • NIH/NINDS 2U01-NS038455-11A1. Meador (Multi-PI) “Maternal Outcomes and Neurodevelopmental Effects of Antiepileptic Drugs;”*

    • NIH/NINDS R01NS088748-01. Drane (PI) “Dissecting the Cognitive Roles of Hippocampus and Other Temporal Lobe Structures” Role: Co-I;

    • NIH 1 R01 NS076665-01A1 Susan Marino (PI) “Characterizing and Predicting Drug Effects on Cognition” Role: Consultant;

    • Sunovion Pharmaceuticals. Meador (PI). “Double-Blind, Randomized, Two Period Crossover Comparison of the Cognitive and Behavioral Effects of Eslicarbazepine Acetate and Carbamazepine in Healthy Adults.”

  • Consultant

    • Consultant for the non-profit Epilepsy Study Consortium that receives monies from multiple pharmaceutical companies. Dr. Meador has consulted for the Epilepsy Study Consortium for the following companies: Eisai, GW Pharmaceuticals, NeuroPace, Novartis, Supernus, Upsher Smith Laboratories, UCB Pharma and Vivus Pharmaceuticals.

  • Other

    • He is Co-I and Director of Cognitive Core of the Human Epilepsy Project for the Consortium.

    • Note that the Epilepsy Study Consortium pays Dr. Meador’s university for his consultant time.

    • Dr. Meador receives income from clinical EEG procedures and care of neurological patients.*

    • Note that those items with asterisk involve personal income in excess of $10,000.

Consent for publication

Not applicable.

Ethics approval and consent to participate

This study was approved by the Institutional Review Board of the University of Florida and the Florida Department of Health. To obtain the research data, we completed the data utilization agreements with Florida Department of Health, and Florida Agency for Health Care Administration.

Author information

Correspondence to Xuerong Wen.

Additional file

Additional file 1: Table S1.

Operational Definition 625 for Component Outcomes. Table S2. Demographic Characteristics and Missing Data of Study Participants. Table S3. Observed Frequency (OBFREQ), Expected Frequency (EXFREQ), Observed Percents (OB%), Expected Percents (EX%), Estimates of Posterior Mean of the Latent Variable S ̂ 632 and the APO by Combinations of Four Observed Outcomes. (DOCX 23 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark


  • Latent trait model
  • Antiepileptic drugs
  • Valproate
  • Adverse pregnancy outcome
  • Adverse perinatal outcome
  • Combining outcomes