s12881-014-0102-9 1471-2350 Research article <p>Replication and exploratory analysis of 24 candidate risk polymorphisms for neural tube defects</p> Pangilinan Faith faith@mail.nih.gov Molloy M Anne amolloy@tcd.ie Mills L James millsj@exchange.nih.gov Troendle F James troendlj@nhlbi.nih.gov Parle-McDermott Anne anne.parle-mcdermott@dcu.ie Kay M Denise dmk11@health.state.ny.us Browne L Marilyn mlb10@health.state.ny.us McGrath C Emily exc14@health.state.ny.us Abaan Ozel Hatice habaan@mail.nih.gov Sutton Marie msutton@hrb.ie Kirke N Peadar pkirke@live.ie Caggana Michele caggana@wadsworth.org Shane Barry bandie@berkeley.edu Scott M John lbrody@mail.nih.gov Brody C Lawrence lbrody@mail.nih.gov

Molecular Pathogenesis Section, Genome Technology Branch, National Human Genome Research Institute, National Institutes of Health, Room 5306, 50 South Drive, Bethesda 20892-8004, MD, USA

Department of Clinical Medicine, Trinity College Dublin, Dublin, Ireland

Division of Epidemiology, Statistics and Prevention Research, Eunice Kennedy Shriver National Institute of Child Health and Human Development, National Institutes of Health, Bethesda, MD, USA

Office of Biostatistics Research, National Heart Lung and Blood Institute, National Institutes of Health, Bethesda, MD, USA

School of Biotechnology, Dublin City University, Dublin, Ireland

New York State Department of Health, Division of Genetics, Wadsworth Center, Albany 12201, NY, USA

New York State Department of Health, Congenital Malformations Registry, Troy 12180, NY, USA

Department of Epidemiology and Biostatistics, School of Public Health, University at Albany, Rensselaer 12144, NY, USA

Evidence Centre, Health Research Board, Dublin, Ireland

Child Health Epidemiology Unit, Health Research Board, Dublin, Ireland

Department of Nutritional Sciences and Toxicology, University of California, Berkeley 94720-3104, CA, USA

School of Biochemistry and Immunology, Trinity College Dublin, Dublin, Ireland

BMC Medical Genetics 1471-2350 2014 15 1 102 http://www.biomedcentral.com/1471-2350/15/102 10.1186/s12881-014-0102-9
12 3 2014 19 8 2014 8 10 2014 2014 Pangilinan et al.; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated. Neural tube defects Spina bifida Folate Folic acid One-carbon metabolism Replication

Abstract

Background

Neural tube defects (NTDs), which are among the most common congenital malformations, are influenced by environmental and genetic factors. Low maternal folate is the strongest known contributing factor, making variants in genes in the folate metabolic pathway attractive candidates for NTD risk. Multiple studies have identified nominally significant allelic associations with NTDs. We tested whether associations detected in a large Irish cohort could be replicated in an independent population.

Methods

Replication tests of 24 nominally significant NTD associations were performed in racially/ethnically matched populations. Family-based tests of fifteen nominally significant single nucleotide polymorphisms (SNPs) were repeated in a cohort of NTD trios (530 cases and their parents) from the United Kingdom, and case–control tests of nine nominally significant SNPs were repeated in a cohort (190 cases, 941 controls) from New York State (NYS). Secondary hypotheses involved evaluating the latter set of nine SNPs for NTD association using alternate case–control models and NTD groupings in white, African American and Hispanic cohorts from NYS.

Results

Of the 24 SNPs tested for replication, ADA rs452159 and MTR rs10925260 were significantly associated with isolated NTDs. Of the secondary tests performed, ARID1A rs11247593 was associated with NTDs in whites, and ALDH1A2 rs7169289 was associated with isolated NTDs in African Americans.

Conclusions

We report a number of associations between SNP genotypes and neural tube defects. These associations were nominally significant before correction for multiple hypothesis testing. These corrections are highly conservative for association studies of untested hypotheses, and may be too conservative for replication studies. We therefore believe the true effect of these four nominally significant SNPs on NTD risk will be more definitively determined by further study in other populations, and eventual meta-analysis.

1 Background

Neural tube defects (NTDs) are common, severe birth defects that affect the development of the spinal cord and/or brain. NTDs mainly present as spina bifida, anencephaly and encephalocele. Although the NTD rate has been reduced in areas with folic acid fortification 1 - 4 , reported NTD rates include ~1 in 1000 births in the US 5 , 6 , 0.1-1.1 in 1000 births in Europe 7 , 1–4.8 in 1000 pregnancies in China 3 , 3.9-8.8 in 1000 births in India 8 , and 0.2-9.6 in 1000 births in Latin America 9 . Both environmental and genetic factors are involved in the development of NTDs. In western countries, dietary folate is the strongest known environmental factor. Mothers with an NTD pregnancy have significantly lower levels of folate 10 , and periconceptional folate supplementation can lower NTD risk by 50-70% 3 , 11 , 12 . The most firmly established genetic factor is a common polymorphism (rs1801133, c.677C > T) in the 5, 10-methylene-tetrahydrofolate reductase (MTHFR) gene. The alternate nucleotide in this single nucleotide polymorphism (SNP) changes an alanine to a valine (p.A222V), resulting in a thermolabile form of the protein 13 . The MTHFR c.677 TT genotype has been significantly associated with NTD cases in many populations (reviewed in 14 , 15 ). Other NTD risk SNPs have been identified in a number of populations (e.g., rs2236225 (c.1958G > A, p.R653Q) in methylenetetrahydrofolate dehydrogenase (NADP + dependent) 1, methenyltetrahydrofolate cyclohydrolase, formyltetrahydrofolate synthetase (MTHFD1) 16 - 21 , rs1805087 (c.2756A > G, p.D919G) in methionine synthase (MTR) 15 , 16 , 22 - 29 , rs1051266 (c.80A > G, p.H27R) in the reduced folate carrier (RFC1/SLC19A1) 15 , 21 , 30 - 33 ), and rs70991108 (19 bp indel; c.86 + 59_86 + 60insACCTGGGCGGGACGCGCCA) in dihydrofolate reductase (DHFR) 34 - 36 ). The majority of associations have not been subjected to robust replication.

Rigorously establishing genetic risk for any multifactorial disorder is important but inherently difficult. Genetic risk is optimally detected with a large number of racially/ethnically homogenous samples that include cases with a well-defined, highly penetrant phenotype. These are difficult criteria to meet for rare, complex disorders, meaning that statistical power is often compromised to some extent. This, in combination with the bias that significant associations are more likely to be published 37 - 40 , contributes to many associations in the literature that would not survive correction for multiple tests.

Specifically in the field of genetic risk for NTDs, studies including large numbers of candidate polymorphisms and/or genes have implicated many candidate SNPs exhibiting nominal NTD associations 21 , 41 - 45 . Each of the cited studies examined a minimum of 37 SNPs for NTD risk, yet only the association of rs1907362 in cubilin (CUBN) with NTDs survived correction in the original study 21 . The most likely explanation is that the reported nominally significant associations were due to chance. However, the large number of tests performed, reduced power due to limited availability of samples, and/or the population-specific effect of a risk allele can all contribute to Type II errors. Therefore replication studies are essential for the validation of any genetic risk factor for NTDs.

In one of the largest studies to date we previously reported evaluation of the common genetic variation in 82 candidate genes for NTD risk in an Irish population 45 . The inclusion of 570 NTD cases (~95% spina bifida cases), their parents and 999 controls made it possible to use both family based methods (the transmission disequilibrium test and log-linear analysis) and case–control based methods (logistic regression) to evaluate genetic risk for NTDs in cases (case effect) as well as genetic risk for an NTD pregnancy in mothers (maternal effect). In the current study, we test 24 of the resulting nominally significant association signals using 9 case–control tests and 14 family-based tests in racially/ethnically similar populations. The 9 SNPs that showed nominal significance by case–control analysis in the previously studied Irish NTD cohort were additionally evaluated for NTD risk using varying models in racially/ethnically similar and distinct populations.

2 Methods

2.1 Statistical methods

For replication analyses, each candidate risk allele was retested using the same association test and model for which it was nominally significant in the primary study. These tests are noted in Tables 1 and 2, and include: 1) case–control tests of logistic regression using a continuous, recessive or dominant genetic model; 2) log-linear tests of case or maternal effect using a dominant or recessive genetic model; and 3) the Spielman transmission disequilibrium test (TDT 46 ).

<p>Table 1</p>

Gene SNP

Test/Model*

Result in Irish NTD Cohort [ 45 ]

Result in NYS NTD Cohort

GRR [95% CI], p-value

GRR [95% CI], p-value

*LR CC = logistic regression, case–control; genetic models: Dom (dominant), Cont (continuous) and Rec (recessive).

ADA rs6031682

LR CC Dom

0.67 [0.52-0.86], p = 0.0016

0.92 [0.63-1.33], p = 0.653

ALDH1A2 rs7169289

LR CC Dom

0.71 [0.56-0.90], p = 0.0043

1.07 [0.77-1.47], p = 0.697

ARID1A rs11247593

LR CC Cont

1.35 [1.11-1.64], p = 0.0027

0.81 [0.63-1.04], p = 0.092

CDKN2A rs7041637

LR CC Cont

0.69 [0.53-0.89], p = 0.0048

1.07 [0.85-1.36], p = 0.564

CTH rs12733999

LR CC Rec

0.57 [0.39-0.84], p = 0.0048

1.12 [0.65-1.92], p = 0.692

ENOSF1 rs1059384

LR CC Rec

1.84 [1.23-2.75], p = 0.0028

0.98 [0.60-1.60], p = 0.937

FOLH1 rs383028

LR CC Cont

0.58 [0.39-0.85], p = 0.0051

1.07 [0.76-1.52], p = 0.697

MFTC rs17803441

LR CC Cont

0.62 [0.48-0.81], p = 0.0003

1.02 [0.66-1.58], p = 0.922

MTHFD1L rs2295083

LR CC Rec

0.60 [0.43-0.85], p = 0.0038

1.25 [0.89-1.76], p = 0.193

Case–control replication analyses in the New York State NTD cohort

<p>Table 2</p>

Gene SNP

Test/Model*

Result in Irish NTD Cohort [ 45 ]

Result in UK Cohort

GRR [95% CI], p-value

GRR [95% CI], p-value

*LL; = log-linear analysis; TDT = transmission disequilibium test; Case = case effect; Mat = maternal effect; genetic models: Dom (dominant) and Rec (recessive).

**Proxy SNP (FOLH1 rs11040291; r2 = 1 in Hapmap CEU) results shown for replication.

ADA rs452159

LL Case Dom

2.28 [1.29-4.05], p = 0.0047

1.86 [1.01-3.40], p = 0.045

CDKN2A rs3218009

LL Mat Dom

2.32 [1.45-3.71], p = 0.0004

1.16 [0.81-1.65], p = 0.418

COMT rs174675

LL Case Dom

0.41 [0.23-0.73], p = 0.0028

0.89 [0.55-1.43], p = 0.621

CUBN rs11254375

LL Mat Dom

1.48 [1.10-1.99], p = 0.0097

1.22 [0.89-1.66], p = 0.210

DNMT3A rs7560488

LL Case Rec

2.10 [1.31-3.38], p = 0.0021

0.89 [0.61-1.28], p = 0.520

DNMT3B rs6058896

TDT

1.88 [1.24-2.85], p = 0.0029

1.18 [0.77-1.82], p = 0.443

FOLH1 rs16906205**

LL Mat Dom

0.43 [0.23-0.78], p = 0.0060

1.10 [0.75-1.63], p = 0.619

GART rs2070388

TDT

0.53 [0.36-0.78], p = 0.0012

0.73 [0.52-1.03], p = 0.070

GNMT rs9462856

LL Case Dom

0.55 [0.36-0.83], p = 0.0048

1.19 [0.85-1.68], p = 0.308

MAT2B rs17535909

LL Case Rec

1.69 [1.18-2.42], p = 0.0045

Failed genotyping

MTHFD1 rs11627525

LL Mat Rec

2.17 [1.24-3.79], p = 0.0067

1.13 [0.76-1.68], p = 0.545

MTHFD1 rs2236225

LL Case Dom

1.66 [1.16-2.37], p = 0.0054

1.21 [0.84-1.74], p = 0.299

MTR rs10925260

LL Case Rec

0.64 [0.48-0.86], p = 0.0031

0.71 [0.53-0.94], p = 0.019

PEMT rs4646402

LL Case Dom

0.600 [0.46-0.8], p = 0.0005

0.92 [0.70-1.23], p = 0.585

PEMT rs16961845

LL Mat Rec

1.92 [1.18-3.11], p = 0.0082

0.73 [0.46-1.15], p = 0.171

Family-based replication analyses in the combined United Kingdom NTD cohort

Secondary hypotheses involved more broadly testing the candidate SNPs for NTD risk in other populations and/or NTD classifications. Three models (continuous, recessive and dominant) of logistic regression were performed to generate genotype relative risks (GRRs) and 95% confidence intervals (CI).

2.2 Study populations

Family-based replication was performed in a United Kingdom cohort consisting of trios of NTD cases and their parents. Exclusion of the “Other NTDs” class, which may include a small number of families with multiple defects or spina bifida occulta, did not substantially change the results. This cohort consists of three groups (Table 3). First, the 400 case families recruited with the assistance of the UK Association for Spina Bifida and Hydrocephalus (ASBAH) (England and Wales) are fully described elsewhere 47 . Second, 131 case families were recruited from Northern Ireland. Ethical approval of the use of these samples was granted by the UK Multi-Centre Research Ethics Committee (University of Newcastle, UK, and University of Northern Ireland, Coleraine) and the Institutional Review Board at the National Human Genome Research Institute (Bethesda, MD, USA).

<p>Table 3</p>

England

Northern Ireland

Wales

Total

*May include NTD in the context of multiple defects or spina bifida occulta.

Spina bifida

331

122

26

479

Encephalocele

7

5

1

13

Spina bifida and Encephalocele

2

0

0

2

Other NTDs*

28

4

5

37

Total NTD Cases

368

131

32

531

NTD Mothers

321

121

30

472

NTD Fathers

263

105

21

389

Number of NTD family members in the UK family-based cohort

Replication of findings from case–control analyses was performed in a NYS case–control cohort. NTD cases from the entire state born 1998–2005 were identified by their inclusion in the NYS Congenital Malformations Registry (NYSCMR). Matched controls were selected as a random sample of non-malformed control infants born 1998–2005 from NYS Newborn Screening Program records. Demographic data was obtained by matching to NYS birth certificates. Four controls matched for maternal race/ethnicity were selected for each NTD case. Due to low numbers, the Asian and “other” racial/ethnic subgroups were excluded, and subjects coded as “Hispanic, white” and “Hispanic, other” were combined into a single Hispanic group for analysis. Case diagnoses allowed classification of the NTDs into six subgroups based on NTD subtype (anencephaly, encephalocele, spina bifida) and whether the NTD was isolated or part of multiple defects (Table 4). To perform the replication analyses, only isolated NTDs of all three subtypes among the NHWs were considered in order to most closely match the composition of the NTD cases in the original Irish cohort. Secondary hypotheses involved analyses of: 1) all NTD cases and all controls, stratified by race/ethnicity; and 2) isolated spina bifida cases and corresponding matched controls. Approval for the use of the de-identified samples was granted by the New York State Department of Health Institutional Review Board and the NIH Office for Human Research Protections.

<p>Table 4</p>

White, non-Hispanic

AA, non-Hispanic

Hispanic, white

Hispanic, other

Asian*

Other/Unknown*

Total

*Excluded from analysis due to low numbers.

Isolated anencephaly

7

2

1

1

0

0

11

Isolated encephalocele

22

10

12

5

1

1

51

Isolated spina bifida

161

65

65

13

16

2

322

Anencephaly - multiple defects

2

3

1

0

1

0

7

Encephalocele - multiple defects

16

5

4

1

0

0

26

Spina bifida - multiple defects

25

13

11

1

2

0

52

Total NTD cases

233

98

94

21

20

3

469

Controls

941

408

393

87

91

12

1932

Number of NTD cases and controls by race/ethnicity in the NY state cohort

2.3 Genotyping

MTHFD1 rs2236225 was genotyped in the UK cohort as a restriction fragment length polymorphism (PCR-RFLP) using MspI as previously described 17 , 48 . Genotypes were obtained for 91.6% of NTD fathers, 92.5% of NTD cases and 93.6% of NTD mothers. Concordance was 100% for repeated (n = 83) and for re-plated (the testing of a second sample from the DNA source) (n = 92) samples using an independent assay based on detection of allele-specific primer extension using matrix-assisted laser desorption/ionization – time of flight (MALDI-TOF) mass spectrometry (Sequenom, San Diego, CA, USA). The remaining SNPs in Table 2 were also genotyped in the UK cohort using the Sequenom platform. Two independent assays of folate hydrolase (FOLH1) rs16906205 failed, so the proxy FOLH1 rs11040291 (r2 = 1 in Hapmap CEU) was genotyped and reported instead. Two independent assays to genotype methionine adenosyltransferase II, beta (MAT2B) rs17535909, were attempted but both failed, and there was no proxy for this singleton SNP. For this set of 13 SNPs, the average call rates were ≥96.8% for each family group (NTD cases, NTD mothers or NTD fathers). Re-plated and re-genotyped samples covered >18% of the cohort with 99.2% genotype concordance for this set of 13 SNPs. The 14 SNPs typed in the UK cohort exhibited non-Mendelian inheritance in <1% of families. These SNPs were also in Hardy Weinberg Equilibrium (HWE, p > 0.01) for each family group. Genotypes for families exhibiting non-Mendelian inheritance and other discordant genotypes were excluded from analysis.

For NYS samples, DNA was extracted from one 3-mm archived dried blood spot specimen 49 and whole-genome amplified using a primer extension pre-amplification method, as described previously 50 . SNPs were genotyped by KBiosciences (Herts, UK) using KASPar chemistry. Eight SNPs were genotyped in duplicate using independently whole-genome amplified DNA aliquots with 100% concordance in genotype calls. FOLH1 rs383028 was genotyped using genomic DNA because data from amplified DNA did not pass quality control criteria. The average call rate for 9 SNPs (Table 1) was 99.9% for both cases and controls. Replated samples covered 6.5% of the cohort with genotype concordance of 100%. No SNPs deviated from HWE (p > 0.01) in any case or control group for any race/ethnicity.

3 Results

The primary aim of this study was to perform replication analyses of the nominally significant NTD associations identified in a recent study in an Irish population 45 . The secondary aim was to test a subset of these candidate SNPs for association using alternate risk models and populations.

3.1 Replication analyses

3.1.1 Replication criteria

The replication strategy was designed to retest nominally significant NTD-associated SNPs in racially/ethnically matched populations using the same association tests and genetic models that previously yielded the lowest p-values among 1441 SNPs in 82 candidate genes tested in an Irish population 45 . Case–control association tests were performed in a cohort of 190 isolated NTD cases and 941 controls from non-Hispanic white (NHW) mothers from NYS, and family-based tests were performed in NTD trios (n = 530) consisting of NTD cases and their parents from the United Kingdom, including centers in Northern Ireland, England and Wales.

The top 25 groups of SNPs sharing high linkage disequilibrium (LD; D’ > 0.9) with the lowest p-values for any test were selected for replication (52 SNPs total). Without access to NTD mothers and corresponding controls several loci could not be retested. This included 9 independent mother-control signals (17 SNPs) in adenosine deaminase (ADA), alcohol dehydrogenase 1 family, member A2 (ALDH1A2), catechol-O-methyltransferase (COMT), CUBN, MTHFD1, methylenetetrahydrofolate dehydrogenase (NADP + dependent) 1-like (MTHFD1L), brachyury (T), and transcription factor AP-2 alpha (TFAP2A). Of the remaining 35 SNPs, the SNP with the lowest observed p-value was selected for replication testing whenever SNPs with a minimum p-value for the same test and model shared high LD (D’ > 0.9). This reduced the number of tests to 24 (9 case–control tests and 15 family-based tests). Results of these tests are shown in Tables 1 and 2.

3.1.2 Replication of associations detected in case–control analyses

We used the NTD case samples from NYS to replicate case effects previously observed in the Irish NTD cohort. Each SNP was tested for association with NTDs by logistic regression with the same genetic model used for the original observation. No SNP was observed to be significantly associated with isolated NTDs in white cases from NYS (Table 1). This lack of replication was accompanied by the corresponding genotype relative risk (GRR) values indicating an inconsistent effect of the candidate risk allele to that observed in the original study for eight of the nine SNPs.

3.1.3 Replication of associations detected in family-based analyses

Replication analyses of previously observed case or maternal effects detected by log-linear analysis were repeated with the same genetic model in a combined cohort of NTD triads from the United Kingdom. Two SNPs showed nominally significant association with NTDs: ADA rs452159 in a dominant model (GRR = 1.86 [1.01-3.40], p = 0.045), and MTR rs10925260 in a recessive model (GRR = 0.71 [0.53-0.94], p = 0.019). In both cases, the magnitude of the effect and the specific risk allele was similar to the original observation in the Irish NTD cohort (Table 2). If applied, the significance of these results would not withstand Bonferroni correction for multiple tests when considering all SNPs tested in the current study. In contrast to the case–control analyses, the direction of effect for the GRRs of these family-based associations largely agreed between the initial and replication studies (10 of 14), regardless of significance.

3.2 Secondary hypotheses - exploratory analyses in new populations

3.2.1 Applying analyses that yielded nominal associations from the initial study

In addition to replication, these candidate SNPs were tested for association in other NTD populations using various models. The nine SNPs selected for case–control replication in the NYS cohort were first tested in African American and Hispanic cases with an isolated NTD and controls using the same tests and models for which each SNP had been originally observed to be nominally associated in the Irish population (Table 1, 2 tests/SNP). Of the nine SNPs examined in each of the two racial/ethnic groups, only one, ALDH1A2 rs7169289, was found to be nominally associated with isolated NTDs -- in African Americans in a continuous model (GRR = 0.57 [0.34-0.98], p = 0.041). This “protective” effect is in contrast to the risk effect seen for this SNP in the Irish cohort using a dominant model.

3.2.2 Case–control analyses in all NTD cases vs. isolated Spina Bifida cases

These SNPs were also tested by performing logistic regression using three genetic models (continuous, dominant and recessive) in all NTD cases and controls in each of the three racial/ethnic groups (9 tests/SNP). Of these nine SNPs tested in nine models (N = 81 tests), AT rich interactive domain 1A (ARID1A) rs11247593 was the only SNP found to be nominally associated with NTDs -- in non-Hispanic whites in a dominant model (GRR = 0.58 [0.35-0.97], p = 0.037). This protective effect is in contrast to the risk effect (GRR > 1) seen in the Irish cohort using a continuous model (Table 1).

Lastly, the same tests were performed in a restricted subset of isolated spina bifida cases and controls in the three racial/ethnic groups (9 tests/SNP). These 81 tests generated two significant findings: ALDH1A2 rs7169289 was nominally associated with isolated spina bifida cases in the African American population in continuous (GRR = 0.46 [0.25-0.87], p = 0.017) and dominant (GRR = 0.47 [0.24-0.94], p = 0.033) models. Similarly, a significant risk effect was observed in the original Irish population, but not the NYS NHW population (Table 1).

These results are summarized in Table 5. These results are nominally significant, though would not withstand Bonferroni correction using the total number of tests as the correction factor.

<p>Table 5</p>

Gene SNP

Race/ Ethnicity

Freq Risk Allele

NTD

Test/Model

GRR [95% CI], p-value

ALDH1A2 rs7169289

AA

0.17

Isolated NTDs

LR Cont

0.57 [0.34-0.98], p = 0.041

ARID1A rs11247593

NHW

0.75

All NTDs

LR Dom

0.58 [0.35-0.97], p = 0.037

ALDH1A2 rs7169289

AA

0.17

Isolated SB

LR Cont

0.46 [0.25-0.87], p = 0.017

ALDH1A2 rs7169289

AA

0.17

Isolated SB

LR Dom

0.47 [0.24-0.94], p = 0.033

Nominally significant associations in the New York state cohort - secondary hypotheses

4 Discussion

Our study addressed two questions. First, are SNPs that were nominally significant upon testing for NTD association in an Irish population also associated with NTDs in a similar, independent population? Second, are the SNPs that were nominally significant upon testing for NTD association in an Irish population by logistic regression also associated with NTDs in different racial/ethnic populations when using a broader range of association tests, genetic models and NTD case groupings?

Our criteria for replication were stringent, and only performed for a SNP when the same association test and genetic model could be applied. Because we did not have samples from mothers of NYS NTD cases, we were unable to test for a maternal risk for nine independent mother-control signals in seven genes. Nine SNPs were re-tested for a case effect by logistic regression in a white NTD sample from NYS, and log-linear analyses were used to re-test ten SNPs for a case effect and five SNPs for a maternal effect in a UK NTD sample. Of 14 SNPs previously observed to be associated with NTDs by family-based analysis in an Irish population, two showed nominally significant NTD association in trios from the UK (Table 2). ADA rs452159 falls in the first intron, and is at the border of a D’ block encompassing the first exon and intron of the gene. MTR rs10925260 is in intron 23 of the gene, and is part of a large block of D’ LD encompassing the entire gene. Due to their strong D’ linkage, these nominally significant associations may reflect a direct signal or that of a causative SNP linked to the tested SNP(s).

Although none of the 9 SNPs found to be nominally significant in Irish NTDs were replicated in isolated NYS white NTD cases, two were nominally associated with NTDs under different conditions. ARID1A rs11247593 did not replicate by logistic regression using a continuous model in isolated NTDs (Table 1), but was significant when all white NTD cases and controls were tested using a dominant model (Table 5). ARID1A rs11247593 is intronic and is part of a large D’ block extending over the entire gene, so the signal may be due to the tested SNP or a linked causative SNP. In addition, ALDH1A2 rs7169289 was significantly associated with isolated NTDs and isolated spina bifida cases in the African American population (Table 5). These results most likely represent a single association signal as the genetic models (continuous, dominant) and NTD sets (isolated NTDs, isolated SB) for these analyses overlap. The estimated effects observed in African American NTD cases from NYS (Table 5; OR = 0.46-0.57, p = 0.017-0.041) are similar to the original effect observed in an Irish population (Table 1; OR = 0.67 [0.52-0.86], p = 0.0016). ALDH1A2 rs7169289 is just downstream of the gene. It falls between two blocks of D’ LD, and the association signal may be due to this SNP or a linked SNP in either block.

As was found in the original study, none of the observed associations in the NYS and UK sample sets would have survived correction for multiple tests. One interpretation is that these associations are indeed due to chance and that the tested SNPs do not contribute to NTD risk. It is not clear, however, that Bonferroni correction is appropriate for replication studies. All the tests performed in this study were clearly based on individual, a priori hypotheses generated for our initial study and supported by previous data. Additionally, factors that can contribute to Type II error should be considered, such as population stratification and genetic heterogeneity.

The most important factor may be limited sample size, which compromises the power to detect true associations. Compared to the number of NTD cases (n ~ 570) in the original Irish cohort, a limited number of white NYS isolated NTD cases (n ~ 190) were available in the current study. With ~530 NTD trios, however, the UK NTD cohort appears comparable, but this is before taking into consideration the power required to replicate an association. Due to the “winner’s curse,” or the tendency of an initial observation to overestimate the effect size or significance of a true association, replication studies generally require larger study sample numbers to detect the original effect 51 , 52 . This may explain why the well known NTD risk allele of MTHFR rs1801133 (T) is not associated with NTDs by TDT (p = 0.742) in our large UK NTD cohort. In fact, it is nominally significant as a protective factor in a recessive model by log-linear analysis (GRR = 0.663 [0.441-0.997], p = 0.049). Considering that this association has been replicated in many studies in other populations supporting its role in NTD risk, it would be surprising if the MTHFR rs1801133 TT genotype does not contribute to NTDs in the UK population. A lack of replication power and chance seem the most likely explanations for this failure to replicate, which must be taken into consideration for the other SNPs tested for replication in this study. Authentic validation of any genetic association requires accumulation of evidence over time, involving multiple studies in independent populations.

Lack of adequate power is a pervasive problem in the field of NTD genetics. One recent review estimated that ~1000 cases would be required to attain 80% power to detect an odds ratio of 2 or under, yet approximately one quarter of published NTD association studies used fewer than 100 cases 53 . This problem is compounded when attempting to evaluate candidate risk SNPs in less studied populations. While we were able to examine candidate risk SNPs of interest in African American and Hispanic populations from NYS, far fewer cases were available compared to whites (Table 4). Although some population-based studies have included African American cases in aggregate analyses of genetic risk for NTDs 54 - 56 , and there are studies of NTD risk in African cohorts 57 , this is the first report of candidate NTD SNPs evaluated in an African American case–control cohort. The nominal association observed for ALDH1A2 rs7169289 may be real, but needs confirmation.

Identifying potential NTD risk SNPs has proven much easier than validating them. A single replication study is not definitive, and the limited numbers in existing NTD cohorts may contribute to subsequent underpowered studies failing to confirm reported associations. By combining data from multiple published studies, meta-analyses increase power and confidence in whether a SNP truly contributes to NTD risk. Meta-analyses involving aggregate data from several hundred to several thousand NTD cases and controls have confirmed MTHFR rs1801133 (c.677C > T) as a maternal 58 and case risk factor for NTDs 14 , 15 , 58 , 59 . Although comparatively fewer data were available, meta-analyses show 5-methyltetrahydrofolate-homocysteine methyltransferase reductase (MTRR) rs1801394 (c/66A > G) is a maternal risk factor for NTDs 60 , 61 , while MTR rs1805087 (c/2756A > G) does not contribute to maternal or case risk 15 , 22 , 60 , 62 . However, meta-analysis requires a large amount of data including full genotype information. These data are absent in publications for the majority of NTD risk SNPs that show nominal significance. It is therefore essential to publish all association study data in a format that allows future meta-analyses to be performed (i.e., genotype counts or a way to unambiguously determine them). As such, we have reported the genotype data for all 24 SNPs tested in our study (Additional file 1: Table S1 and Additional file 2: Table S2).

5 Conclusions

In summary, this study represents both the effort to validate nominally significant NTD associations via replication, and to test a subset of these SNPs in alternate NTD groupings and racial/ethnic populations. The NTD associations we observed with four SNPs would not have survived correction for multiple tests. However, we believe it would be overly severe to apply Bonferroni correction to ADA rs452159 and MTR rs10925260, which were nominally significant by strict replication analysis, as well as ARID1A rs11247593, which was found to be associated by a different model and expanded definition of NTDs. Additionally, to our knowledge, this is the first report of a genetic association with NTDs in African Americans and so the nominal significance of ALDH1A2 rs7169289 in the small NYS NTD cohort warrants follow-up. Further testing in independent populations and meta-analyses are needed to clarify the role of these and a multitude of nominally significant SNPs associated with NTDs.

Abbreviations

LD: Linkage disequilibrium

NTDs: Neural tube defects

SNP: Single nucleotide polymorphism

TDT: Transmission disequilibrium test

NYS: New York State

NHW: Non-Hispanic white

GRR: Genotype relative risk

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

FP, AMM, JLM, PNK, BS, JMS and LCB formulated the study design. FP drafted the manuscript. MS managed subject recruitment and data collection for the UK subjects. AMM managed the UK DNA samples and their selection. DK, MB, MC and ECM managed and selected the NYS DNA samples, and contracted their genotyping. FP, AP-M, and HA performed genotyping. JFT contributed to study design and performed the statistical analyses. All authors read, edited and approved the final manuscript.

Additional files

<p>Additional file 1: Table S1.</p>

Genotype counts for candidate SNPs in the NTD cases, fathers and mothers from the United Kingdom (England, Wales, and Northern Ireland).

Click here for file

<p>Additional file 2: Table S2.</p>

Genotype counts for candidate SNPs in the New York state NTD cases and controls by ethnicity and each analyzed NTD subtype.

Click here for file

Acknowledgements

These studies would not be possible without the participation of the affected families, and their recruitment by the United Kingdom Association of Spina Bifida and Hydrocephalus. The authors acknowledge research support from the Intramural Research programs of the National Human Genome Research Institute, the Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD contract number: N01-DK-7-3431), and the Health Research Board, Ireland. We thank Dr. Charlotte Druschel, Director of the Congenital Malformations Registry, for identifying and reviewing cases for this investigation, and Sandra D. Richardson at the NYSCMR for subject selection and data management. We also thank April J. Atkins, Adam C. Gearhart, and Robert J. Sicko at the Wadsworth Center, New York State Department of Health for providing laboratory and technical assistance.

<p>National estimates and race/ethnic-specific variation of selected birth defects in the United States, 1999–2001</p> Canfield MA Honein MA Yuskiv N Xing J Mai CT Collins JS Devine O Petrini J Ramadhani TA Hobbs CA Kirby RS Birth Defects Res A Clin Mol Teratol 2006 76 747 756 10.1002/bdra.20294 17051527 <p>Trends of selected malformations in relation to folic acid recommendations and fortification: an international assessment</p> Botto LD Lisi A Bower C Canfield MA Dattani N De Vigan C De Walle H Erickson DJ Halliday J Irgens LM Lowry RB McDonnell R Metneki J Poetzsch S Ritvanen A Robert-Gnansia E Siffel C Stoll C Mastroiacovo P Birth Defects Res A Clin Mol Teratol 2006 76 693 705 10.1002/bdra.20307 17029289 <p>Prevention of neural-tube defects with folic acid in China. China-U.S. Collaborative Project for Neural Tube Defect Prevention</p> Berry RJ Li Z Erickson JD Li S Moore CA Wang H Mulinare J Zhao P Wong LY Gindler J Hong SX Correa A N Engl J Med 1999 341 1485 1490 10.1056/NEJM199911113412001 10559448 <p>Folic acid to reduce neonatal mortality from neural tube disorders</p> Blencowe H Cousens S Modell B Lawn J Int J Epidemiol 2010 39 Suppl 1 i110 i121 10.1093/ije/dyq028 20348114 A Report from the International Clearinghouse for Birth Defects Monitoring Systems Elsevier Science Publishers, Amsterdam 1991 <p>Preventing neural tube defects in Europe: population based study</p> Busby A Abramsky L Dolk H Armstrong B BMJ 2005 330 574 575 10.1136/bmj.330.7491.574 15760997 Botto LD, Lisi A, Robert-Gnansia E, Erickson JD, Vollset SE, Mastroiacovo P, Botting B, Cocchi G, de Vigan C, de Walle H, Feijoo M, Irgens LM, McDonnell B, Merlob P, Ritvanen A, Scarano G, Siffel C, Metneki J, Stoll C, Smithells R, Goujard J: International retrospective cohort study of neural tube defects in relation to folic acid recommendations: are the recommendations working? BMJ 2005, 330:571. <p>Incidence of neural tube defects in the least-developed area of India: a population-based study</p> Cherian A Seena S Bullock RK Antony AC Lancet 2005 366 930 931 10.1016/S0140-6736(05)67319-9 16154020 <p>Neural tube defects in Latin America and the impact of fortification: a literature review</p> Rosenthal J Casas J Taren D Alverson CJ Flores A Frias J Public Health Nutr 2014 17 3 537 550 10.1017/S1368980013000256 23464652 <p>Maternal plasma folate and vitamin B12 are independent risk factors for neural tube defects</p> Kirke PN Molloy AM Daly LE Burke H Weir DG Scott JM Q J Med 1993 86 703 708 8265769 <p>Prevention of neural tube defects: results of the Medical Research Council Vitamin Study</p> Lancet 1991 338 131 137 10.1016/0140-6736(91)90133-A <p>Prevention of the first occurrence of neural-tube defects by periconceptional vitamin supplementation</p> Czeizel AE Dudas I N Engl J Med 1992 327 1832 1835 10.1056/NEJM199212243272602 1307234 <p>A candidate genetic risk factor for vascular disease: a common mutation in methylenetetrahydrofolate reductase</p> Frosst P Blom HJ Milos R Goyette P Sheppard CA Matthews RG Boers GJ den Heijer M Kluijtmans LA van den Heuvel LP Nat Genet 1995 10 111 113 10.1038/ng0595-111 7647779 <p>5,10-Methylenetetrahydrofolate reductase gene variants and congenital anomalies: a HuGE review</p> Botto LD Yang Q Am J Epidemiol 2000 151 862 877 10.1093/oxfordjournals.aje.a010290 10791559 Zhang T, Lou J, Zhong R, Wu J, Zou L, Sun Y, Lu X, Liu L, Miao X, Xiong G: Genetic variants in the folate pathway and the risk of neural tube defects: a meta-analysis of the published literature. PLoS One 2013, 8:e59570. <p>Evaluation of folate metabolism gene polymorphisms as risk factors for open and closed neural tube defects</p> Doudney K Grinham J Whittaker J Lynch SA Thompson D Moore GE Copp AJ Greene ND Stanier P Am J Med Genet A 2009 149A 1585 1589 10.1002/ajmg.a.32937 19533788 <p>A polymorphism, R653Q, in the trifunctional enzyme methylenetetrahydrofolate dehydrogenase/methenyltetrahydrofolate cyclohydrolase/formyltetrahydrofolate synthetase is a maternal genetic risk factor for neural tube defects: report of the Birth Defects Research Group</p> Brody LC Conley M Cox C Kirke PN McKeever MP Mills JL Molloy AM O’Leary VB Parle-McDermott A Scott JM Swanson DA Am J Hum Genet 2002 71 1207 1215 10.1086/344213 12384833 <p>Evaluation of a methylenetetrahydrofolate-dehydrogenase 1958G > A polymorphism for neural tube defect risk</p> De Marco P Merello E Calevo MG Mascelli S Raso A Cama A Capra V J Hum Genet 2006 51 98 103 10.1007/s10038-005-0329-6 16315005 <p>Confirmation of the R653Q polymorphism of the trifunctional C1-synthase enzyme as a maternal risk for neural tube defects in the Irish population</p> Parle-McDermott A Kirke PN Mills JL Molloy AM Cox C O’Leary VB Pangilinan F Conley M Cleary L Brody LC Scott JM Eur J Hum Genet 2006 14 768 772 10.1038/sj.ejhg.5201603 16552426 <p>The methylenetetrahydrofolate dehydrogenase (MTHFD1) 1958G > A variant is not associated with spina bifida risk in the Dutch population</p> van der Linden IJ Heil SG Kouwenberg IC den Heijer M Blom HJ Clin Genet 2007 72 599 600 10.1111/j.1399-0004.2007.00904.x 17894836 <p>An association study of 45 folate-related genes in spina bifida: Involvement of cubilin (CUBN) and tRNA aspartic acid methyltransferase 1 (TRDMT1)</p> Franke B Vermeulen SH Steegers-Theunissen RP Coenen MJ Schijvenaars MM Scheffer H den Heijer M Blom HJ Birth Defects Res A Clin Mol Teratol 2009 85 216 226 10.1002/bdra.20556 19161160 <p>Association between the methionine synthase A2756G polymorphism and neural tube defect risk: a meta-analysis</p> Yang M Yang L Qi L Guo Y Lin X Zhang Y Du Y Gene 2013 520 7 13 10.1016/j.gene.2013.02.005 23438943 <p>Susceptibility to spina bifida; an association study of five candidate genes</p> Morrison K Papapetrou C Hol FA Mariman EC Lynch SA Burn J Edwards YH Ann Hum Genet 1998 62 379 396 10.1046/j.1469-1809.1998.6250379.x 10088035 <p>Genetic polymorphisms in methylenetetrahydrofolate reductase and methionine synthase, folate levels in red blood cells, and risk of neural tube defects</p> Christensen B Arbour L Tran P Leclerc D Sabbaghian N Platt R Gilfix BM Rosenblatt DS Gravel RA Forbes P Rozen R Am J Med Genet 1999 84 151 157 10.1002/(SICI)1096-8628(19990521)84:2<151::AID-AJMG12>3.0.CO;2-T 10323741 <p>Spina bifida and common mutations at the homocysteine metabolism pathway</p> Akar N Akar E Deda G Arsan S Clin Genet 2000 57 230 231 10.1034/j.1399-0004.2000.570310.x 10782931 <p>Comorbidity of 5,10-methylenetetrahydrofolate reductase and methionine synthase gene polymorphisms and risk for neural tube defects</p> Johanning GL Tamura T Johnston KE Wenstrom KD J Med Genet 2000 37 949 951 10.1136/jmg.37.12.949 11186937 <p>Study of MTHFR and MS polymorphisms as risk factors for NTD in the Italian population</p> De Marco P Calevo MG Moroni A Arata L Merello E Finnell RH Zhu H Andreussi L Cama A Capra V J Hum Genet 2002 47 319 324 10.1007/s100380200043 12111380 <p>Homocysteine remethylation enzyme polymorphisms and increased risks for neural tube defects</p> Zhu H Wicker NJ Shaw GM Lammer EJ Hendricks K Suarez L Canfield M Finnell RH Mol Genet Metab 2003 78 216 221 10.1016/S1096-7192(03)00008-8 12649067 <p>Polymorphisms in genes related to folate and cobalamin metabolism and the associations with complex birth defects</p> Brouns R Ursem N Lindemans J Hop W Pluijm S Steegers E Steegers-Theunissen R Prenat Diagn 2008 28 485 493 10.1002/pd.2006 18435414 <p>Reduced folate carrier polymorphism (80A– > G) and neural tube defects</p> De Marco P Calevo MG Moroni A Merello E Raso A Finnell RH Zhu H Andreussi L Cama A Capra V Eur J Hum Genet 2003 11 245 252 10.1038/sj.ejhg.5200946 12673279 <p>Reduced folate carrier A80G polymorphism and susceptibility to neural tube defects: a meta-analysis</p> Wang HG Wang JL Zhang J Zhao LX Zhai GX Xiang YZ Chang P Gene 2012 510 180 184 10.1016/j.gene.2012.02.020 22975209 <p>Gene-gene interaction in folate-related genes and risk of neural tube defects in a UK population</p> Relton CL Wilding CS Pearce MS Laffling AJ Jonas PA Lynch SA Tawn EJ Burn J J Med Genet 2004 41 256 260 10.1136/jmg.2003.010694 15060097 <p>Maternal periconceptional vitamin use, genetic variation of infant reduced folate carrier (A80G), and risk of spina bifida</p> Shaw GM Lammer EJ Zhu H Baker MW Neri E Finnell RH Am J Med Genet 2002 108 1 6 10.1002/ajmg.10195 11857541 <p>New 19 bp deletion polymorphism in intron-1 of dihydrofolate reductase (DHFR): a risk factor for spina bifida acting in mothers during pregnancy?</p> Johnson WG Stenroos ES Spychala JR Chatkupt S Ming SX Buyske S Am J Med Genet A 2004 124A 339 345 10.1002/ajmg.a.20505 14735580 <p>The 19-bp deletion polymorphism in intron-1 of dihydrofolate reductase (DHFR) may decrease rather than increase risk for spina bifida in the Irish population</p> Parle-McDermott A Pangilinan F Mills JL Kirke PN Gibney ER Troendle J O’Leary VB Molloy AM Conley M Scott JM Brody LC Am J Med Genet A 2007 143A 1174 1180 10.1002/ajmg.a.31725 17486595 <p>Variation and expression of dihydrofolate reductase (DHFR) in relation to spina bifida</p> van der Linden IJ Nguyen U Heil SG Franke B Vloet S Gellekink H den Heijer M Blom HJ Mol Genet Metab 2007 91 98 103 10.1016/j.ymgme.2007.01.009 17336564 <p>Translational medicine and reliability of single-nucleotide polymorphism studies: can we believe in SNP reports or not?</p> Valachis A Mauri D Neophytou C Polyzos NP Tsali L Garras A Papanikolau EG Int J Med Sci 2011 8 492 500 10.7150/ijms.8.492 21897762 <p>Assessing publication bias in genetic association studies: evidence from a recent meta-analysis</p> Munafo MR Clark TG Flint J Psychiatry Res 2004 129 39 44 10.1016/j.psychres.2004.06.011 15572183 Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan AW, Cronin E, Decullier E, Easterbrook PJ, Von Elm E, Gamble C, Ghersi D, Ioannidis JP, Simes J, Williamson PR: Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS One 2008, 3:e3081. <p>Almost all articles on cancer prognostic markers report statistically significant results</p> Kyzas PA Denaxa-Kyza D Ioannidis JP Eur J Cancer 2007 43 2559 2579 10.1016/j.ejca.2007.08.030 17981458 Shaw GM, Lu W, Zhu H, Yang W, Briggs FB, Carmichael SL, Barcellos LF, Lammer EJ, Finnell RH: 118 SNPs of folate-related genes and risks of spina bifida and conotruncal heart defects. BMC Med Genet 2009, 10:49. Lu W, Guzman AR, Yang W, Chapa CJ, Shaw GM, Greene RM, Pisano MM, Lammer EJ, Finnell RH, Zhu H: Genes encoding critical transcriptional activators for murine neural tube development and human spina bifida: a case–control study. BMC Med Genet 2010, 11:141. <p>Genetic association study of putative functional single nucleotide polymorphisms of genes in folate metabolism and spina bifida</p> Martinez CA Northrup H Lin JI Morrison AC Fletcher JM Tyerman GH Au KS Am J Obstet Gynecol 2009 201 394 e311 e391 <p>Evaluation of 64 candidate single nucleotide polymorphisms as risk factors for neural tube defects in a large Irish study population</p> Carter TC Pangilinan F Troendle JF Molloy AM VanderMeer J Mitchell A Kirke PN Conley MR Shane B Scott JM Brody LC Mills JL Am J Med Genet A 2011 155A 14 21 10.1002/ajmg.a.33755 21204206 Pangilinan F, Molloy AM, Mills JL, Troendle JF, Parle-McDermott A, Signore C, O’Leary VB, Chines P, Seay JM, Geiler-Samerotte K, Mitchell A, VanderMeer JE, Krebs KM, Sanchez A, Cornman-Homonoff J, Stone N, Conley M, Kirke PN, Shane B, Scott JM, Brody LC: Evaluation of common genetic variants in 82 candidate genes as risk factors for neural tube defects. BMC Med Genet 2012, 13:62. <p>Transmission test for linkage disequilibrium: the insulin gene region and insulin-dependent diabetes mellitus (IDDM)</p> Spielman RS McGinnis RE Ewens WJ Am J Hum Genet 1993 52 506 516 8447318 <p>Transcobalamin II receptor polymorphisms are associated with increased risk for neural tube defects</p> Pangilinan F Mitchell A VanderMeer J Molloy AM Troendle J Conley M Kirke PN Sutton M Sequeira JM Quadros EV Scott JM Mills JL Brody LC J Med Genet 2010 47 677 685 10.1136/jmg.2009.073775 20577008 <p>Molecular genetic analysis of the gene encoding the trifunctional enzyme MTHFD (methylenetetrahydrofolate-dehydrogenase, methenyltetrahydrofolate-cyclohydrolase, formyltetrahydrofolate synthetase) in patients with neural tube defects</p> Hol FA van der Put NM Geurds MP Heil SG Trijbels FJ Hamel BC Mariman EC Blom HJ Clin Genet 1998 53 119 125 10.1111/j.1399-0004.1998.tb02658.x 9611072 <p>Cost-effective and scalable DNA extraction method from dried blood spots</p> Saavedra-Matiz CA Isabelle JT Biski CK Duva SJ Sweeney ML Parker AL Young AJ Diantonio LL Krein LM Nichols MJ Caggana M Clin Chem 2013 59 1045 1051 10.1373/clinchem.2012.198945 23509109 <p>Evaluation of genes involved in limb development, angiogenesis, and coagulation as risk factors for congenital limb deficiencies</p> Browne ML Carter TC Kay DM Kuehn D Brody LC Romitti PA Liu A Caggana M Druschel CM Mills JL Am J Med Genet A 2012 158A 2463 2472 10.1002/ajmg.a.35565 22965740 <p>Non-replication of association studies: “pseudo-failures” to replicate?</p> Gorroochurn P Hodge SE Heiman GA Durner M Greenberg DA Genet Med 2007 9 325 331 10.1097/GIM.0b013e3180676d79 17575498 <p>Overcoming the winner’s curse: estimating penetrance parameters from case–control data</p> Zollner S Pritchard JK Am J Hum Genet 2007 80 605 615 10.1086/512821 17357068 <p>Epidemiologic and genetic aspects of spina bifida and other neural tube defects</p> Au KS Ashley-Koch A Northrup H Dev Disabil Res Rev 2010 16 6 15 10.1002/ddrr.93 20419766 <p>Maternal vitamin use, genetic variation of infant methylenetetrahydrofolate reductase, and risk for spina bifida</p> Shaw GM Rozen R Finnell RH Wasserman CR Lammer EJ Am J Epidemiol 1998 148 30 37 10.1093/oxfordjournals.aje.a009555 9663401 <p>Associations between polymorphisms within the thymidylate synthase gene and spina bifida</p> Volcik KA Shaw GM Zhu H Lammer EJ Laurent C Finnell RH Birth Defects Res A Clin Mol Teratol 2003 67 924 928 10.1002/bdra.10029 14745930 <p>Diabetes and obesity-related genes and the risk of neural tube defects in the national birth defects prevention study</p> Lupo PJ Canfield MA Chapa C Lu W Agopian AJ Mitchell LE Shaw GM Waller DK Olshan AF Finnell RH Zhu H Am J Epidemiol 2012 176 1101 1109 10.1093/aje/kws190 23132673 <p>Folate status, homocysteine metabolism, and methylene tetrahydrofolate reductase genotype in rural South African blacks with a history of pregnancy complicated by neural tube defects</p> Ubbink JB Christianson A Bester MJ Van Allen MI Venter PA Delport R Blom HJ van der Merwe A Potgieter H Vermaak WJ Metabolism 1999 48 269 274 10.1016/S0026-0495(99)90046-X 10024094 Yan L, Zhao L, Long Y, Zou P, Ji G, Gu A, Zhao P: Association of the maternal MTHFR C677T polymorphism with susceptibility to neural tube defects in offsprings: evidence from 25 case–control studies. PLoS One 2012, 7:e41689. <p>Is the common 677C– > T mutation in the methylenetetrahydrofolate reductase gene a risk factor for neural tube defects? A meta-analysis</p> van der Put NM Eskes TK Blom HJ QJM 1997 90 111 115 10.1093/qjmed/90.2.111 9068801 <p>Association between MTR A2756G and MTRR A66G polymorphisms and maternal risk for neural tube defects: a meta-analysis</p> Ouyang S Li Y Liu Z Chang H Wu J Gene 2013 515 308 312 10.1016/j.gene.2012.11.070 23266814 <p>The methionine synthase reductase 66A > G polymorphism is a maternal risk factor for spina bifida</p> van der Linden IJ den Heijer M Afman LA Gellekink H Vermeulen SH Kluijtmans LA Blom HJ J Mol Med (Berl) 2006 84 1047 1054 10.1007/s00109-006-0093-x <p>Meta-analyses on the association of MTR A2756G and MTRR A66G polymorphisms with neural tube defect risks in Caucasian children</p> Ouyang S Liu Z Li Y Wu J J Matern Fetal Neonatal Med 2013 26 12 1166 1170 10.3109/14767058.2013.777699 23425389