Autoimmune Diseases

Autoimmune Diseases / 2014 / Article
Special Issue

Environmental Triggers and Autoimmunity

View this Special Issue

Research Article | Open Access

Volume 2014 |Article ID 325461 | https://doi.org/10.1155/2014/325461

Jennifer Ong, Esther Erdei, Robert L. Rubin, Curtis Miller, Carlyle Ducheneaux, Marcia O’Leary, Bernadette Pacheco, Michael Mahler, Patricia Nez Henderson, K. Michael Pollard, Johnnye L. Lewis, "Mercury, Autoimmunity, and Environmental Factors on Cheyenne River Sioux Tribal Lands", Autoimmune Diseases, vol. 2014, Article ID 325461, 12 pages, 2014. https://doi.org/10.1155/2014/325461

Mercury, Autoimmunity, and Environmental Factors on Cheyenne River Sioux Tribal Lands

Academic Editor: Aristo Vojdani
Received07 Nov 2013
Accepted17 Feb 2014
Published24 Apr 2014

Abstract

Mercury (Hg), shown to induce autoimmune disease in rodents, is a ubiquitous toxicant throughout Cheyenne River Sioux Tribe (CRST) lands. CRST members may be exposed to Hg through fish consumption (FC), an important component of native culture that may supplement household subsistence. Our goals were to ascertain whether total blood Hg levels (THg) reflect Hg exposure through FC and smoking, and determine whether THg is associated with the presence of anti-nuclear antibody (ANA) and specific autoantibodies (sAuAb). We recruited 75 participants who regularly consume fish from CRST waters. Hg exposure through FC and smoking were assessed via questionnaires. Whole blood samples were collected from participants, and THg was measured using ICP-MS. ANA and sAuAb in serum were modeled using demographic and exposure information as predictors. Female gender, age, and FC were significant predictors of THg and sAuAb; self-reported smoking was not. 31% of participants tested positive for ANA ≥ 2+. Although ANA was not significantly associated with Hg, the interactions of gender with Hg and proximity to arsenic deposits were statistically significant . FC resulted in a detectable body burden of Hg, but THg alone did not correlate with the presence of ANA or sAuAb in this population.

1. Introduction

For more than a century, mining from greater than 900 mines in the Black Hills, including gold mines in which Hg was used for amalgamation purposes, has released contaminants into watersheds draining onto CRST lands [1]. Additionally, approximately one ton of airborne Hg is emitted per year from coal power plants in Montana, Wyoming, North Dakota, and South Dakota [2] and carried downwind to CRST lands where precipitation and dust wash this mercury out of the air into water and soil. Thus, Hg is virtually ubiquitous throughout the CRST reservation. Studies over the last decade conducted by the tribe, United States Environmental Protection Agency (USEPA), and University of Colorado [3] have documented high mercury concentrations in mid-flow water samples and sediment [4], invertebrates [5], and fish [57]. As a result of the widespread presence of Hg in the environment, fish consumption warnings have been posted along the Cheyenne River since 1974, yet no comprehensive health studies have ever been conducted in the CRST population to assess the health effects of consuming fish from tribal waters. In spite of posted warnings, CRST members still consume locally caught fish for complex reasons. Fishing and fish consumption are not only important in Lakota culture, but high rates of poverty (~50%) [8, 9] and unemployment (88%) [10] on the CRST reservation increase the community’s likelihood of using fish to supplement household subsistence. Therefore, the safety of eating mercury-contaminated fish caught on tribal lands was a prime concern for CRST members. To address the CRST’s environmental health concerns, a research partnership, Environmental Justice on Cheyenne River, was established in 2003 among the CRST Department of Environment and Natural Resources (DENR), the Black Hills Center for American Indian Health, and the University of New Mexico Community Environmental Health Program (UNM CEHP). Through community forums and discussions with tribal leaders, the partnership identified a major concern that a perceived increase in autoimmune disease (AD) prevalence in the CRST population might be related to Hg exposures through fish consumption, as well as a widespread frustration that actual health studies had not occurred in spite of Hg warnings posted for nearly 40 years. Although deidentified numbers of autoimmune cases were obtained from Indian Health Service (IHS) data sources, interpretation of the prevalence is difficult in identification of an appropriate denominator and determination of an appropriate comparison figure for Native American populations. Data on antinuclear antibody (ANA) prevalence in Native populations has not been evaluated. Prevalence of ANA in other US populations was recently derived from National Health and Nutrition Survey data (NHANES) [11, 12], but values for Native American populations could not be extracted due to no representation in that sample. Reference values for specific AD in tribal populations relative to the US total population are also not readily accessible.

Since tribal populations are comparatively more homogenous than other studied US populations, it may be tempting to ascribe any elevations in AD in the CRST merely to genetics. However, while genetic susceptibility has long been acknowledged as an important causative factor in the development of AD and evidence [13, 14] exists that genetic composition may predispose CRST members to AD, it is estimated that genetic factors only account for one-third of disease risk and that gene-environmental interactions play a vital role in the onset of autoimmunity [15]. The growing role of environmental factors, including aluminum metal compounds and thimerisol in vaccines, as adjuvants to the pathogenesis of autoimmunity has been studied extensively [16]. In addition, studies [17, 18] indicate that Hg toxicity and autoimmunity may be synergistically enhanced by various infectious and noninfectious triggers. It is reasonable that chronic stimulation of the immune system by environmental Hg may act through similar mechanisms. To address the community’s concerns and begin to address existing gaps in knowledge about the effects of chronic low-level environmental exposures to metals, we sought to systematically examine the relationships among fish consumption, THg, and basic immune system markers in the CRST population in this study.

Existing knowledge about the effects of metals on the immune system comes mainly from the use of rodent models. In these models, relatively high doses of inorganic mercury administered to genetically susceptible mouse strains lead to the development of lupus-like autoimmune syndrome, which includes increased circulating antibodies to nuclear targets (antinuclear autoantibodies, ANA) [16, 17]. Further, exposure to inorganic or organic mercury exacerbates and accelerates the development of lupus-like disease in susceptible mouse strains [1821]. Rodent models of mercury-induced autoimmunity [2224], as well as their consistency with sex differences in autoimmune disease incidence observed in humans, suggest it is biologically plausible that Hg and other metals contribute to autoimmune pathogenesis in humans. Yet, with the exception of a few epidemiologic studies investigating the role of mercury amalgam fillings in multiple sclerosis [25, 26] and studies of ANA and cytokines in mercury-exposed Amazonian Brazil populations [2730], too few [31, 32] have investigated the potential role of chronic environmental metal exposures as risk factors in the development of AD in humans. While relationships between metal exposure and immune dysfunction have been demonstrated in animals, limited data exist in humans. Since Hg has long been linked to development of AD-like symptoms in animal models [17], we hypothesized that increased mercury exposure, primarily through fish consumption, would be associated with higher levels of circulating autoantibodies in the CRST population. In order to test this hypothesis and respond to community concerns, we modeled ANA and specific autoantibody concentrations in blood collected from CRST community members using THg, fish consumption, smoking, age, gender, and proximity to high-concentration arsenic sediment deposits as predictors.

2. Materials and Methods

2.1. Human Subjects

The protocol and study design were approved by the Executive Committee of the Cheyenne River Sioux Tribe Tribal Council (Tribal Resolution number: E-302-08-CR and extended under E-343-2009-CR) and by the University of New Mexico Health Sciences Center Human Research Protection Office (HRPO number: 08-486). As deidentified serum samples were sent to the Scripps Research Institute Department of Molecular and Experimental Medicine, the Scripps Research Institute’s Institutional Review Board provided approval for an analysis of serum ANA and specific autoantibodies.

Participants were recruited by using community-based communication tools and procedures previously developed by this team and applied in the Environmental Justice on Cheyenne River study. Outreach, enrollment, and sampling were conducted in conjunction with local collaborators, notably Missouri Breaks Industries Research, Inc. (MBIRI), who were crucial contributors in several previous federally funded research projects among Cheyenne River Tribal communities, and collaborating staff from the CRST DENR. The recruitment was targeted toward fishermen and their family members, who were known to local collaborators as regular consumers of fish caught from the Cheyenne River and its tributaries.

Written informed consent was obtained from a total of 75 adults living on the CRST Lands during the peak of fishing season. The study population includes members from multiple communities including Eagle Butte, Cherry Creek, Dupree, Timber Lake, Red Scaffold, Bridger, Takini, and Howes (Figure 1). At each location, enrollment was conducted and biological samples were collected in community centers. These communities, some of which are in close proximity to rivers, lakes and ponds on CRST lands, encompass both commercial centers and rural areas, as well as members whose primary source of food is store-bought versus acquired from the local environment (subsistence lifestyle), and therefore reflect a wide range of potential exposures to Hg through fish consumption. Smoking status was a concern as an alternate contributor to THg based on previosly reported increases in smoking on the CRST reservation [33] and the demonstrated contributions to THg from cigarette smoking [34, 35]. MBIRI team interviewers collected demographic (e.g., age, gender), health condition, fishing, and smoking habit information through personal interviews conducted in English using a Centers for Disease Control- (CDC-) developed fish consumption survey and our own short smoking exposure questionnaire. When participants needed information or clarification spoken in their native language, the community-certified nurse interviewers provided the answers.

2.2. Surveys Used in the Study
2.2.1. Fish Consumption

A CDC questionnaire, as well as local collaborators’ knowledge of CRST community members’ fishing habits, was used to assign a categorical rating of 1, 2, or 3 to each participant’s fish consumption, with 1 designating minimal to no fish consumption, and 3 corresponding to high fish consumption. For reference to the local environment and consumption patterns, the safe amount of fish intake per month was previously recommended by our Environmental Justice on Cheyenne River study using DENR Hg measurements from local fish and USEPA guidelines [37]. One monthly recommended serving was defined as one northern pike, two bass or perch, three walleye, or four catfish. A rating of denotes consumption of <1 serving of fish per month; denotes 1-2 servings/month; and denotes >2 servings/month.

2.2.2. Smoking

To account for smoking as both a potential source of Hg and contributor to immune system effects, participant smoking data were collected via questionnaire. The questionnaire was based on coauthor PNH’s previous work [33] on smoking among tribal members and was given to all participants in order to obtain self-reported information regarding smoking exposures. The questionnaire encompassed both direct and second-hand exposure to cigarette smoke. There were seven questions total; smoking score was coded as low (1) when fewer than two questions were answered affirmatively; medium (2) when 3-4 questions were answered affirmatively; and high (3) when greater than five questions were answered affirmatively. A participant was considered an “active smoker” if he/she answered “yes” to the included question, “Do you smoke currently?”

2.2.3. Arsenic Proximity

During the analytic phase of this study, elevated sedimentary arsenic deposits were discovered in land-use areas in close proximity to several of the sampling-site communities in this study (Figure 2). Ongoing collaborations among DENR, Dr. Lewis, and USEPA Region 8 are surveying residents and characterizing exposure pathways, frequencies, and duration. However, as these deposits were identified subsequent to consent for this study, no arsenic biomonitoring data were obtained from the population in the original design nor were exposure activities involving these sedimentary deposits identified. Due to studies in humans and animals indicating that arsenic suppresses autoimmunity [38, 39], while mercury may either suppress or increase autoimmune response [28, 32], a surrogate of participant arsenic exposure was incorporated into models to address potentially competing exposures. A binary surrogate for arsenic exposure was derived; the designations of “near” or “far” proximity to known quantified environmental arsenic deposits by USEPA were given according to self-reported participant residence data. The designation of “near” was given to participants who live in the communities of Cherry Creek, Takini, Bridger, and Red Scaffold (Figure 1). Surveys of residents have identified potential exposure pathways which include common land-use practices such as fishing; herb, fruit, and firewood gathering; inhalation of wood combustion products during sweat lodge and ceremonial practices; and roping/other horseback riding activities along the Cheyenne River near the identified alluvial arsenic deposits (Figure 2) (personal communication C. Ducheneaux and J. Lewis). Participants residing in the Eagle Butte, Dupree, and Timber Lake (Figure 1) communities more distal to the arsenic deposits were given a designation of “far” for arsenic proximity in this pilot assessment. This binary variable was incorporated to determine if further studies on the relationship of these exposures to AD were warranted.

2.3. Biological Sample Collection
2.3.1. Blood and Serum Samples

Venous blood samples were collected by venipuncture at community centers or during home visits by a trained and certified phlebotomist or registered nurse. One red top (9 mL) for serum collection and one purple top (7 mL) Vacutainer tube were collected for biomonitoring from each participant. After clotting, serum samples were spun at 2,500 rpm for 10 minutes and separated into cryovials and placed into a −80°C freezer. At a later time point, sera were shipped to the UNM HSC laboratory and subsequently to the Scripps Research Institute.

2.4. Experimental Use of Collected Biological Samples
2.4.1. Biomonitoring

The EDTA-containing whole blood samples were transported to the CDC ONDIEH/NCEH Environmental Health Laboratory where inductively coupled plasma mass spectrometry (ICP-MS) was used to determine THg concentrations. The limit of detection was 0.32 μg/L.

2.4.2. Detection of Autoantibodies

(1) Antinuclear Antibodies (ANA). The presence of ANA was determined by indirect immunofluorescence (IIF) microscopy using HEp-2 cells as substrate (MBL-BION, Des Plaines, IL) and Alexa Fluor 488 Goat Anti-Human IgG (H + L) (Life Technologies, NY, USA) as detecting reagent. Sera were diluted 1 : 100 in serum diluent, and detecting reagent 1 : 200 with anti-Ig diluent as previously described [40]. Slides were viewed by a single observer (KMP) blinded to participant identity on a BH2-RFCA fluorescence microscope (Olympus, Lake Success, NY). Intensity of fluorescence was graded on a scale of 0–4+. A reading of ≥2+ was considered significant and further used in our statistical modeling. This cut-off value reflects a stricter value based on the literature [36, 41]. Example immunofluorescence images for ANA determination can be found in Figure 3 for negative (0) and ANA ≥ 2+ readings.

(2) Specific Autoantibodies (sAuAb). Commercially available kits (INOVA Diagnostics, San Diego, CA) were used as described by the manufacturer to detect and quantify serum autoantibodies to the following antigens: chromatin, Sm, RNP, SSA, SSA-52, SSB, Scl-70, RNA Pol III, CENP-A/B, Ribo-P, Jo-1, M2 EP (MIT3), and primary biliary cirrhosis (PBC) screen, a panel of antigens (M2 EP, gp210 and sp100 IgG/IgA). Assay-specific positive controls were used to convert optical density values to units in order to determine whether the results of assays for Sm, RNP, SSA, SSA-52, SSB, Scl-70, RNA Pol III, Ribo-P, and Jo-1 were negative/equivocal (<20 units), weakly positive (20–39 units), moderately positive (40–80 units), or strongly positive (>80 units). The tests for M2 EP and the PBC screen were interpreted as being equivocal from 20.1 to 24.9 units and positive for >25 units. Centromere-A/B (CENP-A/B) has negative/equivocal results for <20 units, weak positive for 20–30 units, and strong positive for >30 units. Chromatin has a negative/equivocal reading <20 units, moderate positive between 20 and 60 units, and a strong positive >60 units.

Additional assays to chromatin, denatured DNA (single-stranded, dDNA), native DNA (nDNA), and histones were quantified by enzyme-linked immunosorbent assays (ELISA) as previously described in [42, 43]. Briefly, Immulon 2HB microtiter plates (Dynex Laboratories, Inc., Alexandria, VA) were coated with antigen at 2.5 μg/mL concentrations. For the antichromatin assays, in-house-prepared H1-stripped chromatin was used as the solid-phase antigen. S1-nuclease (Invitrogen-) treated DNA (Calbiochem) was used in the antinative DNA assay, and DNA was heated for 10 min and then quickly cooled for preparation of the dDNA antigen. Prior to coating plates with nDNA or dDNA, plates were pre-coated at 2 μg/mL with the synthetic 20–50 kDA polypeptide poly(lys-phe) (Sigma-Aldrich), comprising a co-polymer of lysine and phenylalanine at a 1:1 ratio as previously described [43]. Total histone was from Worthington. Serum samples were diluted 1 : 200 and incubated on the plate for 2 hours at room temperature with gentle shaking. Each sample was run in duplicate. The bound antibodies were detected with peroxidase-conjugated anti-human IgG (Southern Biotech, AL) and 2,2′-azino-bis(3-ethylbenzthiazoline-6-sulfonic acid) (MP Bioproducts) as the secondary substrate. Optical densities (OD) beyond the range of direct measurement at 1 h in the ELISA were extrapolated from OD at earlier time-points as described [44]. Positive and negative control sera were always included in each assay, and values determined in different assays were normalized by multiplying by the ratio of the reactivity of the positive control sera tested in each assay.

2.5. Statistical Analysis: Modeling

Total blood mercury results lower than the limit of detection (μg/L) were analyzed with the value of , because fewer than 50% of participants had a biomonitoring value < LOD. Total blood mercury results are presented as median values with the interquartile range, since the median is a better indicator of the true population value for the distribution of the collected data. The mean and 95% confidence interval for THg are also presented for ease of comparison with published NHANES population data. When comparing groups (e.g., male versus female) in relation to THg and ANA status, Fisher’s exact test was used.

To characterize the complex exposures on CRST lands and their relationships to immune system responses and autoantibody production, several statistical models incorporating biomonitoring data, fish consumption score, smoking exposure score, distance to arsenic contamination, and immune system markers were developed. The approaches included multiple linear, logistic, and Poisson regression models to evaluate relative contributions of environmental exposures to circulating autoantibodies. They also included accepted risk factors such as age and gender. Multiple linear regression was used to model THg in relation to environmental exposure and risk factors, while logistic regression was used to model ANA ≥ 2+ in relation to predictors. Poisson regression was used to model the numbers of specific autoantibodies (both determined via INOVA and additional assays) with environmental exposure and risk factors. Poisson models accommodate count information with nonnormal distribution, thereby enhancing the analytical capacity to understand the exposure factors’ underlying contribution to risk. Full models were fitted using all demographic, biomonitoring, and exposure data as predictors. Reduced models were selected using the Akaike information criterion (AIC), which is a measure of the relative quality of a statistical model. The openly available statistical software R [45] and the stepAIC function from the package MASS [46] were used to complete this AIC model selection, where And and is the likelihood of each model. The AIC selection criterion minimizes the distance between the predicted values of the model and the true values while also favoring models with fewer parameters.

2.5.1. Specific Approach to Analyze Specific Autoantibody Results from INOVA Assays

Since positivity for individual-specific autoantibodies was expected to be lower in frequency, we pooled all participants who tested positive for any specific autoantibodies to examine an overall prevalence of specific autoantibodies and the contributing exposure factors by summing the number of specific autoantibodies for which each participant tested positive and then conducting Poisson regression on the count variable generated. Biomonitoring data and exposure data were incorporated as well. This count variable makes biological sense because it follows established clinical AD diagnosis criteria; individuals diagnosed with AD present with varying combinations of specific autoantibodies.

2.5.2. Specific Approach to Analyze Specific Autoantibodies Results from Additional Autoantibody Assays

Poisson regression was used to model several combinations of autoantibodies that would otherwise be rarely detected. The combinations modeled were selected in order to examine different possible scenarios of positive autoantibody response. Individuals with detectable autoantibody response were classified into groups according to the following scenarios based on the literature [4244]:(a)presence of any autoantibody response (nDNA, dDNA, histone, chromatin);(b)detectable levels of potentially environmentally related autoantibodies (dDNA and histone);(c)disease-associated autoantibodies (nDNA and chromatin).

Results of these models were summarized in several tables presented in the next section.

Because anti-chromatin autoantibodies were detected using both INOVA and in-house assays, we evaluated the reproducibility of this antigen. We applied a nonparametric correlation (Spearman -value) and used a -score.

2.5.3. Reporting of Significant Results

While our primary results will follow a more standard reporting cutoff of , we will report those with probabilities up to 0.1 to guard against Type 2 error and to ensure comprehensive consideration of predictors in designing follow-up investigations. This decision is warranted given the importance of the results to the communities, the lack of prior studies in this area and in this population, and the lack of biomonitoring data at this time on other potential environmental exposures including arsenic resulting in imprecise measures for that variable.

3. Results

3.1. Mercury Exposure and Population Characteristics

Population characteristics, including gender, smoking score, fish consumption score, community size, and proximity to identified high-concentration sedimentary arsenic deposits, are summarized in Table 1. Total blood mercury concentrations (THg) ranged from below the limit of detection (LOD, 0.32 μg Hg/L) to 4.14 μg Hg/L, with a median lower than the LOD (Figure 4). For most population characteristic categories, the median THg was below the LOD, with the exception of males (0.37 μg Hg/L) and participants with “medium” or “high” fish consumption scores (0.35 and 0.54 μg Hg/L, resp.).


Population characteristic Participants with THg >LOD*Hg biomarker median (interquartile range)Hg biomarker mean (95% CI)ANA reading ≥2+ ( , %)

All participants7536 (36%)<LOD (<LOD–0.87)0.75 (0.55–0.95)23 (31%)

Gender
 Male3823 (61%)0.37 (<LOD–1.81)1.01 (0.67–1.37)2 (5%)
 Female3713 (35%)<LOD (<LOD–0.56)0.48 (0.32–0.63)9 (24%)
Smoking score
 (1) Low3217 (53%)0.37 (<LOD–0.74)0.67 (0.41–0.92)8 (25%)
 (2) Medium188 (44%)<LOD (<LOD–1.24)0.82 (0.36–1.28)3 (17%)
 (3) High2511 (44%)<LOD (<LOD–1.21)0.81 (0.39–1.23)7 (28%)
Active smoker
 Yes4219 (45%)<LOD (<LOD–0.96)0.77 (0.49–1.05)4 (10%)
 No3116 (52%)0.37 (<LOD–0.87)0.76 (0.40–1.06)7 (23%)
Fish score
 (1) Low4117 (59%)<LOD (<LOD–0.60)0.59 (0.36–0.82)7 (17%)
 (2) Medium1810 (56%)0.35 (<LOD–1.53)0.90 (0.38–1.43)2 (11%)
 (3) High169 (56%)0.54 (<LOD–1.89)0.99 (0.51–1.48)2 (13%)
Arsenic proximity
 Yes237 (30%)<LOD (<LOD–0.52)0.45 (0.25–0.64)7 (30%)
 No 5229 (56%)0.37 (<LOD–1.27)0.89 (0.62–1.16)4 (8%)

LOD = 0.32  g/L.

Total blood mercury in the CRST depended on gender, age, and fish consumption but not smoking. The reduced multiple linear regression modeling results for THg as a response with demographic and exposure information as predictors are summarized in Table 2. Male gender and older age were significant predictors of THg ( and 0.022, resp.); fish consumption approached significance as a predictor for THg ().


Estimate valueStd. error

Intercept0.4120.460.56
Gender*−0.5450.0084 0.2
Age0.01810.022 0.0077
Smoking score−0.01270.910.12
Fish score0.2460.0530.13
Arsenic proximity−0.5260.020 0.22

values less than or equal to 0.05 are italicized.
*Male gender was used as the reference, so the estimate describes the effect of being a female.
3.2. Prevalence of ANA in the CRST Population

Anti-nuclear antibodies (ANA) were analyzed in serum samples from all participants. Data are presented in Table 1 and representative images of negative and ANA ≥ 2+ readings are shown in Figure 3. Approximately thirty-one percent of participants had an ANA reading of ≥2+. For readings ≥2+, ANA prevalence was significantly higher in women than in men (24% versus 5%; ). ANA prevalence was also larger in community members living in proximity to high-concentration sedimentary arsenic deposits (30% versus 8%; ).

Gender and fish consumption were significant predictors of ANA ≥2+, and gender modifies the effects of environmental exposures with respect to ANA. The logistic regression model information is shown in Table 3. Age and fish consumption are borderline predictors () of ANA ≥ 2+ ( and , resp.), with age and fish consumption positively associated with the probability of ANA ≥ 2+ level of circulating ANA. Gender, THg, and proximity to arsenic, by themselves, do not strongly correlate with the probability of ANA ≥ 2+; however, the interactions of gender with THg and arsenic proximity are significant, and their odds ratios are greater than one (, and , , resp.).


OR95% CI value

Intercept0.011N/A0.93
Age1.10.96–1.170.081
Gender2.40.046–645.50.37
THG0.40.045–1.750.89
Fish score2.90.56–20.700.092
Gender: THG13.80.97–487.80.026
Gender: fish score0.10.0013–1.120.97
Gender: arsenic proximity27.10.68–21010.040
Arsenic proximity0.30.015–4.260.82

values less than or equal to 0.05 are italicized.
3.3. Specific Autoantibodies in the CRST Population

Of the specific autoantibodies for which participant sera were tested, SSA, SSA/52, CENP-A/B, M2 EP, and the autoantibodies detected by the primary biliary cirrhosis (PBC) panel were noteworthy. These results are summarized in Figure 5 and Table 4. Fifteen percent of participants tested positive for autoantibodies to M2 EP, while 24% were positive for autoantibodies to the PBC panel.


Negative Moderate positive Strong positive Total positive
Autoantibody

SSA72 (96%)2 (3%)1 (1.3%)3 (4%)
SSA-5270 (93%)2 (3%)3 (4%)5 (7%)
CENP-A/B72 (96%)0 (0%)3 (4%)3 (4%)
M2 EP64 (85%)11 (15%)
PBC panel57 (76%)18 (24%)

The number of specific autoantibodies detectable by INOVA kit increased with female gender and fish consumption score. Information for the reduced Poisson model for the number of detectable specific autoantibodies using INOVA assays can be found in Table 5(a). The number of specific autoantibodies detectable from INOVA assays was associated significantly with female gender (). The model indicated that the mean number of specific autoantibodies detectable in serum is increased by a factor of 6.5 in female versus male community members. Age and fish consumption had significant ( and , resp.) but smaller effects on the number of specific autoantibodies in the collected serum samples. In particular, the mean number of specific autoantibodies detectable by INOVA assay was 2.6 times greater in participants with a high versus a low fish consumption score. The number of participants positive for autoantibodies to native DNA, histone, and chromatin using in-house assays was small in our study. No significant associations were found between any demographic or exposure predictors, including smoking, and various combinations of in-house autoantibodies except in the case of dDNA and histone. The values for the reduced model can be seen in Table 5(b). Fish score was a significant predictor () of the number of subjects with elevated anti-dDNA and anti-histone autoantibodies detectable using in-house assays. An increase of one fish score category predicts a 2.5-factor increase in the number of dDNA and histone autoantibodies. Smoking was a borderline predictor () with a 0.4-factor decrease in the number of dDNA and histone autoantibodies for an increase of one smoking category.

(a)

Factor of change95% CI value

Intercept0.00.00–0.180.0012
Gender*6.51.69–24.780.0064
Age1.01.01–1.040.012
Fish score1.61.13–2.160.0073
Smoking score1.90.60–5.770.29
Gender: smoking score0.50.25–1.010.053

values less than or equal to 0.05 are italicized. *Male gender was used as the reference, thus, the factor of change reflects the effect of being female.
(b)

Factor of change95% CI value

Intercept0.20.004–9.8310.406
Age10.919–1.0550.658
Smoking0.40.127–1.0640.065
Fish score2.51.067–5.9800.035
Arsenic proximity00.000–3.7520.117
Age: arsenic proximity1.10.984–1.2440.092

values less than or equal to 0.05 are italicized.

Antichromatin positivity and reproducibility between INOVA and additional assays were confirmed in all positive serum samples (5/75); there was 100% agreement in detection using INOVA and in-house assays.

4. Discussion

We assumed that, due to consumption of locally caught fish, community members would have elevated levels of total blood mercury (THg). We hypothesized that THg would correspond to an increased level of autoantibodies, as has been shown in animal models [17]. Contrary to expectations, although Hg deposition in fish tissue had been documented in CRST sources by DENR, the detected THg levels in participants were low with a median THg < LOD, despite sampling during the middle of fishing season when fish consumption was considered to be maximal. The median THg for all participants (<LOD) was lower than the published results of the NHANES survey [47]. NHANES reported a mean THg of 0.944 μg/L for those 12 years and older [47]. Native American populations were not stratified in that study; the data were compiled under “other” ethnicity. The low levels of blood mercury among the CRST members found in our study confirmed the THg levels reported in a 2008 collaborative study between our team and CDC [48, 49]. Potential reasons for the observed low THg include variation due to race/ethnicity and possible physiological and metabolic changes among CRST community members, or possible alterations in deposition and clearance with repeated exposure in this population.

While gender, age, and fish consumption showed an impact on THg levels in the CRST population, smoking did not (Table 2). This finding is puzzling since 56% of the participants reported current smoking, yet only 45% of that group had THg above the detection level. The trends in our data parallel those seen in the NHANES survey [50]. Males have greater mean THg versus females, and THg increases with age. Males may consume larger quantities of locally caught fish or engage in activities that increase dust and particulate exposures to mercury (e.g., agricultural work, horse-tending). The age-dependent increase in THg found in this study, as well as in Wolkin et al. [48] and the NHANES survey [50], is likely due to the accumulation of metals in the body over time.

Thirty-one percent of participants had an ANA reading of ≥2+. ANA production could be associated with chronic toxicant exposure, which introduces self-antigens to antigen presenting cells, resulting in the breakdown of T-cell tolerance. While no single predictor was significantly associated () with ANA ≥ 2+, fish score was a borderline predictor (). A larger proportion of ANA-positive participants were female, which concurs with the literature and clinical findings about autoimmune diseases [24], and may support a possible role for female hormones in AD and immune dysregulation. Although THg and proximity to high-concentration arsenic deposits, by themselves, did not correlate with the probability of ANA ≥ 2+, the interactions of female gender with THg and female gender with arsenic proximity are significant ( and , resp.) and the odds ratios were large ( and 27.1, resp.). Gender differences may reflect alterations in the molecular mechanisms by which gender-specific detoxification occurs within the human body.

Another interesting finding is that current smokers were less likely to have ANA ≥ 2+ results (Table 1). Additionally, the specific autoantibody model estimates for smoking were negative with ORs less than one (Tables 5(a) and 5(b)), suggesting a protective effect of smoking. The fact that fewer autoantibodies were detected in this subgroup of smokers sheds light on probable molecular mechanisms by which smoking induces immunosuppressive effects.

There were significant associations between predictor exposure variables and the presence of autoantibodies to dDNA and histone (Table 5(b)). This is potentially similar to previously observed instances of xenobiotic-induced antibody responses such as drug-induced lupus [42]. Autoantibody production to dDNA and histone may also be linked to epigenetic changes triggered by environmental stimuli.

The CRST population exhibited strong positivity for M2 EP autoantibodies and autoantibodies detectable with the PBC screen, both of which are associated with liver diseases. It is possible that the medical problem of high rates of idiopathic liver cirrhosis in Sioux communities (personal communication J. Henderson) may have environmental etiology. Similar findings were reported among Alaskan Natives [51]. As with ANA ≥ 2+ models, fish score was a significant predictor of specific autoantibodies using both detection methods ( for INOVA kit detection and for in-house ELISA).

As to the specific mechanisms responsible for mercury and metal/metalloid-induced autoimmune responses in the CRST population, several mechanisms should be considered. In susceptible individuals, environmental metals may behave as adjuvants that prolong or enhance antigen-specific immune response through various mechanisms such as molecular mimicry [52], polyclonal activation of B cells [53], bystander activation [54], and epitope spreading [55]. Additionally, chronic exposures to environmental metals, including Hg and arsenic, are well known to induce oxidative stress. As has been characterized with thimerisol [56], this oxidative stress could lead to sensitization of inositol 1,4,5-triphospate (IP3) receptors, resulting in enhanced intracellular calcium release and subsequently the dysregulation of immune cells and autoimmunity. Another possibility includes the role of chronic gut exposures to ingested dietary nanoparticles of soil and minerals, which induce inflammasome production and the breakdown of immune tolerance via enhanced gastrointestinal antigen presentation. Since fish consumption was an important predictor of antibody production in this study, dietary exposure may be one potential pathway through which molecular markers of autoimmunity are generated, especially among native community members who are more likely to inhale and ingest large quantities of dust and metals due to their rural location, cultural practices, and subsistence and agricultural activities.

We hypothesize that fish consumption reflects multiple exposures, including coexposures to mercury, arsenic, and other environmental toxicants, such as pesticides, pharmaceuticals, and infectious agents. In animal and cell studies, Hg toxicity and autoimmunity are synergistically enhanced by coexposure to additional xenobiotics. These ideas will be explored in future studies, and additional activities that increase inadvertent exposure to toxicants will also be examined. Future studies will include a larger sample size, participant AD medical record history, and biomonitoring for arsenic and cotinine (indicator of smoking exposures) in order to address this study's limitations. We also acknowledge that technical issues with indirect immunofluorescence assays (IIFA) for the detection of ANA limit the comparability of these data to other population information and previous publications. However, IIFA is the gold-standard technique for ANA detection [57], and we attempted to minimize variability by using only one evaluator of staining (KMP, coauthor).

In this study, compelling evidence that the CRST population exhibited elevated levels of both ANA and specific autoantibodies was found. The observed results highlighted environmental toxicants that may contribute to autoantibody production in this population and also underscored the need to characterize the CRST communities’ lifestyles and behaviors to better understand how complex exposures contribute to autoimmune health effects. There is a large knowledge gap concerning environmental influences on the development of AD, and it is imperative that they be addressed within the context of environmental health disparities issues, particularly in tribal communities. Information will empower CRST community members and leaders by aiding them in making informed decisions about health, health services, the environment, and the preservation of their culture, in which fishing plays a vital role.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Authors’ Contribution

Jennifer Ong and Esther Erdei contributed equally to this work.

Acknowledgments

Colleen Martin and the Centers for Disease Control are acknowledged for their help with data collection and biomonitoring. Dr. Jeffrey A. Henderson from the Black Hills Center for American Indian Health is acknowledged for his continuing support, close relationship with CRST community members, and clinical knowledge. Esther Erdei received Community Engaged Research Pilot Grant from University of New Mexico (UNM) (2008) Center for Participatory Research under the Institute for Public Heath, Department of Family and Community Medicine in partnership with the Community Engagement and Research Unit of the Clinical and Translational Science Center (CTSC). Johnnye Lewis received theUniversity of New Mexico Clinical and Translational Science Center Pilot Grant NIEHS R25 ES013292 Environmental Justice on Cheyenne River (2010).

References

  1. H. Kirkemo, W. L. Newman, and R. P. Ashley, Gold, U.S. Geological Survey, Denver, Colo, USA, 2001.
  2. S. Vinyard and R. Lauren, “Dirty Energy’s Assault on Our Health: Mercury,” 2011. View at: Google Scholar
  3. G. C. Bryner, “Coalbed methane development: the costs and benefits of an emerging energy resource,” Natural Resources Journal, vol. 43, no. 2, pp. 519–560, 2003. View at: Google Scholar
  4. T. W. May, R. H. Wiedmeyer, J. Gober, and S. Larson, “Influence of mining-related activities on concentrations of metals in water and sediment from streams of the Black Hills, South Dakota,” Archives of Environmental Contamination and Toxicology, vol. 40, no. 1, pp. 1–9, 2001. View at: Publisher Site | Google Scholar
  5. J. BigEagle, “Development processes of consumption advisories for the Cheyenne River Sioux Indian Reservation,” in Proceedings of the National Forum on Contaminants in Fish, pp. 142–144, Baltimore, Md, USA, 2005. View at: Google Scholar
  6. J. M. Johnston, D. Hoff, R. Hoogerheide, R. Edgar, D. Wall, and C. Ducheneaux, Mercury Risk Management in Livestock Ponds on the Cheyenne River Sioux Reservation, Science Forum, Washington, DC, USA, 2003.
  7. A. T. Byrne, “Fish Consumption Survey for the Cheyenne River Basin within the Cheyenne River Indian Reservation, South Dakota,” Eagle Butte, SD, USA, 2002. View at: Google Scholar
  8. U.S. Census Bureau, “Distribution of Income by Family and Household,” 2000. View at: Google Scholar
  9. U.S. Department of Health & Human Services, “Poverty Guidelines, Research, and Measurement n.d.”. View at: Google Scholar
  10. United States Department of the Interior Bureau of Indian Affairs Office of Indian Services, “2005 American Indian Population and Labor Force Report,” 2005. View at: Google Scholar
  11. M. Satoh, E. K. L. Chan, L. A. Ho et al., “Prevalence and sociodemographic correlates of antinuclear antibodies in the United States,” Arthritis & Rheumatism, vol. 64, no. 7, pp. 2319–2327, 2012. View at: Publisher Site | Google Scholar
  12. C. M. Gallagher, A. E. McElroy, D. M. Smith, M. G. Golightly, and J. R. Meliker, “Polychlorinated biphenyls, mercury, and antinuclear antibody positivity, NHANES 2003-2004,” International Journal of Hygiene and Environmental Health, vol. 216, no. 6, pp. 721–727, 2013. View at: Publisher Site | Google Scholar
  13. M. S. Leffell, M. D. Fallin, W. H. Hildebrand, J. W. Cavett, B. A. Iglehart, and A. A. Zachary, “HLA alleles and haplotypes among the lakota sioux: report of the ASHI minority workshops, part III,” Human Immunology, vol. 65, no. 1, pp. 78–89, 2004. View at: Publisher Site | Google Scholar
  14. R. C. Williams, L. T. H. Jacobsson, W. C. Knowler et al., “Meta-analysis reveals association between most common class II haplotype in full-heritage native Americans and rheumatoid arthritis,” Human Immunology, vol. 42, no. 1, pp. 90–94, 1995. View at: Publisher Site | Google Scholar
  15. J. Heward and S. C. Gough, “Genetic susceptibility to the development of autoimmune disease,” Clinical Science, vol. 93, no. 6, pp. 479–491, 1997. View at: Google Scholar
  16. K. M. Pollard, P. Hultman, and D. H. Kono, “Immunology and genetics of induced systemic autoimmunity,” Autoimmunity Reviews, vol. 4, no. 5, pp. 282–288, 2005. View at: Publisher Site | Google Scholar
  17. D. Germolec, D. H. Kono, J. C. Pfau, and K. M. Pollard, “Animal models used to examine the role of the environment in the development of autoimmune disease: findings from an NIEHS Expert Panel Workshop,” Journal of Autoimmunity, vol. 39, no. 4, pp. 285–293, 2012. View at: Publisher Site | Google Scholar
  18. S. Havarinasab and P. Hultman, “Alteration of the spontaneous systemic autoimmune disease in (NZB×NZW)F1 mice by treatment with thimerosal (ethyl mercury),” Toxicology and Applied Pharmacology, vol. 214, no. 1, pp. 43–54, 2006. View at: Publisher Site | Google Scholar
  19. P. Hultman, A. Taylor, J. M. Yang, and K. M. Pollard, “The effect of xenobiotic exposure on spontaneous autoimmunity in (SWR×SJL)F1 hybrid mice,” Journal of Toxicology and Environmental Health A, vol. 69, no. 6, pp. 505–523, 2006. View at: Publisher Site | Google Scholar
  20. K. M. Pollard, D. L. Pearson, P. Hultman, T. N. Deane, U. Lindh, and D. H. Kono, “Xenobiotic acceleration of idiopathic systematic autoimmunity in lupus-prone BXSB mice,” Environmental Health Perspectives, vol. 109, no. 1, pp. 27–33, 2001. View at: Google Scholar
  21. K. M. Pollard, D. L. Pearson, P. Hultman, B. Hildebrandt, and D. H. Kono, “Lupus-prone mice as models to study xenobiotic-induced acceleration of systemic autoimmunity,” Environmental Health Perspectives, vol. 107, supplement 5, pp. 729–735, 1999. View at: Google Scholar
  22. D. Fairweather, S. Frisancho-Kiss, and N. R. Rose, “Sex differences in autoimmune disease from a pathological perspective,” The American Journal of Pathology, vol. 173, no. 3, pp. 600–609, 2008. View at: Publisher Site | Google Scholar
  23. J. B. Nielsen and P. Hultman, “Mercury-induced autoimmunity in mice,” Environmental Health Perspectives, vol. 110, no. 5, pp. 877–881, 2002. View at: Google Scholar
  24. K. M. Pollard, “Gender differences in autoimmunity associated with exposure to environmental factors,” Journal of Autoimmunity, vol. 38, no. 2-3, pp. J177–J186, 2012. View at: Publisher Site | Google Scholar
  25. K. K. Aminzadeh and M. Etminan, “Dental amalgam and multiple sclerosis: a systematic review and meta-analysis,” Journal of Public Health Dentistry, vol. 67, no. 1, pp. 64–66, 2007. View at: Publisher Site | Google Scholar
  26. M. N. Bates, J. Fawcett, N. Garrett, T. Cutress, and T. Kjellstrom, “Health effects of dental amalgam exposure: a retrospective cohort study,” International Journal of Epidemiology, vol. 33, no. 4, pp. 894–902, 2004. View at: Publisher Site | Google Scholar
  27. J. F. Nyland, M. Fillion, F. Barbosa Jr. et al., “Biomarkers of methylmercury exposure immunotoxicity among fish consumers in amazonian Brazil,” Environmental Health Perspectives, vol. 119, no. 12, pp. 1733–1738, 2011. View at: Google Scholar
  28. R. M. Gardner, J. F. Nyland, I. A. Silva, A. M. Ventura, J. M. de Souza, and E. K. Silbergeld, “Mercury exposure, serum antinuclear/antinucleolar antibodies, and serum cytokine levels in mining populations in Amazonian Brazil: a cross-sectional study,” Environmental Research, vol. 110, no. 4, pp. 345–354, 2010. View at: Publisher Site | Google Scholar
  29. E. K. Silbergeld, I. A. Silva, and J. F. Nyland, “Mercury and autoimmunity: implications for occupational and environmental health,” Toxicology and Applied Pharmacology, vol. 207, no. 2, supplement, pp. 282–292, 2005. View at: Publisher Site | Google Scholar
  30. I. A. Silva, J. F. Nyland, A. Gorman et al., “Mercury exposure, malaria, and serum antinuclear/antinucleolar antibodies in amazon populations in Brazil: a cross-sectional study,” Environmental Health: A Global Access Science Source, vol. 3, article 11, 2004. View at: Publisher Site | Google Scholar
  31. R. M. Gardner, J. F. Nyland, and E. K. Silbergeld, “Differential immunotoxic effects of inorganic and organic mercury species in vitro,” Toxicology Letters, vol. 198, no. 2, pp. 182–190, 2010. View at: Publisher Site | Google Scholar
  32. R. M. Gardner, J. F. Nyland, S. L. Evans et al., “Mercury induces an unopposed inflammatory response in human peripheral blood mononuclear cells in vitro,” Environmental Health Perspectives, vol. 117, no. 12, pp. 1932–1938, 2009. View at: Publisher Site | Google Scholar
  33. P. N. Henderson, S. Kanekar, Y. Wen et al., “Patterns of cigarette smoking initiation in two culturally distinct American Indian tribes,” American Journal of Public Health, vol. 99, no. 11, pp. 2020–2025, 2009. View at: Publisher Site | Google Scholar
  34. F. Pragst and S. Leo, “Smoking trials with mercury contaminated cigarettes: studies of attempted poisoning,” Archiv für Kriminologie, vol. 188, no. 3-4, pp. 77–86, 1991. View at: Google Scholar
  35. M. R. Fresquez, R. S. Pappas, and C. H. Watson, “Establishment of toxic metal reference range in tobacco from US cigarettes,” Journal of Analytical Toxicology, vol. 37, no. 5, pp. 298–304, 2013. View at: Publisher Site | Google Scholar
  36. J. S. Smolen, B. Butcher, M. J. Fritzler et al., “Reference sera for antinuclear antibodies: II. Further definition of antibody specificities in international antinuclear antibody reference sera by immunofluorescence and western blotting,” Arthritis & Rheumatism, vol. 40, no. 3, pp. 413–418, 1997. View at: Publisher Site | Google Scholar
  37. United States Environmental Protection Agency, “Consumption Advice: Joint Federal Advisory for Mercury in Fish n.d.”. View at: Google Scholar
  38. A. S. Andrew, D. A. Jewell, R. A. Mason, M. L. Whitfield, J. H. Moore, and M. R. Karagas, “Drinking-water arsenic exposure modulates gene expression in human lymphocytes from a U.S. population,” Environmental Health Perspectives, vol. 116, no. 4, pp. 524–531, 2008. View at: Publisher Site | Google Scholar
  39. R. Biswas, P. Ghosh, N. Banerjee et al., “Analysis of T-cell proliferation and cytokine secretion in the individuals exposed to arsenic,” Human and Experimental Toxicology, vol. 27, no. 5, pp. 381–386, 2008. View at: Publisher Site | Google Scholar
  40. J.-M. Yang, B. Hildebrandt, C. Luderschmidt, and K. M. Pollard, “Human scleroderma sera contain autoantibodies to protein components specific to the U3 small nucleolar RNP complex,” Arthritis & Rheumatism, vol. 48, no. 1, pp. 210–217, 2003. View at: Publisher Site | Google Scholar
  41. E. M. Tan, T. E. W. Feltkamp, J. S. Smolen et al., “Range of antinuclear antibodies in “healthy” individuals,” Arthritis & Rheumatism, vol. 40, no. 9, pp. 1601–1611, 1997. View at: Publisher Site | Google Scholar
  42. R. L. Rubin, “Drug-induced lupus,” Toxicology, vol. 209, no. 2, pp. 135–147, 2005. View at: Publisher Site | Google Scholar
  43. R. W. Burlingame and R. L. Rubin, “Subnucleosome structures as substrates in enzyme-linked immunosorbent assays,” Journal of Immunological Methods, vol. 134, no. 2, pp. 187–199, 1990. View at: Publisher Site | Google Scholar
  44. G. Schett, J. Smolen, C. Zimmermann et al., “The autoimmune response to chromatin antigens in systemic lupus erythematosus: autoantibodies against histone H1 are a highly specific marker for SLE associated with increased disease activity,” Lupus, vol. 11, no. 11, pp. 704–715, 2002. View at: Publisher Site | Google Scholar
  45. R Core Team, R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria, 2013.
  46. B. D. Ripley, B. Venables, D. M. Bates, K. Hornik, A. Gebhardt, and D. Firth, “Support Functions and Datasets for Venables and Ripley’s MASS,” 2013. View at: Google Scholar
  47. Centers for Disease Control, “Fourth National Report on Human Exposure to Environmental Chemicals: Updated Tables, September 2013,” 2013. View at: Google Scholar
  48. A. Wolkin, D. Hunt, C. Martin, K. L. Caldwell, and M. A. McGeehin, “Blood mercury levels among fish consumers residing in areas with high environmental burden,” Chemosphere, vol. 86, no. 9, pp. 967–971, 2012. View at: Publisher Site | Google Scholar
  49. C. Martin, A. Wolkin, C. Ducheneaux, J. Lewis, and J. Henderson, Blood Mercury (Hg) Levels Among Consumers of Locally Caught Fish Residing on the Cheyenne River Sioux Tribe (CRST) Reservation, American Public Health Association, 2009.
  50. K. L. Caldwell, M. E. Mortensen, R. L. Jones, S. P. Caudill, and J. D. Osterloh, “Total blood mercury concentrations in the U.S. population: 1999–2006,” International Journal of Hygiene and Environmental Health, vol. 212, no. 6, pp. 588–598, 2009. View at: Publisher Site | Google Scholar
  51. K. J. Hurlburt, B. J. McMahon, H. Deubner, B. Hsu-Trawinski, J. L. Williams, and K. V. Kowdley, “Prevalence of autoimmune liver disease in Alaska natives,” The American Journal of Gastroenterology, vol. 97, no. 9, pp. 2402–2407, 2002. View at: Publisher Site | Google Scholar
  52. E. Israeli, N. Agmon-Levin, M. Blank, and Y. Shoenfeld, “Adjuvants and autoimmunity,” Lupus, vol. 18, no. 13, pp. 1217–1225, 2009. View at: Publisher Site | Google Scholar
  53. O. Barzilai, M. Ram, and Y. Shoenfeld, “Viral infection can induce the production of autoantibodies,” Current Opinion in Rheumatology, vol. 19, no. 6, pp. 636–643, 2007. View at: Publisher Site | Google Scholar
  54. K. Murali-Krishna, J. D. Altman, M. Suresh et al., “Counting antigen-specific CD8 T cells: a reevaluation of bystander activation during viral infection,” Immunity, vol. 8, no. 2, pp. 177–187, 1998. View at: Publisher Site | Google Scholar
  55. P. V. Lehmanann, T. Forthuber, A. Miller, and E. E. Sercaz, “Spreading of T-cell autoimmunity to cryptic determinants of an antigen,” Nature, vol. 358, no. 6382, pp. 155–157, 1992. View at: Publisher Site | Google Scholar
  56. D. Yeter and R. Deth, “ITPKC susceptibility in Kawasaki syndrome as a sensitizing factor for autoimmunity and coronary arterial wall relaxation induced by thimerosal's effects on calcium signaling via IP3,” Autoimmunity Reviews, vol. 11, no. 12, pp. 903–908, 2012. View at: Publisher Site | Google Scholar
  57. N. Agmon-Levin, J. Damoiseaux, C. Kallenberg, U. Sack, T. Witte, M. Herold et al., “International recommendations for the assessment of autoantibodies to cellular antigens referred to as anti-nuclear antibodies,” Annals of the Rheumatic Diseases, vol. 73, no. 1, pp. 17–23, 2014. View at: Publisher Site | Google Scholar

Copyright © 2014 Jennifer Ong et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


More related articles

1921 Views | 708 Downloads | 7 Citations
 PDF Download Citation Citation
 Download other formatsMore
 Order printed copiesOrder

Related articles

We are committed to sharing findings related to COVID-19 as quickly as possible. We will be providing unlimited waivers of publication charges for accepted research articles as well as case reports and case series related to COVID-19. Review articles are excluded from this waiver policy. Sign up here as a reviewer to help fast-track new submissions.