Intracellular and Extracellular Redox Status and Free Radical Generation in Primary Immune Cells from Children with Autism

Rose, Shannon; Melnyk, Stepan; Trusty, Timothy A.; Pavliv, Oleksandra; Seidel, Lisa; Li, Jingyun; Nick, Todd; James, S. Jill

doi:https://doi.org/10.1155/2012/986519

Autism Research and Treatment

On this page

Abstract Introduction Methods Results Discussion Acknowledgments References Copyright Related Articles

Special Issue

Autism: Where Genetics Meets the Immune System

View this Special Issue

Research Article | Open Access

Volume 2012 | Article ID 986519 | https://doi.org/10.1155/2012/986519

Intracellular and Extracellular Redox Status and Free Radical Generation in Primary Immune Cells from Children with Autism

Shannon Rose,¹Stepan Melnyk,¹Timothy A. Trusty,¹Oleksandra Pavliv,¹Lisa Seidel,¹Jingyun Li,¹Todd Nick,¹and S. Jill James¹

Academic Editor: Antonio M. Persico

Received30 Jul 2011

Revised12 Aug 2011

Accepted12 Sept 2011

Published24 Nov 2011

Abstract

The modulation of the redox microenvironment is an important regulator of immune cell activation and proliferation. To investigate immune cell redox status in autism we quantified the intracellular glutathione redox couple (GSH/GSSG) in resting peripheral blood mononuclear cells (PBMCs), activated monocytes and CD4 T cells and the extracellular cysteine/cystine redox couple in the plasma from 43 children with autism and 41 age-matched control children. Resting PBMCs and activated monocytes from children with autism exhibited significantly higher oxidized glutathione (GSSG) and percent oxidized glutathione equivalents and decreased glutathione redox status (GSH/GSSG). In activated CD4 T cells from children with autism, the percent oxidized glutathione equivalents were similarly increased, and GSH and GSH/GSSG were decreased. In the plasma, both glutathione and cysteine redox ratios were decreased in autistic compared to control children. Consistent with decreased intracellular and extracellular redox status, generation of free radicals was significantly elevated in lymphocytes from the autistic children. These data indicate primary immune cells from autistic children have a more oxidized intracellular and extracellular microenvironment and a deficit in glutathione-mediated redox/antioxidant capacity compared to control children. These results suggest that the loss of glutathione redox homeostasis and chronic oxidative stress may contribute to immune dysregulation in autism.

1. Introduction

Autism is a behaviorally defined neurodevelopmental disorder that usually presents in early childhood and is characterized by significant impairments in social interaction and communication and by abnormal repetitive hyper-focused behaviors. The prevalence of autism spectrum disorders has increased more than 10-fold in the last two decades, now affecting one in 110 US children, yet the etiology of these disorders remains elusive [1]. Glutathione depletion and oxidative stress have been implicated in the pathology of numerous neurobehavioral disorders including schizophrenia [2], bipolar disorder [3], and Alzheimer’s disease [4]. Accumulating evidence suggests that redox imbalance and oxidative stress may also contribute to autism pathophysiology. Multiple biomarkers of oxidative stress have been identified in blood samples from children with autism [5–12]. Our group has reported a decrease in concentrations of glutathione (GSH) and several of its metabolic precursors, an increase in oxidized glutathione disulfide (GSSG), and a decrease in glutathione redox ratio (GSH/GSSG) in case-control evaluations of plasma and lymphoblastoid cell lines derived from children with autism [13–16]. Recently, several interactive polymorphisms in enzymes regulating glutathione synthesis were found to be more prevalent in children with autism suggesting that the glutathione deficit and predisposition to oxidative stress may be genetically based in some children [17].

Oxidative stress occurs when cellular antioxidant defense mechanisms fail to counterbalance endogenous ROS production and/or exogenous prooxidant environmental exposures. Glutathione (γ-L-glutamyl-L-cysteinylglycine) is a tripeptide that functions as the major intracellular antioxidant and redox buffer against macromolecular oxidative damage. The glutathione thiol/disulfide redox couple (GSH/GSSG) is the predominant mechanism for maintaining the intracellular microenvironment in a highly reduced state that is essential for antioxidant/detoxification capacity, redox enzyme regulation, cell cycle progression, and transcription of antioxidant response elements (ARE) [18–23]. Subtle variation in the relative concentrations of reduced and oxidized glutathione provides a dynamic redox signaling mechanism that regulates these vital cellular processes [24–27]. For example, in both CNS precursor cells and naïve immune cells, intracellular glutathione redox status is the primary determinant modulating the cellular decision to undergo cell cycle arrest, differentiation, or proliferation [27]. A reducing intracellular environment is required for proliferation, while a more oxidized microenvironment favors cell cycle arrest and differentiation. A chronic deficit in the GSH/GSSG redox ratio is considered to be a reliable indicator of oxidative stress and increased vulnerability to oxidative damage from prooxidant environmental exposures [28, 29].

In the extracellular plasma compartment, the cysteine/cystine (thiol/disulfide) redox couple independently provides the ambient redox environment for circulating immune cells. The ambient extracellular cysteine/cystine redox potential has been shown to be more oxidized than the intracellular GSH/GSSG redox potential and is independently regulated [30]. Dynamic shifts in the plasma cysteine/cystine redox potential alter the redox status of cysteine moieties in cell surface proteins to induce conformational changes in protein structure that can reversibly alter function [31, 32]. For example, under oxidizing extracellular conditions, redox-sensitive cysteine residues in the catalytic core of protein tyrosine phosphatases become oxidized and reversibly inactivate enzyme activity depending on the ambient cysteine/cystine redox potential [31, 33, 34]. Extracellular cysteine/cystine redox status is emerging as an important new signal transduction mechanism that can induce posttranslational alterations in downstream redox-sensitive proteins including a variety of enzymes, transcription factors, receptors, adhesion molecules, and membrane signaling proteins resulting in the dynamic modulation of their activity and function [32, 35, 36].

Recent studies have revealed numerous immunologic abnormalities among children with autism including alterations in immune cell proportions [37–40] and shifts in helper T-cell subpopulations after mitogenic stimulation [41, 42]. Peripheral blood mononuclear cells (PBMCs) from individuals with autism have been shown to produce higher levels of proinflammatory cytokines and abnormal levels of regulatory cytokines compared to control PBMCs at baseline and upon mitogenic stimulation [43–46]. Taken together, the immunological studies suggest a role for a dysregulated immune system in autism that potentially could be related to a deficit in glutathione-mediated antioxidant capacity and an oxidized microenvironment in immune cells. To investigate this possibility, we examined whether primary immune cells (PBMCs) from children with autism exhibit decreased intracellular glutathione redox capacity compared to PBMCs from age-matched control children and whether a more oxidized intracellular and extracellular microenvironment is associated with increased production of oxidizing intracellular free radicals. Because immune cells from children with autism have been shown to have abnormal responses to stimulation, we also elected to challenge the PBMCs with immune activators known to promote oxidative stress and measure the resulting intracellular glutathione redox status in activated isolated monocytes and T cells.

2. Subjects and Methods

2.1. Participants

This investigation was conducted on a subset of children from the autism IMAGE (Integrated Metabolic and Genomic Endeavor) study at Arkansas Children’s Hospital Research Institute (ACHRI) that has recruited over 162 case and control families to date. The IMAGE cohort for this study consisted of 43 children diagnosed with autistic disorder and 41 unaffected control children (16 of which were unaffected siblings). The autism case families were recruited locally after referral to the University of Arkansas for Medical Sciences (UAMS), Dennis Developmental Center and diagnosed by trained developmental pediatricians. Children aged 3 to 10 with a diagnosis of autistic disorder as defined by the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV 299.0), the Autism Diagnostic Observation Schedule (ADOS), and/or the Childhood Autism Rating Scales (CARS >30) were enrolled. Children diagnosed with other conditions on the autism spectrum or rare genetic diseases associated with symptoms of autism were excluded from the study. Children with chronic seizure disorders, recent infection, and high-dose vitamin or mineral supplements exceeding the RDA were also excluded because these conditions are potential confounders that could affect redox status. Unaffected siblings and unrelated, neurotypical children aged 3 to 10 with no medical history of behavioral or neurologic abnormalities by parent report made up the comparison group. The protocol was approved by the Institutional Review Board at UAMS, and all parents signed informed consent.

2.2. Materials

Culture flasks, plates, and pipettes were obtained from Corning Life Sciences (Lowell, Mass, USA). RPMI 1640, penicillin/streptomycin, Dulbecco’s phosphate-buffered saline (PBS), fetal bovine serum (FBS), and glutamine were purchased from Life Technologies (Carlsbad, Calif, USA). Carboxy-H₂DCFDA (6-carboxy-2′,7′-dichlorodihydrofluorescein diacetate, diacetoxymethyl ester) was obtained from Molecular Probes (Carlsbad, Calif, USA). Human Monocyte Isolation Kit II and Human CD4 T cell Isolation Kit II were purchased from Miltenyi Biotec (Bergisch-Gladbach, Germany). Histopaque-1077 and all other chemicals were obtained from Sigma-Aldrich (St. Louis, Mo, USA).

2.3. Isolation of PBMCs and Stimulation of Monocytes and CD4 T Cells

Fasting blood samples (≤20 mL) were collected before 9:00 AM into EDTA-Vacutainer tubes and immediately chilled on ice before centrifuging at 1300 ×g for 10 min at 4°C. Aliquots of plasma were stored at −80°C in cryostat tubes until extraction and HPLC quantification. PBMCs were isolated by centrifugation over Histopaque-1077. Red blood cells were lysed using a brief (15 s) incubation with 1 mL ice-cold water. Approximately, PBMCs were resuspended in RPMI 1640 medium (supplemented with 10% FBS, 1% penicillin/streptomycin, and 2 mM glutamine) at a density of 10⁶ cells/mL. Note that because we were unable to obtain 20 mL blood volume from every child, it was not possible to isolate and analyze monocytes and CD4 T cells for all participants. For monocyte stimulation, PBMCs were treated with 0.1 μg/mL lipopolysaccharide (LPS); for T-cell stimulation, PBMCs were treated with 10 ng/mL phorbol 12-myristate 13-acetate (PMA) and 1 μg/mL ionomycin. Cells were placed in a humidified 5% CO₂ incubator at 37°C for 4 hr. Stimulated monocytes and CD4 T cells were then isolated by negative selection using magnetic cell labeling as described by the manufacturer (Miltenyi Biotec, Bergisch-Gladbach, Germany). Using flow cytometry, we determined that ≥75% of isolated monocytes are positive for CD14 and that ≥87% of isolated CD4 T cells are positive for CD4. For HPLC quantification of GSH and GSSG, approximately unstimulated (resting) PBMCs, stimulated monocytes, or stimulated CD4 T cells were pelleted, snap frozen on dry ice, and stored at −80°C.

2.4. Cell Extraction and HPLC Quantification of Intracellular Glutathione and Plasma Cysteine Redox Status

The storage interval at −80°C before extraction was consistently between 1-2 weeks after blood draw and cell isolation to minimize potential metabolite interconversion. The methodological details for intracellular and extracellular GSH extraction and HPLC elution and electrochemical detection have been described previously [15, 16], and metabolite detection does not require derivatization. Although most GSSG is present as a mixed disulfide with other thiols including cysteine, our measurements detect only the free GSSG in plasma. Glutathione and cysteine concentrations were calculated from peak areas of standard calibration curves using HPLC software. Intracellular results are expressed as nanomoles per milligram of protein using the BCA Protein Assay Kit (Pierce, Rockford, Ill, USA), and plasma results are expressed as micromoles per liter.

2.5. Measurement of Intracellular Free Radicals

Carboxy-H₂DCFDA (DCF) is a membrane-permeable ROS/RNS-sensitive probe that remains nonfluorescent until oxidized by intracellular free radicals. The intensity of DCF fluorescence is directly proportional to the level of free radical oxidation. Approximately, 10⁶ PBMCs were resuspended in 1 mL RPMI 1640 medium supplemented with 10% FBS, 1% penicillin/streptomycin, and 2 mM glutamine and stained in the dark for 20 min with 1 μM DCF at 37°C. Stained cells were washed and resuspended in PBS and analyzed immediately on a Partec CyFlow flow cytometer (Görlitz, Germany) using 488 nm excitation wavelength with 530/30 nm (FL1) emission filter. For each analysis, the fluorescence properties of 10000 cells were collected, and the data were analyzed using the FCS Express software (De Novo Software, Los Angeles, Calif, USA). Intracellular free radical levels are expressed as median fluorescence intensity (MFI) of subject sample DCF fluorescence normalized to DCF fluorescence of a standard PBMC preparation. As an internal control, the standard PBMC preparation was isolated from a 100 mL blood sample from an unaffected healthy adult volunteer, aliquoted and frozen at −180°C in 90% FBS/10% DMSO. An aliquot of the standard PBMC preparation was stained and analyzed with each subject sample. Evaluation of oxidizing free radical production was possible only in those case and unrelated control samples for which sufficient (~20 mL) blood volume was obtained.

2.6. Statistical Analysis

Within the control group, 16 of the 41 unaffected control children were case siblings. There were 27 additional case children without a sibling and 25 additional unrelated control children comprising the total case-control cohort of 84 children. To down-weight the impact of outliers, three metabolites observations were curtailed at the extremes of the distributions for PBMC GSH, PBMC GSSG, and Monocytes GSH/GSSG (see footnote in Table 2). The sibling data are correlated resulting in a combined sample of correlated and uncorrelated data; thus, the assumption of all data being independent is not satisfied for the standard two-sample -test. To make use of all data from dependent and independent observations, we used the corrected -test proposed by Looney and Jones [47]. This statistical approach provides adequate control of Type 1 errors and has more power than a standard Student’s -test. Because the DCF data compared cases and unrelated controls (without siblings) the standard Student’s -test was used with significance set at 0.05. Nonparametric intercorrelations (Spearman correlation coefficients) between age and gender and the 7 outcome variables, GSH, GSSG, GSH/GSSG, % oxidized glutathione, cysteine, cystine, and cysteine/cystine were determined with the significance level set at 0.05. Data was analyzed using SAS 9.2 software (SAS Institute Inc, Cary, NC, USA).

3. Results

3.1. Demographics of Study Population

Table 1 lists the demographics of the study population. The only major differences between cases and controls are that the control group was composed of a greater proportion of females and African Americans, whereas the case group had a greater proportion of Asian subjects. Over-the-counter multivitamin supplement use was higher among cases (39.5%) compared to controls (19.5%); however, the glutathione redox status was statistically unaffected by vitamin use (data not shown).

3.2. Decreased Intracellular Glutathione Redox Status in Autism

Table 2 presents the relative intracellular concentrations of GSH, GSSG, the glutathione redox ratio, and the percentage of oxidized glutathione equivalents in resting (unstimulated) PBMCs and in isolated stimulated monocytes and CD4 T cells from children with autism and age-matched control children. The percent oxidized glutathione is expressed in absolute glutathione equivalents as 2GSSG/(GSH+2GSSG). Relative to controls, the intracellular concentration of GSSG and the percent oxidized glutathione were significantly increased (~40%), and the GSH/GSSG ratio decreased (~21%) in PBMCs from children with autism (). After stimulation with LPS, monocytes from children with autism also exhibited significantly decreased GSH/GSSG (~31%, ), increased GSSG concentration (~32%, ), and 40% higher percent oxidized glutathione (). In mitogen-stimulated CD4 T cells from children with autism, the intracellular GSH concentration was ~33% lower, the GSH/GSSG was ~40% lower (), and the percent oxidized glutathione was ~55% higher than in stimulated CD4 T cells from control children (<0.001). As expected, activation with LPS and PMA both resulted in decreased intracellular GSH levels and GSH/GSSG in isolated monocytes and CD4 T cells compared to resting (unstimulated) PBMCs. Upon stimulation, there was a greater decrease in intracellular GSH and GSH/GSSG in both CD4 T cells and monocytes from children with autism compared to control children. Neither age nor gender was significantly correlated with any of the outcome measures. The protein content per 10⁶ cells did not differ between case and control children (data not shown).

3.3. Decreased Extracellular Glutathione and Cysteine Redox Status in Autism

Table 3 presents the relative concentrations of GSH, GSSG, GSH/GSSG, % oxidized GSH, cysteine, cystine, and the cysteine/cystine redox ratio in the extracellular plasma compartment. Children with autism exhibited a significantly decreased extracellular concentration of GSH (~21%) and GSH/GSSG (~54%) and increased concentration of GSSG and the percent oxidized glutathione (52% and 82%, resp., ). Figures 1(a) and 1(b) compare GSH/GSSG and % oxidized glutathione equivalents, respectively, in plasma, T cells, and monocytes from case and control children and graphically demonstrates the consistent decrease in both extracellular and intracellular glutathione redox status among the case children.

(a)

(b)

The dynamic balance between the reduced and oxidized forms of glutathione can also be expressed as the redox potential or reducing power of the GSH/GSSG redox couple () and can be calculated from the Nernst equation, , where is the standard potential for the glutathione redox couple (−264 mV), is the gas constant (8.314 J/°Kmol), is the absolute temperature of analytical measurement (), is 2 for the number of electrons transferred, and is Faraday’s constant (96,485 coulomb/mol) [48]. The calculated value for the GSH pool in the children with autism is −116 mV, which is 12 mV more oxidized than in the control children, with an value of −128 mV (Table 3).

The concentration of cystine, the oxidized form of cysteine, was significantly elevated (~52%), while the cysteine/cystine redox ratio was significantly decreased (~31%) in plasma from children with autism (). The value for the cysteine pool can also be calculated from the Nernst equation (see above) where the for cysteine is equal to −250 mV [30]. The calculated value for the cysteine pool in children with autism is −106 mV, or 5 mV more oxidized than the control value of −111 mV (Table 3).

3.4. Elevated Free Radical Production in Autism

The level of intracellular free radicals was measured in available resting PBMCs from children with autism () and unaffected control children () using DCF, an ROS/RNS-sensitive fluorescent probe. Monocytes and lymphocytes were gated based on light scatter properties (size and density) and analyzed separately. Figure 2 presents the median fluorescence intensity (MFI) of lymphocytes from children with autism and unaffected control children (normalized to MFI of the standard PBMC preparation). Gated lymphocytes from children with autism exhibited a significantly higher mean level of intracellular free radicals compared to lymphocytes from control children (). No differences in free radical production were observed in gated monocytes from case and control children. Intracellular free radical production was not correlated with age or gender in this cohort.

Figure 2

Intracellular Free Radicals are Elevated in Lymphocytes from Children with Autism. Intracellular free radicals were measured in freshly isolated PBMC from children with autism and unaffected control children using 1 uM DCF. Presented is median fluorescent intensity (MFI) of the gated lymphocyte population from subject samples normalized to MFI of a standard PBMC preparation also treated with 1 uM DCF and analyzed with each subject sample. Lymphocytes from children with autism exhibited a significantly higher mean level of intracellular free radicals than controls (). Control median (95% CI) = 0.576 (0.551–0.640); case median (95% CI) = 0.689 (0.561–1.086).

4. Discussion

Oxidative stress is generally defined as an imbalance between oxidant production and endogenous antioxidant defense mechanisms and can be clinically defined in humans by a decrease in the redox status of GSH/GSSG and cysteine/cystine thiol/disulfide redox couples [49]. The relative equilibrium between reduced and oxidized sulfhydryl groups defines the ambient redox state. Low glutathione redox status has been associated with the pathophysiology of several neurobehavioral disorders including schizophrenia [2, 50], bipolar disorder [3], alcoholism [51], HIV [52], and Alzheimer’s disease [53]. This is the first study to evaluate intracellular glutathione-mediated antioxidant/redox capacity in primary cells from children with autism as well as the extracellular plasma cysteine/cystine redox status. Because these two redox systems are compartmentalized and independently regulated, evaluation of both redox couples provides a complete picture of the primary immune cell microenvironment in children with autism. Supporting and extending our previous findings of decreased plasma and lymphoblastoid cell GSH/GSSG, we now report that both primary immune cell GSH/GSSG and plasma cysteine/cystine redox couples are similarly compromised resulting in a more oxidized immune cell microenvironment in children with autism compared to control children.

Recent evidence supports the notion that subtle fluctuations in ambient redox status may provide an important regulatory mechanism that can dynamically modulate immune cell function. Activation and proliferation of T cells require a reducing intracellular microenvironment, whereas a more oxidized environment promotes cell cycle arrest and blunted responsiveness to immune stimulation [54–57]. For example, a mechanism involving extracellular redox modulation by regulatory T cells (Tregs) was recently elucidated by Yan et al. [35]. Tregs were shown to inhibit the release of cysteine into the immune synapse between dendritic cells and naïve T cells, which effectively reduces GSH levels in T cells by eliminating the rate-limiting amino acid for GSH synthesis. A high ratio of reduced to oxidized glutathione is required for cell cycle progression from G1 to S phase and induction of the T-cell proliferative response [55]. Thus, the more oxidized GSH/GSSG redox state of the intracellular glutathione pool in PBMCs and in activated CD4 T cells observed in children with autism (Table 2) would suggest a hyporesponsive phenotype that is less conducive to T-cell activation and proliferation. Consistent with this hypothesis, several recent studies have documented abnormalities in the adaptive immune response in children with autism [44, 58].

A glutathione deficit in T cells has been shown to negatively affect the adaptive immune response and T-cell proliferation by reducing IL-2 receptor turnover and IL-2-dependent DNA synthesis [59, 60]. In monocytes, an oxidized intracellular environment has been shown to alter the cytokine profile and skew the Th1 and Th2 balance [61, 62]. Studies in mice have demonstrated that the intracellular GSH content of antigen presenting cells (APCs) reversibly alters the Th1 and Th2 cytokine response pattern [61]. Specifically, a GSH deficit reduced Th1-associated IFN-γ production and exaggerated Th2-associated IL-4 production. Restoration of GSH restored the Th1 cytokine response and normalized the Th2 response. Consistent with these observations, two independent studies have reported that helper T-cell subpopulations in PBMCs from children with autism are shifted towards T helper 2 (Th2) dominance [41, 42]. Further, a decrease in T-cell IL-2 receptor expression has been reported to be associated with decreased proliferative response after mitogen stimulation in children with autism [58].

The more oxidized GSH/GSSG redox status in plasma and primary immune cells in children with autism (Figure 1) may offer a mechanistic explanation for the abnormal adaptive immune response previously reported in these children. When intracellular oxidative stress exceeds glutathione redox capacity, cells export GSSG into the plasma as a mechanism to restore internal redox homeostasis [49, 63]. The elevated GSSG concentrations in PBMCs (Table 2) suggest that the GSSG export mechanism and intracellular antioxidant capacity were not sufficient to maintain intracellular redox homeostasis and that redox imbalance was chronic in these children. The association between a more oxidized immune cell microenvironment and an abnormal adaptive immune response warrants continued investigation especially in light of the potential reversibility of immune dysfunction with targeted treatment to restore redox homeostasis [15].

The calculated values for the extracellular GSH and cysteine pools (Table 3) in our control population differ somewhat from previously published values. In adults, the plasma glutathione is more reduced at around −137 mV, and the plasma cysteine redox couple is more oxidized at −80 mV [30, 48]. These discrepancies may reflect methodological differences in sample preparation in that our electrochemical detection does not require derivatization for detection. It is also possible that children (age 3–10 years) may have less reducing capacity than previously reported in adults (age 25–35 years) [48]. Nonetheless, our calculated values are consistent with previous reports that plasma cysteine (−111 mV) is more oxidized than that of GSH (−128 mv).

Mean intracellular free radical production was higher in primary lymphocytes from children with autism relative to lymphocytes from age-matched control children (Figure 2) and was driven by a subset of 5 (33.3%) children whose lymphocytes exhibited especially high levels of free radicals. Mitochondria are the primary producers and targets of intracellular free radicals, and mitochondrial dysfunction has been postulated to be a contributing factor in the pathogenesis of autism and numerous other neurological disorders [64–67]. In a lymphoblastoid cell model, we previously demonstrated that the GSH/GSSG redox ratio in mitochondria was significantly lower in autism compared to control cells and was associated with a significantly lower mitochondrial membrane potential after nitrosative stress [16]. It is well established that mitochondria are highly concentrated in presynaptic terminals and that loss of redox control can negatively affect the efficiency of neurotransmission and synaptic plasticity [68, 69]. Similarly, mitochondrial localization and redox signaling at the immunological synapse between lymphocytes and antigen presenting cells are required for immune activation, and excessive ROS can interrupt these signaling pathways [70–72]. A recent study of mitochondrial defects in lymphocytes from children with autism found decreased complex I activity and overreplication of and deletions in mitochondrial DNA compared to control lymphocytes [73]. Based on this evidence, it is plausible to hypothesize that mitochondria may be the source of the increased levels of lymphocyte free radicals observed in the subset of autistic children presented in Figure 2. Consistent with this hypothesis, a recent meta-analysis estimated that mitochondria dysfunction may affect up to 30% of children with autism [64]. Based on this evidence, further study of mitochondrial function and redox status in lymphocytes from children with autism is warranted.

Relevant to our observations, two recent papers have revealed that an oxidized extracellular cysteine/cystine redox status can initiate a redox signaling cascade that stimulates intracellular mitochondrial ROS production as a mechanism to initiate an inflammatory immune response [74, 75]. The signal transduction from the extracellular to intracellular compartments occurs through oxidative modification of redox-reactive cysteines on cell surface proteins. Exposed cysteine sulfhydryl groups on proteins can be reversibly oxidized to sulfenic acid or disulfide bonds resulting in altered protein structure and function that initiate downstream redox signaling cascades [33, 76, 77]. In an elegant series of experiments, Imhoff and Hansen demonstrated that mitochondrial ROS production was significantly increased in cells incubated under extracellular oxidized cysteine/cystine redox conditions [74]. The stimulated intracellular ROS production resulted in the expression of Nrf-2, the transcription factor responsible for initiation of the inflammatory response. Treatment to block the availability of cell surface cysteine thiol groups abrogated mitochondrial ROS production and Nrf-2 expression. Go et al. confirmed and extended these observations by demonstrating that treatment to maintain mitochondrial redox status abrogated ROS production in the presence of oxidized extracellular cysteine/cystine [75]. Although the precise mechanism for the oxidative cysteine/cystine-dependent signaling for mitochondrial ROS production is not yet clear; the authors provide evidence of a possible link to changes in the redox state of cytoskeletal proteins that could be functionally linked to the mitochondrial membrane. Other studies have demonstrated that an oxidized plasma cysteine/cystine redox potential is associated with proinflammatory conditions [78, 79] and can be modulated by diet [80, 81]. These observations support the possibility that the oxidized plasma cysteine/cystine in children with autism may be functionally related to the increase in lymphocyte free radical production observed and contribute to immune cell abnormalities in these children.

In summary, we show for the first time that both the extracellular and intracellular immune cell compartments are more oxidized in children with autism compared to age-matched unaffected control children. Randomized clinical trials will be needed to determine whether treatment to normalize plasma and intracellular redox status will improve immune cell function and possibly the health and behavior in children with autism.

Conflict of Interests

The authors declare no conflict of interests.

Acknowledgments

The authors would like to express their gratitude to the families in Arkansas affected by autism whose participation made this study possible. They also acknowledge the invaluable help of the nurses and clinicians at the Dennis Developmental Center for referral and evaluation. This research was supported, in part, with funding from the National Institute of Child Health and Development (RO1 HD051873; SJJ), the Department of Defense (AS073218P1; SJJ), and by grants from the Arkansas Children’s Hospital and Arkansas Biosciences Institute (SJJ).

References

CDC, “Prevalence of autism spectrum disorders—autism and developmental disabilities monitoring network, United States, 2006,” Morbidity and Mortality Weekly Report, vol. 58, no. 10, pp. 1–20, 2009.
View at: Google Scholar
J. K. Yao, S. Leonard, and R. Reddy, “Altered glutathione redox state in schizophrenia,” Disease Markers, vol. 22, no. 1-2, pp. 83–93, 2006.
View at: Google Scholar
A. C. Andreazza, M. Kauer-Sant'Anna, B. N. Frey et al., “Oxidative stress markers in bipolar disorder: a meta-analysis,” Journal of Affective Disorders, vol. 111, no. 2-3, pp. 135–144, 2008.
View at: Publisher Site | Google Scholar
W. R. Markesbery, “Oxidative stress hypothesis in Alzheimer's disease,” Free Radical Biology and Medicine, vol. 23, no. 1, pp. 134–147, 1997.
View at: Publisher Site | Google Scholar
G. A. Mostafa, E. S. El-Hadidi, D. H. Hewedi, and M. M. Abdou, “Oxidative stress in Egyptian children with autism: relation to autoimmunity,” Journal of Neuroimmunology, vol. 219, no. 1-2, pp. 114–118, 2010.
View at: Publisher Site | Google Scholar
N. A. Meguid, A. A. Dardir, E. R. Abdel-Raouf, and A. Hashish, “Evaluation of oxidative stress in autism: defective antioxidant enzymes and increased lipid peroxidation,” Biological Trace Element Research, vol. 143, no. 1, pp. 58–65, 2011.
View at: Publisher Site | Google Scholar
A. Chauhan, V. Chauhan, W. T. Brown, and I. Cohen, “Oxidative stress in autism: increased lipid peroxidation and reduced serum levels of ceruloplasmin and transferrin—the antioxidant proteins,” Life Sciences, vol. 75, no. 21, pp. 2539–2549, 2004.
View at: Publisher Site | Google Scholar
S. S. Zoroglu, F. Armutcu, S. Ozen et al., “Increased oxidative stress and altered activities of erythrocyte free radical scavenging enzymes in autism,” European Archives of Psychiatry and Clinical Neuroscience, vol. 254, no. 3, pp. 143–147, 2004.
View at: Publisher Site | Google Scholar
S. Söǧüt, S. S. Zoroǧlu, H. Özyurt et al., “Changes in nitric oxide levels and antioxidant enzyme activities may have a role in the pathophysiological mechanisms involved in autism,” Clinica Chimica Acta, vol. 331, no. 1-2, pp. 111–117, 2003.
View at: Publisher Site | Google Scholar
T. L. Sweeten, D. J. Posey, S. Shankar, and C. J. McDougle, “High nitric oxide production in autistic disorder: a possible role for interferon-γ,” Biological Psychiatry, vol. 55, no. 4, pp. 434–437, 2004.
View at: Publisher Site | Google Scholar
M. A. Junaid, D. Kowal, M. Barua, P. S. Pullarkat, S. S. Brooks, and R. K. Pullarkat, “Proteomic studies identified a single nucleotide polymorphism in glyoxalase I as autism susceptibility factor,” American Journal of Medical Genetics, vol. 131, no. 1, pp. 11–17, 2004.
View at: Publisher Site | Google Scholar
M. Boso, E. Emanuele, P. Minoretti et al., “Alterations of circulating endogenous secretory RAGE and S100A9 levels indicating dysfunction of the AGE-RAGE axis in autism,” Neuroscience Letters, vol. 410, no. 3, pp. 169–173, 2006.
View at: Publisher Site | Google Scholar
S. J. James, P. Cutler, S. Melnyk et al., “Metabolic biomarkers of increased oxidative stress and impaired methylation capacity in children with autism,” American Journal of Clinical Nutrition, vol. 80, no. 6, pp. 1611–1617, 2004.
View at: Google Scholar
S. J. James, S. Melnyk, S. Jernigan et al., “Metabolic endophenotype and related genotypes are associated with oxidative stress in children with autism,” American Journal of Medical Genetics, Part B, vol. 141, no. 8, pp. 947–956, 2006.
View at: Publisher Site | Google Scholar
S. J. James, S. Melnyk, G. Fuchs et al., “Efficacy of methylcobalamin and folinic acid treatment on glutathione redox status in children with autism,” American Journal of Clinical Nutrition, vol. 89, no. 1, pp. 425–430, 2009.
View at: Publisher Site | Google Scholar
S. J. James, S. Rose, S. Melnyk et al., “Cellular and mitochondrial glutathione redox imbalance in lymphoblastoid cells derived from children with autism,” FASEB Journal, vol. 23, no. 8, pp. 2374–2383, 2009.
View at: Publisher Site | Google Scholar
K. Bowers, Q. Li, J. Bressler, D. Avramopoulos, C. Newschaffer, and M. D. Fallin, “Glutathione pathway gene variation and risk of autism spectrum disorders,” Journal of Neurodevelopmental Disorders, vol. 3, no. 2, pp. 132–143, 2011.
View at: Publisher Site | Google Scholar
S. Biswas, A. S. Chida, and I. Rahman, “Redox modifications of protein-thiols: emerging roles in cell signaling,” Biochemical Pharmacology, vol. 71, no. 5, pp. 551–564, 2006.
View at: Publisher Site | Google Scholar
G. Filomeni, G. Rotilio, and M. R. Ciriolo, “Cell signalling and the glutathione redox system,” Biochemical Pharmacology, vol. 64, no. 5-6, pp. 1057–1064, 2002.
View at: Publisher Site | Google Scholar
M. Fratelli, L. O. Goodwin, U. A. Ørom et al., “Gene expression profiling reveals a signaling role of glutathione in redox regulation,” Proceedings of the National Academy of Sciences of the United States of America, vol. 102, no. 39, pp. 13998–14003, 2005.
View at: Publisher Site | Google Scholar
A. Pastore, G. Federici, E. Bertini, and F. Piemonte, “Analysis of glutathione: implication in redox and detoxification,” Clinica Chimica Acta, vol. 333, no. 1-2, pp. 19–39, 2003.
View at: Publisher Site | Google Scholar
Y. W. Kwon, H. Masutani, H. Nakamura, Y. Ishii, and J. Yodoi, “Redox regulation of cell growth and cell death,” Biological Chemistry, vol. 384, no. 7, pp. 991–996, 2003.
View at: Publisher Site | Google Scholar
F. Q. Schafer and G. R. Buettner, “Redox environment of the cell as viewed through the redox state of the glutathione disulfide/glutathione couple,” Free Radical Biology and Medicine, vol. 30, no. 11, pp. 1191–1212, 2001.
View at: Publisher Site | Google Scholar
H. M. Lanďer, A. J. Mllbank, J. M. Tauras et al., “Redox regulation of cell signalling,” Nature, vol. 381, no. 6581, pp. 380–381, 1996.
View at: Google Scholar
P. Ghezzi, “Regulation of protein function by glutathionylation,” Free Radical Research, vol. 39, no. 6, pp. 573–580, 2005.
View at: Publisher Site | Google Scholar
D. A. Dickinson and H. J. Forman, “Glutathione in defense and signaling: lessons from a small thiol,” Annals of the New York Academy of Sciences, vol. 973, pp. 488–504, 2002.
View at: Google Scholar
M. Noble, J. Smith, J. Power, and M. Mayer-Pröschel, “Redox state as a central modulator of precursor cell function,” Annals of the New York Academy of Sciences, vol. 991, pp. 251–271, 2003.
View at: Google Scholar
D. P. Jones, “Extracellular redox state: refining the definition of oxidative stress in aging,” Rejuvenation Research, vol. 9, no. 2, pp. 169–181, 2006.
View at: Publisher Site | Google Scholar
M. Asensi, J. Sastre, F. V. Pallardo et al., “Ratio of reduced to oxidized glutathione as indicator of oxidative stress status and DNA damage,” Methods in Enzymology, vol. 299, pp. 267–276, 1999.
View at: Publisher Site | Google Scholar
S. S. Iyer, C. J. Accardi, T. R. Ziegler et al., “Cysteine redox potential determines pro-inflammatory IL-1β levels,” PLoS One, vol. 4, no. 3, Article ID e5017, 2009.
View at: Publisher Site | Google Scholar
D. Barford, “The role of cysteine residues as redox-sensitive regulatory switches,” Current Opinion in Structural Biology, vol. 14, no. 6, pp. 679–686, 2004.
View at: Publisher Site | Google Scholar
D. P. Jones, Y. M. Go, C. L. Anderson, T. R. Ziegler, J. M. Kinkade Jr., and W. G. Kirlin, “Cysteine/cystine couple is a newly recognized node in the circuitry for biologic redox signaling and control,” FASEB Journal, vol. 18, no. 11, pp. 1246–1248, 2004.
View at: Publisher Site | Google Scholar
D. Spadaro, B. W. Yun, S. H. Spoel, C. Chu, Y. Q. Wang, and G. J. Loake, “The redox switch: dynamic regulation of protein function by cysteine modifications,” Physiologia Plantarum, vol. 138, no. 4, pp. 360–371, 2010.
View at: Publisher Site | Google Scholar
J. Den Hertog, A. Groen, and T. van der Wijk, “Redox regulation of protein-tyrosine phosphatases,” Archives of Biochemistry and Biophysics, vol. 434, no. 1, pp. 11–15, 2005.
View at: Publisher Site | Google Scholar
Z. Yan, S. K. Garg, J. Kipnis, and R. Banerjee, “Extracellular redox modulation by regulatory T cells,” Nature Chemical Biology, vol. 5, no. 10, pp. 721–723, 2009.
View at: Publisher Site | Google Scholar
C. E. Cooper, R. P. Patel, P. S. Brookes, and V. M. Darley-Usmar, “Nanotransducers in cellular redox signaling: modification of thiols by reactive oxygen and nitrogen species,” Trends in Biochemical Sciences, vol. 27, no. 10, pp. 489–492, 2002.
View at: Publisher Site | Google Scholar
R. P. Warren, L. J. Yonk, R. A. Burger et al., “Deficiency of suppressor-inducer (CD4+CD45RA+) T cells in autism,” Immunological Investigations, vol. 19, no. 3, pp. 245–251, 1990.
View at: Google Scholar
L. J. Yonk, R. P. Warren, R. A. Burger et al., “CD4⁺ helper T cell depression in autism,” Immunology Letters, vol. 25, no. 4, pp. 341–346, 1990.
View at: Publisher Site | Google Scholar
D. R. Denney, B. W. Frei, and G. R. Gaffney, “Lymphocyte subsets and interleukin-2 receptors in autistic children,” Journal of Autism and Developmental Disorders, vol. 26, no. 1, pp. 87–97, 1996.
View at: Google Scholar
T. L. Sweeten, D. J. Posey, and C. J. McDougle, “High blood monocyte counts and neopterin levels in children with autistic disorder,” American Journal of Psychiatry, vol. 160, no. 9, pp. 1691–1693, 2003.
View at: Publisher Site | Google Scholar
S. Gupta, S. Aggarwal, B. Rashanravan, and T. Lee, “Th1- and Th2-like cytokines in CD4⁺ and CD8⁺ T cells in autism,” Journal of Neuroimmunology, vol. 85, no. 1, pp. 106–109, 1998.
View at: Publisher Site | Google Scholar
C. A. Molloy, A. L. Morrow, J. Meinzen-Derr et al., “Elevated cytokine levels in children with autism spectrum disorder,” Journal of Neuroimmunology, vol. 172, no. 1-2, pp. 198–205, 2006.
View at: Publisher Site | Google Scholar
P. Ashwood and A. J. Wakefield, “Immune activation of peripheral blood and mucosal CD3⁺ lymphocyte cytokine profiles in children with autism and gastrointestinal symptoms,” Journal of Neuroimmunology, vol. 173, no. 1-2, pp. 126–134, 2006.
View at: Publisher Site | Google Scholar
H. Jyonouchi, S. Sun, and H. Le, “Proinflammatory and regulatory cytokine production associated with innate and adaptive immune responses in children with autism spectrum disorders and developmental regression,” Journal of Neuroimmunology, vol. 120, no. 1-2, pp. 170–179, 2001.
View at: Publisher Site | Google Scholar
P. Ashwood, A. Enstrom, P. Krakowiak et al., “Decreased transforming growth factor beta1 in autism: a potential link between immune dysregulation and impairment in clinical behavioral outcomes,” Journal of Neuroimmunology, vol. 204, no. 1-2, pp. 149–153, 2008.
View at: Publisher Site | Google Scholar
K. Okada, K. Hashimoto, Y. Iwata et al., “Decreased serum levels of transforming growth factor-β1 in patients with autism,” Progress in Neuro-Psychopharmacology and Biological Psychiatry, vol. 31, no. 1, pp. 187–190, 2007.
View at: Publisher Site | Google Scholar
S. W. Looney and P. W. Jones, “A method for comparing two normal means using combined samples of correlated and uncorrelated data,” Statistics in Medicine, vol. 22, no. 9, pp. 1601–1610, 2003.
View at: Publisher Site | Google Scholar
D. P. Jones, J. L. Carlson, V. C. Mody, J. Cai, M. J. Lynn, and P. Sternberg, “Redox state of glutathione in human plasma,” Free Radical Biology and Medicine, vol. 28, no. 4, pp. 625–635, 2000.
View at: Publisher Site | Google Scholar
Y. M. Go and D. P. Jones, “Redox compartmentalization in eukaryotic cells,” Biochimica et Biophysica Acta, vol. 1780, no. 11, pp. 1273–1290, 2008.
View at: Publisher Site | Google Scholar
R. Gysin, R. Kraftsik, J. Sandell et al., “Impaired glutathione synthesis in schizophrenia: convergent genetic and functional evidence,” Proceedings of the National Academy of Sciences of the United States of America, vol. 104, no. 42, pp. 16621–16626, 2007.
View at: Publisher Site | Google Scholar
M. Y. Yeh, E. L. Burnham, M. Moss, and L. A. Brown, “Chronic alcoholism alters systemic and pulmonary glutathione redox status,” American Journal of Respiratory and Critical Care Medicine, vol. 176, no. 3, pp. 270–276, 2007.
View at: Publisher Site | Google Scholar
H. Nakamura, H. Masutani, and J. Yodoi, “Redox imbalance and its control in HIV infection,” Antioxidants and Redox Signaling, vol. 4, no. 3, pp. 455–464, 2002.
View at: Google Scholar
C. Cecchi, S. Latorraca, S. Sorbi et al., “Gluthatione level is altered in lymphoblasts from patients with familial Alzheimer's disease,” Neuroscience Letters, vol. 275, no. 2, pp. 152–154, 1999.
View at: Publisher Site | Google Scholar
A. Larbi, J. Kempf, and G. Pawelec, “Oxidative stress modulation and T cell activation,” Experimental Gerontology, vol. 42, no. 9, pp. 852–858, 2007.
View at: Publisher Site | Google Scholar
J. P. Messina and D. A. Lawrence, “Cell cycle progression of glutathione-depleted human peripheral blood mononuclear cells is inhibited at S phase,” Journal of Immunology, vol. 143, no. 6, pp. 1974–1981, 1989.
View at: Google Scholar
M. Klemke, G. H. Wabnitz, F. Funke, B. Funk, H. Kirchgessner, and Y. Samstag, “Oxidation of cofilin mediates T cell hyporesponsiveness under oxidative stress conditions,” Immunity, vol. 29, no. 3, pp. 404–413, 2008.
View at: Publisher Site | Google Scholar
T. Ando, K. Mimura, C. C. Johansson et al., “Transduction with the antioxidant enzyme catalase protects human T cells against oxidative stress,” Journal of Immunology, vol. 181, no. 12, pp. 8382–8390, 2008.
View at: Google Scholar
P. Ashwood, P. Krakowiak, I. Hertz-Picciotto, R. Hansen, I. N. Pessah, and J. Van de Water, “Altered T cell responses in children with autism,” Brain, Behavior, and Immunity, vol. 25, no. 5, pp. 840–849, 2011.
View at: Publisher Site | Google Scholar
C. M. Liang, N. Lee, D. Cattell, and S. M. Liang, “Glutathione regulates interleukin-2 activity on cytotoxic T-cells,” Journal of Biological Chemistry, vol. 264, no. 23, pp. 13519–13523, 1989.
View at: Google Scholar
H. Gmunder, S. Roth, H. P. Eck, H. Gallas, S. Mihm, and W. Droge, “Interleukin-2 mRNA expression, lymphokine production and DNA synthesis in glutathione-depleted T cells,” Cellular Immunology, vol. 130, no. 2, pp. 520–528, 1990.
View at: Google Scholar
J. D. Peterson, L. A. Herzenberg, K. Vasquez, and C. Waltenbaugh, “Glutathione levels in antigen-presenting cells modulate Th1 versus Th2 response patterns,” Proceedings of the National Academy of Sciences of the United States of America, vol. 95, no. 6, pp. 3071–3076, 1998.
View at: Publisher Site | Google Scholar
Y. Murata, T. Shimamura, and J. Hamuro, “The polarization of T_h1/T_h2 balance is dependent on the intracellular thiol redox status of macrophages due to the distinctive cytokine production,” International Immunology, vol. 14, no. 2, pp. 201–212, 2002.
View at: Google Scholar
L. Eklöw, H. Thor, and S. Orrenius, “Formation and efflux of glutathione disulfide studied in isolated rat hepatocytes,” FEBS Letters, vol. 127, no. 1, pp. 125–128, 1981.
View at: Google Scholar
D. A. Rossignol and R. E. Frye, “Mitochondrial dysfunction in autism spectrum disorders: a systematic review and meta-analysis,” Molecular Psychiatry. In press.
View at: Publisher Site | Google Scholar
A. H. Schapira, J. M. Cooper, D. Dexter, P. Jenner, J. B. Clark, and C. D. Marsden, “Mitochondrial complex I deficiency in Parkinson's disease,” The Lancet, vol. 1, no. 8649, p. 1269, 1989.
View at: Google Scholar
A. Maruszak and C. Zekanowski, “Mitochondrial dysfunction and Alzheimer's disease,” Progress in Neuro-Psychopharmacology and Biological Psychiatry, vol. 35, no. 2, pp. 320–330, 2011.
View at: Publisher Site | Google Scholar
H. B. Clay, S. Sillivan, and C. Konradi, “Mitochondrial dysfunction and pathology in bipolar disorder and schizophrenia,” International Journal of Developmental Neuroscience, vol. 29, no. 3, pp. 311–324, 2011.
View at: Publisher Site | Google Scholar
D. J. Keating, “Mitochondrial dysfunction, oxidative stress, regulation of exocytosis and their relevance to neurodegenerative diseases,” Journal of Neurochemistry, vol. 104, no. 2, pp. 298–305, 2008.
View at: Publisher Site | Google Scholar
Z. Li, K. I. Okamoto, Y. Hayashi, and M. Sheng, “The importance of dendritic mitochondria in the morphogenesis and plasticity of spines and synapses,” Cell, vol. 119, no. 6, pp. 873–887, 2004.
View at: Publisher Site | Google Scholar
A. Quintana, C. Schwindling, A. S. Wenning et al., “T cell activation requires mitochondrial translocation to the immunological synapse,” Proceedings of the National Academy of Sciences of the United States of America, vol. 104, no. 36, pp. 14418–14423, 2007.
View at: Publisher Site | Google Scholar
G. Pani, R. Colavitti, S. Borrello, and T. Galeotti, “Redox regulation of lymphocyte signaling,” IUBMB Life, vol. 49, no. 5, pp. 381–389, 2000.
View at: Google Scholar
T. M. Buttke and P. A. Sandstrom, “Redox regulation of programmed cell death in lymphocytes,” Free Radical Research, vol. 22, no. 5, pp. 389–397, 1995.
View at: Google Scholar
C. Giulivi, Y. F. Zhang, A. Omanska-Klusek et al., “Mitochondrial dysfunction in autism,” Journal of the American Medical Association, vol. 304, no. 21, pp. 2389–2396, 2010.
View at: Publisher Site | Google Scholar
B. R. Imhoff and J. M. Hansen, “Extracellular redox status regulates Nrf2 activation through mitochondrial reactive oxygen species,” Biochemical Journal, vol. 424, no. 3, pp. 491–500, 2009.
View at: Publisher Site | Google Scholar
Y. M. Go, H. Park, M. Koval et al., “A key role for mitochondria in endothelial signaling by plasma cysteine/cystine redox potential,” Free Radical Biology and Medicine, vol. 48, no. 2, pp. 275–283, 2010.
View at: Publisher Site | Google Scholar
L. I. Leichert and U. Jakob, “Protein thiol modifications visualized in vivo,” PLoS Biology, vol. 2, no. 11, Article ID e333, 2004.
View at: Publisher Site | Google Scholar
P. Ghezzi, “Oxidoreduction of protein thiols in redox regulation,” Biochemical Society Transactions, vol. 33, no. 6, pp. 1378–1381, 2005.
View at: Publisher Site | Google Scholar
S. S. Iyer, D. P. Jones, K. L. Brigham, and M. Rojas, “Oxidation of plasma cysteine/cystine redox state in endotoxin-induced lung injury,” American Journal of Respiratory Cell and Molecular Biology, vol. 40, no. 1, pp. 90–98, 2009.
View at: Publisher Site | Google Scholar
S. K. Garg, V. Vitvitsky, R. Albin, and R. Banerjee, “Astrocytic redox remodeling by amyloid beta peptide,” Antioxidants and Redox Signaling, vol. 14, no. 12, pp. 2385–2397, 2011.
View at: Publisher Site | Google Scholar
S. E. Moriarty-Craige, J. Adkison, M. Lynn et al., “Antioxidant supplements prevent oxidation of cysteine/cystine redox in patients with age-related macular degeneration,” American Journal of Ophthalmology, vol. 140, no. 6, pp. 1020–1026, 2005.
View at: Publisher Site | Google Scholar
D. P. Jones, Y. Park, N. Gletsu-Miller et al., “Dietary sulfur amino acid effects on fasting plasma cysteine/cystine redox potential in humans,” Nutrition, vol. 27, no. 2, pp. 199–205, 2011.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2012 Shannon Rose et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

4592

Downloads

2087

Citations