Research Article | Open Access
Patterns of Exposure to Multiple Metals and Associations with Neurodevelopment of Preschool Children from Montevideo, Uruguay
While it is known that toxic metals contribute individually to child cognitive and behavioral deficits, we still know little about the effects of exposure to multiple metals, particularly when exposures are low. We studied the association between children’s blood lead and hair arsenic, cadmium, and manganese and their performance on the Bayley Scales of Infant Development III. Ninety-two preschool children (age 13–42 months) from Montevideo, Uruguay, provided a hair sample and 78 had a blood lead level (BLL) measurement. Using latent class analysis (LCA), we identified four groups of exposure based on metal concentrations: (1) low metals, (2) low-to-moderate metals, (3) high lead and cadmium, and (4) high metals. Using the four-group exposure variable as the main predictor, and fitting raw scores on the cognitive, receptive vocabulary, and expressive vocabulary scales as dependent variables, both complete-case and multiple imputation (MI) analyses were conducted. We found no association between multiple-metal exposures and neurodevelopment in covariate-adjusted models. This study demonstrates the use of LCA together with MI to determine patterns of exposure to multiple toxic metals and relate these to child neurodevelopment. However, because the overall study population was small, other studies with larger sample sizes are needed to investigate these associations.
Worldwide, millions of children are exposed to toxic substances and it is accepted that simultaneous exposure to multiple pollutants is the norm rather than an anomaly [1, 2]. Environmental exposure to multiple toxic metals has been reported in preschool  and school age children [4–6]. We know that, individually, these metals (lead, cadmium, arsenic, and manganese, among others) contribute to cognitive [7–13] and behavioral deficits in children, including hyperactivity, ADHD, antisocial behavior, and delinquency [14–17]. Yet, surprisingly, we know little about the combined effects of exposure to multiple metals on child cognition and behavior.
Based on animal studies, adverse interactive effects of metals on neurodevelopmental functioning in humans are likely. Several animal studies have shown interactions among toxic metals on the accumulation of metals in different brain regions  and on neurotransmitter metabolism [19, 20]. In one study, when lead and manganese were administered together, motor activity and associative (avoidance) learning was reduced . Arsenic and lead given together resulted in higher lead levels in the medulla, pons, and striatum compared to animals receiving lead only . Also, the administration of mining waste, consisting predominantly of arsenic and manganese, but also lead, was associated with lower levels of DOPAC and homovanillic acid in exposed versus control rats .
Very few studies have examined the potential synergistic (or antagonistic) effects of multiple metals on children’s neurodevelopmental outcomes. There are also differences in how studies accounted for multiple exposures. Some examined the effects of one metal at a time [23–26], some investigated main effects of pairs  or groups of metals [8, 28], and only a handful has examined statistical interactions, mostly among pairs of metals [27, 29–33]. Of the studies that have simultaneously measured at least two metals in children, some show evidence of additive or multiplicative effects on cognition or behavior [27, 30–32, 34], but others report no such findings [33, 35]. As a result, we still have little understanding of the extent to which multiple metals interact to produce additive or multiplicative effects on child development.
Another aspect of environmental exposure in young children that has not received much attention is the effect of multiple metals on child outcomes when exposure levels are low. This is important because the vast majority of children worldwide experience exposures that produce low body burdens of metals. Blood lead levels not previously considered to be of concern in children are clearly associated with lower IQ, poorer cognitive performance, and behavior problems [9, 12, 36, 37]. There is much less evidence on other toxic metals but it is likely that they would behave in similar ways due to similar mechanisms of action. It is also possible that low-level exposure to a single metal produces little effect on neurocognitive or behavioral outcomes but has noticeably more damaging effects when cooccurring with other toxicants . Infants and preschool children in Uruguay are exposed to multiple toxic metals at levels that, in other settings, have been associated with cognitive deficits . We have previously examined the association between manganese exposure and neurodevelopment of preschool children while taking into account their hair lead levels . The objective of the present study was to determine the extent to which children are exposed to multiple metals (manganese, lead, cadmium, and arsenic) and how these patterns of exposure are related to measures of neurodevelopment in Uruguayan preschoolers, specifically focusing on the lower spectrum of exposure to these metals. We applied the latent class analysis (LCA) approach to classify children according to the most salient patterns of metal exposure in this population.
2.1. Study Setting
The study was conducted in Montevideo, the capital of Uruguay, which is a densely populated and industrial coastal city with approximately 1.7 million inhabitants. Previous studies have documented lead and multiple metal exposures in children and adults [3, 39–41]. Anemia in young children is also a concern  and cooccurrence of anemia and elevated blood lead levels in Montevideo children has been reported . Exposure to lead may occur from a variety of sources. Leaded gasoline was phased out in 2004 and while blood lead levels have dropped, exposure continues to be a problem . In addition, both formal and cottage industries (cable burning, battery recycling, and scrap-metal recycling) have been shown to contribute to lead exposures in this population . The sources of exposure to other metals have not been clearly identified.
2.2. Participant Recruitment
Study recruitment has been described in detail elsewhere . In brief, participants were recruited from among mother-child pairs who had participated in an earlier screening of blood lead levels and anemia in Montevideo  and from five preschools located in the study area and enrolling children between 12 and 36 months of age. The preschool directors were contacted by telephone and if they expressed an interest in the study, an in-person meeting was arranged to explain the study purpose and procedure. The directors were asked for permission to send informational letters to parents of the preschoolers. Interested parents contacted the research team and set-up study appointments.
Overall, 109 children between the ages of 13 and 55 months were included in the study sample. Of those, 95 children were aged less than 42 months and therefore eligible for developmental assessment using the Bayley Scales of Infant Development. Ninety-two children (97%) provided a hair sample for the analysis of metal concentrations, 78 (82%) had a blood lead measurement, and 71 (75%) were tested with the Bayley Scales.
2.3. Ethical Considerations
This study was approved by the Ethics Committee at the Catholic University of Uruguay and the Office of Research Protections at the Pennsylvania State University. Informed consent was conducted by the coordinating pediatrician or psychologist in Spanish, when potential participants arrived for the first study visit. The consent form was read slowly with pauses for parents to ask questions and for the coordinator to explain procedures in more detail. Parents signed the form and retained a copy for their records.
Children and their caregivers were invited to attend two separate evaluation sessions at the Catholic University Faculty of Psychology Practicum Center. One visit focused on the collection of biological samples, anthropometric measurements, and demographic questionnaires. In another visit, maternal IQ, depression, and stress as well as child development were evaluated. If necessary, a third visit was scheduled to finish the assessments that could not be completed in the first two visits. Each visit at the Center lasted 1.5–2 hours. The two visits were scheduled approximately 1 week apart to accommodate other study activities. At the end of the procedure, each child received an age-appropriate toy gift for participating in the study. Caregivers were compensated for their own and the child’s bus fare. Children also received a light snack after the blood draw.
2.5.1. Blood Lead Concentrations
A phlebotomy nurse collected a nonfasting venous blood sample from the child using a 25-gauge blood collection set with butterfly needle (Vacutainer, Becton Dickinson, Franklin Lakes, NJ). Blood was collected into two tubes: a lithium heparin tube for blood lead determination (Vacutest Plast, Italy) and a serum tube with clot activator and separator gel (Vacutest Plast). A drop of blood was taken immediately after the blood draw from the serum tube for the analysis of hemoglobin using the HemoCue 201+ portable hemoglobinometer (HemoCue, Lake Forest, CA). The instrument was calibrated daily using standard controls (low, medium, and high). The whole blood tube was stored on ice until being transported to the University of the Republic, where it was stored at −20°C until analysis. Blood lead analyses were performed as described previously  at “CEQUIMTOX” (Specialized Center for Chemical Toxicology), Department of Toxicology and Environmental Hygiene, Faculty of Chemistry, the University of the Republic of Uruguay. Atomic Absorption Spectrometry (AAS, VARIAN SpectrAA-55B) was used with either flame (detection limit = 2.5 μg/dL) or graphite (detection limit = 2.0 μg/dL) furnace ionization, depending on whole blood volume available. The graphite furnace AAS was used to analyze 38% of blood samples for which volume was low (below 2 mL). Analytical conditions were validated with standard quality assurance and control procedures . For laboratory certification, accuracy is tested with a monthly participation in the Interlaboratory Program for Quality Control for Lead in Blood, Spain (PICC-PbS, 2001). For 95.1% of the blood samples, analytic results were CV < 2%. CEQUIMTOX is enrolled in the CDC’s Lead and Multi-Element Proficiency Program.
2.5.2. Hair Metal Concentrations
Hair samples were obtained from children using stainless steel, blunt-tip scissors. Samples were taken from the occipital region, cut close to the scalp, and deposited in clean, white envelopes. An equivalent of the thickness of a pencil was collected (in children this was equivalent to g; range 2.6–3.4 g). For girls with long hair, the strands were isolated, twisted, and cut. For boys and children with short or very fine hair, samples were taken from several areas of the head and collected directly into the envelope. Samples were stored at room temperature until analysis.
The analytical procedure for the determination of metal concentrations in hair has been described previously . Very briefly, samples were washed with 10 mL 1% Triton X-100 solution, after which they were sonicated and rinsed 3 times with double distilled water. After drying at 60°C for 24 hours, the samples were digested in one mL of concentrated HNO3 using a high-temperature oven. Subsequently, 20 mL double distilled water was added to dissolve the sample. Samples were analyzed at the Materials Characterization Laboratory at the Pennsylvania State University using Inductively Coupled Plasma Mass Spectrometry (ICP-MS) with Collision Cell Technology (Thermo Fisher Scientific Waltham, MA). The NIST1643 trace element in water solution served as the standard reference material. The instrument detection limit is 0.02, 0.02, and 0.005 μg/L for manganese, arsenic, and cadmium, respectively. All the readings obtained from the ICP-MS are adjusted through division by the actual weight of the hair sample used in analysis and reported as ppm (ng/g). There were no values below the limit of detection (LOD) for hair manganese or hair cadmium. Four values were below the reporting limit for hair arsenic; we used the actual instrument values in the analysis.
2.5.3. Cognitive/Psychological Assessments
All cognitive assessments were conducted by trained psychologists or advanced psychology students supervised by trained psychologists. The testing procedures and tools used in the study have been described previously in detail . Tests and questionnaires were administered to the mother/child individually by experienced researchers (except when the child refused to be alone or the mother did not feel comfortable leaving during testing, which depended mainly on the child’s age and comfort level with the parent’s absence).
Wechsler Adult Intelligence Scale III (WAIS III, TEA Ediciones, S.A., Madrid, Spain) was used to assess maternal IQ. Five subtests were administered, including Similarities, Arithmetic, Vocabulary, Block Design, and object assembly. Scores on these subtests were used to calculate an estimated IQ based on the methodology of López and colleagues .
Maternal depressive symptoms were assessed using the Argentinian adaptation of the Beck Depression Inventory II (BDI II, Ediciones Paidós, Buenos Aires, Argentina). The BDI II evaluates symptoms in adults corresponding to the depressive disorders in the Diagnostic and Statistical Manual of Mental Disorders IV (DSM IV). The instrument consists of 21 items assessing the components of depression, such as sadness, pessimism, failure, feelings of guilt, self-criticism, and suicidal thoughts. Answers to the questions are scored on a scale value of 0 to 3; higher total scores indicate more severe depressive symptoms (scores greater than 19 are indicative of moderate-to-severe depression).
Bayley Scales of Infant and Toddler Development, 3rd Edition (Bayley III, Harcourt Assessment, San Antonio, TX) was used to assess the development of participating children less than 42 months of age. The Bayley III is a validated instrument that assesses several domains of child development. In this study, Cognitive and Language (including receptive and expressive communication) abilities were considered. Bayley III was administered in Spanish in an isolated room, with only the tester and child (alone or with parent) present. The child sat independently in a chair without the caregiver present or was seated on the caregiver’s lap (with the caregiver asked not to aid or participate in the testing). The scales of interest were administered in one session unless the child became visibly fatigued, fussy, or uncooperative, in which case the testing was rescheduled.
An abbreviated version of the Home Observation for Measurement of the Environment (HOME) Inventory was used to assess children’s home environments. The abbreviated version was based on the interview portion of the original HOME Inventory by Caldwell and Bradley and was adapted from the instruments used in the New York Longitudinal Study, as described previously . The questionnaire was translated into Spanish by the study team. Separate questions were used for children younger than 3 years of age and children between 3 and 6 years of age. Among other things, the questions assessed the number of books and toys the child had, how often parents read to the child, how many times per week the child left the house to go to the supermarket and other outings, and how often the child spent time/ate meals with both biological parents.
During the “clinic” visit, caregivers were asked to respond to a series of questionnaires about the household and the child. Specifically, they were queried on parents’ age, education and occupation, family size, size and characteristics of their house, and household possessions. The study nurse read each question aloud to the caregiver and recorded her/his responses.
2.6. Statistical Analysis
Summary statistics for participant characteristics were calculated. Children were assigned to latent clusters according to their metal exposure characteristics using specialized software (Latent Gold 4.5, Statistical Innovations Inc., Belmont MA). A latent class or latent cluster is a variable indicating underlying subgroups of individuals based on the measured (observed) characteristics. Although latent class analysis allows missing data on the latent class indicators (i.e., metals), it does not allow missing data on covariates. Thus, we used multiple imputation (MI) via chained equations to impute 25 complete data sets, as described below.
Recent research has found that not including the cluster membership variable in the imputation model can attenuate the relationships between the covariates and cluster membership . One approach for addressing this issue, the two-stage imputation , was developed for categorical latent class indicators, whereas our indicators were continuous. We followed a four-step procedure that was analogous to that proposed by Harel et al. , as outlined below.
In Step 1, we determined the number of latent clusters by fitting the model to all children who had at least one observed metal indicator. This resulted in only 3 children being removed from the data set (i.e., ). We determined the number of clusters based on the Akaike Information Criterion (AIC) and the Bayesian Information Criterion (BIC). We also specified the indicators to be continuous and censored at zero because metal levels are not negative. Based on the chosen latent cluster model, we obtained the posterior predicted probabilities of membership in each latent cluster and assigned each child to the one with the highest probability.
In Step 2, we imputed 25 complete data sets in which the covariates, the outcomes, the measured metal indicators, and the cluster membership variable from Step 1 were all included in the imputation model.
In Step 3, we deleted the cluster membership variable from Step 1 and refit the model in each of the 25 imputed data sets to estimate a new set of posterior predicted probabilities by including the covariates in the model. We did this because Bray and colleagues  have shown that when covariates and/or outcomes of cluster membership are of interest, then classifying individuals on the basis of the maximum posterior probability estimated from a model without the covariates (i.e., the model in Step 1) results in an attenuation of effect estimates. Thus, we estimated the cluster membership based only on the indicators (i.e., Step 1) for use in the imputation model (i.e., Step 2) and then reestimated the cluster membership based on the indicators and covariates once we had complete data on the covariates.
In Step 4, following the assignment of children to a latent cluster, we fit regression models on the 25 imputed data sets and combined the estimates across imputations using standard rules , which take into account the uncertainty in imputing the missing data.
Unadjusted and covariate-adjusted ordinary least squares regression models were fitted to test for the association between children’s multiple exposure to metals and their neurodevelopmental scores. A single exposure variable obtained from latent class analysis was entered as the independent predictor variable. Children’s performance on the Bayley III Cognitive, Expressive Vocabulary and Receptive Vocabulary scales were entered as dependent variables into separate regression models. Because the Bayley III has not been standardized in a normative sample of Uruguayan children, only direct/raw scores were used. Covariates used in the multivariate models were chosen based on previous literature, biological plausibility, and previous research in this population, and included child’s age and hemoglobin level, maternal IQ and depressive symptoms score, household density, HOME score, and socioeconomic status. We also included a dummy variable representing the tester who administered the Bayley III. Both complete-case analyses (based on the inclusion of children with a complete set of information on all outcomes, predictors and covariates) and regressions based on multiply-imputed data were conducted. Regression analyses were conducted with STATA 12.0 (STATA Corp., College Station, TX).
The mean age of study children was months and most had healthy hemoglobin values (Table 1). Most children lived in two-parent households that were not affluent but also not overcrowded. The children’s mothers were aged 16–43 years and had a mean 9 years of education, fairly low IQ, and a moderate prevalence of depression.
The latent class analysis identified four latent clusters of children according to their levels of the four metals: arsenic, cadmium, lead, and manganese. The values for the 3 and 4 class cluster models are given in Table 2; the 5-class model was not identified. In general, the metals exposure levels were low and it is in this context that the clusters are described and named (Table 3). The first cluster, “low metal exposure,” represented 72% of the children and was characterized by low mean concentrations of hair arsenic, cadmium, and manganese. The second cluster, “low-to-moderate metal exposure,” represented 19% of the sample and had hair metal concentrations that were higher than cluster 1 but still fairly low. Six percent of the sample was represented by the third cluster (“high lead and cadmium”), which had mean hair cadmium and blood lead concentrations higher than the previous two clusters. The fourth cluster (2% of the sample) had elevated mean concentrations of arsenic, lead, and manganese, but not cadmium, and was named “high metal exposure.” In terms of mean blood lead levels, cluster 2 (low-to-moderate exposure) had the lowest and cluster 3 (high lead and manganese) had the highest mean concentrations.
|Bayesian Information Criterion; 2Akaike Information Criterion; 3Corrected Akaike Information Criterion.|
|Values given as proportion of the study sample represented by the cluster; 2values given as mean concentration of a given metal in each cluster; highest mean concentrations of each metal appearing in bold.|
No statistically significant associations were found between clusters of metal exposure and any of the cognitive performance scales, either in the complete case or the multiple-imputation analysis (Table 4). There were similarities between the complete-case and multiple-imputation analyses in that differences in scores tended to get larger between the reference group and the clusters representing more “severe” exposure. This is particularly interesting because these differences suggested better performance in cluster 4 than in the low-exposure reference group. However, particularly in the multiple-imputation analysis, the error around the estimates was very large, indicating a high level of uncertainty.
|Sample size was 47–49 for complete-case analysis and 92 for models with imputed data; 2cluster 1 (“Low metal exposure”) served as the reference group; 3models adjusted for child age in months, maternal IQ and depressive scores, household density, HOME score, socioeconomic status, tester, and the child’s hemoglobin value.|
To better protect human health, there is a need to understand the effects of exposure to chemical mixtures , including metals. However, because only a handful of studies have examined the potential synergistic effects of multiple metals on neurodevelopmental outcomes in children, there is little existing evidence on these relationships. We used LCA to describe patterns of exposure to multiple metals (arsenic, cadmium, manganese, and lead) in young children living in Uruguay. We found no associations between children’s exposure to multiple metals and their performance on cognitive and language scales of the Bayley Scales of Infant Development III.
There are several possible explanations for these findings, as discussed below. First, it could be that low-level environmental exposure, even to multiple metals, does not produce neurocognitive deficits in young children. Given the epidemiological and animal studies published to date, this explanation is not very likely. Several animal studies have shown interactions among toxic metals on the accumulation of metals in different brain regions , neurotransmitter metabolism [19, 20], and activity . Thus, it is reasonable to suspect that metal interactions would affect several cognitive functions in humans. Furthermore, because many of the metals in question appear to act in similar ways (the dopaminergic system is one major target of toxicity and all contribute to oxidative stress), there is a reasonable expectation that together they would produce multiplicative effects even at low doses, the concept of concentration addition .
In a recent review, Claus Henn et al.  concluded that the toxicity of lead appeared to increase when children are coexposed with other metals, such as manganese, arsenic, mercury, and cadmium. Of the studies that have measured at least two metals in children, several have shown evidence of additive or multiplicative effects on cognition or behavior [27, 30–32, 34]. More recently, an interaction was reported between blood lead and cadmium concentrations measured in late pregnancy on children’s MDI scores . Similarly, Lin and colleagues  found poorer cognitive and language scores in 2-year old children whose mothers had elevated lead and manganese concentrations in cord blood, while Claus Henn and colleagues  found synergistic lead-by-manganese effects on Bayley scores in Mexican children.
A second explanation for the null findings in this study is that there was insufficient statistical power to detect the associations. Post hoc power analysis for the final model comparing the four metal exposure groups for a significance level of 0.05, power of 0.80, and a moderate effect size, , resulted in an estimated sample size of 44 per group. We did not have an overall sample of this size and only the low-metal exposure cluster included at least 44 participants. Estimating post hoc power for a large effect size resulted in a sample size of 18 per group. The low-metal and low-to-moderate metal exposure clusters met this sample size criterion. Although at an imputed sample size of 92 our study is larger than some previous reports of metal interactions , future studies will need to include larger samples to test the neurodevelopmental effects of multiple-metal exposures. This is particularly important at low and very low level exposures, which may produce small effects.
Third, we used latent class analysis to separate children into metal exposure clusters. LCA is a widely accepted and used statistical approach , although its application to environmental exposure is less common. Previous approaches used to evaluate the association between multiple metal exposures and cognitive abilities or performance entered each biomarker separately into regression models to test either the main effects or interactions of the metals, typically in pairs. This study is the first to use LCA to construct independent variables representing metal exposures in children. However, LCA is also somewhat arbitrary in that, being data-driven, it relies on the observed distribution of each metal to classify individuals into groups. As such, depending on the range of exposures in a given population, the mean metal concentratins within clusters may differ among studies. Furthermore, it is also likely that the classes identified and the names given to the groups will differ among studies. These limitations do not detract from the validity of LCA but it is also worth mentioning that other statistical approaches have been used .
We identified four patterns of metal exposure using LCA: (1) low-metal exposure, (2) low-to-moderate metal exposure, (3) high lead and cadmium, and (4) high-metal exposure. Several points are worth noting about metal concentrations in these clusters. Mean BLLs fell below 10 μg/dL in all the clusters. While cognitive deficits have been noted in children with low BLLs , in this study the high lead and cadmium and high-metal exposure clusters did not appear to differ dramatically on BLL from the reference group and is one potential reason for why no differences in test scores would be seen among these clusters. However, it is important to note that in another study of these children we found no independent associations between blood lead concentrations and Bayley III scores . Furthermore, in our study, mean hair manganese concentrations in clusters 3 and 4 (high lead and cadmium and high-metal exposure, resp.) were above 3 μg/g. Others have reported increased behavior problems in school-age children with hair manganese concentrations above this level . In another study of Uruguayan preschoolers, we found limited evidence of an association between Bayley III scores and hair manganese . On the other hand, Claus Henn and colleagues  reported negative associations between blood manganese and Bayley scores at 12 months of age, although there were no associations at later ages. Cadmium exposure has been associated with cognitive deficits in young children , but studies are limited and mostly measure blood cadmium [56, 57]. For this reason it is difficult to comment on the range of hair cadmium concentrations in the clusters identified in our study or on their relative contribution to cognitive deficits. This is also true for hair arsenic. To our knowledge, only one other study examined the association of hair arsenic concentrations with children’s cognition and found arsenic-by-manganese interactions . Based on this limited evidence, we would have expected but did not find lower cognitive scores in the high-metal exposure cluster compared to the low-metal exposure cluster.
Using a latent class approach we found no evidence of poorer neurodevelopmental scores in young Uruguayan children exposed to multiple toxic metals. Although LCA has limitations that have implications for cross-study comparison, it also represents an approach that is valid and, importantly, data-driven. Therefore, our study can serve as a model for the use of LCA in environmental exposure science (alone or in combination with multiple imputation to reduce the influence of missing data on point estimates). We recommend that additional studies using the LCA are conducted with larger samples to test for the association with low-level multiple metal exposure and the neurobehavioral development of preschool children.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
Funding for this study was provided by the Children, Youth and Families Consortium, Pennsylvania State University (PI: Kordas) and the National Institute of Environmental Health (1R21 ES16523, PI: Kordas). The authors would like to thank nurses Delminda Ribeiro and Graciela Yuane for conducting clinic visits; Dr. Ariel Cuadro, Catholic University of Uruguay, for graciously hosting our research team by providing office and research space; and Jimena Deana, María Sicardi, Mercedes Perez, for conducting questionnaires and mother/child assessments.
- D. A. Cory-Slechta, “Studying toxicants as single chemicals: does this strategy adequately identify neurotoxic risk?” NeuroToxicology, vol. 26, no. 4, pp. 491–510, 2005.
- C. T. De Rosa, H. A. El-Masri, H. Pohl, W. Cibulas, and M. M. Mumtaz, “Implications of chemical mixtures in public health practice,” Journal of Toxicology and Environmental Health. Part B: Critical Reviews, vol. 7, no. 5, pp. 339–350, 2004.
- K. Kordas, E. I. Queirolo, A. S. Ettinger, R. O. Wright, and R. J. Stoltzfus, “Prevalence and predictors of exposure to multiple metals in preschool children from Montevideo, Uruguay,” Science of the Total Environment, vol. 408, no. 20, pp. 4488–4494, 2010.
- B. Beneš, J. Sladká, V. Spěváčková, and J. Šmíd, “Determination of normal concentration levels of Cd, Cr, Cu, Hg, Pb, Se and Zn in hair of the child population in the Czech Republic,” Central European Journal of Public Health, vol. 11, no. 4, pp. 184–186, 2003.
- J. Chłopicka, Z. Zachwieja, P. Zagrodzki, J. Frydrych, P. Słota, and M. Krośniak, “Lead and cadmium in the hair and blood of children from a highly industrial area in poland,” Biological Trace Element Research, vol. 62, no. 3, pp. 229–234, 1998.
- M. Nadal, A. Bocio, M. Schuhmacher, and J. L. Domingo, “Monitoring metals in the population living in the vicinity of a hazardous waste incinerator: levels in hair of school children,” Biological Trace Element Research, vol. 104, no. 3, pp. 203–213, 2005.
- J. L. Rosado, D. Ronquillo, K. Kordas et al., “Arsenic exposure and cognitive performance in Mexican Schoolchildren,” Environmental Health Perspectives, vol. 115, no. 9, pp. 1371–1375, 2007.
- G. A. Wasserman, X. Liu, F. Parvez et al., “Water manganese exposure and children's intellectual function in Araihazar, Bangladesh,” Environmental Health Perspectives, vol. 114, no. 1, pp. 124–129, 2006.
- B. P. Lanphear, R. Hornung, J. Khoury et al., “Low-level environmental lead exposure and children's intellectual function: an international pooled analysis,” Environmental Health Perspectives, vol. 113, no. 7, pp. 894–899, 2005.
- G. A. Wasserman, X. Liu, F. Parvez et al., “Water arsenic exposure and intellectual function in 6-year-old children in Araihazar, Bangladesh,” Environmental Health Perspectives, vol. 115, no. 2, pp. 285–289, 2007.
- M. F. Bouchard, S. Sauvé, B. Barbeau et al., “Intellectual impairment in school-age children exposed to manganese from drinking water,” Environmental Health Perspectives, vol. 119, no. 1, pp. 138–143, 2011.
- K. Kordas, R. L. Canfield, P. López et al., “Deficits in cognitive function and achievement in Mexican first-graders with low blood lead concentrations,” Environmental Research, vol. 100, no. 3, pp. 371–386, 2006.
- H.-P. Tseng, Y.-H. Wang, M.-M. Wu, H.-W. The, H.-Y. Chiou, and C.-J. Chen, “Association between chronic exposure to arsenic and slow nerve conduction velocity among adolescents in Taiwan,” Journal of Health, Population and Nutrition, vol. 24, no. 2, pp. 182–189, 2006.
- K. N. Dietrich, R. M. Douglas, P. A. Succop, O. G. Berger, and R. L. Bornschein, “Early exposure to lead and juvenile delinquency,” Neurotoxicology and Teratology, vol. 23, no. 6, pp. 511–518, 2001.
- M. Bouchard, F. Laforest, L. Vandelac, D. Bellinger, and D. Mergler, “Hair manganese and hyperactive behaviors: pilot study of school-age children exposed through tap water,” Environmental Health Perspectives, vol. 115, no. 1, pp. 122–127, 2007.
- K. Kordas, R. J. Stoltzfus, P. López, J. A. Rico, and J. L. Rosado, “Iron and zinc supplementation does not improve parent or teacher ratings of behavior in first grade Mexican children exposed to lead,” Journal of Pediatrics, vol. 147, no. 5, pp. 632–639, 2005.
- K. P. K. Olympio, P. V. Oliveira, J. Naozuka et al., “Surface dental enamel lead levels and antisocial behavior in Brazilian adolescents,” Neurotoxicology and Teratology, vol. 32, no. 2, pp. 273–279, 2010.
- G. S. Shukla and S. V. Chandra, “Concurrent exposure to lead, manganese, and cadmium and their distribution to various brain regions, liver, kidney, and testis of growing rats,” Archives of Environmental Contamination and Toxicology, vol. 16, no. 3, pp. 303–310, 1987.
- A. Pillai, L. Priya, and S. Gupta, “Effects of combined exposure to lead and cadmium on the hypothalamic-pituitary axis function in proestrous rats,” Food and Chemical Toxicology, vol. 41, no. 3, pp. 379–384, 2003.
- J. J. Mejía, F. Díaz-Barriga, J. Calderón, C. Ríos, and M. E. Jiménez-Capdeville, “Effects of lead-arsenic combined exposure on central monoaminergic systems,” Neurotoxicology and Teratology, vol. 19, no. 6, pp. 489–497, 1997.
- S. V. Chandra, M. Mohd. Ali, D. K. Saxena, and R. C. Murthy, “Behavioral and neurochemical changes in rats simultaneously exposed to manganese and lead,” Archives of Toxicology, vol. 49, no. 1, pp. 49–56, 1981.
- V. M. Rodríguez, L. Dufour, L. Carrizales, F. Díaz-Barriga, and M. E. Jiménez-Capdaville, “Effects of oral exposure to mining waste on in vivo dopamine release from rat striatum,” Environmental Health Perspectives, vol. 106, no. 8, pp. 487–491, 1998.
- C. Bonithon-Kopp, G. Huel, T. Moreau, and R. Wendling, “Prenatal exposure to lead and cadmium and psychomotor development of the child at 6 years,” Neurobehavioral Toxicology and Teratology, vol. 8, no. 3, pp. 307–310, 1986.
- M. Torrente, M. T. Colomina, and J. L. Domingo, “Metal concentrations in hair and cognitive assessment in an adolescent population,” Biological Trace Element Research, vol. 104, no. 3, pp. 215–221, 2005.
- P. J. Barlow, “A pilot study on the metal levels in the hair of hyperactive children,” Medical Hypotheses, vol. 11, no. 3, pp. 309–318, 1983.
- M. Marlowe, J. Errera, and J. Jacobs, “Increased lead and cadmium burdens among mentally retarded children and children with borderline intelligence,” American Journal of Mental Deficiency, vol. 87, no. 5, pp. 477–483, 1983.
- Y. Kim, B.-N. Kim, Y.-C. Hong et al., “Co-exposure to environmental lead and manganese affects the intelligence of school-aged children,” NeuroToxicology, vol. 30, no. 4, pp. 564–571, 2009.
- T. D. Wachs, H. Creed-Kanashiro, S. Cueto, and E. Jacoby, “Maternal education and intelligence predict offspring diet and nutritional status,” Journal of Nutrition, vol. 135, no. 9, pp. 2179–2186, 2005.
- L. Takser, J. Lafond, M. Bouchard, G. St-Amour, and D. Mergler, “Manganese levels during pregnancy and at birth: relation to environmental factors and smoking in a Southwest Quebec population,” Environmental Research, vol. 95, no. 2, pp. 119–125, 2004.
- R. O. Wright, C. Amarasiriwardena, A. D. Woolf, R. Jim, and D. C. Bellinger, “Neuropsychological correlates of hair arsenic, manganese, and cadmium levels in school-age children residing near a hazardous waste site,” NeuroToxicology, vol. 27, no. 2, pp. 210–216, 2006.
- M. Marlowe, J. Stellern, J. Errera, and C. Moon, “Main and interaction effects of metal pollutants on visual-motor performance,” Archives of Environmental Health, vol. 40, no. 4, pp. 221–225, 1985.
- B. Claus Henn, L. Schnaas, A. S. Ettinger et al., “Associations of early childhood manganese and lead coexposure with neurodevelopment,” Environmental Health Perspectives, vol. 120, no. 1, pp. 126–131, 2012.
- J. Calderón, M. E. Navarro, M. E. Jimenez-Capdeville et al., “Exposure to arsenic and lead and neuropsychological development in Mexican children,” Environmental Research, vol. 85, no. 2, pp. 69–76, 2001.
- R. W. Thatcher, M. L. Lester, R. McAlaster, and R. Horst, “Effects of low levels of cadmium and lead on cognitive functioning in children,” Archives of Environmental Health, vol. 37, no. 3, pp. 159–166, 1982.
- G. A. Wasserman, X. Liu, F. Parvez et al., “Water arsenic exposure and children's intellectual function in Araihazar, Bangladesh,” Environmental Health Perspectives, vol. 112, no. 13, pp. 1329–1333, 2004.
- R. L. Canfield, C. R. Henderson Jr., D. A. Cory-Slechta, C. Cox, T. A. Jusko, and B. P. Lanphear, “Intellectual impairment in children with blood lead concentrations below 10 μg per deciliter,” The New England Journal of Medicine, vol. 348, no. 16, pp. 1517–1526, 2003.
- J. M. Braun, R. S. Kahn, T. Froehlich, P. Auinger, and B. P. Lanphear, “Exposures to environmental toxicants and attention deficit hyperactivity disorder in U.S. children,” Environmental Health Perspectives, vol. 114, no. 12, pp. 1904–1909, 2006.
- S. M. Rink, G. Ardoino, E. I. Queirolo, D. Cicariello, N. Mañay, and K. Kordas, “Associations between hair manganese levels and cognitive, language, and motor development in preschool children from Montevideo, Uruguay,” Archives of Environmental and Occupational Health, vol. 69, no. 1, pp. 46–54, 2014.
- N. Mañay, A. Z. Cousillas, C. Alvarez, and T. Heller, “Lead contamination in uruguay: the ‘la teja’ neighborhood case,” Reviews of Environmental Contamination and Toxicology, vol. 195, pp. 93–115, 2008.
- A. Z. Cousillas, N. Mañay, L. Pereira, C. Alvarez, and Z. Coppes, “Evaluation of lead exposure in Uruguayan children,” Bulletin of Environmental Contamination and Toxicology, vol. 75, no. 4, pp. 629–636, 2005.
- E. I. Queirolo, A. S. Ettinger, R. J. Stoltzfus, and K. Kordas, “Association of anemia, child and family characteristics with elevated blood lead concentrations in preschool children from Montevideo, Uruguay,” Archives of Environmental and Occupational Health, vol. 65, no. 2, pp. 94–100, 2010.
- M. Illa, M. J. Moll, A. M. García D'aponte et al., “Estudio de la frecuencia y magnitud del déficit de hierro en niños de 6 a 24 meses de edad, usuarios de los servicios del ministerio de salud pública [Study of the prevalence and severity of iron deficiency in 6 to 24 month old children attended by health services of the ministry of public health],” Archivos de Pediatria Urugaya, vol. 79, pp. 21–31, 2008.
- A. Cousillas, L. Pereira, C. Alvarez et al., “Comparative study of blood lead levels in Uruguayan children (1994–2004),” Biological Trace Element Research, vol. 122, no. 1, pp. 19–25, 2008.
- K. Kordas, G. Ardoino, D. Ciccariello et al., “Association of maternal and child blood lead and hemoglobin levels with maternal perceptions of parenting their young children,” NeuroToxicology, vol. 32, no. 6, pp. 693–701, 2011.
- P. J. Parsons and J. J. J. Chisolm, “The lead laboratory,” in Screening Young Children for Lead Poisoning: Guidance for State and Local Health Officials, Centers for Disease Control and Prevention, Atlanta, Ga, USA, 1997.
- K. Kordas, E. I. Queirolo, N. Mañay et al., “Hemoglobin status is positively associated with neurodevelopment in lead-exposed preschool children from Montevideo, Uruguay,” Public Health Frontier, vol. 1, no. 1, pp. 16–22, 2012.
- M. J. L. López, J. M. Rodríguez González, C. S. Vilariño, and E. T. Linares, “Utilidad de las formas cortas de la escala de inteligencia de wechsler para adultos (wais),” Anales de Psicología, vol. 19, no. 1, pp. 53–63, 2003.
- B. C. Bray, S. T. Lanza, and X. Tan, “Eliminating bias in classify-analyze approaches for latent class analysis,” Structural Equation Modeling, vol. 22, no. 1, pp. 1–11, 2015.
- O. Harel, H. Chung, and D. Miglioretti, “Latent class regression: inference and estimation with two-stage multiple imputation,” Biometrical Journal, vol. 55, no. 4, pp. 541–553, 2013.
- D. B. Rubin, Multiple Imputation for Nonresponse in Surveys, John Wiley & Sons, New York, NY, USA, 1987.
- B. Claus Henn, B. A. Coull, and R. O. Wright, “Chemical mixtures and children's health,” Current Opinion in Pediatrics, vol. 26, no. 2, pp. 223–229, 2014.
- A. Kortenkamp, M. Faust, M. Scholze, and T. Backhaus, “Low-level exposure to multiple chemicals: reason for human health concerns?” Environmental Health Perspectives, vol. 115, supplement 1, pp. 106–114, 2007.
- Y. Kim, E. H. Ha, H. Park et al., “Prenatal lead and cadmium co-exposure and infant neurodevelopment at 6 months of age: the mothers and children's environmental health (moceh) study,” Neurotoxicology, vol. 35, pp. 15–22, 2013.
- C.-C. Lin, Y.-C. Chen, F.-C. Su et al., “In utero exposure to environmental lead and manganese and neurodevelopment at 2 years of age,” Environmental Research, vol. 123, pp. 52–57, 2013.
- B. Claus Henn, A. S. Ettinger, J. Schwartz et al., “Early postnatal blood manganese levels and children's neurodevelopment,” Epidemiology, vol. 21, no. 4, pp. 433–439, 2010.
- M. Kippler, F. Tofail, J. D. Hamadani et al., “Early-life cadmium exposure and child development in 5-year-old girls and boys: a cohort study in rural Bangladesh,” Environmental Health Perspectives, vol. 120, no. 10, pp. 1462–1468, 2012.
- Y. Cao, A. Chen, J. Radcliffe et al., “Postnatal cadmium exposure, neurodevelopment, and blood pressure in children at 2, 5, and 7 years of age,” Environmental Health Perspectives, vol. 117, no. 10, pp. 1580–1586, 2009.
Copyright © 2015 Katarzyna Kordas et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.