Oxidative Stress in Association with Metabolic Health and Obesity in Young Adults

Jakubiak, Grzegorz K.; Osadnik, Kamila; Lejawa, Mateusz; Kasperczyk, Sławomir; Osadnik, Tadeusz; Pawlas, Natalia

doi:https://doi.org/10.1155/2021/9987352

Oxidative Medicine and Cellular Longevity

On this page

Abstract Introduction Materials and Methods Results Discussion Abbreviations Data Availability Conflicts of Interest Acknowledgments Supplementary Materials References Copyright Related Articles

Special Issue

Strategies for Modulating Oxidative Stress Under Diverse Physiological and Pathological Conditions 2021

View this Special Issue

Research Article | Open Access

Volume 2021 | Article ID 9987352 | https://doi.org/10.1155/2021/9987352

Oxidative Stress in Association with Metabolic Health and Obesity in Young Adults

Grzegorz K. Jakubiak,^1,2Kamila Osadnik,¹Mateusz Lejawa,¹Sławomir Kasperczyk,³Tadeusz Osadnik,^1,4and Natalia Pawlas¹

Academic Editor: Jolanta Czuczejko

Received11 Mar 2021

Revised27 May 2021

Accepted09 Jun 2021

Published28 Jun 2021

Abstract

Introduction. Obesity is one of the most important public health problems in the world. Among obese people, there are those who, apart from excessive body weight, do not exhibit other metabolic dysfunctions, have a lower risk of developing cardiovascular diseases (CVDs), and show lower mortality. According to the theory, they are referred as metabolically healthy obese (MHO), in contrast to metabolically unhealthy obese (MUO). Metabolic disturbances occurring with obesity have been well established to be associated with oxidative stress. Aim. The purpose of this study was to analyse the association between selected anthropometric and biochemical parameters with oxidative stress in MHO, MUO, and normal weight young adults. Material and Methods. Individuals with age between 18 and 36 years with no history of chronic diseases and use of medicaments, with or without obesity, participated in the study. Complete blood counts, biochemical measurements, and parameters of oxidative stress such as total antioxidant capacity (TAC), total oxidative status (TOS), oxidative stress index (OSI), serum concentration of malondialdehyde (MDA), ceruloplasmin, thiol groups and lipid hydroperoxides (LPH), concentration of lipofuscin (LPS) in erythrocytes, and the activity of superoxide dismutase (SOD) were measured. Results. 422 patients who met the inclusion criteria were enrolled in the study. Among the study participants, 208 people (49.29%) were offspring of patients with angiographically confirmed coronary artery disease. Among the participants, 16 patients have been included in the group of metabolically healthy obese (MHO) people and 61 patients in the group of metabolically unhealthy obese (MUO) people and 345 patients had normal body weight. Significant differences between metabolically unhealthy obese and normal weight patients, as well as between women and men, have been found. Conclusions. We showed significant differences in the selected parameters of oxidative stress between metabolically unhealthy obese (MUO) individuals and young volunteers with normal body weight as well as without significant medical history.

1. Introduction

Obesity is a significant risk factor for metabolic disorders leading to multiple diseases such as diabetes mellitus, cancer, and cardiovascular diseases [1]. It has been observed that there is a subgroup of patients, called metabolically healthy obese (MHO), with no metabolic abnormalities despite excessive body weight. Patients with metabolic disorders in the course of obesity belong to metabolically unhealthy obese (MUO) individuals [2]. According to the current definition, body mass index (BMI) above 30 kg/m² allows the diagnosis of obesity. Obesity causes worsening of quality of life and poses economic burden for countries worldwide [3]. The prevalence rate of obesity increased by 27.5% between 1980 and 2013 [4].

Cardiovascular diseases (CVDs), such as coronary heart disease and stroke, belong to the most important causes of mortality worldwide [5, 6]. The incidence of CVDs among young people has increased past two decades, and it may be associated with increasing incidence of obesity [7]. Atherosclerosis is the main mechanism leading to CVDs [8]. Oxidative stress is suspected to play an important role in the pathogenesis of atherosclerosis [9].

Oxidative stress results from imbalance between prooxidative and antioxidant factors in favour of prooxidative factors [10]. Representatives of reactive oxygen species (ROS), highly reactive radical or nonradical molecules generated in the course of oxygen metabolism, are superoxide anion, hydroxyl radical, and hydrogen peroxide [11]. Superoxide dismutase (SOD), glutathione peroxidase, and catalase are main antioxidant enzymes in humans [12]. Ascorbic acid, glutathione, beta-carotene, tocopherols, and tocotrienols belong to nonenzymatic antioxidants [13]. Reactive oxygen species can damage macromolecules such as proteins, lipids, and deoxyribonucleic acid (DNA) [14]. Lipid peroxidation assessment by measurement of malondialdehyde blood concentration is a useful marker of oxidative stress [15]. Oxidative stress was shown to be a distinctive feature of obesity [16].

Although there is a distinction between MHO and MUO, research results show that MHO individuals have a greater risk of developing cardiovascular diseases and cardiovascular events than normal weight individuals but less than MUO individuals. Research on the differences in metabolic status between MUO and MHO individuals may contribute to a better understanding of the metabolic heterogeneity phenomenon in obese people and the pathogenesis of cardiovascular disease in the course of obesity. It was recently documented that such abnormalities as increased serum myeloperoxidase (MPO) activity, nitric oxide (NO) formation, and nitrosative damage to proteins are associated with the progression of metabolic disturbances of obesity as well as elevated ONOO—blood concentration may be a valuable predictor of development of hypertension and metabolic syndrome in obese individuals [17].

The purpose of this study was to analyse the association between selected anthropometric and biochemical parameters with oxidative stress in young healthy adults with and without obesity and metabolic disturbances.

2. Materials and Methods

Blood samples were taken from healthy volunteers, both descendants of people with premature angiographically confirmed CHD and healthy volunteers from the MAGNETIC study (Metabolic and Genetic Profiling of Young Adults with and without a Family History of Premature Coronary Heart Disease). The detailed recruitment procedure of the MAGNETIC study, which was a case-control study, was published [18]. Individuals were recruited from offspring of patients hospitalized in the Silesian Centre for Heart Diseases due to premature CHD and from untreated people aged 18–36 years without a family history of CHD. From the whole group of recruited volunteers, we selected obese individuals and those with normal weight. The group was divided into two subgroups: metabolically healthy obese (MHO) persons and metabolically unhealthy obese (MUO) persons. The control group constituted of normal weight persons without the metabolic syndrome. Criteria of metabolic health according to Buscemi et al. have been used [19]. Subjects who met at least two of the following conditions are considered metabolically unhealthy: (1) systolic blood pressure or diastolic blood pressure or use of antihypertensive medication; (2) or use of lipid-lowering medication; (3) high density lipoprotein (HDL) (1.0 mmol/L) (men) or < 50 mg/dL (1.2 mmol/L) (women); (4) (5.2 mmol/L) or use of cholesterol-lowering medication; (5) (5.55 mmol/L) or diabetes mellitus type 2. People who met one or no criterion are considered metabolically healthy.

Inclusion criteria for the study group were as follows: (1) age between 18 and 36 years, (2) obesity, (3) no use of medicaments, and (4) agreement for participation in trial. Inclusion criteria for the control group were as follows: (1) age between 18 and 36 years, (2) normal weight, (3) no metabolic syndrome, (4) no use of medicaments, and (5) agreement for participation in the trial. Exclusion criteria for both groups were as follows: (1) age below 18 years or above 36 years, (2) use of medicaments, and (3) acute or chronic disease.

Blood pressure was measured with a certified automatic apparatus. Blood samples were obtained from every individual between 7 am and 9 am, approx. 8–10 h after the last meal. The serum sample was obtained for oxidative stress analyses and frozen immediately at -80 C. Complete blood counts (CBC) were analysed by a Sysmex XE2100 (Sysmex Corporation, Kobe, Japan). Biochemical measurements were analysed by a Cobas 6000 (Roche Diagnostics, Indianapolis, IN, USA) using Roche reagents. The following parameters were assessed: uric acid, total cholesterol, low density lipoprotein (LDL) cholesterol, high density lipoprotein (HDL) cholesterol, triglycerides, and glucose. The measurements were done in a clinical laboratory. In all patients, the body mass, height, BMI, waist-hip ratio (WHR), visceral adipose index (VAI), SBP, and DBP were measured. VAI was calculated from waist circumference (WC), BMI, triglycerides (TG) blood concentration, and high density lipoprotein (HDL) concentration based on the methodology described by Amato et al. [20] according to the following rules:

The thiol (SH) group serum concentration was measured according to the methodology described by Koster et al. 5,5-Dithiobis (2-nitrobenzoic acid) (DTNB) is reduced by compounds containing SH groups, yielding the yellow anion derivative, 5-thio-2-nitrobenzoate, absorbing at a wavelength of 412 nm [21]. An automated PerkinElmer analyser was applied. Results have been shown as the thiol group concentration per gram of protein.

Total antioxidant capacity (TAC) was determined by the colorimetric method developed by Erel. Ions 2,2-azinobis-3-ethylbenzothiazoline-6-sulfonate change colour, and they are measured as the modification in absorbance at 660 nm [22]. This procedure was conducted in an automated PerkinElmer analyser calibrated with Trolox.

The methodology described by Erel has been used to measure serum total oxidative status (TOS). Oxidizing agents in an acidic medium cause the oxidation of ferrous ions to ferric ions. Xylenol orange changes colour in the presence of ferric ions, and it is measured as the change in absorbance at 560 nm [23]. This assay was conducted in an automated analyser (PerkinElmer) calibrated with hydrogen peroxide.

Oxidative stress index (OSI) has been calculated as percentage ratio of TOS to TAC.

Malondialdehyde (MDA) serum concentration was measured fluorometrically according to Ohkawa et al. with modifications. Samples were mixed with 8.1% sodium dodecyl sulfate, 20% acetic acid, and 0.8% 2-thiobarbituric acid. Samples were vortexed and then incubated for one hour at 95 Celsius degrees. In the next step, butanol-pyridine 15 : 1 () was added. The mixture was shaken for ten minutes and then centrifuged. The butanol-pyridine layer was measured fluorometrically at 552 nm and 515 nm excitation (PerkinElmer, Waltham, Massachusetts). Tetraethoxypropane was used as the standard. 2-Thiobarbituric acid-reactive substance concentration values are expressed as MDA equivalents [24].

Ceruloplasmin (CER) serum concentration has been determined by the methodology described by Richterich. It is based on the ability of ceruloplasmin to catalyse the oxidation of p-phenylenediamine to the coloured product which can be detected spectrophotometrically [25].

Measurements of lipid hydroperoxides (LPH) concentration were conducted basing on the methodology developed by Sődergren et al. It is associated with colour change of xylenol orange in the presence of ferric ions, followed by the addition of methanol and butylated hydroxytoluene (BHT). The change of absorbance was measured at 560 nm in the Victor X3 automated analyser (PerkinElmer), which was calibrated with hydrogen peroxide [26].

Concentration of lipofuscin (LPS) in erythrocytes has been measured according to Jain as fluorescence of the extraction of erythrocytes in a mixture of isopropanol and chloroform [27]. Results were shown in relative units (RUs).

The activity of superoxide dismutase (SOD) has been measured according to the method published by Oyanagui. In this method, the activity of SOD is negatively proportional to the concentration of coloured product generated in the reaction of nitric ions with naphthalene diamine and sulfanilic acid. Nitric ions are products in the reaction of superoxide ions (generating by xanthine oxidase) with hydroxylamine. Absorbance was measured using an automated PerkinElmer analyser at a wavelength of 550 nm. The enzymatic activity of SOD was expressed in nitric units (NUs). The activity of SOD isoenzymes such as MnSOD and CuZnSOD has been determined using KCN as the inhibitor of the CuZnSOD activity [28].

The experimental protocol has been approved by the Bioethics Committee at the Institute of Occupational Medicine and Environmental Health in Sosnowiec (no. 03/2013) and further extended by the Bioethics Committee at the Medical University of Silesia (no. KNW/0022/KB1/118/18/19).

Statistical analysis has been performed by Statistica 10 (Statsoft, Tibco). The normality of distribution was checked with the Shapiro-Wilk as well as Lilliefors test. Spearman’s rank correlation has been performed for the analysis of correlations between determined parameters in the group of all participants and for both men and women separately. Mann–Whitney test has been used to analyse the associations of measured parameters with sex. Kruskal-Wallis ANOVA and post hoc test were used to find differences between MHO, MUO, and metabolically healthy normal weight (MHNW) participants. Statistical tests were performed correcting for multiple comparisons (Dunn’s test). Frequencies of categorical values were compared using the test. Box plots and respective tests were prepared in the R software.

3. Results

422 patients who met inclusion criteria have been enrolled in the study. In this group, 44.8% (189) were men and 55.2% (233) were women. The average age was in the whole group, among men and among women. 16 patients were classified as metabolically healthy obese people (7 women and 9 men). 61 patients met the definition of metabolically unhealthy obese (19 women and 42 men). 345 patients were classified as metabolically healthy with normal weight (MHNW) (207 women and 138 men). Among the study participants, 208 people (49.29%) were offspring of people with angiographically confirmed CHD (98 men and 110 women). 76 participants were current smokers (37 men and 39 women), 47 persons were past smokers (27 men and 20 women), and 298 participants had never smoked (125 men and 173 women). Differences between MHNW, MHO, and MUO individuals in terms of epidemiologic, anthropometric, and biochemical data are presented in Table 1.

There were significant differences between men and women in biochemical parameters and unhealthy behaviour such as alcohol consumption between men and women as well as the parameters of oxidative stress (Table 2). Oxidative stress parameters assessed in the study may be divided into three groups: antioxidant barrier (SH groups, SOD, MnSOD, CuZnSOD, and CER), parameters associated with total antioxidant/oxidant status (TAC, TOS, and OSI), and oxidative damage (MDA, LPH, and LPS). In the whole group of participants, TOS, OSI, and SOD activities (total SOD, MnSOD, and CuZnSOD) and LPS and ceruloplasmin concentrations were significantly higher among women than men. The thiol group concentration per gram of protein was significantly lower among women than men. In both males and females, TAC positively correlated with uric acid concentration.

Among men, significant differences associated with metabolic status in LPH and LPS blood concentration and SOD blood activity (total and CuZnSOD, but not MnSOD) were observed. LPH concentration in MUO was higher than in MHNW. LPS concentration was the highest in MHNW and the lowest in MHO. SOD total blood activity and CuZnSOD activity were highest in MHNW (Figure 1, Supplementary table 1). There were no differences between MHO and MUO regarding oxidative stress parameters.

(a)

(b)

(c)

(d)

(e)

(f)

(g)

(h)

(i)

(j)

(k)

Figure 1

Oxidative stress parameters—differences between men with different metabolic status. MHNW: metabolically healthy normal weight individuals; MHO: metabolically healthy obese individuals; MUO: metabolically unhealthy obese individuals. Data are presented in boxes as median, first, and third quartile values. (a) Thiol group concentration; (b) ceruloplasmin; (c) total antioxidant capacity; (d) total oxidative status; (e) oxidative stress index; (f) lipid hydroperoxides; (g) superoxide dismutase; (h) Mn-dependent superoxide dismutase; (i) Cu- and Zn-dependent superoxide dismutase; (j) lipofuscin; (k) malondialdehyde.

Among women, significant differences associated with metabolic status in SH group concentration per gram of protein (PSH), TAC, and total SOD activity (but not MnSOD and CuZnSOD) were observed. TAC was the highest in MUO and the lowest in MHNW. Total SOD activity was higher in MHNW than in MUO (Figure 2, Supplementary table 2).

(a)

(b)

(c)

(d)

(e)

(f)

(g)

(h)

(i)

(j)

(k)

Figure 2

Oxidative stress parameters—differences between women with different metabolic status. MHNW: metabolically healthy normal weight individuals; MHO: metabolically healthy obese individuals; MUO: metabolically unhealthy obese individuals. Data are presented in boxes as median, first, and third quartile values. (a) thiol group concentration; (b) ceruloplasmin; (c) total antioxidant capacity; (d) total oxidative status; (e) oxidative stress index; (f) lipid hydroperoxides; (g) superoxide dismutase; (h) Mn-dependent superoxide dismutase; (i) Cu- and Zn-dependent superoxide dismutase; (j) lipofuscin; (k) malondialdehyde.

In men, we observed significant negative correlation between age and TAC, SOD, and CuZnSOD. The LPS negatively correlated with age, total cholesterol, LDL, triglycerides, BMI, WHR, and VAI while positively with HDL. SOD activity negatively correlated with triglycerides, BMI, WHR, and VAI, while opposite correlation was found between the latter parameters and LPH. TAC was negatively correlated with age and HDL cholesterol, while positively with triglycerides, uric acid, and VAI (Table 3).

In women, we observed significant negative correlation between age and SOD and CuZnSOD, while positive with TAC and LPS. The LPH positively correlated with triglycerides, SBP, and VAI. TAC was positively correlated with cholesterol, triglycerides, and uric acid (Table 4).

4. Discussion

Our results show that gender differences have a significant impact on parameters related to oxidative stress. In some parameters, we observed a significant trend related to the number of metabolic disturbances from healthy persons with normal weight to metabolically unhealthy obese. Comparing to other studies, our subjects were younger and they were not treated for any disease.

The strength of our study is undoubtedly the participation of young people, without a significant medical history and medication administration. The limitation of our work is the design and the lack of follow-up which could allow us to investigate the relationship between selected parameters of oxidative stress, in the predisposition to develop coronary artery disease. The prospective studies are needed. The study presented by us is a case-control study; therefore, it allows only to determine the presence of specific correlations, not a cause-and-effect relationship. Another limitation of the study is the lack of evaluation of oxidative stress in red blood cells and the lack of oxidative nucleic acid as well as protein damage. Another limitation is the lack of one accepted definition of MHO and MUO; thus, the necessity to choose one of the suggested. We used the criteria according to Buscemi, which take into account parameters such as blood pressure, blood glucose concentration, and plasma lipid profile (TG, TC, and HDL-C). The criteria for the diagnosis of MUO developed by other authors take into account also other parameters. For example, the Karelis criteria and the Wildman criteria include the value of the homeostasis model assessment of insulin resistance (HOMA-IR) index [29], which was not calculated in our study.

4.1. Gender Differences in Terms of Oxidative Stress

According to the results of the study conducted on the healthy population by Brunelli et al., the state of oxidative stress is higher in women than in men. In this study, such parameters as diacron reactive oxygen metabolite (dROM) and biological antioxidant potential (BAP) have been assessed [30]. Higher lipid peroxidation among women has been reported in the study conducted by Block et al. [31] In the other study, higher oxidative stress in men than in women measured by blood concentration of the thiobarbituric acid-reacting substances (TBARS) and urinary concentration of 8-iso-PGF2α has been documented [32]. Nielsen et al. have shown that MDA concentration is slightly but significantly higher in men than in women [33]. The data available in the literature therefore show discrepancies in the relationship between sex and oxidative stress, which our study also confirms; however, we have also shown higher intensity of oxidative stress in women than in men regarding following parameters: PSH, CER, TOS, SOD, MnSOD, CuZnSOD, and LPS.

Due to the described differences between men and women in terms of the parameters of oxidative stress in our cohort, we decided to analyse the relationship between body weight and metabolic health status and the parameters of oxidative stress separately for women and men.

4.2. Oxidative Stress in Association with Body Weight and Metabolic Health

4.2.1. Oxidative Stress Parameters Related to Antioxidant Barrier

Gol et al. studied the differences in the concentration of native thiol groups (-SH) and the total concentration of thiol groups (-SH and -S-S-) between people who lead a sedentary lifestyle, people who are overweight or obese, and people who exercise regularly. There was no significant difference between these groups in the native thiol groups. In terms of the total number of thiol groups, the highest value was found among people who exercise regularly and the lowest among people who lead a sedentary lifestyle [34]. In our study, we assessed the concentration of thiol groups per gram of protein. In women, the value of this parameter was decreased both in MHO and in MUO, which implies the higher intensity of oxidative stress, and was negatively correlated with triglycerides and BMI and there was no association with uric acid, while in men, the parameter positively correlated with triglycerides and uric acid, while negatively with HDL cholesterol concentration. Decreased concentration of reduced thiol groups may be a result of increased oxidative stress in those individuals and indicated different prooxidant and antioxidant mechanisms in men and in women.

Alissa et al. published the results of a study aimed at assessing the relationship between selected parameters of iron metabolism and dietary iron supply and risk factors for coronary heart disease among men from Saudi Arabia. 270 men participated in the study: 130 of whom underwent coronary angiography (<50% stenosis was found) constituted the study group and 140 persons without grounds for suspecting coronary artery disease constituted the control group. There was a significantly higher incidence of such cardiovascular risk factors as diabetes mellitus, hypertension, and metabolic syndrome in the research group. People in the study group were also significantly older than those in the control group ( vs. ). It was found that in the research group, the concentration of ceruloplasmin in the blood was significantly higher [35]. In our study, no significant differences in the concentration of ceruloplasmin were found between the groups with or without metabolic disturbances; however, we observed that it was significantly higher in women. Perhaps the increase in ceruloplasmin concentration occurs only at a later stage of metabolic disorder progression than in the population we studied.

SOD is one of the most important antioxidant enzymes in the human organism [36]. Baynes and Thorpe suggested that in response to oxidative stress, cells increase the production of this enzyme to prevent mitochondria from oxidative damage [37, 38]. The function of this enzyme is to catalyse the dismutation reaction of the highly reactive superoxide radical anion. SOD occurs in the form of three isoenzymes: cytosolic CuZnSOD, mitochondrial MnSOD, and extracellular SOD (EC-SOD). It has been shown that oxidative stress causes increase in the expression of antioxidant enzymes such as SOD [39]. The data available in the literature on the dependence of SOD activity on body weight and metabolic health status are not unequivocal. Isogawa et al. published data that gave partially similar conclusions to ours. According to the results of their study, SOD activity negatively correlates with BMI. They have shown also that lower SOD activity correlates with increased carotid intima-media thickness which is a well-known indicator of increased cardiovascular risk, but on the other hand, existence of carotid plaque positively correlates with SOD activity [40]. Among the population we studied, the relationship is even stronger in obese individuals with a metabolically unhealthy phenotype and is slightly greater in women than in men. Yubero-Serrano et al. showed that the activity of SOD in patients with two components of metabolic syndrome is significantly lower than in patients with three or more concomitant components of the metabolic syndrome. They have concluded that SOD activity could be the most relevant biomarker of oxidative stress in patients suffering from metabolic syndrome [41]. It is noteworthy that in both above-mentioned studies, mean age of participants was similar and higher than in our study. Isogawa et al. performed their study on the group of patients in which only some of the participants had components of the metabolic syndrome, but Yubero-Serrano et al. enrolled only people with metabolic syndrome. Farah et al. have shown no significant difference in SOD activity between MHO and MUO patients [42]. According to our results, the total blood SOD activity was significantly lower in MUO than in MHNW, both in women (difference 6.37%; ) and in men (difference 11.79%; ). According to our research, the determination of total blood SOD activity could be a marker of obesity-related metabolic disorders, both in women and in men.

4.2.2. Oxidative Stress Parameters Related to Total Antioxidant/Oxidant Status

The term TAC of plasma or tissue fluid refers to the total capacity to neutralize the prooxidative potential of reactive oxygen species. It is important that the determination of the TAC takes into account the synergistic or antagonistic effect of the various antioxidants present in the plasma or tissue fluid, as opposed to the measurement of the concentration of individual antioxidants [43]. A high fraction of TAC is attributed to uric acid as the endogenous antioxidant molecule [44]. That is why we observed a strong correlation in the whole group.

OSI is the percentage ratio of TOS to TAC. In a study by Nowicki et al., in which people after cardiovascular events (study group) and those without a history of cardiovascular events (control group) participated, no significant difference was found in OSI between the research and the control group, as well as no significant correlation was found between OSI and BMI [45]. Our study also showed no significant difference in terms of OSI between the MUO, MHO, and MHNW groups. Romuk et al. conducted a study to investigate the differences in the parameters of oxidative stress between patients with ischemic and nonischemic cardiomyopathy. It has been found that in patients with ischemic cardiomyopathy, the TAC value is significantly higher and the OSI value is significantly lower. There were no significant differences in TOS. In the study, people with normal body weight or overweight participated [46]. In obese and overweight adolescents, TAC and TOS measured in the plasma and saliva were documented to be higher than in the control group [47]. Higher BMI was shown to be an independent risk factor for the lower total antioxidant status (TAS) which may be correlated with increased carotid intima-media thickness in patients with arterial hypertension [48]. In our study, TAC was significantly higher in obese women with metabolic diseases, and we found an increasing correlation of TAC with increasing metabolic disorders, measured as total cholesterol and triglyceride level. This may suggest that obesity and related metabolic disturbances may contribute to the development of coronary artery disease in a young population. In our results, the TAC among MHO women was 2.91% higher than that among MHNW women, and the TAC value among MUO women was 10.68% higher than that among MHNW women (). Our results suggest that TAC could be a marker of metabolic disorders developing in the course of obesity in women, but more research is needed in this direction.

4.2.3. Oxidative Stress Parameters Related to Oxidative Damage

Simão et al. conducted a study that compared the parameters of oxidative stress in patients who had suffered an ischemic stroke, depending on the coexistence or absence of features of the metabolic syndrome. In the group of patients with metabolic syndrome, a significantly higher concentration of lipid hydroperoxides and a significantly higher value of the oxidative stress index were found. In the entire population studied by us, as well as among men analysed separately, the concentration of lipid hydroperoxides was significantly higher in metabolically obese patients (MUO) but, as already mentioned, without significant differences in OSI [49]. As shown in this study, MUO subjects had increased hydroperoxide lipid levels compared to MHNW and MHO individuals. It has been previously demonstrated that hydroperoxides derivatives are the main primary products of lipid oxidation, particularly in several human inflammatory diseases including diabetes, hypertension, dyslipidaemia, and metabolic syndrome [50, 51].

Lipofuscin is a conglomerate of highly oxidized proteins and lipids considered to be a marker of cell aging. Oxidative stress plays a role in the formation of lipofuscin [52]. There is not a large amount of data elucidating the clinical relevance of LPS measurement in metabolic syndrome. Cazzola et al. have documented that overweight and obesity are associated with increased LPS content in erythrocytes. Taking into account the overall results of this study, it is probably associated with increased lipid peroxidation and the making of aldehydes promoting the formation of cross-links between proteins and phospholipids. Only metabolically healthy females have been enrolled into the study [53]. Our results are therefore not fully comparable as we showed a downward trend for LPS content with increasing metabolic abnormalities. Further studies are needed to better understand the role of LPS as a possible marker of oxidative stress in the course of metabolic disorders.

Research shows that metabolically healthy obesity (MHO) is not a permanent condition. Echouffo-Tcheugui et al. showed that in a four-year follow-up, 43% of MHO women and 46% of MHO men develop disorders that allow them to qualify as metabolically obese patients (MUO) [54]. Moreover, even obese people who are metabolically healthy have an increased health risk. According to the results of the meta-analysis carried out by Zheng et al., MHO individuals have a significantly higher risk of cardiovascular events than metabolically healthy normal weight people (MHNW) (RR 1.5; 95% CI 1.27–1,77) [55]. Bell et al. demonstrated an increased risk of developing type 2 diabetes in this population [56], and Arnlöv et al. showed an increased risk of developing CVD [57]. The state of MHO should therefore not be regarded as completely normal but rather as a transition period between the state of health and the development of overt metabolic syndrome, as well as a condition associated with an increased risk of morbidity.

4.3. Can Supplementation of Antioxidants Be a Useful Direction in Therapy?

The results presented in this study show that obese people with metabolic disorders show more disturbances in the parameters of oxidative stress than people with normal body weight without metabolic disorders. The literature suggests the usefulness of many nutraceuticals with antioxidant properties in obese patients, but much of the information on this topic is based mainly on the results of basic research [58]. Recently, the role of isoflavones in the prevention and therapy of type 2 diabetes has been described in detail [59], as well as the properties of phytoestrogens in the context of their use in the prevention of obesity and the resulting disorders [60]. However, it should be noted that this subject is of great interest, and in recent years, the results of clinical trials and meta-analyses evaluating the importance of antioxidant supplementation in the context of the treatment of obesity and related metabolic disorders have been published. Suliburska et al. presented the results of a randomized, double-blind study, which showed that a 3-month supplementation of green tea extract has a positive effect on body weight, lipid profile, blood glucose concentration, and TAS in obese people, as well as on zinc and magnesium metabolism [61]. A systematic review and meta-analysis of clinical trials showed that spirulina supplementation is associated with weight loss in obese subjects [62]. Saffron has documented beneficial effects on waist circumference and fasting blood glucose [63]. The supplementation of certain nutraceuticals with antioxidant properties has a beneficial effect on the metabolic status of obese people and may be considered in the treatment of obese people. However, it should be remembered that such an approach should be of an auxiliary nature and cannot replace a lifestyle change, including a rational diet and exercise, leading to weight loss.

5. Summary

Our findings suggest that metabolically unhealthy obese patients have more pronounced oxidative stress parameters comparing to those with normal weight without metabolic disturbances. The significant differences between men and women may imply different mechanisms leading to oxidative stress and its complications. Our results are partially confirmed by the studies that have been conducted so far, which, however, mainly concerned patients with already developed disease entities, which are complications of obesity.

An important achievement of our research is the demonstration that the total SOD activity is statistically significantly lower in MUO compared to MHNW in both women and men, while the TAC value increases significantly in MUO women. Our study involved young people, untreated for chronic diseases; therefore, these parameters of oxidative stress could be considered for use in clinical practice as early markers of the development of metabolic disorders with weight gain. More research is needed. These results show that obesity is always a pathological condition, despite the lack of specific disease entities already developed.

Abbreviations

BMI:	Body mass index
CBC:	Complete blood count
CER:	Ceruloplasmin
CHD:	Coronary heart disease
CI:	Confidence interval
CuZnSOD:	Copper- and zinc-containing superoxide dismutase
CVD:	Cardiovascular disease
DBP:	Diastolic blood pressure
EC-SOD:	Extracellular superoxide dismutase
HDL:	High density lipoprotein
HDL-C:	High density lipoprotein cholesterol
HOMA-IR:	Homeostasis model assessment of insulin resistance
HR:	Hazard ratio
LDL:	Low density lipoprotein
LDL-C:	Low density lipoprotein cholesterol
LPH:	Lipid hydroperoxides
LPS:	Lipofuscin
MDA:	Malondialdehyde
MHNW:	Metabolically healthy normal weight
MHO:	Metabolically healthy obese/obesity
MnSOD:	Manganese-containing superoxide dismutase
MPO:	Myeloperoxidase
MUO:	Metabolically unhealthy obese/obesity
NU:	Nitric unit
OSI:	Oxidative stress index
oxLDL:	Oxidized low density lipoproteins
PSH:	Thiol group concentration per gram protein
ROS:	Reactive oxygen species
RR:	Relative risk
RU:	Relative unit
SBP:	Systolic blood pressure
SOD:	Superoxide dismutase
TAC:	Total antioxidant capacity
TAS:	Total antioxidant status
TBARS:	Thiobarbituric acid-reacting substances
TC:	Total cholesterol
TG:	Triglycerides
TOS:	Total oxidative status
UA:	Uric acid
VAI:	Visceral adipose index
WC:	Waist circumference
WHR:	Waist-hip ratio.

Data Availability

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

Acknowledgments

The study was financed by the National Science Centre (UMO-2014/13/B/NZ5/03166, OPUS 7) and Medical University of Silesia (Grant No. KNW-1-039/N/8/K).

Supplementary Materials

Supplementary Table 1: oxidative stress parameters—differences in men with different metabolic status. Supplementary Table 2: oxidative stress parameters—differences in women with different metabolic status. (Supplementary Materials)

References

Y. C. Chooi, C. Ding, and F. Magkos, “The epidemiology of obesity,” Metabolism, vol. 92, pp. 6–10, 2019.
View at: Publisher Site | Google Scholar
N. Stefan, H. U. Häring, F. B. Hu, and M. B. Schulze, “Metabolically healthy obesity: epidemiology, mechanisms, and clinical implications,” Lancet Diabetes and Endocrinology, vol. 1, no. 2, pp. 152–162, 2013.
View at: Publisher Site | Google Scholar
C. M. Apovian, “Obesity: definition, comorbidities, causes, and burden,” American Journal of Managed Care, vol. 22, 7 Suppl, pp. S176–S185, 2016.
View at: Google Scholar
M. Ng, T. Fleming, M. Robinson et al., “Global, regional, and national prevalence of overweight and obesity in children and adults during 1980-2013: a systematic analysis for the Global Burden of Disease Study 2013,” Lancet, vol. 384, no. 9945, pp. 766–781, 2014.
View at: Publisher Site | Google Scholar
P. L. Schnall, M. Dobson, and P. Landsbergis, “Globalization, work, and cardiovascular disease,” International Journal of Health Services, vol. 46, no. 4, pp. 656–692, 2016.
View at: Publisher Site | Google Scholar
H. Thomas, J. Diamond, A. Vieco et al., “Global atlas of cardiovascular disease 2000-2016: the path to prevention and control,” Global Heart, vol. 13, no. 3, pp. 143–163, 2020.
View at: Publisher Site | Google Scholar
C. Andersson and R. S. Vasan, “Epidemiology of cardiovascular disease in young individuals,” Nature Reviews Cardiology, vol. 15, no. 4, pp. 230–240, 2018.
View at: Publisher Site | Google Scholar
J. Frostegard, “Immunity, atherosclerosis and cardiovascular disease,” BMC Medicine, vol. 11, no. 1, article 117, 2013.
View at: Publisher Site | Google Scholar
N. R. Madamanchi, A. Vendrov, and M. S. Runge, “Oxidative stress and vascular disease,” Arteriosclerosis, Thrombosis and Vascular Biology, vol. 25, no. 1, pp. 29–38, 2005.
View at: Publisher Site | Google Scholar
K. Cervantes Gracia, D. Llanas-Cornejo, and H. Husi, “CVD and oxidative stress,” Journal of Clinical Medicine, vol. 6, no. 2, p. 22, 2017.
View at: Publisher Site | Google Scholar
M. P. Murphy, “How mitochondria produce reactive oxygen species,” Biochemical Journal, vol. 417, no. 1, pp. 1–13, 2009.
View at: Publisher Site | Google Scholar
M. Wołonciej, E. Milewska, and W. Roszkowska-Jakimiec, “Trace elements as an activator of antioxidant enzymes,” Postępy Higieny i Medycyny Doświadczalnej, vol. 70, pp. 1483–1498, 2016.
View at: Publisher Site | Google Scholar
A. M. Kabel, “Free radicals and antioxidants: role of enzymes and nutrition,” Journal of Nutrition and Health, vol. 2, no. 3, pp. 35–38, 2014.
View at: Google Scholar
S. Biswal, H. Rizwan, S. Pal, S. Sabnam, P. Parida, and A. Pal, “Oxidative stress, antioxidant capacity, biomolecule damage, and inflammation symptoms of sickle cell disease in children,” Hematology, vol. 24, no. 1, pp. 1–9, 2019.
View at: Publisher Site | Google Scholar
F. Ito, Y. Sono, and T. Ito, “Measurement and clinical significance of lipid peroxidation as a biomarker of oxidative stress: oxidative stress in diabetes, atherosclerosis, and chronic inflammation,” Antioxidants, vol. 8, no. 3, p. 72, 2019.
View at: Publisher Site | Google Scholar
F. Pietrocola and J. M. Bravo-San Pedro, “Targeting autophagy to counteract obesity-associated oxidative stress,” Antioxidants, vol. 10, no. 1, p. 102, 2021.
View at: Publisher Site | Google Scholar
B. Choromańska, P. Myśliwiec, M. Łuba et al., “The impact of hypertension and metabolic syndrome on nitrosative stress and glutathione metabolism in patients with morbid obesity,” Oxidative Medicine and Cellular Longevity, vol. 2020, Article ID 1057570, 10 pages, 2020.
View at: Publisher Site | Google Scholar
T. Osadnik, K. Osadnik, N. Pawlas et al., “Metabolic and genetic profiling of young adults with and without a family history of premature coronary heart disease (MAGNETIC). Study design and methodology,” Archives of Medical Science, vol. 15, no. 3, pp. 590–597, 2019.
View at: Publisher Site | Google Scholar
S. Buscemi, P. Chiarello, C. Buscemi et al., “Characterization of metabolically healthy obese people and metabolically unhealthy normal-weight people in a general population cohort of the ABCD study,” Journal of Diabetes Research, vol. 2017, Article ID 9294038, 9 pages, 2017.
View at: Publisher Site | Google Scholar
M. C. Amato, C. Giordano, M. Galia et al., “Visceral adiposity index: a reliable indicator of visceral fat function associated with cardiometabolic risk,” Diabetes Care, vol. 33, no. 4, pp. 920–922, 2010.
View at: Publisher Site | Google Scholar
J. F. Koster, P. Biemond, and A. J. Swaak, “Intracellular and extracellular sulphydryl levels in rheumatoid arthritis,” Annals of the Rheumatic Diseases, vol. 45, no. 1, pp. 44–46, 1986.
View at: Publisher Site | Google Scholar
O. Erel, “A novel automated direct measurement method for total antioxidant capacity using a new generation, more stable ABTS radical cation,” Clinical Biochemistry, vol. 37, no. 4, pp. 277–285, 2004.
View at: Publisher Site | Google Scholar
O. Erel, “A new automated colorimetric method for measuring total oxidant status,” Clinical Biochemistry, vol. 38, no. 12, pp. 1103–1111, 2005.
View at: Publisher Site | Google Scholar
H. Ohkawa, N. Ohishi, and K. Yagi, “Assay for lipid peroxides in animal tissues by thiobarbituric acid reaction,” Analytical Biochemistry, vol. 95, no. 2, pp. 351–358, 1979.
View at: Publisher Site | Google Scholar
R. Richterich, Chemia Kliniczna: Teoria i Praktyka, PZWL, Warszawa, 1971.
E. Sődergren, J. Nourooz-Zadeh, L. Berglund, and B. Vessby, “Re-evaluation of the ferrous oxidation in xylenol orange assay for the measurement of plasma lipid hydroperoxides,” Journal of Biochemical and Biophysical Methods, vol. 37, no. 3, pp. 137–146, 1998.
View at: Publisher Site | Google Scholar
S. K. Jain, “In vivo externalization of phosphatidylserine and phosphatidylethanolamine in the membrane bilayer and hypercoagulability by the lipid peroxidation of erythrocytes in rats,” Journal of Clinical Investigation, vol. 76, no. 1, pp. 281–286, 1985.
View at: Publisher Site | Google Scholar
Y. Oyanagui, “Reevaluation of assay methods and establishment of kit for superoxide dismutase activity,” Analytical Biochemistry, vol. 142, no. 2, pp. 290–296, 1984.
View at: Publisher Site | Google Scholar
A. Tsatsoulis and S. A. Paschou, “Metabolically healthy obesity: criteria, epidemiology, controversies, and consequences,” Current Obesity Reports, vol. 9, no. 2, pp. 109–120, 2020.
View at: Publisher Site | Google Scholar
E. Brunelli, F. Domanico, D. La Russa, and D. Pellegrino, “Sex differences in oxidative stress biomarkers,” Current Drug Targets, vol. 15, no. 8, pp. 811–815, 2014.
View at: Publisher Site | Google Scholar
G. Block, M. Dietrich, E. P. Norkus et al., “Factors associated with oxidative stress in human populations,” American Journal of Epidemiology, vol. 156, no. 3, pp. 274–285, 2002.
View at: Publisher Site | Google Scholar
T. Ide, H. Tsutsui, N. Ohashi et al., “Greater oxidative stress in healthy young men compared with premenopausal women,” Thrombosis and Vascular Biology, vol. 22, no. 3, pp. 438–442, 2002.
View at: Publisher Site | Google Scholar
F. Nielsen, B. B. Mikkelsen, J. B. Nielsen, H. R. Andersen, and P. Grandjean, “Plasma malondialdehyde as biomarker for oxidative stress: reference interval and effects of life-style factors,” Clinical Chemistry, vol. 43, no. 7, pp. 1209–1214, 1997.
View at: Publisher Site | Google Scholar
M. Gol, B. Özkaya, C. Yildirim, and R. Bal, “Regular exercise, overweight/obesity and sedentary lifestyle cause adaptive changes in thiol-disulfide homeostasis,” Annals of the Brazilian Academy of Sciences, vol. 91, no. 2, article e20180547, 2019.
View at: Publisher Site | Google Scholar
E. M. Alissa, W. H. Ahmed, N. Al-ama, and G. A. A. Ferns, “Relationship between indices of iron status and coronary risk factors including diabetes and the metabolic syndrome in Saudi subjects without overt coronary disease,” Journal of Trace Elements in Medicine and Biology, vol. 21, no. 4, pp. 242–254, 2007.
View at: Publisher Site | Google Scholar
H. Sies, “Oxidative stress: oxidants and antioxidants,” Experimental Physiology, vol. 82, no. 2, pp. 291–295, 1997.
View at: Publisher Site | Google Scholar
J. W. Baynes, “Role of oxidative stress in development of complications in diabetes,” Diabetes, vol. 40, no. 4, pp. 405–412, 1991.
View at: Publisher Site | Google Scholar
J. W. Baynes and S. R. Thorpe, “Role of oxidative stress in diabetic complications: a new perspective on an old paradigm,” Diabetes, vol. 48, no. 1, pp. 1–9, 1999.
View at: Publisher Site | Google Scholar
J. É. M. MatÉs, C. Pérez-Gómez, and I. N. de Castro, “Antioxidant enzymes and human diseases,” Clinical Biochemistry, vol. 32, no. 8, pp. 595–603, 1999.
View at: Publisher Site | Google Scholar
A. Isogawa, M. Yamakado, M. Yano, and T. Shiba, “Serum superoxide dismutase activity correlates with the components of metabolic syndrome or carotid artery intima-media thickness,” Diabetes Research and Clinical Practice, vol. 86, no. 3, pp. 213–218, 2009.
View at: Publisher Site | Google Scholar
E. M. Yubero-Serrano, J. Delgado-Lista, P. Peña-Orihuela et al., “Oxidative stress is associated with the number of components of metabolic syndrome: LIPGENE study,” Experimental and Molecular Medicine, vol. 45, no. 6, p. e28, 2013.
View at: Publisher Site | Google Scholar
R. Farah, P. Gilbey, M. Grozovski, H. Asli, R. Khamisy-Farah, and N. Assy, “Antioxidant enzyme activity and cognition in obese individuals with or without metabolic risk factors,” Experimental and Clinical Endocrinology and Diabetes, vol. 124, no. 9, pp. 568–571, 2016.
View at: Publisher Site | Google Scholar
C. G. Fraga, P. I. Oteiza, and M. Galleano, “In vitro measurements and interpretation of total antioxidant capacity,” Biochimica et Biophysica Acta, vol. 1840, no. 2, pp. 931–934, 2014.
View at: Publisher Site | Google Scholar
A. Gawron-Skarbek, A. Guligowska, A. Prymont-Przymińska, D. Nowak, and T. Kostka, “Plasma and salivary non-urate total antioxidant capacity does not depend on dietary vitamin C, E, or β-carotene intake in older subjects,” Molecules, vol. 23, no. 4, p. 983, 2018.
View at: Publisher Site | Google Scholar
G. J. Nowicki, B. Ślusarska, A. Prystupa, M. Polak, M. Czubaj-Kowal, and E. Rudnicka-Drożak, “Oxidative/antioxidative status in patients after myocardial infarction and in those without cardiovascular event depending on anthropometric factors defining body weight,” International Journal of Environmental Research and Public Health, vol. 16, no. 21, p. 4077, 2019.
View at: Publisher Site | Google Scholar
E. Romuk, C. Wojciechowska, W. Jacheć et al., “Comparison of oxidative stress parameters in heart failure patients depending on ischaemic or nonischaemic aetiology,” Oxidative Medicine and Cellular Longevity, vol. 2019, Article ID 7156038, 13 pages, 2019.
View at: Publisher Site | Google Scholar
A. Zalewska, A. Kossakowska, K. Taranta-Janusz et al., “Dysfunction of salivary glands, disturbances in salivary antioxidants and increased oxidative damage in saliva of overweight and obese adolescents,” Journal of Clinical Medicine, vol. 9, no. 2, p. 548, 2020.
View at: Publisher Site | Google Scholar
P. Gać, M. Poręba, L. Januszewska et al., “The total antioxidant status, serum selenium concentrations and the ultrasound assessment carotid intima media thickness in patients with arterial hypertension,” Antioxidants, vol. 10, no. 1, p. 63, 2021.
View at: Publisher Site | Google Scholar
A. N. C. Simão, M. F. Lehmann, D. F. Alfieri et al., “Metabolic syndrome increases oxidative stress but does not influence disability and short-time outcome in acute ischemic stroke patients,” Metabolic Brain Disease, vol. 30, no. 6, pp. 1409–1416, 2015.
View at: Publisher Site | Google Scholar
N. Houstis, E. D. Rosen, and E. S. Lander, “Reactive oxygen species have a causal role in multiple forms of insulin resistance,” Nature, vol. 440, no. 7086, pp. 944–948, 2006.
View at: Publisher Site | Google Scholar
A. Fortuno, G. San Jose, M. U. Moreno, O. Beloqui, J. Diez, and G. Zalba, “Phagocytic NADPH oxidase overactivity underlies oxidative stress in metabolic syndrome,” Diabetes, vol. 55, no. 1, pp. 209–215, 2006.
View at: Publisher Site | Google Scholar
T. Jung, N. Bader, and T. Grune, “Lipofuscin: formation, distribution, and metabolic consequences,” Annals of the New York Academy of Sciences, vol. 1119, no. 1, pp. 97–111, 2007.
View at: Publisher Site | Google Scholar
R. Cazzola, M. Rondanelli, S. Russo-Volpe, E. Ferrari, and B. Cestaro, “Decreased membrane fluidity and altered susceptibility to peroxidation and lipid composition in overweight and obese female erythrocytes,” Journal of Lipid Research, vol. 45, no. 10, pp. 1846–1851, 2004.
View at: Publisher Site | Google Scholar
J. B. Echouffo-Tcheugui, M. I. Short, V. Xanthakis et al., “Natural history of obesity subphenotypes: dynamic changes over two decades and prognosis in the Framingham Heart Study,” Journal of Clinical Endocrinology and Metabolism, vol. 104, no. 3, pp. 738–752, 2019.
View at: Publisher Site | Google Scholar
R. Zheng, D. Zhou, and Y. Zhu, “The long-term prognosis of cardiovascular disease and all-cause mortality for metabolically healthy obesity: a systematic review and meta-analysis,” Journal of Epidemiology and Community Health, vol. 70, no. 10, pp. 1024–1031, 2016.
View at: Publisher Site | Google Scholar
J. A. Bell, M. Kivimaki, and M. Hamer, “Metabolically healthy obesity and risk of incident type 2 diabetes: a meta- analysis of prospective cohort studies,” Obesity Reviews, vol. 15, no. 6, pp. 504–515, 2014.
View at: Publisher Site | Google Scholar
J. Arnlöv, E. Ingelsson, J. Sundström, and L. Lind, “Impact of body mass index and the metabolic syndrome on the risk of cardiovascular disease and death in middle-aged men,” Circulation, vol. 121, no. 2, pp. 230–236, 2010.
View at: Publisher Site | Google Scholar
H. A. Hassan and N. E. El-Gharib, “Obesity and clinical riskiness relationship: therapeutic management by dietary antioxidant supplementation – a review,” Applied Biochemistry and Biotechnology, vol. 176, no. 3, pp. 647–669, 2015.
View at: Publisher Site | Google Scholar
A. Kuryłowicz, “The role of isoflavones in type 2 diabetes prevention and treatment – a narrative review,” International Journal of Molecular Sciences, vol. 22, no. 1, p. 218, 2021.
View at: Publisher Site | Google Scholar
A. Kuryłowicz, M. Cąkała-Jakimowicz, and M. Puzianowska-Kuźnicka, “Targeting abdominal obesity and its complications with dietary phytoestrogens,” Nutrients, vol. 12, no. 2, p. 582, 2020.
View at: Publisher Site | Google Scholar
J. Suliburska, P. Bogdanski, M. Szulinska, M. Stepien, D. Pupek-Musialik, and A. Jablecka, “Effects of green tea supplementation on elements, total antioxidants, lipids, and glucose values in the serum of obese patients,” Biological Trace Element Research, vol. 149, no. 3, pp. 315–322, 2012.
View at: Publisher Site | Google Scholar
S. Moradi, R. Ziaei, S. Foshati, H. Mohammadi, S. M. Nachvak, and M. H. Rouhani, “Effects of Spirulina supplementation on obesity: A systematic review and meta- analysis of randomized clinical trials,” Complementary Therapies in Medicine, vol. 47, article 102211, 2019.
View at: Publisher Site | Google Scholar
J. Rahmani, E. Bazmi, C. Clark, and S. S. Hashemi Nazari, “The effect of saffron supplementation on waist circumference, HA1C, and glucose metabolism: a systematic review and meta-analysis of randomized clinical trials,” Complementary Therapies in Medicine, vol. 49, article 102298, 2020.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2021 Grzegorz K. Jakubiak et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

2258

Downloads

1299

Citations