Research Article | Open Access
Oxidative Stress and Effect of Treatment on the Oxidation Product Decomposition Processes in IBD
Oxidative stress plays an important role in IBD because chronic intestinal inflammation is associated with the overproduction of reactive oxygen species (ROS) leading to oxidative stress, which has been implicated in IBD. Many lines of evidence suggest that IBD is associated with an imbalance between ROS and antioxidant activity which generates oxidative stress as the result of either ROS overproduction or a decrease in antioxidant activity. Our study was to evaluate the influence of oxidative stress and antioxidants on the course of the disease and treatment of IBD patients. Our results show that an increase of LOOH levels positively correlates with an increase in MDA levels; therefore, MDA may be a marker indicating lipid peroxidation. Also, being the decomposition product of oxidation processes, MDA may be applied as a useful biomarker for identifying the effect of endogenous oxidative stress in Crohn’s disease patients. The anti-inflammatory efficacy of AZA drugs may be the result of a reduction of the amount of lipid peroxides in the intestinal mucosa cells in CD patients and facilitate mucosal healing.
Inflammatory bowel diseases (IBDs) mainly include Crohn’s disease (CD) and ulcerative colitis (UC). Both conditions constitute a chronic and relapsing disorder of the gastrointestinal tract (GI), associated with an exacerbated intestinal immune response to harmless stimulus, leading to an upregulation of proinflammatory mediators, which may trigger the onset and perpetuation of IBD [1–3]. Despite some overlapping clinical features, these diseases are defined by separate inflammatory profiles, gut microbiota composition, and symptomatology. CD affects any portion of the alimentary tract and is defined by a discontinuous and ulcerous transmural inflammation, associated with intestinal granulomas, obstructions, abscesses, strictures, and fistulas. In UC, inflammation involves only the superficial layers of the intestinal mucosa and is localized to regions of the gut most highly colonized by bacteria, specifically at the rectum and moving proximally along the large bowel . The accumulation of ROS could cause damage to specific genes involved in cell growth or differentiation and could cause changes in antioxidant enzyme levels. Oxidative stress in IBD patients with increased ROS levels and decreased antioxidant levels in the inflamed mucosa, could ultimately contribute to chronic tissue damage . ROS is the mediator responsible for the intracellular damage of lipids, proteins, carbohydrates, and nucleic acids and are highly reactive due to their unstable conditions with unpaired electrons [6, 7]. RON causes intestinal tissue lipid peroxidation and, consequently, disruption of intercellular junctions, as well as leukocyte and neutrophil infiltration that produces ROS, and cytokines that lead to the inflammatory process . Moreover, ROS upregulates the expression of genes involved in adaptive and innate immune responses in the GI tract . Increased ROS, which is produced through the oxidative stress associated with the inflammatory process in cells, may lead to severe damage to macromolecules .
Once initiated by any of several pathways, lipid peroxidation, the oxidative damage of membrane lipids, spreads aggressively in a self-propagating chain reaction and intensifies oxidative damage. Lipid peroxides adversely change membrane structure and function and generate highly reactive toxic secondary products that react with DNA and proteins, compromising normal activity . Defense mechanisms minimize the toxic effects of these compounds but in some cases are insufficient and lead to initiation and progression of many diseases such as IBD . Among the antioxidant enzymes, the catalyzed superoxide dismutase (SOD) is a mutation of O2 to H2O2 and molecular oxygen, while the decomposition of H2O2 to nontoxic compounds is the main function of catalase (CAT), peroxiredoxins, and glutathione peroxidase (GPx) . The functioning of the antioxidant system plays an important role in elements such as zinc, which plays a pivotal role in wound repair, tissue regeneration, and the immune response . Zinc excess induces copper deficiency, which has been related to multiple adverse effects, such as decreased expression of copper-dependent enzymes (e.g., superoxide dismutase and ceruloplasmin), which are important in antioxidant defense . Although the role of oxidative stress and antioxidants in IBD has been evaluated, their role in the pathogenesis of IBD is not well understood.
The present study was undertaken mainly to evaluate the influence of oxidative stress and antioxidants on the course of the disease and on the treatment of IBD patients.
2. Material and Methods
A combined group of 90 individuals took part in the study, including 40 IBD patients and 50 healthy individuals. The study was carried out in the years 2014–2016 among patients of the gastroenterology ward and gastroenterology clinic of the Cardinal Stefan Wyszyński Regional Specialist Hospital in Lublin. A group of 20 individuals, comprised patients diagnosed with Crohn’s disease (CD), K50 according to the ICD-10 criteria. The age range in this group was 19–52 years, and the mean age was 33. A group of 20 individuals comprised patients diagnosed with ulcerative colitis, K51 according to the ICD-10 classification (UC). The age range in this group was 21–78 years, with a mean age of 37 years 6 months. The control consisted of 50 healthy volunteers (controls). This group was aged 19–67, with a mean age of 40 years. The material for the study consisted of plasma isolated from peripheral blood collected from the 40 IBD patients and the 50 healthy individuals (blood was collected once).
Concentrations of lipid hydroperoxides (LOOH) and malondialdehyde (MDA) were determined using kits produced by Cell Biolabs Inc., San Diego, USA. A diagnostic kit manufactured by Oxis International Inc., Portland, USA, was used to determine the activity of superoxide dismutase (SOD) and catalase (CAT). In blood plasma, the activity of ceruloplasmin (Cp) was determined using the Ceruloplasmin ELISA kit (Biomatik, Delaware, USA) and total glutathione was determined (GSH + GSSG) using the Total Glutathione Assay (Cell Biolabs Inc., San Diego, USA). The content of Cu and Zn in the samples of blood was determined by inductively coupled plasma optical emission spectrometry (ICP-OES).
Table 1shows the results of Cu, Zn, Na, CAT, GSH + GSSG, MDA, LOOH, and Cp levels among CD and UC patients and control individuals, which we compare against Table 2 showing the results of the correlation of age, duration, CRP, WBC, RBC Cu, Zn, Na, CAT, GSH + GSSG, MDA, LOOH, and Cp among CD and UC patients and control individuals (Pearson correlation coefficient).
The mean values of LOOH concentrations (μmol/l) in the plasma of patients with CD (18.52 ± 10.99 μmol/l) and UC (18.06 ± 8 μmol/l) is significantly lower () compared to that of the control group of healthy people (51.08 ± 20.58 μmol/l) (Figure 1).
It was shown that the mean LOOH concentration (μmol/l) in women with UC (14.61 ± 4.94 μmol/l) is significantly lower () in comparison to that in men with UC (20.12 ± 5.71 μmol/l) (Figure 2). In patients with CD, no significant difference in LOOH concentration between the sexes was found (Figure 2).
It has been shown that in patients taking Imuran in CD, the mean LOOH (9.91 ± 4.11 mmol/l) is significantly lower () compared to that in CD patients not taking this drug (18.62 ± 6.69) (Figure 3).
Figure 4 shows the positive correlation of LOOH concentration (μmol/l) with leukocyte level ( ) in patients with UC.
Patients with CD showed a positive correlation of LOOH concentration with age (, ) (Figure 5).
Patients with CD showed a positive correlation between LOOH concentration and MDA concentration (, ) (Figure 6).
The gastrointestinal tract is a major site for the generation of prooxidants, whose production is primarily due to the presence of a variety of microbes, food ingredients, and interactions between immune cells. To eliminate ROS, intestinal cells have several enzymatic and nonenzymatic antioxidants, including SOD, GSH, and CAT, but excessive generation of ROS enhances LP and could deplete antioxidant defenses . The susceptibility of a given organ to oxidative stress depends on its antioxidant defense status, and a general balance between oxidants and antioxidants is required to maintain cellular homeostasis .
Several lines of evidence suggest that regarding trace elements with antioxidant functions, reduced plasma, selenium, and zinc levels were reported in IBD patients as compared to that in healthy controls . Other lines of evidence indicate that copper concentrations did not differ between patients with IBD and controls . This may suggest different antioxidative mechanisms in patients with IBD.
Our studies have shown that levels of antioxidants such as Zn, Cu, SOD, CAT, GSH + GSSG, and Cp in IBD patients as compared to that in healthy controls do not show significant differences (Table 1). Discrepancies concerning the plasma activity of the enzymes may result from applied treatment derivatives of 5-ASA, sulfasalazine, and mesalazine. Previous investigations reported that sulfasalazine decreased ROS concentration. It has been pointed out that inflammation has been extensively associated with an increase in oxidative stress; the protection afforded by 5-ASA could be related to their well-known antioxidant properties . It was shown that UC patients who were taking 5-ASA, besides having the lowest number of flares per year of follow-up, also exhibited the lowest level of DNA damage. Moreover, the value found was even lower than the DNA damage found in controls, and this could be attributed to the antioxidant and free radical scavenging action of 5-ASA . In the UC process, the antioxidant capacity of the damaged mucosa is compromised. Therefore, the use of nontraditional therapy that eliminates ROS, inhibits cell damage, and improves the activity of antioxidant enzymes, can be beneficial, either associated or not with anti-inflammatory medicines . Significantly lower LOOH in women than in men may suggest that women take more antioxidants compared to men. This is in agreement with our report where we showed that women with CD showed a significantly higher level of Zn (μmol/l) () and Cu (μmol/l) () in comparison with men with CD (Table 1). Balmus et al.  noted that an excess of lipid peroxidation is probably an important pathogenetic factor in IBDs. We, in turn demonstrated that the levels of plasma LOOH were diminished in IBD patients regardless of disease type as compared to that in healthy controls (Figure 1). Our results suggest that the effect of the treatment applied has an impact on reducing lipid peroxidation and reduction of LOOH.
In this study, the measurement of lipid peroxidation showed a decrease in the level of LOOH markers in UC and CD patients taking Imuran compared to the patients not taking this drug (Figure 3). Azathioprine (AZA) is an immune response modifier drug used in patients with reduced 5-aminosalicylate response. AZA is a prodrug that is converted into the body to 6-mercaptopurine, an active metabolite effective for inflammatory bowel disease . AZA induces apoptosis in activated lymphocytes and these effects should be crucial in determining the efficacy of these medications as immunomodulators in patients with IBD . AZA is a purine analog inhibiting the synthesis of purine nucleotide and is frequently associated with a number of adverse effects; for this reason, it is has been discontinued . These adverse effects include pancreatitis, fever, rash, malaise, nausea, diarrhea, hepatitis, leukopenia, and some forms of hepatitis .
The study of Sood et al.  has been shown that AZA is an established treatment for UC patients. The authors studied the effectiveness of AZA in a large cohort of UC (225) patients, of whom 154 achieved sustained clinical benefit. This shows that AZA is a safe and effective therapy in UC patients who fail 5-aminosalicylates.
In a review study by Axelrad et al. , the authors concluded that AZA is more effective than placebo for the maintenance of remission in CD and there are several randomized controlled studies regarding the efficacy of thiopurines in inducing remission in CD. Therefore, AZA is widely used in the treatment of IBD. This drug can induce and maintain remission with a response rate of 55% to 70% . AZA is an efficient anti-inflammatory drug that decreases infiltration of inflammatory cells into the ileal mucosa in CD patients and facilitates mucosal healing . Our research may suggest that AZA may have an impact on the decrease of lipid peroxides responsible for many of the damaging reactions in the cell membranes. Moreover in our study, we have demonstrated that LOOH (μmol/l) correlates positively with age (Figure 5).
The peroxidation of lipids can result in damage to the cell membrane due to the high concentration of lipids present. The end products of lipid peroxidation can be both mutagenic and carcinogenic and can play a role in aging and disease progression . There is a growing amount of experimental evidence proving the free radical theory of aging. The formation of reactive oxygen species increases with age, ultimately resulting in damage to cells and their components such as proteins, lipids, and DNA .
A major hallmark of aging, and a key driver for the onset of age-related pathophysiologies is the disruption of cellular redox homeostatic mechanisms that protect against environmental factors, such as oxidative, pathological, and toxicological insults . During aging, weakened antioxidant defenses allow the accumulation of toxic reactive oxygen species that contribute to aging and to the onset of multiple diseases .
In studies concerning effect of exercise-induced oxidative stress on health and aging, it was shown that lipid peroxidation increased significantly with age and submaximal effort . Also, researchers Chen et al.  emphasize that lipid peroxides are generated by oxidative stress in cells and contribute to ageing. Furthermore, our studies have shown a positive correlation between LOOH and the level of leukocytes in UC patients (Figure 5).
Research stressed that infiltration of the mucosa by T cells and the increased production of proinflammatory T cell cytokines are a hallmark of IBD . Bisping et al.  showed that intestinal epithelial cells (iEC) play a key role in the initiation and perpetuation of intestinal inflammation, and T cell/monocyte interactions influence epithelial physiology in states of inflammation. Research shows that T cells and T cell-derived cytokines induce and regulate mucosal immune response stimulation of epithelial proliferation and modulation of epithelial secretory activities. It was also demonstrated that iEC influences T lymphocytes as they downregulate intraepithelial lymphocytes. In CD and UC, many immunoregulatory abnormalities in intestinal and peripheral T lymphocytes are noted, for example, the altered ratio of proinflammatory to immunosuppressive cytokines or the selective activation of T-helper lymphocyte subsets and abnormalities in epithelial antigen presentation.
Additionally in studies on colonic biopsies, Balmus et al. showed that oxidative stress could be correlated to disease activity and the main sites of ROS production are phagocytic leukocytes during their massive infiltration of the intestinal mucosa in inflammation . C-reactive protein (CRP) is a valuable marker to detect and follow-up disease activity in CD. UC has only a modest to absent CRP response despite active inflammation, and the reason for this is unknown [29, 30]. Our data showed that LOOH is negatively correlated with CRP in CD patients (Table 2).
In their studies, Pinto et al.  described a decreased plasmatic and erythrocyte glutathione peroxidase (GPx) activity in remission with a subsequent increase in active inflammation. This modulation suggests a compensatory role of GPx in the oxidative stress caused by active bowel inflammation in CD. These studies indicate the defense of the cell against inflammation by the growth of antioxidants. That is why negative correlation between LOOH and CRP may suggest cell defense against apoptosis. In the present study, it has been shown that elevated plasma lipid peroxide products are associated with elevated malondialdehyde (MDA) levels in CD patients (Figure 5). Lipid peroxidation was documented by higher plasma MDA concentrations in CD patients .
In this research, increased levels of lipid peroxides which are secreted into the blood circulation from the gut of CD patients to produce systemic effects have been pointed out. MDA was significantly increased during both active and inactive phases, though the second group tended to harbour lower levels . The decomposition products of lipid peroxidation, such as MDA, can affect membrane proteins by cross-linkage, rendering them useless as receptors or enzymes. Lipid peroxide can lead to cellular dysfunction and may result in the deaths of the affected cells . MDA is the final result of lipoperoxidation and is used as a marker of lipid peroxidation. It was estimated to indicate peroxide damage to membranes caused by inflammation. MDA levels in ileal segments from the colitic rats were higher as compared to those in the control rats . Our results show that the increase of LOOH positively correlates with MDA, therefore MDA may be a marker indicating lipid peroxidation.
We arrive at the following conclusions: (1)The decomposition products of oxidation processes, MDA, may be applied as a useful biomarker for identifying the effect of endogenous oxidative stress in Crohn’s disease patients.(2)The anti-inflammatory efficacy of AZA drugs may be the result of a reduction in the amount of lipid peroxides into the intestinal mucosa cells in CD patients and facilitate mucosal healing.
The data used to support the findings of this study are included within the article.
Conflicts of Interest
The authors declare that there is no conflict of interest regarding the publication of this paper.
- S. R. Pereira, R. Pereira, I. Figueiredo, V. Freitas, T. C. P. Dinis, and L. M. Almeida, “Comparison of anti-inflammatory activities of an anthocyanin-rich fraction from Portuguese blueberries (Vaccinium corymbosum L.) and 5-aminosalicylic acid in a TNBS-induced colitis rat model,” PLoS One, vol. 12, no. 3, article e0174116, 2017.
- E. Dudzińska, M. Gryzińska, K. Ognik, M. Krauze, and P. Listos, “Non-specific inflammatory bowel disease and the risk of tumour growth,” Medycyna Weterynaryjna, vol. 74, no. 1, pp. 228–232, 2018.
- T. Vezza, A. Rodríguez-Nogales, F. Algieri, M. P. Utrilla, M. E. Rodriguez-Cabezas, and J. Galvez, “Flavonoids in inflammatory bowel disease: a review,” Nutrients, vol. 8, no. 4, p. 211, 2016.
- L. Abdel Hadi, C. Di Vito, and L. Riboni, “Fostering inflammatory bowel disease: sphingolipid strategies to join forces,” Mediators of Inflammation, vol. 2016, Article ID 3827684, 13 pages, 2016.
- S. V. Rana, S. Sharma, K. K. Prasad, S. K. Sinha, and K. Singh, “Role of oxidative stress & antioxidant defence in ulcerative colitis patients from north India,” The Indian Journal of Medical Research, vol. 139, no. 4, pp. 568–571, 2014.
- A. Esmaelzadeh, H. Vosooghinia, M. Reza Sheikhian et al., “Pro-oxidant antioxidant balance in inflammatory bowel disease,” International Journal of Clinical Medicine, vol. 7, no. 5, pp. 334–341, 2016.
- T. Tian, Z. Wang, and J. Zhang, “Pathomechanisms of oxidative stress in inflammatory bowel. Disease and potential antioxidant therapies,” Oxidative Medicine and Cellular Longevity, vol. 2017, Article ID 4535194, 18 pages, 2017.
- F. A. Moura, K. Q. de Andrade, J. C. F. dos Santos, O. R. P. Araújo, and M. O. F. Goulart, “Antioxidant therapy for treatment of inflammatory bowel disease: does it work?” Redox Biology, vol. 6, pp. 617–639, 2015.
- X. Chen, H. Hall, J. P. Simpson, W. D. Leon-Salas, D. F. Ready, and V. M. Weake, “Cytochrome b5 protects photoreceptors from light stress-induced lipid peroxidation and retinal degeneration,” NPJ Aging and Mechanisms of Disease, vol. 3, no. 1, p. 18, 2017.
- D. Bouzid, B. Gargouri, R. B. Mansour et al., “Oxidative stress markers in intestinal mucosa of Tunisian inflammatory bowel disease patients,” Saudi Journal of Gastroenterology, vol. 19, no. 3, pp. 131–135, 2013.
- S. Siva, D. T. Rubin, G. Gulotta, K. Wroblewski, and J. Pekow, “Zinc deficiency is associated with poor clinical outcomes in patients with inflammatory bowel disease,” Inflammatory Bowel Diseases, vol. 23, no. 1, pp. 152–157, 2017.
- D. D. Marreiro, K. J. Cruz, J. B. Morais, J. B. Beserra, J. S. Severo, and A. R. de Oliveira, “Zinc and oxidative stress: current mechanisms,” Antioxidants, vol. 6, no. 2, p. 24, 2017.
- S. Hengstermann, L. Valentini, L. Schaper et al., “Altered status of antioxidant vitamins and fatty acids in patients with inactive inflammatory bowel disease,” Clinical Nutrition, vol. 27, no. 4, pp. 571–578, 2008.
- E. Mohammadi, D. Qujeq, H. Taheri, and K. Hajian-Tilaki, “Evaluation of serum trace element levels and superoxide dismutase activity in patients with inflammatory bowel disease: translating basic research into clinical application,” Biological Trace Element Research, vol. 177, no. 2, pp. 235–240, 2017.
- A. Piechota-Polanczyk and J. Fichna, “Review article: the role of oxidative stress in pathogenesis and treatment of inflammatory bowel diseases,” Naunyn-Schmiedeberg’s Archives of Pharmacology, vol. 387, no. 7, pp. 605–620, 2014.
- C. Pereira, R. Coelho, D. Grácio et al., “DNA damage and oxidative DNA damage in inflammatory bowel disease,” Journal of Crohn’s & Colitis, vol. 10, no. 11, pp. 1316–1323, 2016.
- I. M. Balmus, A. Ciobica, A. Trifan, and C. Stanciu, “The implications of oxidative stress and antioxidant therapies in inflammatory bowel disease: clinical aspects and animal models,” Saudi Journal of Gastroenterology, vol. 22, no. 1, pp. 3–17, 2016.
- R. C. Schwanke, R. Marcon, A. F. Bento, and J. B. Calixto, “EPA- and DHA-derived resolvins’ actions in inflammatory bowel disease,” European Journal of Pharmacology, vol. 785, pp. 156–164, 2016.
- G. Stocco, M. Pelin, R. Franca et al., “Pharmacogenetics of azathioprine in inflammatory bowel disease: a role for glutathione-S-transferase?” World Journal of Gastroenterology, vol. 20, no. 13, pp. 3534–3541, 2014.
- J. Yeo, H. S. Woo, S. M. Lee et al., “Drug-induced eosinophilic pneumonia in a patient with Crohn’s disease: diagnosis and treatment using fraction of exhaled nitric oxide,” Intestinal Research, vol. 15, no. 4, pp. 529–534, 2017.
- R. Sood, S. Ansari, T. Clark, P. J. Hamlin, and A. C. Ford, “Long-term efficacy and safety of azathioprine in ulcerative colitis,” Journal of Crohn’s & Colitis, vol. 9, no. 2, pp. 191–197, 2015.
- J. E. Axelrad, A. Roy, G. Lawlor, B. Korelitz, and S. Lichtiger, “Thiopurines and inflammatory bowel disease: current evidence and a historical perspective,” World Journal of Gastroenterology, vol. 22, no. 46, pp. 10103–10117, 2016.
- K. D. Jacob, N. Noren Hooten, A. R. Trzeciak, and M. K. Evans, “Markers of oxidant stress that are clinically relevant in aging and age-related disease,” Mechanisms of Ageing and Development, vol. 134, no. 3-4, pp. 139–157, 2013.
- D. Pastori, P. Pignatelli, A. Farcomeni et al., “Aging-related decline of glutathione peroxidase 3 and risk of cardiovascular events in patients with atrial fibrillation,” Journal of the American Heart Association, vol. 5, no. 9, article e003682, 2016.
- N. O. Thomas, K. P. Shay, A. R. Kelley, J. A. Butler, and T. M. Hagen, “Glutathione maintenance mitigates age-related susceptibility to redox cycling agents,” Redox Biology, vol. 10, pp. 45–52, 2016.
- Y. Barranco-Ruiz, A. Martínez-Amat, C. Casals et al., “A lifelong competitive training practice attenuates age-related lipid peroxidation,” Journal of Physiology and Biochemistry, vol. 73, no. 1, pp. 37–48, 2017.
- S. Zundler and M. F. Neurath, “Immunopathogenesis of inflammatory bowel diseases: functional role of T cells and T cell homing,” Clinical and Experimental Rheumatology, vol. 33, Supplement 92, no. 4, pp. S19–S28, 2015.
- G. Bisping, N. Lügering, S. Lütke-Brintrup et al., “Patients with inflammatory bowel disease (IBD) reveal increased induction capacity of intracellular interferon-gamma (IFN-γ) in peripheral CD8+ lymphocytes co-cultured with intestinal epithelial cells,” Clinical and Experimental Immunology, vol. 123, no. 1, pp. 15–22, 2001.
- S. Vermeire, G. Van Assche, and P. Rutgeerts, “C-reactive protein as a marker for inflammatory bowel disease,” Inflammatory Bowel Diseases, vol. 10, no. 5, pp. 661–665, 2004.
- M. A. S. Pinto, M. S.-M. S. Lopes, S. T. O. Bastos et al., “Does active Crohn’s disease have decreased intestinal antioxidant capacity?” Journal of Crohn’s & Colitis, vol. 7, no. 9, pp. e358–e366, 2013.
- A. P. Agouridis, M. Elisaf, and H. J. Milionis, “An overview of lipid abnormalities in patients with inflammatory bowel disease,” Annals of Gastroenterology, vol. 24, no. 3, pp. 181–187, 2011.
- I. Moret-Tatay, M. Iborra, E. Cerrillo, L. Tortosa, P. Nos, and B. Beltrán, “Possible biomarkers in blood for Crohn’s disease: oxidative stress and microRNAs—current evidences and further aspects to unravel,” Oxidative Medicine and Cellular Longevity, vol. 2016, Article ID 2325162, 9 pages, 2016.
- M. A. Alzoghaibi, “Concepts of oxidative stress and antioxidant defense in Crohn’s disease,” World Journal of Gastroenterology, vol. 19, no. 39, pp. 6540–6547, 2013.
- A. M. Bou-Fersen, J. T. Anim, and I. Khan, “Experimental colitis is associated with ultrastructural changes in inflamed and uninflamed regions of the gastrointestinal tract,” Medical Principles and Practice, vol. 17, no. 3, pp. 190–196, 2008.
Copyright © 2018 Ewa Dudzińska et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.