Serum Metabolites as Potential Biomarkers for Diagnosis of Knee Osteoarthritis

Zhang, Qingmeng; Li, Heng; Zhang, Zhendong; Yang, Fan; Chen, Jiying

doi:https://doi.org/10.1155/2015/684794

Disease Markers

On this page

Abstract Introduction Materials and Methods Results Discussion Conclusions Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2015 | Article ID 684794 | https://doi.org/10.1155/2015/684794

Serum Metabolites as Potential Biomarkers for Diagnosis of Knee Osteoarthritis

Qingmeng Zhang,¹Heng Li,¹Zhendong Zhang,¹Fan Yang,¹and Jiying Chen¹

Academic Editor: Markus Herrmann

Received25 Dec 2014

Revised08 Feb 2015

Accepted12 Feb 2015

Published16 Mar 2015

Abstract

Knee osteoarthritis (OA) is a highly prevalent chronic degenerative joint disease that mainly affects the elderly population. The aim of this study was to investigate serum signature metabolites as potential biomarkers for early diagnosis of knee OA. Global serum metabolic profiles of 40 patients with knee OA and 20 healthy controls (HC) were analyzed by ultra-performance liquid chromatography coupled to mass spectrometry. An OA-specific metabolic profile was established that can clearly discriminate patients with OA from HCs. Fourteen metabolites that are involved in the metabolism of amino acids, purine, energy, glycolysis, fatty acids, and lipids were significantly altered in patients with OA compared to HCs. These metabolites could be potentially used as biomarkers for the diagnosis of knee OA.

1. Introduction

Osteoarthritis (OA) is a highly prevalent chronic degenerative joint disease that is characterized by the progressive destruction of articular cartilage. Compared to that affecting other joints, OA of the knee is most likely to cause functional impairment, which not only contributes to reduced quality of life but also is the leading cause of joint replacement in the elderly population [1]. The reported overall incidence of knee OA is about 40% in elderly persons aged over 65 years [2]; however, this percentage is based on current diagnostic criteria that mainly rely on radiographic evaluations and clinical manifestations including pain symptoms and stiffness in the affected joints. Indeed, OA could be a silent disease for many years before the typical symptoms and radiographic changes emerge, and during this long-term subclinical stage, damage to articular cartilage may have occurred and become irreversible [3]. Thus, development of novel diagnostic markers that can reflect the destruction of articular cartilage in real time is an attractive option for early diagnosis and better treatment of OA.

Metabolomics, a recently applied approach in systems biology, focuses on the holistic investigation of endogenous metabolic responses of complex living systems and has been used in studies of both physiological and pathological conditions [4]. Disease-specific metabolic profiles have proven to be a useful marker for early diagnosis of various disorders including OA [5–8], and since metabolic perturbations occur in real time, alternations of signature metabolites could also be used in the surveillance of disease progression.

In the present study, we applied ultra-performance liquid chromatography coupled to mass spectrometry (UPLC-MS) to compare the serum metabolic profiles between patients with knee OA and healthy controls (HC). Our ultimate goal was to identify signature serum metabolites of knee OA that could be used as biomarkers for the diagnosis of OA.

2. Materials and Methods

The present study met the requirements of the 1975 Declaration of Helsinki and was approved by the institutional review board of the General Hospital of Chinese Army. Written informed consent was obtained from each patient included in the study.

2.1. Study Population

A total of 40 patients with knee OA were recruited from outpatients of our department between July 2012 and July 2013. The diagnosis of OA was based on self-reported joint pain and stiffness and radiographic evidence of structural damage (joint space narrowing with or without the presence of osteophytes) of the affected joint [9]. The exclusion criteria were the following: (1) patients with a history of other known joint disorders (e.g., trauma, autoimmunity, and bone tumors); (2) patients with a history of other known chronic disorders that could possibly influence the metabolic profiles, including metabolic syndromes, diabetes, history of corticosteroid medication, cancer, infectious diseases, and autoimmune diseases.

The Kellgren and Lawrence grade (K-L grade) of each patient was given by a radiologist and an orthopedist as the following: grade 0, no radiological changes; grade I, doubtful narrowing of joint space and possible osteophytic lipping; grade II, definite osteophytes and possible narrowing of joint space; grade III, moderate multiple osteophytes, definite narrowing of joint space, some sclerosis and possible deformity of bone contour; grade 4, large osteophytes, marked narrowing of joint space, severe sclerosis, and definite deformity of bone contour [10]. To discriminate metabolic alterations of OA at different stages, OA patients were divided into a mild group (K-L grade II or III) and a severe group (KL grade IV). The K-L grade used for analysis was the higher one in patients in which both knees were affected.

Patients with mild OA () were all newly diagnosed and treatment naïve. Their serum samples were collected right after the diagnosis. Patients with severe OA () were selected from those who came to our department for surgery. Their OA was diagnosed elsewhere before, but we strictly required them not to have corticosteroid or nonsteroidal anti-inflammatory drugs (NSAIDs) for at least a month before the sample collection. Twenty age- and gender-matched healthy individuals with an absence of the exclusion criteria were recruited during their routine annual medical examination in our hospital. The control individuals were given physical and radiographic exams to exclude OA after the enrollment. Serum samples were collected in all subjects before breakfast without fasting for more than 12 hours and were stored at −80°C until used.

2.2. Chemicals and Reagents

Methanol and acetonitrile were purchased from Merck (Darmstadt, Germany). Formic acid was obtained from Fluka (Buchs, Switzerland). Ultrapure water was prepared using a Milli-Q water purification system (Millipore Corp., Bedford, US). The remaining chemicals were of analytical grade.

2.3. Sample Preparation

Prior to the analysis, every 100 L of serum was mixed with 300 μL of acetonitrile to precipitate the protein. The solution was centrifuged at 13,000 RPM for 15 min at 4°C, and the clear supernatant was then transferred into a vial for UPLC-MS analysis.

2.4. UPLC-MS Analysis

The UPLC-MS analysis used a nontargeted method as described by Qi et al. [11] on an Agilent 1290 Infinity LC system equipped with an Agilent 6520 Accurate-Mass Quadrupole Time of Flight mass spectrometer (Agilent Technologies, Palo Alto, CA, USA). The ultimate goal of a nontargeted metabolomics analysis is to detect metabolites that are significantly increased or decreased during a pathological condition. The method is not quantitative because the significantly altered metabolites can only be identified after the analysis, but quantification of a certain metabolite requires having its high-quality standard substances prepared before analysis and assayed simultaneously with the samples. Chromatographic separations were performed at 35°C on an ACQUITY UPLC HSS T3 column (2.1 × 100 mm, 1.8 μm; Waters, Milford, MA, USA). The mobile phase consisted of 0.1% (volume v/v) formic acid (solvent A) and acetonitrile modified with 0.1% formic acid (solvent B). The optimized elution started from 2% B at 0–3 min and increased to 95% B at 3–16 min, which was maintained for 3 min, followed by an equilibrating step of 5 min. The flow rate was set to 0.35 mL/min, and the injection volume was 3 μL. The autosampler was maintained at 4°C.

An electrospray ionization source was used in the positive mode. The optimized conditions were as follows: capillary voltage, 4 KV for positive mode; drying gas flow, 10 L/min; gas temperature, 350°C; nebulizer pressure, 40 psig; fragmentor voltage, 120 V; skimmer voltage, 60 V. Data were collected in the centroid mode from 100 to 1,100 m/z. Potential biomarkers were further analyzed by MS/MS; the collision energy was set at 10–50 eV.

2.5. Data Processing and Statistical Analysis

Raw data from the UPLC-MS were converted to common data format (.mzdata) files using the Agilent Mass Hunter Qualitative software, with the threshold set to 0.1% to exclude isotope interference. The XCMS program (http://metlin.scripps.edu/download/) was used for peak extraction, alignment, and integration in a visual matrix. All detected ions in each sample were normalized to the sum of the peak area to obtain the relative intensity of metabolites. After mean-centering and Pareto scaling, the three-dimensional data matrix, including sample names, retention time, and m/z pairs, and normalized ion intensities were imported into the SIMCA-P 12.0 software package (Umetrics, Umea, Sweden) for multivariate analysis. Parameters including , , , and permutation tests were analyzed to evaluate the quality of the models. and represent the fraction of the original and data matrixes used to build PLS-DA model and provide an estimation of how well the model fits the and data, respectively. represents the predictive accuracy of the model. Higher and indicate that more original data are represented. Higher suggests better predictive ability of the model.

Quantitative clinical data were expressed as mean ± standard deviation (SD) and were compared between groups by Student’s -test. The relative intensity of each detectable UPLC-MS peak was normalized into a value of 0-1 and was then imported into the SPSS (version 20.0, SPSS Inc., Chicago, IL, US) for the statistical analysis. One-way analysis of variance (ANOVA) with Tukey’s post hoc tests was carried out for the comparison between groups. A two-tailed value of 0.05 or less was considered statistically significant. The Kyoto Encyclopedia of Genes and Genomes (KEGG) PATHWAY database (http://www.genome.jp/kegg/) was used to construct the key pathway of different metabolites.

3. Results

3.1. Clinical Parameters of Participants

Demographic and clinical characteristics of patients with OA and the controls are shown in Table 1. Serum C reaction protein (CRP) level was significantly increased in patients with OA compared to that of HCs. No differences were identified in body mass index (BMI), white blood cell (WBC) count, and creatinine between the OA and HC group.

3.2. Serum Metabolomics Analysis

Serum metabolic profiles were assessed in 40 patients with knee OA and 20 HCs according to our optimized UPLC-MS analysis protocol. By comparing the ion features in the assayed samples to the reference libraries, namely, the Human Metabolomics Database (HMDB) and KEGG, 106 metabolites were finally identified.

The nonsupervised multivariate analysis, principal component analysis (PCA), was performed to visualize the sample distribution and possible outliners. Score plots illustrated that patients with moderate and severe OA could be clearly separated from HCs, and no outliers were observed (Figure 1(a)). The supervised multivariate analysis, partial least squares projection to latent structures and discriminant analysis (PLS-DA), was then performed to screen the metabolites that significantly contributed to the OA-specific metabolic profile; this showed a clear tendency of separation of patients with OA from HCs (Figure 1(b), cumulative , , and were 0.792, 0.831, and 0.663, resp.). We further demonstrated the different metabolic profiles between patients with mild and severe OA. The results showed that despite the overlap in several patients, mild and severe OA could also be stratified by our model (Figure 1(c), cumulative , , and were 0.414, 0.469, and 0.566, resp.).

(a)

(b)

(c)

To identify the significantly altered metabolites that composed the signature metabolic profile of OA, ions with varying importance in the projection (1.0) were considered as potential significantly altered metabolites and were further compared within the OA and HC groups by one-way ANOVA with Tukey’s post hoc tests. Fourteen metabolites were finally identified that were significantly altered in OA and that could be used as potential biomarkers to discriminate OA patients from HCs and/or to monitor the progression of OA (Table 2). Figure 2 illustrated a graphic summary of the significantly altered metabolites and the possible metabolic pathways involved.

4. Discussion

OA is considered a “wear and tear” disease that results in chronic loss of cartilage. Unlike other tissues, articular cartilage has limited metabolic activity and a weak ability to self-repair once damaged; its degeneration is generally irreversible and is accelerated by the complex local inflammatory cytokine networks [1, 12]. Thus, early interventions based on the early identification of articular cartilage destruction with methods having appropriate sensitivity and feasibility are of significant importance. Unfortunately, current laboratory exams used in OA diagnosis are either nonspecific or only effective in patients with apparent symptoms.

Metabolomics is an emerging tool based on the global study of the complement of metabolites in a biomedical sample. This feature provides the ability to map biochemical changes in the early stages of disease and hence provide potential predictive biomarkers and earlier interventions [4, 13]. In the present study, we analyzed the serum metabolomics in 40 patients with knee OA and 20 HCs to identify serum metabolic biomarkers for the early diagnosis of OA. Our UPLC-MS analysis identified an OA-specific serum metabolic profile that could clearly discriminate patients with knee OA from age- and gender-matched HCs. Moreover, the OA-specific metabolomic profile was also capable of stratifying different severities of OA, indicating its potential application for monitoring OA progression.

Our study demonstrated significantly decreased glycine and histidine levels in the serum of patients with OA compared to levels in HCs. Furthermore, serum glycine and histidine levels showed an apparent declining tendency when compared between early and late stage OA, indicating their possible role for monitoring the degree of joint damage in OA. Glycine and histidine have long been a focus in research on arthritis [14–16]. Reduced glycine and histidine in OA cartilage samples have been reported in metabolomics analyses using high-resolution nuclear magnetic resonance spectroscopy [14–16], and serum valine to histidine and leucine to histidine ratios have been proposed to be potential biomarkers for the management of OA [17]. In addition, reduced urinary glycine and histidine levels were also found to be associated with a poor response to methotrexate treatment in a collagen-induced arthritis animal model [18]. Taken together, evidence strongly suggests that glycine and histidine as well as their relevant metabolic pathways may undergo pathological alterations during the development of OA. Further explorations on the mechanisms behind these metabolic changes may provide important information on the etiology and/or treatment of OA.

Homocysteine (Hcy) is a sulfur-containing amino acid that plays pivotal roles in the biosynthesis and metabolism of multiple amino acids, nucleic acids, and phospholipids [19]. With the exception of cardiovascular diseases, homocysteine is also involved in the pathogenesis of several connective tissue disorders [17, 20–22]. Longitudinal observational studies have shown that hyperhomocysteinemia is closely associated with abnormal bone mineral density and the incidence of osteoporosis and osteoporotic fractures [22]. A higher concentration of Hcy is found in serum and synovial fluid of patients with rheumatoid arthritis (RA) [23], and Hcy level has been correlated with disease activity of patients with ankylosing spondylitis (AS) [24]. An in vitro experiment indicated that a high Hcy level is responsible for the apoptosis of osteoblastic cells via the endoplasmic reticulum stress pathway, which may support our findings that a significantly elevated serum Hcy level was observed in patients with severe OA compared to those with mild OA or HCs [25].

Serum L-tryptophan showed a significant increase in patients with OA compared to the HCs in our study. Igari and colleges reported that, unlike in RA, tryptophan metabolizes mainly through the kynurenic acid and nicotinic acid pathway in OA [26]. Kynurenic acid, as a downstream metabolite of tryptophan in OA, has been demonstrated to be altered in various human disorders and is considered to contribute to chronic inflammation. Interestingly, enhanced tryptophan metabolism was found in cultured human synovial cells stimulated by interferon-gamma, indicating its connection to the local inflammatory microenvironment in an OA affected joint [27].

Our study had several limitations. First, apart from the disease per se, metabolism can be influenced by multiple factors. In the present study, to reduce bias caused by preexisting uncontrolled conditions, we specifically excluded some common conditions from the control group that may influence the metabolic profiles. However, it has to be pointed out that this exclusion may limit the utility of our model in the clinical practice. Moreover, several of the OA signature metabolites we identified also manifested significant alternations in other connective tissue disorders, such as RA and AS [23, 24], indicating these metabolites might be more closely connected to bone destruction rather than to OA. Therefore, great challenges still exist before the eventual application of our model in the OA clinic, and further adjustments by studies with a broader disease spectrum are still needed. Second, the patient number of our study is relatively small. Further studies with larger patient numbers, ideally a prospective comparison on the longitude metabolic changes in samples of the same patients before and after the onset of OA, are necessary to build a more reliable model. Third, mild and severe OA were not clearly separated by our model, which left us a major task for further study. Besides the limited sample number, this is probably because the K-L grading system is a subjective and radiographic based method that may cause bias during the grouping of OA cases. In addition, we only studied serum samples in the present study; combined analysis of the urine and/or synovial fluid may provide superior specificity and sensitivity of our model to accomplish the goal of early diagnosis of OA.

5. Conclusions

By comparing serum metabolomics with UPLC-MS, we identified an OA-specific metabolic profile that could clearly discriminate patients with OA from HCs. Fourteen metabolites that involved metabolism of amino acids, purine, energy, glycolysis, fatty acids, and lipids were identified to be significantly altered in patients with OA compared to HCs. These metabolites could be potentially used as biomarkers for either the early diagnosis or progression monitoring of knee OA.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Authors’ Contribution

Qingmeng Zhang and Heng Li contributed equally to this work.

Acknowledgments

This work was supported by health industry research and special funds project from the Chinese Ministry of Health (Grant no. 201302007) and the National High Technology Research and Development Program of China (863 Program, Grant no. SS2015AA032103).

References

D. T. Felson, “Osteoarthritis of the knee,” The New England Journal of Medicine, vol. 354, no. 8, pp. 841–848, 2006.
View at: Publisher Site | Google Scholar
W. Zhang, R. W. Moskowitz, G. Nuki et al., “OARSI recommendations for the management of hip and knee osteoarthritis, Part I: critical appraisal of existing treatment guidelines and systematic review of current research evidence,” Osteoarthritis and Cartilage, vol. 15, no. 9, pp. 981–1000, 2007.
View at: Publisher Site | Google Scholar
F. J. Blanco and C. Ruiz-Romero, “Osteoarthritis: metabolomic characterization of metabolic phenotypes in OA,” Nature Reviews Rheumatology, vol. 8, no. 3, pp. 130–132, 2012.
View at: Publisher Site | Google Scholar
S. Medina, R. Domínguez-Perles, J. I. Gil, F. Ferreres, and A. Gil-Izquierdo, “Metabolomics and the diagnosis of human diseases -A guide to the markers and pathophysiological pathways affected,” Current Medicinal Chemistry, vol. 21, no. 7, pp. 823–848, 2014.
View at: Publisher Site | Google Scholar
S. B. Adams, L. A. Setton, E. Kensicki, M. P. Bolognesi, A. P. Toth, and D. L. Nettles, “Global metabolic profiling of human osteoarthritic synovium,” Osteoarthritis and Cartilage, vol. 20, no. 1, pp. 64–67, 2012.
View at: Publisher Site | Google Scholar
T. Hügle, H. Kovacs, I. A. F. M. Heijnen et al., “Synovial fluid metabolomics in different forms of arthritis assessed by nuclear magnetic resonance spectroscopy,” Clinical and Experimental Rheumatology, vol. 30, no. 2, pp. 240–245, 2012.
View at: Google Scholar
X. Li, S. Yang, Y. Qiu et al., “Urinary metabolomics as a potentially novel diagnostic and stratification tool for knee osteoarthritis,” Metabolomics, vol. 6, no. 1, pp. 109–118, 2010.
View at: Publisher Site | Google Scholar
B. Mickiewicz, B. J. Heard, J. K. Chau et al., “Metabolic profiling of synovial fluid in a unilateral ovine model of anterior cruciate ligament reconstruction of the knee suggests biomarkers for early osteoarthritis,” Journal of Orthopaedic Research, vol. 33, no. 1, pp. 71–77, 2015.
View at: Publisher Site | Google Scholar
R. Altman, E. Asch, and D. Bloch, “Development of criteria for the classification and reporting of osteoarthritis: classification of osteoarthritis of the knee,” Arthritis & Rheumatism, vol. 29, no. 8, pp. 1039–1052, 1986.
View at: Publisher Site | Google Scholar
J. H. Kellgren and J. S. Lawrence, Atlas of Standard Radiographs of Arthritis, Blackwell Scientific, Oxford, UK, 1963.
Y. Qi, Y. Song, H. Gu, G. Fan, and Y. Chai, “Global metabolic profiling using ultra-performance liquid chromatography/quadrupole time-of-flight mass spectrometry,” in Mass Spectrometry in Metabolomics, D. Raftery, Ed., vol. 1198 of Methods in Molecular Biology, pp. 15–27, Springer, New York, NY, USA, 2014.
View at: Publisher Site | Google Scholar
F. Berenbaum, “Osteoarthritis as an inflammatory disease (osteoarthritis is not osteoarthrosis!),” Osteoarthritis and Cartilage, vol. 21, no. 1, pp. 16–21, 2013.
View at: Publisher Site | Google Scholar
G. A. N. Gowda, S. Zhang, H. Gu, V. Asiago, N. Shanaiah, and D. Raftery, “Metabolomics-based methods for early disease diagnostics,” Expert Review of Molecular Diagnostics, vol. 8, no. 5, pp. 617–633, 2008.
View at: Publisher Site | Google Scholar
K. Shet, S. M. Siddiqui, H. Yoshihara, J. Kurhanewicz, M. Ries, and X. Li, “High-resolution magic angle spinning NMR spectroscopy of human osteoarthritic cartilage,” NMR in Biomedicine, vol. 25, no. 4, pp. 538–544, 2012.
View at: Publisher Site | Google Scholar
K. R. Keshari, J. C. Lotz, J. Kurhanewicz, and S. Majumdar, “Correlation of HR-MAS spectroscopy derived metabolite concentrations with collagen and proteoglycan levels and thompson grade in the degenerative disc,” Spine, vol. 30, no. 23, pp. 2683–2688, 2005.
View at: Publisher Site | Google Scholar
R. K. Madsen, T. Lundstedt, J. Gabrielsson et al., “Diagnostic properties of metabolic perturbations in rheumatoid arthritis,” Arthritis Research and Therapy, vol. 13, no. 1, article R19, 2011.
View at: Publisher Site | Google Scholar
G. Zhai, R. Wang-Sattler, D. J. Hart et al., “Serum branched-chain amino acid to histidine ratio: a novel metabolomic biomarker of knee osteoarthritis,” Annals of the Rheumatic Diseases, vol. 69, no. 6, pp. 1227–1231, 2010.
View at: Publisher Site | Google Scholar
J. S. Dixon, N. G. Sitton, K. E. Surrall, M. F. R. Martin, M. E. Pickup, and H. A. Bird, “The effect of drugs on serum histidine levels in rheumatoid arthritis,” Rheumatology International, vol. 3, no. 4, pp. 145–149, 1983.
View at: Publisher Site | Google Scholar
R. Levasseur, “Bone tissue and hyperhomocysteinemia,” Joint Bone Spine, vol. 76, no. 3, pp. 234–240, 2009.
View at: Publisher Site | Google Scholar
R. J. A. N. Lamers, J. H. J. van Nesselrooij, V. B. Kraus et al., “Identification of an urinary metabolite profile associated with osteoarthritis,” Osteoarthritis and Cartilage, vol. 13, no. 9, pp. 762–768, 2005.
View at: Publisher Site | Google Scholar
C. G. Gjesdal, S. E. Vollset, P. M. Ueland, H. Refsum, H. E. Meyer, and G. S. Tell, “Plasma homocysteine, folate, and vitamin B₁₂ and the risk of hip fracture: the hordaland homocysteine study,” Journal of Bone and Mineral Research, vol. 22, no. 5, pp. 747–756, 2007.
View at: Publisher Site | Google Scholar
R. R. McLean, P. F. Jacques, J. Selhub et al., “Homocysteine as a predictive factor for hip fracture in older persons,” The New England Journal of Medicine, vol. 350, no. 20, pp. 2042–2049, 2004.
View at: Publisher Site | Google Scholar
S. Berglund, A. Södergren, S. W. Jonsson, and S. R. Dahlqvist, “Atherothrombotic events in rheumatoid arthritis are predicted by homocysteine—a six-year follow-up study,” Clinical and Experimental Rheumatology, vol. 27, no. 5, pp. 822–825, 2009.
View at: Google Scholar
B. M. Başkan, F. Sivas, L. A. Aktekin, Y. P. Doǧan, K. Özoran, and H. Bodur, “Serum homocysteine level in patients with ankylosing spondylitis,” Rheumatology International, vol. 29, no. 12, pp. 1435–1439, 2009.
View at: Publisher Site | Google Scholar
S.-J. Park, K.-J. Kim, W.-U. Kim, I.-H. Oh, and C.-S. Cho, “Involvement of endoplasmic reticulum stress in homocysteine-induced apoptosis of osteoblastic cells,” Journal of Bone and Mineral Metabolism, vol. 30, no. 4, pp. 474–484, 2012.
View at: Publisher Site | Google Scholar
T. Igari, K. Obara, S. Ono, and Y. Toba, “Tryptophan metabolism in the joint diseases,” Acta Vitaminologica et Enzymologica, vol. 29, no. 1–6, pp. 194–197, 1975.
View at: Google Scholar
D. G. Malone, P. W. Dolan, R. R. Brown et al., “Interferon α induced production of indoleamine 2,3 dioxygenase in cultured human synovial cells,” The Journal of Rheumatology, vol. 21, no. 6, pp. 1011–1019, 1994.
View at: Google Scholar

Copyright

Copyright © 2015 Qingmeng Zhang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

2582

Downloads

1416

Citations