Association of Genetic Variants of RANK, RANKL, and OPG with Ankylosing Spondylitis Clinical Features in Taiwanese

Wang, Chin-Man; Tsai, Shu-Chun; Lin, Jing-Chi; Wu, Yeong-Jian Jan; Wu, Jianming; Chen, Ji-Yih

doi:https://doi.org/10.1155/2019/8029863

Mediators of Inflammation

On this page

Abstract Introduction Methods Results Discussion Conclusion Data Availability Conflicts of Interest Authors’ Contributions Acknowledgments Supplementary Materials References Copyright Related Articles

Research Article | Open Access

Volume 2019 | Article ID 8029863 | https://doi.org/10.1155/2019/8029863

Association of Genetic Variants of RANK, RANKL, and OPG with Ankylosing Spondylitis Clinical Features in Taiwanese

Chin-Man Wang,¹Shu-Chun Tsai,²Jing-Chi Lin,³Yeong-Jian Jan Wu,³Jianming Wu,⁴and Ji-Yih Chen³

Academic Editor: Tânia Silvia Fröde

Received12 Jul 2018

Revised10 Jan 2019

Accepted29 Jan 2019

Published20 Mar 2019

Abstract

Ankylosing spondylitis (AS) is a chronic inflammatory disease that leads to spinal ankylosis. The receptor activator of the nuclear factor-kappa (RANK), RANK ligand, and osteoprotegerin (OPG) (RANK/RANKL/OPG) pathway plays critical roles in bone metabolism and the immune system. The current study was aimed at investigating whether six single-nucleotide polymorphisms (SNPs) within the RANK, RANKL, and OPG genes essential for bone homeostasis are associated with AS. Genotype distributions, allele and haplotype frequencies, were compared between 1120 AS patients and 1435 healthy controls and among AS patients with stratification by syndesmophyte formation, onset age, and HLA-B27 positivity. We found that RANKL SNPs were associated with AS syndesmophyte formation. Notably, the RANKL SNP haplotype rs7984870C/rs9533155G/rs9525641C was negatively associated with AS susceptibility and appeared to protect against syndesmophyte formation in AS. Functionally, RANKL promoter SNPs (rs9525641 C/T and rs9533155 G/C) affected DNA-protein complex formation and promoter activity in promoter reporter analyses. The OPG SNP haplotype rs2073618G/rs3102735T was significantly associated with HLA-B27 negativity in AS patients. Furthermore, AS patients with syndesmophyte formation had significantly lower levels of soluble RANKL levels than those without syndesmophyte formation. Our data suggested a role for RANKL in AS susceptibility and severity.

1. Introduction

Ankylosing spondylitis (AS) is a chronic inflammatory disease primarily affecting the axial bones, leading to spinal ankylosis. Multiple factors including genetic compositions, infectious agents, and immune response dysfunctions contribute to the development of AS in individuals. Most AS patients are positive for the human leukocyte antigen (HLA) B27. Nevertheless, overwhelming majority of individuals who are positive for HLA-B27 do not have AS, and therefore, HLA-B27 positivity only accounts for a small fraction of the AS heritability [1]. Moreover, there is high interindividual variability in the rate of AS disease progression based on radiographic assessment of syndesmophyte formation [2–4].

Bone morphogenesis and remodeling are tightly regulated processes characterized by continuous bone synthesis and resorption, which are controlled by functions of osteoblasts and osteoclasts and intercellular cell-cell interactions [5–7]. A proper balance between bone resorption and synthesis is essential to maintain bone mechanical strength and structure [8]. In AS patients, chronic inflammation and osteogenesis break the balance between bone resorption and synthesis, resulting in structural bone damage, spinal immobility, and significant functional impairment [9–11]. The osteogenesis in AS patients is also accompanied by bone loss, causing systemic osteopenia or osteoporosis and spinal damage [12–15]. The excessive resorption of trabecular bone and the synthesis of new cortical bone at sites of inflammation are manifested as spinal ankylosis with fusion of sacroiliac joints [16].

Cytokines regulating osteoclast formation and function likely contribute to hyperactive osteoclastogenesis in AS patients. The receptor activator of nuclear factor-kappa ligand (RANKL) is a membrane-bound TNF-related factor expressed by osteoblasts, stromal cells, fibroblasts, and activated T cells [17–19]. Osteoclast differentiation requires the interaction between RANK expressed on osteoclast precursors and RANKL expressed on osteoblasts and stromal cells [20–24]. RANKL activates several signalling pathways to fine-tune bone homeostasis through controlling osteoclast development and bone loss [25]. RANKL upregulates the activity of the transcription factor nuclear factor-activated T cell c1 (NFATc1) to tightly regulate osteoclast differentiation [26]. The MHC class II transactivator and SWAP-70-like adapter of T cells (SLAT) decrease RANKL-mediated osteoclast differentiation by downregulating NFATc1 [27, 28]. Therefore, RANKL promotes osteoclast differentiation, maturation, and activation and contributes to osteoporosis by promoting bone resorption.

Osteoprotegerin (OPG) is a soluble RANKL “decoy” receptor that inhibits RANKL function, thereby decreasing osteoclast development [22, 29]. The increased synovial expressions of RANKL and OPG in peripheral spondylarthritis were unlikely associated with the degree of systemic and local inflammation in most patients [30]. However, patients that responded well to TNF alpha blockade therapy had decreased RANKL expression in the intimal lining layer [30]. Thus, the RANK/RANKL/OPG axis appears to affect the pathogenesis and clinical outcome of some patients with AS. Genetic variation at the OPG locus was reported to associate with the clinical features of AS [31]. Nevertheless, it remained unclear whether RANKL single-nucleotide polymorphisms (SNPs) have a role in AS. The purpose of current study was to investigate whether genetic variants of RANK, RANKL, and OPG are associated with AS disease susceptibility and clinical manifestations.

2. Material and Methods

2.1. Study Subjects

AS patients (926 males and 194 females) who fulfilled the 1984 revised New York diagnostic criteria for AS [32] were recruited at the Chang Gung Memorial Hospital (a 3600-bed medical center and university hospital). Two rheumatology specialists independently evaluated syndesmophyte formation and graded the severity of AS according to the modified Stoke’s Ankylosing Spondylitis Spinal Score (mSASSS) through examining radiographs of cervical, thoracic, and lumbar spines [33, 34]. Based on radiography, AS patients were placed into three groups: no syndesmophytes, (group 1), fewer than 4 syndesmophytes, (group 2), and 4 or more syndesmophytes, (group 3) [34]. The rare disagreements of these evaluations were resolved by consultations between physicians. The presence or absence of HLA-B27 was determined by flow cytometry and/or PCR assays. A total of 1435 healthy blood donors (798 males and 637 females, age range: 18 to 64 years, mean age: ) were recruited as normal healthy controls. The study was carried out in accordance with the relevant guidelines and regulations. All experimental protocols were approved by the ethics committee of Chang Gung Memorial Hospital, and informed consent was obtained from all subjects.

2.2. Nucleic Acid Isolation

Anticoagulated peripheral blood was obtained from AS patients and the comparison group (healthy subjects). Genomic DNA was isolated from anticoagulated peripheral blood using the Puregene DNA isolation kit (Gentra Systems, Minneapolis, MN, USA) as previously described [35].

2.3. RANK, RANKL, and OPG SNP Analyses

Matrix-assisted laser desorption ionization time-of-flight (MALDI-TOF) mass spectrometry was used to genotype the RANKL promoter SNPs as previously described [35]. Briefly, the DNA fragment-containing RANKL proximal promoter was amplified using the forward primer nucleotide sequence 5 to 3 F: TTTTAAAAAGCCCTAGCAAGGT and the reverse primer nucleotide sequence 5 to 3 F: TTGTCTGCGGCCAACTC in 96-well PCR plates with 15 ng of genomic DNA. The 865 bp PCR products were automatically purified on the MALDI-TOF MAP II/8 Robotic Platform using the Genopure DS Magnetic Bead DNA Purification kit (Bruker Daltonics). The purified DNA fragment was subsequently used for the PCR-based SNP detection assays with a SNP-specific detection primer and a termination mix. The SNP allele-specific products purified with the Genopure Oligo Magnetic Bead DNA Purification kit (Bruker Daltonics) were automatically spotted onto the 384-well AnchorChip plate and analyzed by AutoFlex mass spectrometry. Genotype data from MALDI-TOF analyses completely matched with the results of Sanger sequencing analysis in 39 samples using the BigDye terminator sequencing kit on an ABI 3100 sequencer (Applied Biosystems), confirming the reliability of MALDI-TOF SNP assays.

RANK and OPG SNPs were genotyped with the TaqMan SNP Made-to-Order allelic discrimination assays (Applied Biosystems). Allele-specific probes labeled with a fluorescent dye (FAM or VIC) were used in TaqMan SNP analyses on a real-time PCR thermocycler (Applied Biosystems). Genotypes were determined using TaqMan Genotyper software (Applied Biosystems) according to the vendor’s instructions.

2.3.1. Gene Cloning and Plasmid Preparation

The RANKL promoter fragment was amplified with PCR using human genomic DNA. The purified RANKL promoter region was cloned into the pGL4.20 vector (Promega) at the XhoI and HindIII sites. The luciferase reporter plasmids were prepared by using the Geneaid mini plasmid kit (Geneaid).

2.3.2. Site-Directed Mutagenesis of the RANKL Promoter

The confirmed plasmid of the RANKL promoter was mutated at three sites by a quick-change Tm XL site-directed mutagenesis kit (Stratagene, Agilent). The nucleotide sequences of the cloned constructs were confirmed by direct sequencing from both directions on an ABI 377 Sequencer with ABI BigDye Terminator Cycle Sequencing Kit.

2.3.3. Electrophoretic Mobility Shift Assay (EMSA)

Nuclear extracts of human fetal osteoblastic (hFOB) 1.19 cells were harvested as previously described [36]. LightShift Chemiluminescent EMSA kit (Thermo Scientific) was used for EMSA analyses according to the manufacturer’s instructions. Briefly, both forward and reverse strands of polynucleotides were labeled with biotin at the 5 ends and then annealed to form a double-strand probe. Four probes (−693C, −693T, −290T, and −290C) covering 2 regions of the RANKL promoter were used in this assay. The −693C double-strand DNA probe has the nucleotide sequence 5 to 3 F: TGTTGGGTGAGCCCTCCTCGGATGCTTGCT while the −693G double-strand DNA probe has the nucleotide sequence 5 to 3 F: TGTTGGGTGAGCCCTGCTCGGATGCTTGCT. The −290T double-strand DNA probe has the nucleotide sequence 5 to 3 F: CCTCTGCGTCTTCTTTAACCCATCTCTTGG while the −290C double strand DNA probe has the nucleotide sequence 5 to 3 F: CCTCTGCGTCTTCCTTAACCCATCTCTTGG. The binding reaction was performed in a total volume of 20 μL with 6 μg of nuclear extracts, 2.5 nM biotin-labeled probe, 1 μg poly(dI-dC), 2.5% glycerol, and 0.05% Nonidet P-40 (NP40) in 1x binding buffer. For competition experiments, 500 nM of unlabeled probes was added. For antibody supershift experiments, 2 μg of anti-Sp1 antibody (Sigma) or normal mouse IgG (Millipore) was added. All reaction mixtures were incubated at room temperature for 30 min, electrophoresed in 6% native polyacrylamide gels with Tris-borate buffer (90 mM Tris, 90 mM boric acid, and 2 mM EDTA), and then transferred to Hybond-N membranes (Amersham Biosciences). The membranes were UV crosslinked and blocked, and the signals were measured with the Chemiluminescent Nucleic Acid Detection Module (Pierce) according to the manufacturer’s instructions.

2.3.4. Luciferase Promoter Reporter Assay

hFOB 1.19 cells seeded in 12-well plates at 50% confluence were transfected with 0.8 μg of RANKL promoter reporter plasmid DNA plus 0.2 μg of internal control pEGFP-C1 (Promega) plasmid DNA using the TransIT-2020 transfection reagent (Mirus). Cells were harvested 72 h after transfection and subsequently lysed with Passive Lysis Buffer (Promega). Bright-Glo Luciferase Assay reagent (Promega) was used to determine luciferase activity and GFP fluorescence values. The relative fold of reporter activity normalized by GFP intensity represented the ratios of promoter reporter luciferase values versus the pGL4 control luciferase value (Supplemental Figure 1).

2.3.5. Soluble RANKL Assay

The total soluble RANKL (sRANKL) ELISA kit (Enzo Life Sciences; catalog: ALX-850-019-KI01) was used to measure serum RANKL levels in the sera of AS patients by following the manufacturer’s instructions.

2.3.6. Statistical Analysis

Promoter activity data are presented as means and standard errors of the means (SEM). The 2-tailed -test was used to compare the levels of two polymorphic human RANKL luciferase reporter constructs. The correlation between different parameters was assessed by linear regression analysis and Pearson’s coefficient of correlation. Three chi-squared tests (the genotype test, allele test, and Cochran-Armitage trend test) were performed to analyze the associations of SNPs with AS disease susceptibility and phenotypes. Based on the risk allele identified, values, odds ratios (ORs), and 95% confidence interval (CIs) were then calculated. To account for the multiple testing corrections, the FDR-corrected values were generated by using false discovery rate (FDR) correction using the modified version of FDR programmed in QVALUE software (http://genomics.princeton.edu/storeylab/qvalue/). Linkage disequilibrium (LD) between marker loci was measured, and haplotype blocks were constructed using Haploview 4.2 (Broad Institute, Cambridge, MA, USA; http://www.broad.mit.edu/mpg/haploview). The SAS HAPLOTYPE procedure was used to infer haplotype information and estimation of frequencies. Association of the estimated haplotypes and disease status was tested by logistic regression models. For the markers within the same haplotype block, we used disease status (case vs control) and clinical characteristics (early age onset, HLA B27 positivity, and syndesmophyte formation) as traits and tested for the haplotype-trait association utilizing the haplo.stat SAS HAPLOTYPE procedure. Mann-Whitney tests were used to analyze the serum sRANKL levels among AS patients using GraphPad Prism 6.0 (GraphPad, La Jolla, CA, USA). The 5% level of significance for values was used for all analyses.

3. Results

3.1. Clinical Characteristics of Patients with AS

Among 1120 Taiwanese AS patients (926 males and 194 females), 297 patients had disease onset ages of ≤16 years while 823 patients had the onset ages between 17 and 60 years. Within the AS cohort, 1021 patients (91.2%) were positive for HLA-B27 and 485 patients (43.3%) were positive for syndesmophyte formation based on spinal X-ray analysis (146 patients with mSASSS being less than 24 and 339 patients with mSASSS of being 24 or more).

3.2. Association of SNPs of RANK, RANKL, and OPG with AS Susceptibility

We carried out genetic analyses to investigate whether RANK, RANKL, and OPG genes are involved in AS susceptibility. The RANK SNP (rs1805034), three RANKL SNPs (rs7984870, rs9525641, and rs9533155), and two OPG SNPs (rs2073618 and rs3102735) were genotyped in 1120 AS patients and 1435 healthy controls. The RANKL SNP rs7984870G allele (trend test, with 100000 permutations), rs9533155C allele (trend test, ), and RANKL SNP rs9525641T (trend test, ) tended to be enriched in AS patients (Table 1). However, no significant associations were observed between all six SNPs and AS susceptibility after the corrections for multiple hypothesis testing. In addition, no significant deviations from the Hardy-Weinberg equilibrium in the distributions of genotypes and alleles were observed for all SNPs in AS patients and normal controls, indicating that individual genetic variants of RANK, RANKL, and OPG may not have an effect on AS susceptibility.

3.3. Association of RANKL, RANK, and OPG SNPs with Clinical Characteristics of AS Patients

AS is a polygenic disease manifested with diverse clinical symptoms and disease severity. Accordingly, we carried out genetic analyses of RANKL, RANK, and OPG SNPs by stratifying AS patients based on HLA-B27 positivity and clinical characteristics. As shown in Table 2, RANKL SNP rs7984870G allele (trend test ; ), rs9525641T allele (trend test ; ), and rs9533155C allele (trend test: ; ) were significantly enriched in AS patients positive for syndesmophyte formation as compared to normal controls. The RANKL rs7984870G allele carriers (genotypes vs CC; , , 95% -1.86), the rs9525641T allele carriers of ( vs CC; , , 95% -1.84), and rs9533155C allele carriers ( vs GG; , , 95% -1.86) were also significantly increased in the AS patients with syndesmophyte formation as compared to normal controls. In addition, the RANKL SNP rs7984870G allele (trend test: ; ), rs9525641T allele (trend test: ; ), and rs9525641C allele (trend test: ; ) were significantly associated with HLA-B27 positivity (Table 3). No significant associations were observed between clinical characteristics and SNPs of RANK and OPG among AS patients.

3.4. Association of the RANKL Promoter and OPG SNP Haplotypes with AS Susceptibility and Clinical Manifestations

Since RANKL promoter SNP haplotypes may differentially affect promoter functions, we carried out haplotype analyses to assess the association of RANKL SNP haplotypes with AS susceptibility and syndesmophyte formation. Two common RANKL SNP haplotypes (rs7984870C/rs9533155G/rs9525641C and rs7984870G/rs9533155C/rs9525641T) and several rare haplotypes with frequencies less than 0.05 were deduced. We found that the RANKL rs7984870C/rs9533155G/rs9525641C (or RANKL CGC) haplotype was significantly decreased in AS patients as compared to normal controls (AS: 41.83%, control: 45.88%; adjusted , , 95% ), suggesting that the RANKL CGC haplotype may have a protection role against the development of AS (Table 4). In addition, the frequency of the RANKL CGC haplotype appeared to decrease in AS patients with syndesmophytes as compared to AS patients negative for syndesmophytes (AS syndesmophyte positive: 39.71%, AS syndesmophyte negative: 43.45%; adjusted , , 95% -1.01) (Supplemental Table 2). However, RANKL SNP haplotypes were not associated with either HLA-B27 positivity or early age of onset among AS patients (Supplemental Tables 3 and 4). Two OPG SNPs formed four SNP haplotypes on chromosome 8. No associations were observed between four major OPG haplotypes and AS susceptibility (Supplemental Table 5), syndesmophyte formation (Supplemental Table 6), and age of disease onset (Supplemental Table 7). Nevertheless, the OPG rs2073618G/rs3102735T (or OPG GT) haplotype was significantly enriched in HLA-B27-negative AS patients (, ; 95% -0.98) as compared to AS patients positive for HLA-B27 (Supplemental Table 8). Taken together, the RANKL SNP haplotype rs7984870C/rs9533155G/rs9525641C seems to associate with the low risks for AS and AS syndesmophyte formation. On the other hand, the OPG SNP haplotype rs2073618G/rs3102735T may associate with HLA-B27 negativity in AS patients.

3.5. RANKL Promoter SNPs Affect Promoter Functions

Since RANKL SNP haplotypes were significantly associated with risk for AS. We attempted to identify novel SNPs in the RANKL proximal promoter region. Sequencing analyses of a 1 kb RANKL proximal promoter region revealed three SNPs: −693G/C (rs9533155), −643C/T (rs9533156), and −290C/T (rs9525641). Results of transcription factor-searching software based on the matrix of nucleotide sequence identity indicate that the SNPs −693G/C and −290C/T may sit at a putative specificity protein 1 (Sp1) transcription factor-binding site. We carried out EMSA analyses to examine the effect of those RANKL SNPs on the binding to transcription factors. As shown in Figure 1, the probe containing the -693G allele could form three DNA-protein complexes while none of the complexes could be formed with the probe containing -693C (lanes 2 and 8, Figure 1(a)). Anti-Sp1 antibody (S) failed to cause supershifts or the disruption of three DNA-protein complexes (lane 11, Figure 1(a)), suggesting that Sp1 is not included in those DNA-protein complexes. A 200-fold excess of −693C (C) or −693G (G) unlabeled probes effectively blocked the formation of the high-molecular weight complex but only slightly inhibited the formation of two low-molecular weight complexes (lanes 9 and 10, Figure 1(a)). Thus, even though the −693C probe failed to form the tight DNA-protein complexes, an excess of the -693C probe that may have low affinity for nuclear proteins had the ability to interfere the binding of the -693G probe to nuclear proteins. Figure 1(b) showed that the −290T probe appeared to form more DNA-nuclear protein complexes than did the −290C probe.

(a)

(b)

Figure 1

RANKL promoter probes containing SNPs bind nuclear proteins with different affinities. A nuclear extract of hFOB cells was incubated with biotin-labeled probes in the presence or absence of a 100-fold excess of unlabeled probes, 2 μg anti-Sp1 antibody (S), or mouse IgG (m). After 30 min, the reaction mixture was analyzed by EMSA. (a) Nuclear proteins formed 3 complexes with the -693G probe, but none with the -693C probe. (b) Nuclear proteins and DNA probes formed more complexes with the −290T probe than with the -290C probe at the indicated region. Asterisks indicate protein-DNA complexes.

Subsequently, we carried out promoter reporter assays to determine the activity of the three most common RANKL SNP haplotypes (-693C/−643T/−290T or CTT, −693C/−643T/−290C or CTC, and −693G/−643C/−290C or GCC). We found that all three RANKL promoter reporters (CTT, CTC, and GCC) yielded significantly lower luciferase activities than did the pGL4 vector control (Supplemental Figure 1), suggesting that the proximal RANKL promoter region contains strong repressors. Interestingly, the RANKL CTC promoter reporter had the lowest activity, suggesting that the CTC haplotype allele may constitute the strongest repressor. Notably, the common haplotypes CTT and GCC had the similar promoter activity. Our data indicate that proximal RANKL promoter SNPs may affect RANKL promoter function.

3.6. Association of sRANKL Levels with AS Syndesmophyte Formation

Our genetic analyses indicate that RANKL may be involved in the development of AS. Subsequently, we measured soluble RANKL (sRANKL) levels in the serum of AS patients to determine whether sRANKL levels are associated with RANKL SNP haplotypes and syndesmophyte formation. As shown in Figure 2, sRANKL levels were not significantly different between two common RANKL haplotypes (CGC and GCT). However, AS patients with syndesmophyte formation had significantly lower sRANKL serum levels (, ) than did those without syndesmophyte formation (; ; ). Our data indicate that sRANKL may block syndesmophyte formation in AS patients.

(a)

(b)

4. Discussion

The bone is a critical target in the development of AS. The disruption of normal bone remodeling in AS patients is characterized by local and systemic bone loss and subsequent new bone formation [9]. In the current genetic study, the RANKL SNP haplotype rs7984870C/rs9533155G/rs9525641C was identified as a protecting factor against the development of AS in large cohorts of Taiwanese AS patients and healthy controls. More importantly, we found that the low serum sRANKL levels were significantly associated with syndesmophyte formation in AS patients, suggesting a protective role of sRANKL against syndesmophyte formation. Our data provided new insights into the functional roles of the RANK/RANKL/OPG axis in the pathogenesis of AS. A limitation of the current study is that the syndesmophyte formation was considered as an established manifestation. We should be cautious in interpreting the genetic association between SNPs and syndesmophyte formation.

The progressive joint destruction and bone mineral degradation in AS patients are due in part to the activity of numerous proteolytic enzymes synthesized by osteoclasts [37]. Osteoclastogenesis is significantly increased in AS patients with sacroiliac joint ankyloses. In addition, AS patients had high levels of serum sRANKL and OPG, which may relate to the disease progression and clinical outcomes [38]. The production of OPG might reflect systemic inflammation as OPG levels are associated with poor physical mobility in AS patients [38]. The sRANKL levels and the sRANKL/OPG ratio were found to correlate with bone mineral density (BMD) and radiological changes in AS patients [39]. Taken together, RANKL and OPG may be involved in the pathogenesis of AS.

Several studies have been carried out to investigate the effect of genetic variations of those genes on osteoclast-related conditions, such as osteoporosis [40, 41], and autoimmune diseases [42–47]. The RANKL SNP rs2277438 reportedly contributes to the radiographic progression of RA in a Japanese population [43]. In addition, carriers of the RANKL SNP rs7984870-CC genotype had twofold higher plasma levels of sRANKL and an earlier age of RA onset, particularly in those patients with antibodies against cyclic citrullinated peptide (CCP) and rheumatoid factor (RF) [48, 49]. RF-positive RA patients carrying the RANKL SNP rs7984870-CC genotype also had significantly elevated RANKL mRNA expression in the activated T cells. Therefore, the RANKL SNP rs7984870C>G located in the distal RANKL promoter (−1816) may play a key role in disease pathogenesis through regulating RANKL production.

The RANKL proximal promoter (1 kb) interacts with transcription factors such as heat shock proteins, vitamin D3, CCAAT/enhancer-binding protein beta (CEBP beta), E2F1 (E2F transcription factor 1), SP1 (specificity protein 1), SP3 (Sp3 transcription factor), and core-binding factor a1 (Cbfa1), which affect the expression of RANKL [50–56]. The deletion analysis revealed the region between nucleotide positions −300 to −1000 contains the RANKL promoter repressor, where the SNPs −693G>C (rs9533155) and −643C>T (rs9525641) are located [54]. In the current study, we found that RANKL SNP −693G>C and -290C>T significantly affect the formation of DNA-protein complexes. Nevertheless, we failed to identify specific transcription factors that bind to the regions containing RANKL SNPs in EMSA analyses. Our promoter reporter analysis confirmed that the RANKL SNPs −693G>C and −290C>T are within a promoter repressor as the RANKL promoter SNP haplotypes differently suppressed the promoter activities, suggesting that RANKL promoter SNPs may be functional.

Interestingly, we found that the common RANKL promoter rs7984870C/rs9525641G/rs9525641C (CGC) haplotype with high-activity rs7984870C allele was associated with the protection against the development of AS. In particular, the common RANKL promoter CGC haplotype allele seems to protect against syndesmophyte formation. However, those serum sRANKL levels of AS patients were not associated with RANKL promoter haplotypes (Figure 2(a)). We speculate that functional RANKL promoter SNPs may influence the RANKL gene expression but not the production of sRANKL, which is the cleavage product of a type II membrane protein. The production of sRANKL from membrane RANKL requires the action of proteases [57]. Additionally, we found that sRANKL levels were significantly associated with syndesmophyte formation, suggesting that the production of sRANKL may be influenced by AS disease activity. Our data suggest that the decreased RANKL expression may adversely affect the bone remodeling process in AS patients.

Previous studies showed that an excess of recombinant OPG could block the OPG expression of endothelial cells and macrophages in the synovial lining layer [58]. In addition, the OPG expression in macrophage-type synovial lining cells and endothelial cells was significantly reduced in RA patients with active synovitis and the low levels of OPG were associated with the development of radiologically defined joint erosions in inflamed joints [58]. By contrast, OPG was highly expressed in spondyloarthropathy patients with active synovitis, indicating distinct disease pathways in RA and AS [59]. The OPG genetic variation was associated with peripheral arthritis, age of onset, and HLA-B27 positivity in a cohort of AS patients [31]. However, we found a modest association between HLA-B27 positivity and OPG SNPs (rs2073618 and rs3102735). The discrepancies may be explained by different sample sizes and ethnicities of study subjects.

During AS development, the increased peri-inflammatory bone formation is followed by healing of erosions, ossifying enthesitis, and ankylosing of sacroiliac joints and intervertebral connections, eventually biomechanical changes in the spine [15]. The RANKL/RANK/OPG axis is a part of the important pathways controlling bone remodeling in AS. AS patients with syndesmophyte formation had the augmented levels of bone formation markers (bone morphogenetic proteins (BMPs) [60] and wingless-related integration sites (WNTs)) [61] and low concentrations of inhibitors of bone formation (sclerostin and dickkopf-1) [62, 63]. The disruption of the bone remodeling process in AS may involve multiple pathways controlling bone formation and resorption. Further investigations are required to delineate precise pathways involved in the pathogenesis of AS.

5. Conclusion

The RANKL/RANK/OPG axis affecting osteoclast differentiation and osteoproliferation may affect AS disease susceptibility and severity.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare no conflict of interest.

Authors’ Contributions

C. M. W. and J. Y. C. designed and coordinated the study and helped prepare the manuscript. S. C. T. performed the functional study. Y. J. J. W. and J. C. L. participated in sample acquisition and data interpretation. J. W. conceived the study, participated in its design, and helped in drafting the manuscript. All authors reviewed the manuscript.

Acknowledgments

This study was supported by funding from the Chang Gung Memorial Hospital (CMRPG3C0063 and CMRPG3F0051-3) and the Ministry of Science and Technology, Taiwan (105-2314-B-068-MY3), and an award from the New Century Health Care Promotion Foundation to Dr. JY Chen. We greatly appreciate the Shin Chu Blood Donor Center for proving the collection of blood samples and Dr. Su-Wei Chang for the statistical analysis.

Supplementary Materials

Table S1: association of the RANKL/RANK/OPG SNPs with age of disease onset in the AS patients. Table S2: haplotype association of the RANKL SNPs rs7984870, rs9533155, and rs9525641 with syndesmophyte formation in AS cases. Table S3: haplotype association of the RANKL SNPs rs7984870, rs9533155, and rs9525641 with HLA-B27 in AS cases. Table S4: haplotype association of the RANKL SNPs rs7984870, rs9533155, and rs9525641 with age of disease onset in AS cases. Table S5: haplotype association of the OPG SNPs rs2073618 and rs3102735 in the AS cases and healthy controls. Table S6: haplotype association of the OPG SNPs rs2073618 and rs3102735 with syndesmophyte formation in the AS cases. Table S7: haplotype association of the OPG SNPs rs2073618 and rs3102735 with age of disease onset in the AS cases. Table S8: haplotype association of the OPG SNPs rs2073618 and rs3102735 with HLA-B27 in the AS cases. Figure S1: the promoter activity by transient transfection of hFOB 1.19 cells with plasmid constructs that contained different RANKL promoters and a luciferase reporter. (Supplementary Materials)

References

M. A. Brown, L. G. Kennedy, A. J. MacGregor et al., “Susceptibility to ankylosing spondylitis in twins the role of genes, HLA, and the environment,” Arthritis & Rheumatism, vol. 40, no. 10, pp. 1823–1828, 1997.
View at: Publisher Site | Google Scholar
X. Baraliakos, J. Listing, A. von der Recke, and J. Braun, “The natural course of radiographic progression in ankylosing spondylitis--evidence for major individual variations in a large proportion of patients,” The Journal of Rheumatology, vol. 36, no. 5, pp. 997–1002, 2009.
View at: Publisher Site | Google Scholar
D. Poddubnyy, H. Haibel, J. Listing et al., “Baseline radiographic damage, elevated acute-phase reactant levels, and cigarette smoking status predict spinal radiographic progression in early axial spondylarthritis,” Arthritis & Rheumatism, vol. 64, no. 5, pp. 1388–1398, 2012.
View at: Publisher Site | Google Scholar
S. Ramiro, C. Stolwijk, A. van Tubergen et al., “SAT0248 evolution of radiographic damage in ankylosing spondylitis over 12 years of follow-up,” Annals of the Rheumatic Diseases, vol. 72, Supplement 3, pp. A665–A6A666, 2013.
View at: Publisher Site | Google Scholar
S. L. Teitelbaum, “Therapeutic implications of suppressing osteoclast formation versus function,” Rheumatology, vol. 55, Supplement 2, pp. ii61–ii63, 2016.
View at: Publisher Site | Google Scholar
J. F. Charles and A. O. Aliprantis, “Osteoclasts: more than ‘bone eaters’,” Trends in Molecular Medicine, vol. 20, no. 8, pp. 449–459, 2014.
View at: Publisher Site | Google Scholar
M. Furuya, J. Kikuta, S. Fujimori et al., “Direct cell-cell contact between mature osteoblasts and osteoclasts dynamically controls their functions in vivo,” Nature Communications, vol. 9, no. 1, p. 300, 2018.
View at: Publisher Site | Google Scholar
S. Harada and G. A. Rodan, “Control of osteoblast function and regulation of bone mass,” Nature, vol. 423, no. 6937, pp. 349–355, 2003.
View at: Publisher Site | Google Scholar
R. J. Lories and G. Schett, “Pathophysiology of new bone formation and ankylosis in spondyloarthritis,” Rheumatic Diseases Clinics of North America, vol. 38, no. 3, pp. 555–567, 2012.
View at: Publisher Site | Google Scholar
J. Braun and J. Sieper, “Ankylosing spondylitis,” The Lancet, vol. 369, no. 9570, pp. 1379–1390, 2007.
View at: Publisher Site | Google Scholar
G. Schett, “Structural bone changes in spondyloarthritis: mechanisms, clinical impact and therapeutic considerations,” The American Journal of the Medical Sciences, vol. 341, no. 4, pp. 269–271, 2011.
View at: Publisher Site | Google Scholar
S. Carter and R. J. Lories, “Osteoporosis: a paradox in ankylosing spondylitis,” Current Osteoporosis Reports, vol. 9, no. 3, pp. 112–115, 2011.
View at: Publisher Site | Google Scholar
N. Davey-Ranasinghe and A. Deodhar, “Osteoporosis and vertebral fractures in ankylosing spondylitis,” Current Opinion in Rheumatology, vol. 25, no. 4, pp. 509–516, 2013.
View at: Publisher Site | Google Scholar
E. Klingberg, M. Lorentzon, J. Göthlin et al., “Bone microarchitecture in ankylosing spondylitis and the association with bone mineral density, fractures, and syndesmophytes,” Arthritis Research & Therapy, vol. 15, no. 6, article R179, 2013.
View at: Publisher Site | Google Scholar
P. Geusens and W. F. Lems, “Osteoimmunology and osteoporosis,” Arthritis Research & Therapy, vol. 13, no. 5, p. 242, 2011.
View at: Publisher Site | Google Scholar
R. J. Lories, F. P. Luyten, and K. de Vlam, “Progress in spondylarthritis. Mechanisms of new bone formation in spondyloarthritis,” Arthritis Research & Therapy, vol. 11, no. 2, p. 221, 2009.
View at: Publisher Site | Google Scholar
L. C. Hofbauer and A. E. Heufelder, “Role of receptor activator of nuclear factor-κB ligand and osteoprotegerin in bone cell biology,” Journal of Molecular Medicine, vol. 79, no. 5-6, pp. 243–253, 2001.
View at: Publisher Site | Google Scholar
Y. Y. Kong, H. Yoshida, I. Sarosi et al., “OPGL is a key regulator of osteoclastogenesis, lymphocyte development and lymph-node organogenesis,” Nature, vol. 397, no. 6717, pp. 315–323, 1999.
View at: Publisher Site | Google Scholar
D. L. Lacey, E. Timms, H. L. Tan et al., “Osteoprotegerin ligand is a cytokine that regulates osteoclast differentiation and activation,” Cell, vol. 93, no. 2, pp. 165–176, 1998.
View at: Publisher Site | Google Scholar
W. C. Dougall, M. Glaccum, K. Charrier et al., “RANK is essential for osteoclast and lymph node development,” Genes & Development, vol. 13, no. 18, pp. 2412–2424, 1999.
View at: Publisher Site | Google Scholar
J. Li, I. Sarosi, X. Q. Yan et al., “RANK is the intrinsic hematopoietic cell surface receptor that controls osteoclastogenesis and regulation of bone mass and calcium metabolism,” Proceedings of the National Academy of Sciences of the United States of America, vol. 97, no. 4, pp. 1566–1571, 2000.
View at: Publisher Site | Google Scholar
N. Takahashi, N. Udagawa, and T. Suda, “A new member of tumor necrosis factor ligand family, ODF/OPGL/TRANCE/RANKL, regulates osteoclast differentiation and function,” Biochemical and Biophysical Research Communications, vol. 256, no. 3, pp. 449–455, 1999.
View at: Publisher Site | Google Scholar
H. Hsu, D. L. Lacey, C. R. Dunstan et al., “Tumor necrosis factor receptor family member RANK mediates osteoclast differentiation and activation induced by osteoprotegerin ligand,” Proceedings of the National Academy of Sciences of the United States of America, vol. 96, no. 7, pp. 3540–3545, 1999.
View at: Publisher Site | Google Scholar
N. Udagawa, N. Takahashi, E. Jimi et al., “Osteoblasts/stromal cells stimulate osteoclast activation through expression of osteoclast differentiation factor/RANKL but not macrophage colony-stimulating factor: receptor activator of NF-kappa B ligand,” Bone, vol. 25, no. 5, pp. 517–523, 1999.
View at: Publisher Site | Google Scholar
A. Leibbrandt and J. M. Penninger, “RANKL/RANK as key factors for osteoclast development and bone loss in arthropathies,” Advances in Experimental Medicine and Biology, vol. 649, pp. 100–113, 2009.
View at: Publisher Site | Google Scholar
F. Ikeda, R. Nishimura, T. Matsubara et al., “Critical roles of c-Jun signaling in regulation of NFAT family and RANKL-regulated osteoclast differentiation,” The Journal of Clinical Investigation, vol. 114, no. 4, pp. 475–484, 2004.
View at: Publisher Site | Google Scholar
J. H. Kim, K. Kim, B. U. Youn, H. M. Jin, and N. Kim, “MHC class II transactivator negatively regulates RANKL-mediated osteoclast differentiation by downregulating NFATc1 and OSCAR,” Cellular Signalling, vol. 22, no. 9, pp. 1341–1349, 2010.
View at: Publisher Site | Google Scholar
B. U. Youn, K. Kim, J. H. Kim et al., “SLAT negatively regulates RANKL-induced osteoclast differentiation,” Molecules and Cells, vol. 36, no. 3, pp. 252–257, 2013.
View at: Publisher Site | Google Scholar
V. Shalhoub, J. Faust, W. J. Boyle et al., “Osteoprotegerin and osteoprotegerin ligand effects on osteoclast formation from human peripheral blood mononuclear cell precursors,” Journal of Cellular Biochemistry, vol. 72, no. 2, pp. 251–261, 1999.
View at: Publisher Site | Google Scholar
B. Vandooren, T. Cantaert, T. Noordenbos, P. P. Tak, and D. Baeten, “The abundant synovial expression of the RANK/RANKL/osteoprotegerin system in peripheral spondylarthritis is partially disconnected from inflammation,” Arthritis and Rheumatism, vol. 58, no. 3, pp. 718–729, 2008.
View at: Publisher Site | Google Scholar
C. H. Huang, J. C. Wei, P. S. Hung et al., “Osteoprotegerin genetic polymorphisms and age of symptom onset in ankylosing spondylitis,” Rheumatology, vol. 50, no. 2, pp. 359–365, 2011.
View at: Publisher Site | Google Scholar
S. van der Linden, H. A. Valkenburg, and A. Cats, “Evaluation of diagnostic criteria for ankylosing spondylitis. A proposal for modification of the New York criteria,” Arthritis & Rheumatism, vol. 27, no. 4, pp. 361–368, 1984.
View at: Publisher Site | Google Scholar
M. C. Creemers, M. J. Franssen, M. A. van't Hof, F. W. Gribnau, L. B. van de Putte, and P. L. van Riel, “Assessment of outcome in ankylosing spondylitis: an extended radiographic scoring system,” Annals of the Rheumatic Diseases, vol. 64, no. 1, pp. 127–129, 2005.
View at: Publisher Site | Google Scholar
X. Baraliakos, J. Listing, M. Rudwaleit, J. Sieper, and J. Braun, “Development of a radiographic scoring tool for ankylosing spondylitis only based on bone formation: addition of the thoracic spine improves sensitivity to change,” Arthritis & Rheumatism, vol. 61, no. 6, pp. 764–771, 2009.
View at: Publisher Site | Google Scholar
J. Y. Chen, C. M. Wang, C. C. Ma et al., “Association of a transmembrane polymorphism of Fcgamma receptor IIb (FCGR2B) with systemic lupus erythematosus in Taiwanese patients,” Arthritis & Rheumatism, vol. 54, no. 12, pp. 3908–3917, 2006.
View at: Publisher Site | Google Scholar
S. C. Tsai, S. J. Lin, P. W. Chen et al., “EBV Zta protein induces the expression of interleukin-13, promoting the proliferation of EBV-infected B cells and lymphoblastoid cell lines,” Blood, vol. 114, no. 1, pp. 109–118, 2009.
View at: Publisher Site | Google Scholar
M. Neidhart, X. Baraliakos, C. Seemayer et al., “Expression of cathepsin K and matrix metalloproteinase 1 indicate persistent osteodestructive activity in long-standing ankylosing spondylitis,” Annals of the Rheumatic Diseases, vol. 68, no. 8, pp. 1334–1339, 2009.
View at: Publisher Site | Google Scholar
C. H. Chen, H. A. Chen, H. T. Liao, C. H. Liu, C. Y. Tsai, and C. T. Chou, “Soluble receptor activator of nuclear factor-kappaB ligand (RANKL) and osteoprotegerin in ankylosing spondylitis: OPG is associated with poor physical mobility and reflects systemic inflammation,” Clinical Rheumatology, vol. 29, no. 10, pp. 1155–1161, 2010.
View at: Publisher Site | Google Scholar
H. R. Kim, S. H. Lee, and H. Y. Kim, “Elevated serum levels of soluble receptor activator of nuclear factors-κB ligand (sRANKL) and reduced bone mineral density in patients with ankylosing spondylitis (AS),” Rheumatology, vol. 45, no. 10, pp. 1197–1200, 2006.
View at: Publisher Site | Google Scholar
S. Mencej-Bedrač, J. Preželj, T. Kocjan et al., “The combinations of polymorphisms in vitamin D receptor, osteoprotegerin and tumour necrosis factor superfamily member 11 genes are associated with bone mineral density,” Journal of Molecular Endocrinology, vol. 42, no. 3, pp. 239–247, 2009.
View at: Publisher Site | Google Scholar
S. Mencej, O. M. Albagha, J. Prezelj, T. Kocjan, and J. Marc, “Tumour necrosis factor superfamily member 11 gene promoter polymorphisms modulate promoter activity and influence bone mineral density in postmenopausal women with osteoporosis,” Journal of Molecular Endocrinology, vol. 40, no. 6, pp. 273–279, 2008.
View at: Publisher Site | Google Scholar
G. Assmann, J. Koenig, M. Pfreundschuh et al., “Genetic variations in genes encoding RANK, RANKL, and OPG in rheumatoid arthritis: a case-control study,” The Journal of Rheumatology, vol. 37, no. 5, pp. 900–904, 2010.
View at: Publisher Site | Google Scholar
T. Furuya, M. Hakoda, N. Ichikawa et al., “Associations between HLA-DRB1, RANK, RANKL, OPG, and IL-17 genotypes and disease severity phenotypes in Japanese patients with early rheumatoid arthritis,” Clinical Rheumatology, vol. 26, no. 12, pp. 2137–2141, 2007.
View at: Publisher Site | Google Scholar
L. Paternoster, M. Lorentzon, L. Vandenput et al., “Genome-wide association meta-analysis of cortical bone mineral density unravels allelic heterogeneity at the RANKL locus and potential pleiotropic effects on bone,” PLoS Genetics, vol. 6, no. 11, article e1001217, 2010.
View at: Publisher Site | Google Scholar
R. H. Mohamed, R. H. Mohamed, and E. E. El-Shahawy, “Relationship between RANK and RANKL gene polymorphisms with osteoporosis in rheumatoid arthritis patients,” Genetic Testing and Molecular Biomarkers, vol. 20, no. 5, pp. 249–254, 2016.
View at: Publisher Site | Google Scholar
S. Xu, X. X. Ma, L. W. Hu, L. P. Peng, F. M. Pan, and J. H. Xu, “Single nucleotide polymorphism of RANKL and OPG genes may play a role in bone and joint injury in rheumatoid arthritis,” Clinical and Experimental Rheumatology, vol. 32, no. 5, pp. 697–704, 2014.
View at: Google Scholar
A. C. Bonfa, L. P. Seguro, V. Caparbo, E. Bonfa, and R. M. Pereira, “RANKL and OPG gene polymorphisms: associations with vertebral fractures and bone mineral density in premenopausal systemic lupus erythematosus,” Osteoporosis international, vol. 26, no. 5, pp. 1563–1571, 2015.
View at: Publisher Site | Google Scholar
W. Tan, H. Wu, J. Zhao et al., “A functional RANKL polymorphism associated with younger age at onset of rheumatoid arthritis,” Arthritis & Rheumatism, vol. 62, no. 10, pp. 2864–2875, 2010.
View at: Publisher Site | Google Scholar
H. Wu, D. Khanna, G. Park et al., “Interaction between RANKL and HLA-DRB1 genotypes may contribute to younger age at onset of seropositive rheumatoid arthritis in an inception cohort,” Arthritis & Rheumatism, vol. 50, no. 10, pp. 3093–3103, 2004.
View at: Publisher Site | Google Scholar
K. Kim, J. H. Kim, J. Lee et al., “Nuclear factor of activated T cells c1 induces osteoclast-associated receptor gene expression during tumor necrosis factor-related activation-induced cytokine-mediated osteoclastogenesis,” The Journal of Biological Chemistry, vol. 280, no. 42, pp. 35209–35216, 2005.
View at: Publisher Site | Google Scholar
S. Kitazawa, K. Kajimoto, T. Kondo, and R. Kitazawa, “Vitamin D3 supports osteoclastogenesis via functional vitamin D response element of human RANKL gene promoter,” Journal of Cellular Biochemistry, vol. 89, no. 4, pp. 771–777, 2003.
View at: Publisher Site | Google Scholar
J. Liu, H. Yang, W. Liu, X. Cao, and X. Feng, “Sp1 and Sp3 regulate the basal transcription of receptor activator of nuclear factor kappa B ligand gene in osteoblasts and bone marrow stromal cells,” Journal of Cellular Biochemistry, vol. 96, no. 4, pp. 716–727, 2005.
View at: Publisher Site | Google Scholar
J. L. Roccisana, N. Kawanabe, H. Kajiya, M. Koide, G. D. Roodman, and S. V. Reddy, “Functional role for heat shock factors in the transcriptional regulation of human RANK ligand gene expression in stromal/osteoblast cells,” The Journal of Biological Chemistry, vol. 279, no. 11, pp. 10500–10507, 2004.
View at: Publisher Site | Google Scholar
Y. Hu, M. Sun, N. Nadiminty, W. Lou, E. Pinder, and A. C. Gao, “Transcriptional regulation of human RANK ligand gene expression by E2F1,” Biochemical and Biophysical Research Communications, vol. 370, no. 3, pp. 440–444, 2008.
View at: Publisher Site | Google Scholar
H. J. Kim, M. J. Yoon, J. Lee, J. M. Penninger, and Y. Y. Kong, “Osteoprotegerin ligand induces beta-casein gene expression through the transcription factor CCAAT/enhancer-binding protein beta,” The Journal of Biological Chemistry, vol. 277, no. 7, pp. 5339–5344, 2002.
View at: Publisher Site | Google Scholar
M. Takamoto, K. Tsuji, T. Yamashita et al., “Hedgehog signaling enhances core-binding factor a1 and receptor activator of nuclear factor-kappaB ligand (RANKL) gene expression in chondrocytes,” The Journal of Endocrinology, vol. 177, no. 3, pp. 413–421, 2003.
View at: Publisher Site | Google Scholar
H. Kanzaki, S. Makihira, M. Suzuki et al., “Soluble RANKL cleaved from activated lymphocytes by TNF-α–converting enzyme contributes to osteoclastogenesis in periodontitis,” The Journal of Immunology, vol. 197, no. 10, pp. 3871–3883, 2016.
View at: Publisher Site | Google Scholar
D. R. Haynes, E. Barg, T. N. Crotti et al., “Osteoprotegerin expression in synovial tissue from patients with rheumatoid arthritis, spondyloarthropathies and osteoarthritis and normal controls,” Rheumatology, vol. 42, no. 1, pp. 123–134, 2003.
View at: Publisher Site | Google Scholar
H. Appel, R. Maier, C. Loddenkemper et al., “Immunohistochemical analysis of osteoblasts in zygapophyseal joints of patients with ankylosing spondylitis reveal repair mechanisms similar to osteoarthritis,” The Journal of Rheumatology, vol. 37, no. 4, pp. 823–828, 2010.
View at: Publisher Site | Google Scholar
H. A. Chen, C. H. Chen, Y. J. Lin et al., “Association of bone morphogenetic proteins with spinal fusion in ankylosing spondylitis,” The Journal of Rheumatology, vol. 37, no. 10, pp. 2126–2132, 2010.
View at: Publisher Site | Google Scholar
E. Klingberg, M. Nurkkala, H. Carlsten, and H. Forsblad-d'Elia, “Biomarkers of bone metabolism in ankylosing spondylitis in relation to osteoproliferation and osteoporosis,” The Journal of Rheumatology, vol. 41, no. 7, pp. 1349–1356, 2014.
View at: Publisher Site | Google Scholar
G. T. Sakellariou, A. Iliopoulos, M. Konsta et al., “Serum levels of Dkk-1, sclerostin and VEGF in patients with ankylosing spondylitis and their association with smoking, and clinical, inflammatory and radiographic parameters,” Joint Bone Spine, vol. 84, no. 3, pp. 309–315, 2017.
View at: Publisher Site | Google Scholar
G. T. Sakellariou, A. D. Anastasilakis, I. Bisbinas et al., “Circulating periostin levels in patients with AS: association with clinical and radiographic variables, inflammatory markers and molecules involved in bone formation,” Rheumatology, vol. 54, no. 5, pp. 908–914, 2015.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2019 Chin-Man Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1810

Downloads

1011

Citations